2023-12-04T05:15:03.617 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T05:15:03.617 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose --name vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632 --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/orig.config.yaml 2023-12-04T05:15:03.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:15:03.750 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632 branch: wip-vshankar-testing-20231127.102654 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7476632' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102654 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 47c1c547372ed5bff7984647dc200bac0e019caf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 47c1c547372ed5bff7984647dc200bac0e019caf kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102654 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1098 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102654 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 47c1c547372ed5bff7984647dc200bac0e019caf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB3bTo/PTgMXf3A1uSBugWKWKj700MOlex9DrpUHxR/0It3S5nisaOnkBFAPZPFGuvUuzYPGEiKV3JsO4vPqI= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPCSXg8+31216oRUvI2Qnin8aZkRTRTomhx2/8zkEKtXVrI+MjRKBIL/irBi/IxOyPzxSuYoVVzzkF/0g128+/8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-04_05:06:51 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-04T05:15:03.750 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa; will attempt to use it 2023-12-04T05:15:03.751 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks 2023-12-04T05:15:03.751 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-04T05:15:03.753 INFO:teuthology.task.internal:Checking packages... 2023-12-04T05:15:03.774 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '47c1c547372ed5bff7984647dc200bac0e019caf' 2023-12-04T05:15:03.774 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-04T05:15:03.774 INFO:teuthology.packaging:ref: None 2023-12-04T05:15:03.774 INFO:teuthology.packaging:tag: None 2023-12-04T05:15:03.774 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102654 2023-12-04T05:15:03.774 INFO:teuthology.packaging:sha1: 47c1c547372ed5bff7984647dc200bac0e019caf 2023-12-04T05:15:03.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102654 2023-12-04T05:15:03.920 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:15:03.921 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-04T05:15:03.928 INFO:teuthology.task.internal:no buildpackages task found 2023-12-04T05:15:03.928 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-04T05:15:03.941 INFO:teuthology.task.internal:Saving configuration 2023-12-04T05:15:03.957 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-04T05:15:03.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T05:15:03.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:22.243785', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIsCxBBM4EWxMj17tuIDPIyFf/Zftz7LPaJg31MSgr8c'} 2023-12-04T05:15:04.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:22.245360', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDSBklbNGq7CWEJwdR5FjwTPX1Ic8n/7/R14GW/T4Hun'} 2023-12-04T05:15:04.011 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-04T05:15:04.018 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-04T05:15:04.018 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-04T05:15:04.018 INFO:teuthology.run_tasks:Running task console_log... 2023-12-04T05:15:04.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc74f4a0d0>, signals=[15]) 2023-12-04T05:15:04.093 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-04T05:15:04.099 INFO:teuthology.task.internal:Opening connections... 2023-12-04T05:15:04.099 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:15:04.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:15:04.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:15:04.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:15:04.249 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-04T05:15:04.257 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-12-04T05:15:04.262 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-12-04T05:15:04.262 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-12-04T05:15:04.311 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:15:04.312 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:15:04.313 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-12-04T05:15:04.341 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-12-04T05:15:04.347 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-12-04T05:15:04.347 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-04T05:15:04.395 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2023-12-04T05:15:04.395 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-04T05:15:04.416 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-04T05:15:04.425 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-04T05:15:04.431 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-04T05:15:04.431 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2023-12-04T05:15:04.434 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2023-12-04T05:15:04.442 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-04T05:15:04.449 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-04T05:15:04.449 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2023-12-04T05:15:04.481 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2023-12-04T05:15:04.495 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-04T05:15:04.552 INFO:teuthology.run_tasks:Running task kernel... 2023-12-04T05:15:04.566 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-04T05:15:04.566 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-04T05:15:04.566 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-04T05:15:04.566 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-04T05:15:04.567 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-04T05:15:04.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:15:04.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-04T05:15:04.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:15:04.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-04T05:15:04.779 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:15:04.779 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-12-04T05:15:04.779 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-12-04T05:15:04.784 INFO:teuthology.orchestra.run.smithi143.stdout:5.15.0-56-generic 2023-12-04T05:15:04.785 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:15:04.785 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-04T05:15:04.785 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-04T05:15:04.785 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-04T05:15:04.847 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:15:04.847 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-12-04T05:15:04.847 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-12-04T05:15:04.848 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-04T05:15:04.853 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2023-12-04T05:15:04.853 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:15:04.853 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-04T05:15:04.853 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-04T05:15:04.854 DEBUG:teuthology.orchestra.run.smithi097:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-04T05:15:04.912 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-04T05:15:04.968 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-04T05:15:04.968 INFO:teuthology.orchestra.run.smithi143.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git config --global init.defaultBranch 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: 2023-12-04T05:15:04.969 INFO:teuthology.orchestra.run.smithi143.stderr:hint: git branch -m 2023-12-04T05:15:04.970 INFO:teuthology.orchestra.run.smithi143.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-04T05:15:04.972 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-04T05:15:05.038 DEBUG:teuthology.orchestra.run.smithi143:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-04T05:15:05.039 INFO:teuthology.orchestra.run.smithi097.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: git config --global init.defaultBranch 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: 2023-12-04T05:15:05.040 INFO:teuthology.orchestra.run.smithi097.stderr:hint: git branch -m 2023-12-04T05:15:05.041 INFO:teuthology.orchestra.run.smithi097.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-04T05:15:05.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-04T05:15:05.103 DEBUG:teuthology.orchestra.run.smithi143:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-04T05:15:05.111 DEBUG:teuthology.orchestra.run.smithi097:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-04T05:15:05.165 DEBUG:teuthology.orchestra.run.smithi097:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-04T05:16:43.305 INFO:teuthology.orchestra.run.smithi143.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-04T05:16:43.305 INFO:teuthology.orchestra.run.smithi143.stderr: * [new branch] main -> origin/main 2023-12-04T05:16:43.336 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190312 -> 20190312 2023-12-04T05:16:43.337 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190416 -> 20190416 2023-12-04T05:16:43.337 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190514 -> 20190514 2023-12-04T05:16:43.337 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190618 -> 20190618 2023-12-04T05:16:43.337 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190717 -> 20190717 2023-12-04T05:16:43.337 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190815 -> 20190815 2023-12-04T05:16:43.338 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20190923 -> 20190923 2023-12-04T05:16:43.338 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191022 -> 20191022 2023-12-04T05:16:43.338 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20191215 -> 20191215 2023-12-04T05:16:43.338 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200122 -> 20200122 2023-12-04T05:16:43.338 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200316 -> 20200316 2023-12-04T05:16:43.339 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200421 -> 20200421 2023-12-04T05:16:43.339 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200519 -> 20200519 2023-12-04T05:16:43.339 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200619 -> 20200619 2023-12-04T05:16:43.339 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200721 -> 20200721 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200817 -> 20200817 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20200918 -> 20200918 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201022 -> 20201022 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201118 -> 20201118 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20201218 -> 20201218 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210208 -> 20210208 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210315 -> 20210315 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210511 -> 20210511 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210716 -> 20210716 2023-12-04T05:16:43.341 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210818 -> 20210818 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20210919 -> 20210919 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211027 -> 20211027 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20211216 -> 20211216 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220209 -> 20220209 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220310 -> 20220310 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220411 -> 20220411 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220509 -> 20220509 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220610 -> 20220610 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220708 -> 20220708 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220815 -> 20220815 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20220913 -> 20220913 2023-12-04T05:16:43.342 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221012 -> 20221012 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221109 -> 20221109 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20221214 -> 20221214 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230117 -> 20230117 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230210 -> 20230210 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230310 -> 20230310 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230404 -> 20230404 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230515 -> 20230515 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230625 -> 20230625 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230804 -> 20230804 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20230919 -> 20230919 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231030 -> 20231030 2023-12-04T05:16:43.344 INFO:teuthology.orchestra.run.smithi143.stderr: * [new tag] 20231111 -> 20231111 2023-12-04T05:16:47.326 INFO:teuthology.orchestra.run.smithi143.stderr:Updating files: 51% (1672/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 65% (2116/3254) Updating files: 65% (2118/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-04T05:16:47.331 INFO:teuthology.orchestra.run.smithi143.stdout:HEAD is now at f63dd70d Merge branch 'robot/patch-0-1701352637' into 'main' 2023-12-04T05:16:47.352 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-12-04T05:16:47.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:16:47.650 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-12-04T05:16:47.650 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-12-04T05:16:47.653 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-12-04T05:16:49.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04 05:16:49 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-12-04T05:16:49.433 INFO:teuthology.orchestra.run.smithi143.stderr:FINISHED --2023-12-04 05:16:49-- 2023-12-04T05:16:49.433 INFO:teuthology.orchestra.run.smithi143.stderr:Total wall clock time: 1.8s 2023-12-04T05:16:49.433 INFO:teuthology.orchestra.run.smithi143.stderr:Downloaded: 1 files, 37M in 1.6s (22.8 MB/s) 2023-12-04T05:16:49.435 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-12-04T05:16:49.436 DEBUG:teuthology.orchestra.run.smithi143:> sudo dpkg -i /tmp/linux-image.deb 2023-12-04T05:16:49.722 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-12-04T05:16:51.789 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-04T05:16:51.794 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-04T05:16:51.952 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-12-04T05:16:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-04T05:16:55.011 INFO:teuthology.orchestra.run.smithi097.stderr: * [new branch] main -> origin/main 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190312 -> 20190312 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190416 -> 20190416 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190514 -> 20190514 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190618 -> 20190618 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190717 -> 20190717 2023-12-04T05:16:55.043 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190815 -> 20190815 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20190923 -> 20190923 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20191022 -> 20191022 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20191215 -> 20191215 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200122 -> 20200122 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200316 -> 20200316 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200421 -> 20200421 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200519 -> 20200519 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200619 -> 20200619 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200721 -> 20200721 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200817 -> 20200817 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20200918 -> 20200918 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201022 -> 20201022 2023-12-04T05:16:55.046 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201118 -> 20201118 2023-12-04T05:16:55.047 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20201218 -> 20201218 2023-12-04T05:16:55.047 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210208 -> 20210208 2023-12-04T05:16:55.047 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210315 -> 20210315 2023-12-04T05:16:55.047 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210511 -> 20210511 2023-12-04T05:16:55.047 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210716 -> 20210716 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210818 -> 20210818 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20210919 -> 20210919 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20211027 -> 20211027 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20211216 -> 20211216 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220209 -> 20220209 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220310 -> 20220310 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220411 -> 20220411 2023-12-04T05:16:55.049 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220509 -> 20220509 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220610 -> 20220610 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220708 -> 20220708 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220815 -> 20220815 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20220913 -> 20220913 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221012 -> 20221012 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221109 -> 20221109 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20221214 -> 20221214 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230117 -> 20230117 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230210 -> 20230210 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230310 -> 20230310 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230404 -> 20230404 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230515 -> 20230515 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230625 -> 20230625 2023-12-04T05:16:55.050 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230804 -> 20230804 2023-12-04T05:16:55.051 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20230919 -> 20230919 2023-12-04T05:16:55.051 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20231030 -> 20231030 2023-12-04T05:16:55.051 INFO:teuthology.orchestra.run.smithi097.stderr: * [new tag] 20231111 -> 20231111 2023-12-04T05:16:55.694 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-12-04T05:16:55.789 INFO:teuthology.orchestra.run.smithi143.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:16:59.041 INFO:teuthology.orchestra.run.smithi097.stderr:Updating files: 50% (1656/3254) Updating files: 51% (1660/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 64% (2111/3254) Updating files: 65% (2116/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-04T05:16:59.046 INFO:teuthology.orchestra.run.smithi097.stdout:HEAD is now at f63dd70d Merge branch 'robot/patch-0-1701352637' into 'main' 2023-12-04T05:16:59.067 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-12-04T05:16:59.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-12-04T05:16:59.326 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-12-04T05:16:59.327 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-12-04T05:16:59.329 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi097.front.sepia.ceph.com to complete... 2023-12-04T05:17:00.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04 05:17:01 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-12-04T05:17:00.989 INFO:teuthology.orchestra.run.smithi097.stderr:FINISHED --2023-12-04 05:17:01-- 2023-12-04T05:17:00.989 INFO:teuthology.orchestra.run.smithi097.stderr:Total wall clock time: 1.6s 2023-12-04T05:17:00.990 INFO:teuthology.orchestra.run.smithi097.stderr:Downloaded: 1 files, 37M in 1.4s (26.0 MB/s) 2023-12-04T05:17:00.993 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-12-04T05:17:00.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo dpkg -i /tmp/linux-image.deb 2023-12-04T05:17:01.265 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-12-04T05:17:03.266 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-04T05:17:03.270 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-04T05:17:03.406 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-12-04T05:17:07.034 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-12-04T05:17:07.142 INFO:teuthology.orchestra.run.smithi097.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:17:17.304 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-12-04T05:17:17.327 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-04T05:17:17.352 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-12-04T05:17:17.654 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:17.683 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:17:18.020 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-04T05:17:18.037 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-04T05:17:18.096 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-04T05:17:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-04T05:17:18.261 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-04T05:17:18.261 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-04T05:17:18.261 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-04T05:17:18.306 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-12-04T05:17:18.498 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-deb -c /tmp/linux-image.deb 2023-12-04T05:17:18.505 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-12-04T05:17:18.505 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-12-04T05:17:18.505 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-12-04T05:17:18.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-12-04T05:17:18.517 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-12-04T05:17:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-12-04T05:17:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-12-04T05:17:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-12-04T05:17:18.537 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-12-04T05:17:18.538 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-04T05:17:18.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-04T05:17:18.540 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-04T05:17:18.541 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-12-04T05:17:18.542 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-04T05:17:18.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-04T05:17:18.543 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-04T05:17:18.555 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-12-04T05:17:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-12-04T05:17:18.557 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-12-04T05:17:18.558 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-12-04T05:17:18.559 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-12-04T05:17:18.560 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-12-04T05:17:18.561 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-04T05:17:18.562 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-12-04T05:17:18.563 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-12-04T05:17:18.564 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-12-04T05:17:18.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-12-04T05:17:18.565 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-12-04T05:17:18.565 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-12-04T05:17:18.621 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-12-04T05:17:18.622 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-04T05:17:18.623 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-04T05:17:18.624 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-04T05:17:18.625 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-12-04T05:17:18.626 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-12-04T05:17:18.627 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-04T05:17:18.628 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-04T05:17:18.629 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-12-04T05:17:18.630 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-12-04T05:17:18.631 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-12-04T05:17:18.632 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-12-04T05:17:18.633 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-04T05:17:18.634 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-04T05:17:18.635 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-12-04T05:17:18.636 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-12-04T05:17:18.637 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-12-04T05:17:18.638 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-04T05:17:18.639 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-12-04T05:17:18.640 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-12-04T05:17:18.641 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-12-04T05:17:18.642 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-12-04T05:17:18.643 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-04T05:17:18.644 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-12-04T05:17:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-12-04T05:17:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-04T05:17:18.647 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-04T05:17:18.648 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-04T05:17:18.649 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-04T05:17:18.650 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-04T05:17:18.651 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-04T05:17:18.652 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-12-04T05:17:18.653 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-04T05:17:18.654 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-04T05:17:18.655 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-04T05:17:18.656 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-12-04T05:17:18.657 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-12-04T05:17:18.658 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-12-04T05:17:18.659 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-12-04T05:17:18.660 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-12-04T05:17:18.661 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-12-04T05:17:18.662 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-12-04T05:17:18.663 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-04T05:17:18.664 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-12-04T05:17:18.665 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-12-04T05:17:18.666 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-12-04T05:17:18.667 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-12-04T05:17:18.668 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-04T05:17:18.669 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-12-04T05:17:18.670 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-04T05:17:18.671 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-04T05:17:18.672 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-04T05:17:18.673 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-04T05:17:18.746 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-04T05:17:18.747 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-04T05:17:18.748 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-04T05:17:18.749 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-04T05:17:18.750 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-04T05:17:18.751 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-04T05:17:18.752 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-12-04T05:17:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-04T05:17:18.754 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-12-04T05:17:18.755 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-04T05:17:18.756 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-12-04T05:17:18.757 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-12-04T05:17:18.758 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-04T05:17:18.759 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-04T05:17:18.760 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-12-04T05:17:18.761 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-12-04T05:17:18.762 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-04T05:17:18.763 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-04T05:17:18.764 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-04T05:17:18.765 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-04T05:17:18.766 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-12-04T05:17:18.767 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-12-04T05:17:18.768 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-12-04T05:17:18.769 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-04T05:17:18.770 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-04T05:17:18.771 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-04T05:17:18.772 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-04T05:17:18.773 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-04T05:17:18.774 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-12-04T05:17:18.775 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-12-04T05:17:18.776 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-04T05:17:18.777 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-04T05:17:18.778 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-12-04T05:17:18.779 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-04T05:17:18.781 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-12-04T05:17:18.782 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-04T05:17:18.783 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-12-04T05:17:18.784 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-12-04T05:17:18.785 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-12-04T05:17:18.786 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-04T05:17:18.787 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-04T05:17:18.788 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-12-04T05:17:18.789 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-04T05:17:18.790 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-04T05:17:18.791 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-12-04T05:17:18.792 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-12-04T05:17:18.793 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-12-04T05:17:18.794 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-04T05:17:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-12-04T05:17:18.796 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-04T05:17:18.797 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-04T05:17:18.798 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-12-04T05:17:18.799 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-12-04T05:17:18.800 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-12-04T05:17:18.801 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-12-04T05:17:18.802 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-12-04T05:17:18.803 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-12-04T05:17:18.804 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-04T05:17:18.805 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-04T05:17:18.806 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-12-04T05:17:18.807 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-12-04T05:17:18.808 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-12-04T05:17:18.809 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-12-04T05:17:18.810 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-12-04T05:17:18.811 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-12-04T05:17:18.812 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-12-04T05:17:18.852 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-12-04T05:17:18.853 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-12-04T05:17:18.854 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-12-04T05:17:18.855 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-12-04T05:17:18.856 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-04T05:17:18.857 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-12-04T05:17:18.858 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-12-04T05:17:18.859 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-12-04T05:17:18.860 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-12-04T05:17:18.861 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-12-04T05:17:18.862 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-04T05:17:18.863 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-12-04T05:17:18.864 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-04T05:17:18.865 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-12-04T05:17:18.866 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-12-04T05:17:18.867 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-12-04T05:17:18.868 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-04T05:17:18.869 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-04T05:17:18.870 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-12-04T05:17:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-12-04T05:17:18.872 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-04T05:17:18.873 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-04T05:17:18.874 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-12-04T05:17:18.875 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-04T05:17:18.876 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-12-04T05:17:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-04T05:17:18.878 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-04T05:17:18.879 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-04T05:17:18.880 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-12-04T05:17:18.881 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-04T05:17:18.882 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-12-04T05:17:18.883 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-12-04T05:17:18.884 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-12-04T05:17:18.885 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-12-04T05:17:18.886 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-12-04T05:17:18.887 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-12-04T05:17:18.888 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-12-04T05:17:18.889 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-12-04T05:17:18.890 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-12-04T05:17:18.891 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-12-04T05:17:18.892 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-12-04T05:17:18.893 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-12-04T05:17:18.894 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-12-04T05:17:18.895 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-12-04T05:17:18.896 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-12-04T05:17:18.896 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-12-04T05:17:18.896 DEBUG:teuthology.orchestra.run.smithi143:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-12-04T05:17:18.903 INFO:teuthology.orchestra.run.smithi143.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:18.903 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:18.903 INFO:teuthology.orchestra.run.smithi143.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:18.904 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-04T05:17:18.904 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-12-04T05:17:18.904 DEBUG:teuthology.orchestra.run.smithi143:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-04T05:17:18.946 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi143.front.sepia.ceph.com to complete... 2023-12-04T05:17:19.315 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub' 2023-12-04T05:17:19.317 INFO:teuthology.orchestra.run.smithi143.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-04T05:17:19.335 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2023-12-04T05:17:19.514 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:19.521 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:17:19.752 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-04T05:17:19.758 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-04T05:17:19.802 INFO:teuthology.orchestra.run.smithi143.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-04T05:17:19.807 INFO:teuthology.orchestra.run.smithi143.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-04T05:17:19.926 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-04T05:17:19.927 INFO:teuthology.orchestra.run.smithi143.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-04T05:17:19.927 INFO:teuthology.orchestra.run.smithi143.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-04T05:17:19.940 INFO:teuthology.orchestra.run.smithi143.stderr:done 2023-12-04T05:17:28.193 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2023-12-04T05:17:28.208 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-04T05:17:28.236 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-12-04T05:17:28.556 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:28.570 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:17:28.879 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-04T05:17:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-04T05:17:28.951 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-04T05:17:28.957 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-04T05:17:29.102 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-04T05:17:29.103 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-04T05:17:29.103 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-04T05:17:29.149 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-12-04T05:17:29.375 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-deb -c /tmp/linux-image.deb 2023-12-04T05:17:29.425 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-12-04T05:17:29.425 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-12-04T05:17:29.425 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-12-04T05:17:29.438 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-12-04T05:17:29.438 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:29.462 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-12-04T05:17:29.462 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-12-04T05:17:29.463 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-04T05:17:29.464 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-04T05:17:29.465 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-12-04T05:17:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-12-04T05:17:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-12-04T05:17:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-04T05:17:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-04T05:17:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-12-04T05:17:29.555 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-04T05:17:29.556 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-12-04T05:17:29.557 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-12-04T05:17:29.558 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-12-04T05:17:29.559 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-12-04T05:17:29.560 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-12-04T05:17:29.561 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-12-04T05:17:29.562 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-12-04T05:17:29.563 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-12-04T05:17:29.564 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-04T05:17:29.565 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-12-04T05:17:29.566 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-12-04T05:17:29.567 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-04T05:17:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-12-04T05:17:29.569 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-12-04T05:17:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-12-04T05:17:29.571 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-04T05:17:29.572 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-12-04T05:17:29.573 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-12-04T05:17:29.574 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-12-04T05:17:29.575 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-12-04T05:17:29.576 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-12-04T05:17:29.577 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-04T05:17:29.578 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-12-04T05:17:29.579 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-04T05:17:29.580 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-12-04T05:17:29.581 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-04T05:17:29.582 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-12-04T05:17:29.583 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-12-04T05:17:29.584 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-12-04T05:17:29.585 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-12-04T05:17:29.586 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-04T05:17:29.587 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-04T05:17:29.588 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-12-04T05:17:29.589 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-12-04T05:17:29.590 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-04T05:17:29.591 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-04T05:17:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-12-04T05:17:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-04T05:17:29.594 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-12-04T05:17:29.595 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-12-04T05:17:29.596 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-04T05:17:29.597 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-12-04T05:17:29.598 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-04T05:17:29.599 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-12-04T05:17:29.600 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-12-04T05:17:29.601 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-04T05:17:29.602 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-12-04T05:17:29.603 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-12-04T05:17:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-12-04T05:17:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-04T05:17:29.606 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-04T05:17:29.607 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-12-04T05:17:29.608 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-12-04T05:17:29.609 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-12-04T05:17:29.610 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-12-04T05:17:29.611 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-04T05:17:29.612 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-12-04T05:17:29.613 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-04T05:17:29.614 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-04T05:17:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-12-04T05:17:29.616 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-04T05:17:29.617 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-04T05:17:29.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-04T05:17:29.618 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-04T05:17:29.618 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-04T05:17:29.699 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-04T05:17:29.700 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-04T05:17:29.701 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-04T05:17:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-04T05:17:29.703 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-12-04T05:17:29.704 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-12-04T05:17:29.705 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-04T05:17:29.706 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-12-04T05:17:29.707 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-12-04T05:17:29.708 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-12-04T05:17:29.709 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-04T05:17:29.710 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-04T05:17:29.711 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-04T05:17:29.712 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-04T05:17:29.713 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-04T05:17:29.714 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-04T05:17:29.715 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-12-04T05:17:29.716 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-04T05:17:29.717 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-12-04T05:17:29.718 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-04T05:17:29.719 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-04T05:17:29.720 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-04T05:17:29.721 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-04T05:17:29.722 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-12-04T05:17:29.723 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-12-04T05:17:29.724 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-12-04T05:17:29.725 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-04T05:17:29.726 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-04T05:17:29.727 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-04T05:17:29.728 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-12-04T05:17:29.729 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-04T05:17:29.730 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-04T05:17:29.731 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-12-04T05:17:29.732 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-12-04T05:17:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-04T05:17:29.734 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-12-04T05:17:29.735 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-04T05:17:29.736 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-04T05:17:29.737 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-04T05:17:29.738 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-12-04T05:17:29.739 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-12-04T05:17:29.740 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-12-04T05:17:29.741 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-12-04T05:17:29.742 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-12-04T05:17:29.743 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-04T05:17:29.744 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-04T05:17:29.745 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-04T05:17:29.746 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-12-04T05:17:29.747 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-04T05:17:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-04T05:17:29.749 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-04T05:17:29.750 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-04T05:17:29.751 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-04T05:17:29.752 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-12-04T05:17:29.753 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-12-04T05:17:29.754 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-12-04T05:17:29.755 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-12-04T05:17:29.756 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-12-04T05:17:29.757 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-12-04T05:17:29.758 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-12-04T05:17:29.759 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-12-04T05:17:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-12-04T05:17:29.761 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-12-04T05:17:29.762 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-12-04T05:17:29.763 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-12-04T05:17:29.764 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-12-04T05:17:29.765 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-12-04T05:17:29.766 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-12-04T05:17:29.767 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-12-04T05:17:29.767 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-12-04T05:17:29.803 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-12-04T05:17:29.804 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-12-04T05:17:29.805 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-12-04T05:17:29.806 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-12-04T05:17:29.807 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-04T05:17:29.808 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-12-04T05:17:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-12-04T05:17:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-12-04T05:17:29.811 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-04T05:17:29.812 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-12-04T05:17:29.813 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-12-04T05:17:29.814 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-04T05:17:29.815 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-04T05:17:29.816 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-12-04T05:17:29.817 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-12-04T05:17:29.818 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-04T05:17:29.819 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-04T05:17:29.820 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-04T05:17:29.821 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-04T05:17:29.822 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-12-04T05:17:29.823 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-12-04T05:17:29.824 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-04T05:17:29.825 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-12-04T05:17:29.826 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-12-04T05:17:29.827 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-12-04T05:17:29.828 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-12-04T05:17:29.829 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-12-04T05:17:29.830 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-12-04T05:17:29.831 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-12-04T05:17:29.832 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-12-04T05:17:29.833 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-12-04T05:17:29.834 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-12-04T05:17:29.835 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-12-04T05:17:29.836 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-12-04T05:17:29.837 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-12-04T05:17:29.837 INFO:teuthology.orchestra.run.smithi097.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-12-04T05:17:29.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-12-04T05:17:29.837 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-12-04T05:17:29.837 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-12-04T05:17:29.838 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-12-04T05:17:29.838 DEBUG:teuthology.orchestra.run.smithi097:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-12-04T05:17:29.852 INFO:teuthology.orchestra.run.smithi097.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:29.852 INFO:teuthology.orchestra.run.smithi097.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:29.852 INFO:teuthology.orchestra.run.smithi097.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-04T05:17:29.853 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-04T05:17:29.853 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-12-04T05:17:29.853 DEBUG:teuthology.orchestra.run.smithi097:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-04T05:17:29.896 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi097.front.sepia.ceph.com to complete... 2023-12-04T05:17:30.340 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2023-12-04T05:17:30.340 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-04T05:17:30.359 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2023-12-04T05:17:30.549 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-12-04T05:17:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-12-04T05:17:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-04T05:17:30.853 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-04T05:17:30.895 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-04T05:17:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-04T05:17:31.037 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-04T05:17:31.037 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-04T05:17:31.037 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-04T05:17:31.050 INFO:teuthology.orchestra.run.smithi097.stderr:done 2023-12-04T05:17:51.099 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-04T05:17:51.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:17:51.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:02.170 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-04T05:18:02.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:18:02.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:09.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-04T05:18:18.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:18:18.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:20.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-04T05:18:21.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-04T05:18:29.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:18:29.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:32.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-04T05:18:33.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:18:33.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:44.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:18:44.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:18:52.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-04T05:19:03.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-12-04T05:19:07.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:19:07.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:07.440 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-04T05:19:08.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:19:08.867 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-12-04T05:19:08.867 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2023-12-04T05:19:08.918 INFO:teuthology.orchestra.run.smithi143.stdout:6.6.0-g8247bbb5b470 2023-12-04T05:19:08.918 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-12-04T05:19:08.918 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-04T05:19:08.918 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-04T05:19:09.920 DEBUG:teuthology.parallel:result is None 2023-12-04T05:19:18.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:19:18.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:19:18.279 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-04T05:19:18.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:19:18.974 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-12-04T05:19:18.974 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2023-12-04T05:19:19.026 INFO:teuthology.orchestra.run.smithi097.stdout:6.6.0-g8247bbb5b470 2023-12-04T05:19:19.027 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-12-04T05:19:19.027 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-04T05:19:19.027 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-04T05:19:20.027 DEBUG:teuthology.parallel:result is None 2023-12-04T05:19:20.028 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-04T05:19:20.035 INFO:teuthology.task.internal:Creating test directory... 2023-12-04T05:19:20.035 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-04T05:19:20.039 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-04T05:19:20.050 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-04T05:19:20.056 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-04T05:19:20.066 INFO:teuthology.task.internal:Creating archive directory... 2023-12-04T05:19:20.066 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-04T05:19:20.092 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-04T05:19:20.121 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-04T05:19:20.127 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-04T05:19:20.128 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-04T05:19:20.159 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-04T05:19:20.253 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T05:19:20.263 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T05:19:20.276 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T05:19:20.281 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T05:19:20.284 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-04T05:19:20.292 INFO:teuthology.task.internal:Configuring sudo... 2023-12-04T05:19:20.293 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-04T05:19:20.296 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-04T05:19:20.318 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-04T05:19:20.327 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-04T05:19:20.327 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-04T05:19:20.360 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-04T05:19:20.370 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T05:19:20.424 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T05:19:20.478 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:19:20.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-04T05:19:20.567 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T05:19:20.576 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T05:19:20.627 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:19:20.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-04T05:19:20.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2023-12-04T05:19:20.707 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2023-12-04T05:19:20.823 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-04T05:19:20.831 INFO:teuthology.task.internal:Starting timer... 2023-12-04T05:19:20.835 INFO:teuthology.run_tasks:Running task pcp... 2023-12-04T05:19:20.847 INFO:teuthology.run_tasks:Running task selinux... 2023-12-04T05:19:20.862 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2023-12-04T05:19:20.862 DEBUG:teuthology.task.selinux:Excluding smithi143: OS 'ubuntu' does not support SELinux 2023-12-04T05:19:20.862 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-04T05:19:20.862 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-04T05:19:20.862 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-04T05:19:20.863 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-04T05:19:20.875 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-04T05:19:20.875 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-04T05:19:20.902 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-04T05:19:20.904 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-04T05:32:31.947 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2023-12-04T05:32:31.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:32:31.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:32:32.032 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-12-04T05:32:32.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-12-04T05:32:32.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:32:32.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T05:32:32.234 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-04T05:32:32.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-04T05:32:32.375 INFO:teuthology.run_tasks:Running task clock... 2023-12-04T05:32:35.564 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-04T05:32:35.565 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-04T05:32:35.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T05:32:35.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-04T05:32:35.577 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T05:32:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Command line: ntpd -gq 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: ---------------------------------------------------- 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: ntp-4 is maintained by Network Time Foundation, 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: corporation. Support and training for ntp-4 are 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: available at https://www.nwtime.org/support 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: ---------------------------------------------------- 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: proto: precision = 0.043 usec (-24) 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: basedate set to 2022-02-04 2023-12-04T05:32:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: gps base set to 2022-02-06 (week 2196) 2023-12-04T05:32:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-04T05:32:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-04T05:32:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: restrict ::: KOD does nothing without LIMITED. 2023-12-04T05:32:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-04T05:32:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen and drop on 0 v6wildcard [::]:123 2023-12-04T05:32:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-04T05:32:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen normally on 2 lo 127.0.0.1:123 2023-12-04T05:32:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2023-12-04T05:32:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen normally on 4 lo [::1]:123 2023-12-04T05:32:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2023-12-04T05:32:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:35 ntpd[28001]: Listening on routing socket on fd #22 for interface updates 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Command line: ntpd -gq 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: ---------------------------------------------------- 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: ntp-4 is maintained by Network Time Foundation, 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-04T05:32:35.624 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: corporation. Support and training for ntp-4 are 2023-12-04T05:32:35.625 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: available at https://www.nwtime.org/support 2023-12-04T05:32:35.625 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: ---------------------------------------------------- 2023-12-04T05:32:35.625 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: proto: precision = 0.040 usec (-24) 2023-12-04T05:32:35.625 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: basedate set to 2022-02-04 2023-12-04T05:32:35.625 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: gps base set to 2022-02-06 (week 2196) 2023-12-04T05:32:35.626 INFO:teuthology.orchestra.run.smithi143.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-04T05:32:35.626 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-04T05:32:35.626 INFO:teuthology.orchestra.run.smithi143.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-04T05:32:35.627 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: restrict ::: KOD does nothing without LIMITED. 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen and drop on 0 v6wildcard [::]:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen normally on 2 lo 127.0.0.1:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen normally on 3 enp3s0f1 172.21.15.143:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen normally on 4 lo [::1]:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7783%5]:123 2023-12-04T05:32:35.628 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:35 ntpd[27974]: Listening on routing socket on fd #22 for interface updates 2023-12-04T05:32:36.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:36.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:36.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:36.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:36 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:37.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:37 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:37.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:37 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:38.614 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.614 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:38.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:38 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:38.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:38.626 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:38 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:39.614 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:39.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:39 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:39.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:39.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:39.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:39 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:40.614 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:40.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:40 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.624 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:40.625 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:40 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:41.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:41 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:41.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:41 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:42.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:42 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:42.622 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:42.623 INFO:teuthology.orchestra.run.smithi143.stdout: 4 Dec 05:32:42 ntpd[27974]: ntpd: time slew -0.004836 s 2023-12-04T05:32:42.623 INFO:teuthology.orchestra.run.smithi143.stdout:ntpd: time slew -0.004836s 2023-12-04T05:32:42.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-04T05:32:42.623 INFO:teuthology.orchestra.run.smithi143.stderr: 4 Dec 05:32:42 ntpd[27974]: can't open /var/log/ntpstats/loopstats.20231204: Permission denied 2023-12-04T05:32:42.719 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-12-04T05:32:42.720 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-12-04T05:32:42.720 INFO:teuthology.orchestra.run.smithi143.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:42.720 INFO:teuthology.orchestra.run.smithi143.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:42.720 INFO:teuthology.orchestra.run.smithi143.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:42.720 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:43.614 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: can't open /var/log/ntpstats/rawstats.20231204: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: can't open /var/log/ntpstats/peerstats.20231204: Permission denied 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stdout: 4 Dec 05:32:43 ntpd[28001]: ntpd: time slew -0.002127 s 2023-12-04T05:32:43.615 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.002127s 2023-12-04T05:32:43.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-04T05:32:43.616 INFO:teuthology.orchestra.run.smithi097.stderr: 4 Dec 05:32:43 ntpd[28001]: can't open /var/log/ntpstats/loopstats.20231204: Permission denied 2023-12-04T05:32:43.727 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-12-04T05:32:43.727 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-12-04T05:32:43.727 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:43.727 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:43.728 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:43.728 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:32:43.728 INFO:teuthology.run_tasks:Running task install... 2023-12-04T05:32:43.736 DEBUG:teuthology.task.install:project ceph 2023-12-04T05:32:43.737 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}} 2023-12-04T05:32:43.737 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'} 2023-12-04T05:32:43.737 INFO:teuthology.task.install:Using flavor: default 2023-12-04T05:32:43.744 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-04T05:32:43.744 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-04T05:32:43.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2023-12-04T05:32:43.745 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-key list | grep Ceph 2023-12-04T05:32:43.854 INFO:teuthology.orchestra.run.smithi143.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-04T05:32:43.875 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-04T05:32:43.908 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-04T05:32:43.908 INFO:teuthology.orchestra.run.smithi143.stdout:uid [ unknown] Ceph.com (release key) 2023-12-04T05:32:43.909 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-04T05:32:43.909 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-04T05:32:43.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-12-04T05:32:43.926 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-04T05:32:43.926 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2023-12-04T05:32:43.927 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-04T05:32:43.927 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-04T05:32:43.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-12-04T05:32:44.074 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-12-04T05:32:44.074 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:32:44.144 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-12-04T05:32:44.144 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:32:44.295 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:32:44.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-04T05:32:44.318 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2023-12-04T05:32:44.448 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:32:44.448 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-04T05:32:44.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo apt-get update 2023-12-04T05:32:44.634 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-04T05:32:44.664 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-04T05:32:44.704 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-04T05:32:44.715 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-12-04T05:32:44.782 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-04T05:32:44.782 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-04T05:32:44.786 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-04T05:32:44.802 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-04T05:32:44.823 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-12-04T05:32:44.853 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-12-04T05:32:44.855 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-04T05:32:44.863 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-04T05:32:44.890 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-04T05:32:44.944 INFO:teuthology.orchestra.run.smithi143.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-04T05:32:44.959 INFO:teuthology.orchestra.run.smithi143.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-04T05:32:45.030 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-12-04T05:32:45.128 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-04T05:32:45.271 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 28.6 kB in 1s (50.0 kB/s) 2023-12-04T05:32:45.987 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-04T05:32:46.198 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-04T05:32:46.219 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:32:46.223 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 28.6 kB in 2s (17.0 kB/s) 2023-12-04T05:32:46.294 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-04T05:32:46.462 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-12-04T05:32:46.463 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-12-04T05:32:46.615 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-12-04T05:32:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-04T05:32:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-04T05:32:46.615 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-04T05:32:46.616 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-04T05:32:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-04T05:32:46.617 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-04T05:32:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-04T05:32:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-04T05:32:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-04T05:32:46.618 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-04T05:32:46.619 INFO:teuthology.orchestra.run.smithi143.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout:Recommended packages: 2023-12-04T05:32:46.620 INFO:teuthology.orchestra.run.smithi143.stdout: btrfs-tools 2023-12-04T05:32:46.767 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-12-04T05:32:46.767 INFO:teuthology.orchestra.run.smithi143.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-04T05:32:46.767 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-04T05:32:46.768 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-04T05:32:46.768 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-04T05:32:46.769 INFO:teuthology.orchestra.run.smithi143.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-04T05:32:46.770 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-04T05:32:46.771 INFO:teuthology.orchestra.run.smithi143.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-04T05:32:46.771 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-04T05:32:46.771 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-04T05:32:46.771 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-04T05:32:46.771 INFO:teuthology.orchestra.run.smithi143.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-04T05:32:46.772 INFO:teuthology.orchestra.run.smithi143.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-04T05:32:46.772 INFO:teuthology.orchestra.run.smithi143.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-04T05:32:46.772 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-04T05:32:46.772 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-04T05:32:46.772 INFO:teuthology.orchestra.run.smithi143.stdout: socat unzip xmlstarlet zip 2023-12-04T05:32:46.984 INFO:teuthology.orchestra.run.smithi143.stdout:0 upgraded, 124 newly installed, 0 to remove and 265 not upgraded. 2023-12-04T05:32:46.984 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 187 MB of archives. 2023-12-04T05:32:46.984 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-04T05:32:46.984 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-04T05:32:46.996 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-12-04T05:32:47.067 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-04T05:32:47.113 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-04T05:32:47.142 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-04T05:32:47.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:32:47.238 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-04T05:32:47.314 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-04T05:32:47.402 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-12-04T05:32:47.403 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-12-04T05:32:47.408 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-04T05:32:47.421 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-04T05:32:47.434 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-12-04T05:32:47.473 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-04T05:32:47.552 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-12-04T05:32:47.553 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-04T05:32:47.553 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-04T05:32:47.553 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-04T05:32:47.553 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-04T05:32:47.553 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-04T05:32:47.554 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-04T05:32:47.554 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-12-04T05:32:47.554 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-04T05:32:47.555 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-04T05:32:47.555 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-04T05:32:47.555 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-04T05:32:47.555 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-04T05:32:47.555 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-04T05:32:47.556 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-04T05:32:47.557 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-04T05:32:47.558 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-04T05:32:47.558 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-04T05:32:47.558 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2023-12-04T05:32:47.558 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2023-12-04T05:32:47.589 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-12-04T05:32:47.629 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-12-04T05:32:47.642 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-12-04T05:32:47.642 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-12-04T05:32:47.648 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-04T05:32:47.648 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-12-04T05:32:47.650 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-12-04T05:32:47.656 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-04T05:32:47.684 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-12-04T05:32:47.684 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-04T05:32:47.692 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-04T05:32:47.706 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-04T05:32:47.707 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-04T05:32:47.708 INFO:teuthology.orchestra.run.smithi097.stdout: socat unzip xmlstarlet zip 2023-12-04T05:32:47.856 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-04T05:32:47.902 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 124 newly installed, 0 to remove and 265 not upgraded. 2023-12-04T05:32:47.902 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 187 MB of archives. 2023-12-04T05:32:47.902 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-04T05:32:47.902 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-04T05:32:47.987 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-12-04T05:32:47.987 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-04T05:32:48.012 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-12-04T05:32:48.014 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-12-04T05:32:48.023 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-12-04T05:32:48.030 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-04T05:32:48.235 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-04T05:32:48.335 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-04T05:32:48.348 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-04T05:32:48.403 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-04T05:32:48.437 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-04T05:32:48.451 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-04T05:32:48.467 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-04T05:32:48.476 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-04T05:32:48.477 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-04T05:32:48.493 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-04T05:32:48.530 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-04T05:32:48.545 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-04T05:32:48.550 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-04T05:32:48.551 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-04T05:32:48.575 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-04T05:32:48.584 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-04T05:32:48.612 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-04T05:32:48.621 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-04T05:32:48.718 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-04T05:32:48.784 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-04T05:32:48.801 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-04T05:32:48.807 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-04T05:32:48.884 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-04T05:32:48.912 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-04T05:32:48.921 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-04T05:32:48.963 INFO:teuthology.orchestra.run.smithi143.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-04T05:32:48.975 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-12-04T05:32:49.139 INFO:teuthology.orchestra.run.smithi143.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-04T05:32:49.154 INFO:teuthology.orchestra.run.smithi143.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-04T05:32:49.160 INFO:teuthology.orchestra.run.smithi143.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-04T05:32:49.166 INFO:teuthology.orchestra.run.smithi143.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-04T05:32:49.250 INFO:teuthology.orchestra.run.smithi143.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-12-04T05:32:49.350 INFO:teuthology.orchestra.run.smithi143.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-04T05:32:49.369 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-04T05:32:49.384 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-04T05:32:49.400 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-04T05:32:49.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-04T05:32:49.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-04T05:32:49.428 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-04T05:32:49.432 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-12-04T05:32:49.432 INFO:teuthology.orchestra.run.smithi143.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-04T05:32:49.446 INFO:teuthology.orchestra.run.smithi143.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-04T05:32:49.463 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-04T05:32:49.476 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-04T05:32:49.480 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-04T05:32:49.481 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-04T05:32:49.534 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-12-04T05:32:49.585 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-12-04T05:32:49.596 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-12-04T05:32:49.600 INFO:teuthology.orchestra.run.smithi143.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-12-04T05:32:49.607 INFO:teuthology.orchestra.run.smithi143.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-12-04T05:32:49.612 INFO:teuthology.orchestra.run.smithi143.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-12-04T05:32:49.615 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-12-04T05:32:49.622 INFO:teuthology.orchestra.run.smithi143.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-04T05:32:49.624 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-12-04T05:32:49.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-04T05:32:49.671 INFO:teuthology.orchestra.run.smithi143.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-04T05:32:49.676 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-12-04T05:32:49.688 INFO:teuthology.orchestra.run.smithi143.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-04T05:32:49.700 INFO:teuthology.orchestra.run.smithi143.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-12-04T05:32:49.732 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-04T05:32:49.754 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-04T05:32:49.813 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-04T05:32:49.843 INFO:teuthology.orchestra.run.smithi143.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-04T05:32:49.843 INFO:teuthology.orchestra.run.smithi143.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-04T05:32:49.853 INFO:teuthology.orchestra.run.smithi143.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-04T05:32:49.853 INFO:teuthology.orchestra.run.smithi143.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-04T05:32:49.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-04T05:32:49.868 INFO:teuthology.orchestra.run.smithi143.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-04T05:32:49.879 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-04T05:32:49.900 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-04T05:32:50.052 INFO:teuthology.orchestra.run.smithi143.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-04T05:32:50.072 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-04T05:32:50.088 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-04T05:32:50.095 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-04T05:32:50.099 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-04T05:32:50.286 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-04T05:32:50.294 INFO:teuthology.orchestra.run.smithi143.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-12-04T05:32:50.316 INFO:teuthology.orchestra.run.smithi143.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-04T05:32:50.366 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-04T05:32:50.382 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-04T05:32:50.454 INFO:teuthology.orchestra.run.smithi143.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-04T05:32:50.497 INFO:teuthology.orchestra.run.smithi143.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-04T05:32:50.526 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-12-04T05:32:50.541 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-12-04T05:32:50.556 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-04T05:32:50.589 INFO:teuthology.orchestra.run.smithi143.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-04T05:32:50.598 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-12-04T05:32:50.599 INFO:teuthology.orchestra.run.smithi143.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-04T05:32:50.605 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-04T05:32:50.611 INFO:teuthology.orchestra.run.smithi143.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-04T05:32:50.619 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-04T05:32:50.654 INFO:teuthology.orchestra.run.smithi143.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-04T05:32:50.778 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-04T05:32:50.778 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-04T05:32:50.781 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-04T05:32:50.786 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-04T05:32:50.801 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-04T05:32:50.916 INFO:teuthology.orchestra.run.smithi143.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-04T05:32:50.917 INFO:teuthology.orchestra.run.smithi143.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-04T05:32:50.918 INFO:teuthology.orchestra.run.smithi143.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-04T05:32:50.985 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-04T05:32:51.105 INFO:teuthology.orchestra.run.smithi143.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-04T05:32:51.247 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-04T05:32:51.375 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-04T05:32:51.419 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-04T05:32:51.448 INFO:teuthology.orchestra.run.smithi143.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-04T05:32:51.507 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-04T05:32:51.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-04T05:32:51.529 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-04T05:32:51.570 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-04T05:32:51.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-04T05:32:51.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-04T05:32:51.837 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-04T05:32:51.856 INFO:teuthology.orchestra.run.smithi143.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-04T05:32:51.866 INFO:teuthology.orchestra.run.smithi143.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-04T05:32:51.866 INFO:teuthology.orchestra.run.smithi143.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-04T05:32:51.937 INFO:teuthology.orchestra.run.smithi143.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-04T05:32:51.937 INFO:teuthology.orchestra.run.smithi143.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-04T05:32:51.938 INFO:teuthology.orchestra.run.smithi143.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-04T05:32:51.939 INFO:teuthology.orchestra.run.smithi143.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-04T05:32:51.940 INFO:teuthology.orchestra.run.smithi143.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-04T05:32:51.940 INFO:teuthology.orchestra.run.smithi143.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-04T05:32:52.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-04T05:32:52.137 INFO:teuthology.orchestra.run.smithi143.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-04T05:32:52.340 INFO:teuthology.orchestra.run.smithi143.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-04T05:32:52.351 INFO:teuthology.orchestra.run.smithi143.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-12-04T05:32:52.352 INFO:teuthology.orchestra.run.smithi143.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-12-04T05:32:52.403 INFO:teuthology.orchestra.run.smithi143.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-12-04T05:32:52.415 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-04T05:32:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-12-04T05:32:52.591 INFO:teuthology.orchestra.run.smithi143.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-12-04T05:32:52.598 INFO:teuthology.orchestra.run.smithi143.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-12-04T05:32:52.661 INFO:teuthology.orchestra.run.smithi143.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-04T05:32:52.707 INFO:teuthology.orchestra.run.smithi143.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-04T05:32:52.713 INFO:teuthology.orchestra.run.smithi143.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-12-04T05:32:52.735 INFO:teuthology.orchestra.run.smithi143.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-04T05:32:52.743 INFO:teuthology.orchestra.run.smithi143.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-04T05:32:52.789 INFO:teuthology.orchestra.run.smithi143.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-04T05:32:52.815 INFO:teuthology.orchestra.run.smithi143.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-04T05:32:52.817 INFO:teuthology.orchestra.run.smithi143.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-04T05:32:52.817 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-04T05:32:52.829 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-04T05:32:52.830 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-04T05:32:52.830 INFO:teuthology.orchestra.run.smithi143.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-04T05:32:52.830 INFO:teuthology.orchestra.run.smithi143.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-04T05:32:52.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-04T05:32:52.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-04T05:32:52.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-04T05:32:52.899 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-04T05:32:52.900 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-04T05:32:52.901 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-04T05:32:53.024 INFO:teuthology.orchestra.run.smithi143.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-04T05:32:53.065 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-04T05:32:53.272 INFO:teuthology.orchestra.run.smithi143.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-12-04T05:32:53.272 INFO:teuthology.orchestra.run.smithi143.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-12-04T05:32:53.272 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-04T05:32:53.281 INFO:teuthology.orchestra.run.smithi143.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-04T05:32:53.544 INFO:teuthology.orchestra.run.smithi143.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-04T05:32:53.546 INFO:teuthology.orchestra.run.smithi143.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-04T05:32:53.555 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-12-04T05:32:53.563 INFO:teuthology.orchestra.run.smithi143.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-04T05:32:53.567 INFO:teuthology.orchestra.run.smithi143.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-04T05:32:53.601 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-04T05:32:53.605 INFO:teuthology.orchestra.run.smithi143.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-04T05:32:53.621 INFO:teuthology.orchestra.run.smithi143.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-04T05:32:53.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-04T05:32:53.673 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-04T05:32:53.682 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-04T05:32:53.711 INFO:teuthology.orchestra.run.smithi143.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-04T05:32:53.712 INFO:teuthology.orchestra.run.smithi143.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-04T05:32:53.714 INFO:teuthology.orchestra.run.smithi143.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-04T05:32:53.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-04T05:32:53.754 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-04T05:32:53.756 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-04T05:32:53.765 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-04T05:32:53.765 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-04T05:32:53.895 INFO:teuthology.orchestra.run.smithi143.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-04T05:32:53.962 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-04T05:32:54.167 INFO:teuthology.orchestra.run.smithi143.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-04T05:32:54.218 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-04T05:32:54.434 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-12-04T05:32:54.466 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-12-04T05:32:54.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-12-04T05:32:54.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-04T05:32:54.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-04T05:32:54.500 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-04T05:32:54.506 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-04T05:32:54.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-04T05:32:54.562 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-04T05:32:54.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-04T05:32:54.652 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-04T05:32:54.654 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-04T05:32:54.673 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-12-04T05:32:54.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-04T05:32:55.109 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-04T05:32:55.955 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-12-04T05:32:56.438 INFO:teuthology.orchestra.run.smithi143.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-12-04T05:32:56.454 INFO:teuthology.orchestra.run.smithi143.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-12-04T05:32:56.464 INFO:teuthology.orchestra.run.smithi143.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-12-04T05:32:56.464 INFO:teuthology.orchestra.run.smithi143.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-12-04T05:32:56.465 INFO:teuthology.orchestra.run.smithi143.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-12-04T05:32:56.466 INFO:teuthology.orchestra.run.smithi143.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-12-04T05:32:57.256 INFO:teuthology.orchestra.run.smithi143.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-12-04T05:32:57.902 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 187 MB in 10s (17.9 MB/s) 2023-12-04T05:32:58.147 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-04T05:32:58.215 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-04T05:32:58.218 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-04T05:32:58.257 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-04T05:32:58.535 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-12-04T05:32:58.535 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-12-04T05:32:58.565 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-04T05:32:58.577 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-12-04T05:32:58.579 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-04T05:32:58.616 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-04T05:32:58.701 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-12-04T05:32:58.748 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-12-04T05:32:58.757 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-12-04T05:32:58.868 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-12-04T05:32:58.960 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cmd2. 2023-12-04T05:32:58.974 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-04T05:32:59.018 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-04T05:32:59.362 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-04T05:32:59.394 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-04T05:32:59.394 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-12-04T05:32:59.394 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-12-04T05:32:59.463 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-04T05:32:59.799 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-04T05:32:59.818 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-04T05:32:59.883 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-04T05:33:00.160 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-04T05:33:00.175 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-04T05:33:00.210 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-04T05:33:00.631 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-04T05:33:00.645 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:00.689 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:01.142 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-04T05:33:01.158 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:01.203 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:01.326 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-12-04T05:33:01.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-12-04T05:33:01.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-12-04T05:33:01.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-12-04T05:33:01.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-12-04T05:33:01.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-12-04T05:33:01.529 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-04T05:33:01.542 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:01.577 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:01.738 INFO:teuthology.orchestra.run.smithi097.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-12-04T05:33:01.905 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-04T05:33:01.920 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-04T05:33:01.972 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-04T05:33:02.300 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librados2. 2023-12-04T05:33:02.314 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:02.361 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:02.374 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 187 MB in 14s (13.3 MB/s) 2023-12-04T05:33:02.539 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-04T05:33:02.610 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-04T05:33:02.611 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-04T05:33:02.654 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-04T05:33:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librbd1. 2023-12-04T05:33:02.791 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:02.836 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:03.140 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-04T05:33:03.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-04T05:33:03.199 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-04T05:33:03.405 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs2. 2023-12-04T05:33:03.419 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:03.455 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:03.501 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cmd2. 2023-12-04T05:33:03.516 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-04T05:33:03.552 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-04T05:33:03.699 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rados. 2023-12-04T05:33:03.714 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:03.757 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:03.837 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-04T05:33:03.851 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-04T05:33:03.946 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-04T05:33:04.109 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-04T05:33:04.124 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:04.167 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:04.266 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-04T05:33:04.281 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-04T05:33:04.324 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-04T05:33:04.403 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cephfs. 2023-12-04T05:33:04.418 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:04.461 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:04.686 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-04T05:33:04.701 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-04T05:33:04.750 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-04T05:33:04.750 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-04T05:33:04.763 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:04.797 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:05.095 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-prettytable. 2023-12-04T05:33:05.107 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-04T05:33:05.150 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-04T05:33:05.173 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-04T05:33:05.188 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:05.403 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rbd. 2023-12-04T05:33:05.418 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:05.460 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:05.638 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-04T05:33:05.654 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:05.701 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:05.797 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-04T05:33:05.811 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-04T05:33:05.855 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-04T05:33:06.037 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-04T05:33:06.052 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-04T05:33:06.096 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:33:06.182 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-04T05:33:06.197 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-04T05:33:06.241 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-04T05:33:06.459 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-04T05:33:06.478 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-04T05:33:06.512 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-04T05:33:06.519 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-04T05:33:06.526 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-04T05:33:06.560 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-04T05:33:06.881 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua5.1. 2023-12-04T05:33:06.881 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2023-12-04T05:33:06.893 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:06.894 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-04T05:33:06.936 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:06.938 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-04T05:33:07.282 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-any. 2023-12-04T05:33:07.297 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-04T05:33:07.341 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-04T05:33:07.397 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2023-12-04T05:33:07.412 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:07.455 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:07.585 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package zip. 2023-12-04T05:33:07.600 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-04T05:33:07.634 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking zip (3.0-12build2) ... 2023-12-04T05:33:07.849 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2023-12-04T05:33:07.864 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:07.909 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:08.004 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package unzip. 2023-12-04T05:33:08.021 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-04T05:33:08.062 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-04T05:33:08.321 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2023-12-04T05:33:08.335 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:08.370 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:08.466 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package luarocks. 2023-12-04T05:33:08.483 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-04T05:33:08.524 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-04T05:33:08.697 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-04T05:33:08.711 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:08.759 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:08.916 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package librgw2. 2023-12-04T05:33:08.929 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:08.973 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:09.007 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2023-12-04T05:33:09.022 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:09.065 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:09.410 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-04T05:33:09.427 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:09.443 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rgw. 2023-12-04T05:33:09.456 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:09.472 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:09.500 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:09.829 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2023-12-04T05:33:09.836 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-04T05:33:09.844 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-04T05:33:09.850 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-04T05:33:09.887 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-04T05:33:09.894 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-04T05:33:10.116 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2023-12-04T05:33:10.130 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:10.164 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:10.206 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libradosstriper1. 2023-12-04T05:33:10.220 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:10.291 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:10.559 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-04T05:33:10.574 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-04T05:33:10.621 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-04T05:33:10.708 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-common. 2023-12-04T05:33:10.723 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:10.758 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:10.912 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-04T05:33:10.927 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-04T05:33:10.970 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-04T05:33:11.273 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-04T05:33:11.290 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-04T05:33:11.332 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-04T05:33:11.693 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2023-12-04T05:33:11.709 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-04T05:33:11.744 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-04T05:33:11.788 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-base. 2023-12-04T05:33:11.803 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:11.855 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:12.087 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2023-12-04T05:33:12.102 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-04T05:33:12.145 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-04T05:33:12.398 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2023-12-04T05:33:12.412 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-04T05:33:12.456 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2023-12-04T05:33:12.570 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-04T05:33:12.582 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-04T05:33:12.625 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-04T05:33:12.800 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2023-12-04T05:33:12.816 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-04T05:33:12.860 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-04T05:33:12.936 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cheroot. 2023-12-04T05:33:12.951 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-04T05:33:12.995 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-04T05:33:13.363 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2023-12-04T05:33:13.378 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-04T05:33:13.421 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-04T05:33:13.639 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-04T05:33:13.654 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-04T05:33:13.697 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-04T05:33:13.845 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2023-12-04T05:33:13.858 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:13.903 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:14.008 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-04T05:33:14.024 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-04T05:33:14.058 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-04T05:33:14.302 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-04T05:33:14.316 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-04T05:33:14.353 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-04T05:33:14.364 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2023-12-04T05:33:14.378 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:14.414 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:14.679 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempora. 2023-12-04T05:33:14.694 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-04T05:33:14.733 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-04T05:33:14.757 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-04T05:33:14.757 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-04T05:33:14.791 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-04T05:33:15.041 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-portend. 2023-12-04T05:33:15.056 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-04T05:33:15.107 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-04T05:33:15.128 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2023-12-04T05:33:15.144 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:15.186 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:15.368 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-04T05:33:15.387 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-04T05:33:15.421 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-04T05:33:15.614 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2023-12-04T05:33:15.631 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:15.664 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:15.687 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-04T05:33:15.702 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-04T05:33:15.738 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-04T05:33:16.082 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-natsort. 2023-12-04T05:33:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-04T05:33:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-04T05:33:16.454 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-logutils. 2023-12-04T05:33:16.466 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-04T05:33:16.535 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-04T05:33:16.719 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2023-12-04T05:33:16.733 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:16.778 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:16.879 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-04T05:33:16.894 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-04T05:33:16.941 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-04T05:33:17.242 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-mako. 2023-12-04T05:33:17.255 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-04T05:33:17.290 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-04T05:33:17.431 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-04T05:33:17.445 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-04T05:33:17.490 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-04T05:33:17.586 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-04T05:33:17.600 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-04T05:33:17.660 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-04T05:33:17.825 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2023-12-04T05:33:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-04T05:33:17.892 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-04T05:33:17.962 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-04T05:33:17.977 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-04T05:33:18.022 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-04T05:33:18.220 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-04T05:33:18.236 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-04T05:33:18.282 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-04T05:33:18.339 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webob. 2023-12-04T05:33:18.356 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-04T05:33:18.397 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-04T05:33:18.831 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-04T05:33:18.846 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-04T05:33:18.894 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-04T05:33:19.184 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-04T05:33:19.199 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-04T05:33:19.235 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-04T05:33:19.485 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-waitress. 2023-12-04T05:33:19.499 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-04T05:33:19.546 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-04T05:33:19.570 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2023-12-04T05:33:19.586 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-04T05:33:19.628 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-04T05:33:19.865 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-tempita. 2023-12-04T05:33:19.877 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-04T05:33:19.912 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-04T05:33:20.164 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-paste. 2023-12-04T05:33:20.182 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-04T05:33:20.231 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-04T05:33:20.490 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2023-12-04T05:33:20.504 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-04T05:33:20.534 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-04T05:33:20.550 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-04T05:33:20.550 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-04T05:33:20.584 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-04T05:33:20.867 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-04T05:33:20.882 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-04T05:33:20.895 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-04T05:33:20.910 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-04T05:33:20.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-04T05:33:20.953 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-04T05:33:21.228 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-04T05:33:21.243 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-04T05:33:21.256 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-webtest. 2023-12-04T05:33:21.271 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-04T05:33:21.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-04T05:33:21.330 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-04T05:33:21.650 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pecan. 2023-12-04T05:33:21.665 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2023-12-04T05:33:21.665 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-04T05:33:21.680 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-04T05:33:21.708 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-04T05:33:21.723 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-04T05:33:22.042 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2023-12-04T05:33:22.057 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-04T05:33:22.104 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-certifi. 2023-12-04T05:33:22.109 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-04T05:33:22.119 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-04T05:33:22.162 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-04T05:33:22.362 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-04T05:33:22.377 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-04T05:33:22.420 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-04T05:33:22.498 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-idna. 2023-12-04T05:33:22.513 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-04T05:33:22.550 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-04T05:33:22.757 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2023-12-04T05:33:22.773 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-04T05:33:22.816 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-04T05:33:22.868 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-urllib3. 2023-12-04T05:33:22.887 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-04T05:33:22.926 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-04T05:33:23.177 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-04T05:33:23.191 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-04T05:33:23.212 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests. 2023-12-04T05:33:23.227 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-04T05:33:23.234 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-04T05:33:23.270 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-04T05:33:23.545 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-04T05:33:23.560 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-04T05:33:23.607 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-04T05:33:23.751 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-04T05:33:23.763 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-04T05:33:23.826 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-04T05:33:23.899 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2023-12-04T05:33:23.913 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-04T05:33:23.948 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-04T05:33:24.084 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-04T05:33:24.100 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:24.145 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:24.295 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2023-12-04T05:33:24.310 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-04T05:33:24.362 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-04T05:33:24.505 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-04T05:33:24.520 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:24.563 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:24.665 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2023-12-04T05:33:24.677 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-04T05:33:24.720 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-04T05:33:24.908 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-04T05:33:24.923 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-04T05:33:24.959 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-04T05:33:25.056 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2023-12-04T05:33:25.073 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-04T05:33:25.115 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-04T05:33:25.218 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-openssl. 2023-12-04T05:33:25.234 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-04T05:33:25.277 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-04T05:33:25.467 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-04T05:33:25.484 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-04T05:33:25.525 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-04T05:33:25.629 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr. 2023-12-04T05:33:25.644 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:25.688 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:25.828 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-04T05:33:25.843 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-04T05:33:25.888 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-04T05:33:26.074 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mon. 2023-12-04T05:33:26.090 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:26.134 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:26.224 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2023-12-04T05:33:26.238 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-04T05:33:26.282 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-04T05:33:26.634 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2023-12-04T05:33:26.649 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-04T05:33:26.683 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-04T05:33:26.988 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-osd. 2023-12-04T05:33:27.003 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:27.009 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2023-12-04T05:33:27.019 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-04T05:33:27.047 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:27.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-04T05:33:27.408 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2023-12-04T05:33:27.422 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-04T05:33:27.465 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-04T05:33:27.802 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2023-12-04T05:33:27.816 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-04T05:33:27.861 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-04T05:33:28.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2023-12-04T05:33:28.204 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-04T05:33:28.246 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-04T05:33:28.267 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph. 2023-12-04T05:33:28.282 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:28.324 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:28.574 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-04T05:33:28.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-04T05:33:28.604 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-fuse. 2023-12-04T05:33:28.618 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:28.632 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-04T05:33:28.652 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:28.998 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mds. 2023-12-04T05:33:29.012 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:29.080 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:29.121 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-04T05:33:29.134 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:29.177 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:29.458 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephadm. 2023-12-04T05:33:29.474 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:29.517 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:29.592 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-04T05:33:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:29.640 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:29.812 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-04T05:33:29.830 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-04T05:33:29.861 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-04T05:33:29.917 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-04T05:33:29.932 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-04T05:33:29.976 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-04T05:33:30.214 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-04T05:33:30.230 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-04T05:33:30.264 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-04T05:33:30.320 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2023-12-04T05:33:30.335 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-04T05:33:30.378 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-04T05:33:30.748 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2023-12-04T05:33:30.763 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:30.806 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:31.184 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2023-12-04T05:33:31.199 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:31.242 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:31.277 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-babel. 2023-12-04T05:33:31.292 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-04T05:33:31.336 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-04T05:33:31.659 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-jinja2. 2023-12-04T05:33:31.670 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-04T05:33:31.706 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-04T05:33:32.035 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-04T05:33:32.048 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:32.071 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2023-12-04T05:33:32.084 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:32.085 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:32.129 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:32.404 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-04T05:33:32.419 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-04T05:33:32.454 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-04T05:33:32.740 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-routes. 2023-12-04T05:33:32.755 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-04T05:33:32.798 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-04T05:33:33.127 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-04T05:33:33.142 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:33.210 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:33.374 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2023-12-04T05:33:33.390 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:33.424 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:33.622 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-04T05:33:33.636 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-04T05:33:33.680 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-04T05:33:33.751 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2023-12-04T05:33:33.765 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:33.809 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:34.170 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2023-12-04T05:33:34.188 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:34.229 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:34.342 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-joblib. 2023-12-04T05:33:34.356 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-04T05:33:34.392 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-04T05:33:34.632 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2023-12-04T05:33:34.646 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:34.690 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:34.763 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-04T05:33:34.779 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-04T05:33:34.924 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-04T05:33:34.993 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-04T05:33:35.009 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-04T05:33:35.042 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-04T05:33:35.209 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-sklearn. 2023-12-04T05:33:35.225 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-04T05:33:35.293 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-04T05:33:35.361 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-04T05:33:35.377 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-04T05:33:35.419 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-04T05:33:35.970 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-04T05:33:35.984 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:36.028 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:36.474 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2023-12-04T05:33:36.488 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-04T05:33:36.524 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-04T05:33:36.977 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2023-12-04T05:33:36.992 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-04T05:33:37.028 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-04T05:33:37.132 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-cachetools. 2023-12-04T05:33:37.147 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-04T05:33:37.184 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-04T05:33:37.372 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-04T05:33:37.386 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:37.421 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:37.501 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-04T05:33:37.517 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-04T05:33:37.560 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-04T05:33:37.719 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-04T05:33:37.733 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-04T05:33:37.766 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-04T05:33:37.888 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-04T05:33:37.903 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-04T05:33:37.946 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-04T05:33:38.086 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2023-12-04T05:33:38.102 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-04T05:33:38.152 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-04T05:33:38.266 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-rsa. 2023-12-04T05:33:38.283 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-04T05:33:38.324 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-04T05:33:38.473 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-04T05:33:38.487 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:38.530 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:38.695 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-google-auth. 2023-12-04T05:33:38.713 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-04T05:33:38.753 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-04T05:33:38.941 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-04T05:33:38.957 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-04T05:33:39.032 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-04T05:33:39.065 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-04T05:33:39.080 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-04T05:33:39.115 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-04T05:33:39.426 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-websocket. 2023-12-04T05:33:39.441 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-04T05:33:39.493 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-04T05:33:39.720 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2023-12-04T05:33:39.735 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-04T05:33:39.786 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-04T05:33:39.822 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-04T05:33:39.838 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-04T05:33:39.881 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-04T05:33:40.240 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-04T05:33:40.255 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-04T05:33:40.392 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-04T05:33:40.536 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-04T05:33:40.550 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:40.595 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:40.778 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2023-12-04T05:33:40.793 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-04T05:33:40.844 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-04T05:33:40.889 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-04T05:33:40.903 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-04T05:33:40.947 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-04T05:33:41.258 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-04T05:33:41.272 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-04T05:33:41.317 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-04T05:33:41.587 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-04T05:33:41.595 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package jq. 2023-12-04T05:33:41.601 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:41.610 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-04T05:33:41.644 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-04T05:33:41.645 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:41.864 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package socat. 2023-12-04T05:33:41.886 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-04T05:33:41.922 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-04T05:33:42.218 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package xmlstarlet. 2023-12-04T05:33:42.233 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-04T05:33:42.275 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-04T05:33:42.623 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2023-12-04T05:33:42.638 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-04T05:33:42.664 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-test. 2023-12-04T05:33:42.677 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:42.683 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-04T05:33:42.722 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:42.984 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-04T05:33:42.999 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-04T05:33:43.067 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-04T05:33:43.412 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-04T05:33:43.427 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-04T05:33:43.470 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-04T05:33:43.815 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2023-12-04T05:33:43.834 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-04T05:33:43.881 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-04T05:33:44.227 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2023-12-04T05:33:44.243 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-04T05:33:44.286 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-04T05:33:44.604 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-04T05:33:44.619 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-04T05:33:44.654 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-04T05:33:44.801 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ceph-volume. 2023-12-04T05:33:44.817 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:44.859 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:44.932 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2023-12-04T05:33:44.947 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-04T05:33:44.982 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-04T05:33:45.247 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-04T05:33:45.263 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:45.285 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-04T05:33:45.302 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-04T05:33:45.308 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:45.377 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-04T05:33:45.600 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-colorama. 2023-12-04T05:33:45.616 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-04T05:33:45.658 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-04T05:33:45.953 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-shell. 2023-12-04T05:33:45.970 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:46.011 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:46.092 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-04T05:33:46.106 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:46.150 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:46.255 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package cephfs-top. 2023-12-04T05:33:46.271 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:46.313 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:46.469 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-04T05:33:46.483 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-04T05:33:46.544 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-04T05:33:46.566 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-04T05:33:46.581 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:46.624 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:46.847 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-04T05:33:46.861 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-04T05:33:46.905 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-04T05:33:46.947 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-04T05:33:46.960 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-04T05:33:47.002 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-04T05:33:47.201 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2023-12-04T05:33:47.216 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-04T05:33:47.258 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-04T05:33:47.307 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-04T05:33:47.323 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-04T05:33:47.366 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-04T05:33:47.510 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2023-12-04T05:33:47.528 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-04T05:33:47.569 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-04T05:33:47.736 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package nvme-cli. 2023-12-04T05:33:47.752 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-04T05:33:47.828 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-04T05:33:47.897 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2023-12-04T05:33:47.912 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-04T05:33:47.957 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-04T05:33:48.233 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pkg-config. 2023-12-04T05:33:48.248 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-04T05:33:48.291 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-04T05:33:48.351 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2023-12-04T05:33:48.365 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:48.409 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:48.545 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-04T05:33:48.561 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-04T05:33:48.606 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-04T05:33:49.040 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-04T05:33:49.056 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-04T05:33:49.097 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-04T05:33:49.368 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pastescript. 2023-12-04T05:33:49.383 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-04T05:33:49.428 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-04T05:33:49.779 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pluggy. 2023-12-04T05:33:49.795 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-04T05:33:49.838 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-04T05:33:50.157 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-psutil. 2023-12-04T05:33:50.176 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-04T05:33:50.215 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-04T05:33:50.413 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2023-12-04T05:33:50.428 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:50.462 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:50.562 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-py. 2023-12-04T05:33:50.579 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-04T05:33:50.618 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-04T05:33:50.833 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-04T05:33:50.848 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:50.883 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:50.964 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pygments. 2023-12-04T05:33:50.980 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-04T05:33:51.022 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-04T05:33:51.169 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-colorama. 2023-12-04T05:33:51.184 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-04T05:33:51.228 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-04T05:33:51.468 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-04T05:33:51.483 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-04T05:33:51.517 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-04T05:33:51.529 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-shell. 2023-12-04T05:33:51.544 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:51.588 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:51.798 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-toml. 2023-12-04T05:33:51.811 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-04T05:33:51.832 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephfs-top. 2023-12-04T05:33:51.849 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-12-04T05:33:51.854 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-04T05:33:51.916 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:52.129 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-04T05:33:52.141 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:52.176 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:52.182 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-pytest. 2023-12-04T05:33:52.198 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-04T05:33:52.240 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-04T05:33:52.487 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-04T05:33:52.502 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-04T05:33:52.535 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package python3-simplejson. 2023-12-04T05:33:52.545 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-04T05:33:52.552 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-04T05:33:52.593 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-04T05:33:52.855 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-04T05:33:52.872 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-04T05:33:52.891 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-04T05:33:52.906 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-04T05:33:52.913 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-04T05:33:52.950 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-04T05:33:53.353 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2023-12-04T05:33:53.368 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-04T05:33:53.411 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-04T05:33:53.592 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package radosgw. 2023-12-04T05:33:53.608 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:53.642 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:53.833 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2023-12-04T05:33:53.847 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-04T05:33:53.891 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-04T05:33:54.181 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-04T05:33:54.194 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-04T05:33:54.244 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-04T05:33:54.262 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package rbd-fuse. 2023-12-04T05:33:54.278 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:54.322 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:54.615 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-04T05:33:54.655 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-04T05:33:54.669 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-04T05:33:54.723 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-04T05:33:54.876 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-04T05:33:55.016 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2023-12-04T05:33:55.030 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-04T05:33:55.066 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-04T05:33:55.069 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-04T05:33:55.333 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-04T05:33:55.411 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2023-12-04T05:33:55.425 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-04T05:33:55.469 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-04T05:33:55.720 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-04T05:33:55.780 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2023-12-04T05:33:55.794 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-04T05:33:55.838 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-04T05:33:56.199 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2023-12-04T05:33:56.214 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-04T05:33:56.258 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-04T05:33:56.383 INFO:teuthology.orchestra.run.smithi143.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-04T05:33:56.400 INFO:teuthology.orchestra.run.smithi143.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-04T05:33:56.500 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:56.602 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2023-12-04T05:33:56.617 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-04T05:33:56.661 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-04T05:33:57.140 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-04T05:33:57.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-04T05:33:57.199 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-04T05:33:57.246 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user cephadm....done 2023-12-04T05:33:57.467 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2023-12-04T05:33:57.481 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-04T05:33:57.525 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-04T05:33:57.724 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-04T05:33:57.820 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2023-12-04T05:33:57.834 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-04T05:33:57.881 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-04T05:33:58.171 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-04T05:33:58.248 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2023-12-04T05:33:58.262 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-04T05:33:58.298 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-04T05:33:58.509 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-04T05:33:58.575 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-04T05:33:58.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-04T05:33:58.634 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-04T05:33:58.752 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-04T05:33:59.029 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-04T05:33:59.297 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-04T05:33:59.320 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2023-12-04T05:33:59.334 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:33:59.404 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:33:59.424 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-04T05:33:59.733 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-04T05:34:00.015 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2023-12-04T05:34:00.030 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-12-04T05:34:00.073 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:00.085 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-04T05:34:00.349 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-04T05:34:00.404 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-04T05:34:00.628 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-04T05:34:00.674 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-04T05:34:00.754 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-04T05:34:00.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-04T05:34:01.024 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-04T05:34:01.291 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-04T05:34:01.427 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-04T05:34:01.536 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-04T05:34:01.786 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-04T05:34:02.018 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-04T05:34:02.061 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:02.066 INFO:teuthology.orchestra.run.smithi097.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-04T05:34:02.106 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:02.338 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-04T05:34:02.464 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-04T05:34:02.590 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-04T05:34:02.667 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2023-12-04T05:34:02.851 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-04T05:34:02.853 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-04T05:34:02.959 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-04T05:34:03.122 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-04T05:34:03.219 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-04T05:34:03.365 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-04T05:34:03.532 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-04T05:34:03.710 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-04T05:34:03.743 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-04T05:34:03.793 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-04T05:34:03.806 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-04T05:34:03.932 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-04T05:34:04.062 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-04T05:34:04.202 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-04T05:34:04.308 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-04T05:34:04.470 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-04T05:34:04.512 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-04T05:34:04.752 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-04T05:34:04.914 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-04T05:34:05.199 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-04T05:34:05.458 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-04T05:34:05.462 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-04T05:34:05.776 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-04T05:34:05.788 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up zip (3.0-12build2) ... 2023-12-04T05:34:05.914 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-04T05:34:06.027 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-04T05:34:06.403 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-04T05:34:06.616 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-04T05:34:06.671 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-04T05:34:06.867 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-04T05:34:06.972 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:06.985 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-04T05:34:07.112 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-04T05:34:07.231 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-04T05:34:07.359 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-04T05:34:07.437 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-04T05:34:07.483 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-04T05:34:07.777 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-04T05:34:07.864 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-04T05:34:07.902 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-04T05:34:08.123 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-04T05:34:08.169 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-04T05:34:08.501 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-04T05:34:08.542 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-04T05:34:08.579 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-04T05:34:08.650 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-04T05:34:08.799 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-04T05:34:08.828 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-04T05:34:09.130 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-04T05:34:09.171 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-04T05:34:09.326 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-04T05:34:09.481 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-04T05:34:09.611 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-04T05:34:09.758 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-04T05:34:09.858 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:09.886 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-04T05:34:10.159 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-idna (3.3-1) ... 2023-12-04T05:34:10.189 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2023-12-04T05:34:10.313 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-04T05:34:10.486 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-04T05:34:11.024 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-04T05:34:11.299 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-04T05:34:11.426 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-04T05:34:11.576 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-04T05:34:11.743 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-04T05:34:11.894 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-04T05:34:11.961 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:12.095 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-04T05:34:12.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-04T05:34:12.371 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-04T05:34:12.497 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-04T05:34:12.546 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-04T05:34:12.623 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-04T05:34:12.932 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-04T05:34:12.950 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-04T05:34:13.210 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-04T05:34:13.233 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-04T05:34:13.477 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:13.584 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-04T05:34:13.604 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-04T05:34:13.939 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-04T05:34:13.944 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-04T05:34:14.198 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-04T05:34:14.204 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-04T05:34:14.330 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:14.466 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-04T05:34:14.671 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1) ... 2023-12-04T05:34:14.758 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-04T05:34:15.002 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-04T05:34:15.039 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-04T05:34:15.269 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-04T05:34:15.395 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-04T05:34:15.680 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-04T05:34:15.851 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-04T05:34:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-04T05:34:16.270 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-04T05:34:16.442 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-04T05:34:16.480 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:16.606 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-04T05:34:16.685 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-04T05:34:16.846 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-04T05:34:16.882 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-04T05:34:16.970 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-04T05:34:17.008 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-04T05:34:17.059 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-04T05:34:17.134 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-04T05:34:17.306 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-04T05:34:17.415 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-04T05:34:17.445 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-04T05:34:17.711 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-04T05:34:17.800 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-04T05:34:17.981 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:18.090 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-04T05:34:18.093 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-04T05:34:18.219 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-04T05:34:18.382 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-04T05:34:18.479 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:18.614 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-04T05:34:18.650 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-04T05:34:18.933 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-04T05:34:18.950 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-04T05:34:19.201 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-04T05:34:19.257 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-04T05:34:19.460 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-04T05:34:19.558 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-04T05:34:19.736 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-04T05:34:19.761 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-04T05:34:19.862 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-04T05:34:20.046 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-04T05:34:20.138 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-04T05:34:20.281 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-04T05:34:20.315 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-04T05:34:20.574 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-04T05:34:20.587 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-04T05:34:20.951 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-04T05:34:21.142 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-04T05:34:21.256 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-04T05:34:21.409 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-04T05:34:21.535 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-04T05:34:21.606 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-04T05:34:21.661 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-04T05:34:21.732 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:21.751 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-04T05:34:21.852 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:21.978 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-04T05:34:21.996 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-04T05:34:22.122 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-04T05:34:22.290 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:22.413 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:22.541 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-04T05:34:22.541 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-04T05:34:22.808 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-04T05:34:22.834 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:22.934 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-04T05:34:22.934 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:23.068 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:23.201 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-04T05:34:23.270 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-04T05:34:23.270 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-04T05:34:23.327 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-04T05:34:23.678 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-04T05:34:23.878 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:23.988 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-04T05:34:24.047 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:24.172 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:24.272 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-04T05:34:24.299 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:24.425 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-04T05:34:24.467 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-04T05:34:24.735 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-04T05:34:25.036 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-04T05:34:25.304 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-04T05:34:25.706 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-04T05:34:25.712 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:25.838 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:25.956 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:25.999 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-04T05:34:26.107 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:26.234 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:26.351 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-04T05:34:26.360 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:26.486 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:26.636 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:26.762 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-04T05:34:26.914 INFO:teuthology.orchestra.run.smithi143.stdout:Adding group ceph....done 2023-12-04T05:34:27.057 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:27.216 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:27.291 INFO:teuthology.orchestra.run.smithi143.stdout:Adding system user ceph....done 2023-12-04T05:34:27.342 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-04T05:34:27.484 INFO:teuthology.orchestra.run.smithi143.stdout:Setting system user ceph properties....done 2023-12-04T05:34:27.506 INFO:teuthology.orchestra.run.smithi143.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-04T05:34:27.627 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:27.645 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-04T05:34:27.786 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:27.912 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:28.035 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-04T05:34:28.120 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-04T05:34:28.121 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-04T05:34:28.653 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:28.731 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:28.847 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-04T05:34:28.847 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-04T05:34:28.865 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:28.982 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:29.109 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:29.234 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-04T05:34:29.454 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:29.572 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.088 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-04T05:34:30.088 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-04T05:34:30.514 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.647 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.682 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.748 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.866 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:30.993 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:31.042 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-04T05:34:31.146 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:31.739 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2023-12-04T05:34:31.799 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:32.033 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-04T05:34:32.033 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-04T05:34:32.071 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2023-12-04T05:34:32.260 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2023-12-04T05:34:32.277 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-04T05:34:32.417 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-04T05:34:32.633 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:32.806 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-04T05:34:32.855 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-04T05:34:32.855 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-04T05:34:33.459 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:33.477 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:33.685 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-04T05:34:33.685 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-04T05:34:33.780 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-04T05:34:33.780 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-04T05:34:34.296 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:34.386 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:34.412 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:34.513 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:34.647 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:34.840 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-04T05:34:34.840 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-04T05:34:34.935 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-04T05:34:34.936 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-04T05:34:35.432 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:35.566 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:35.591 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:35.717 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:35.851 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:35.955 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-04T05:34:36.196 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-04T05:34:36.305 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-04T05:34:36.499 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-04T05:34:36.618 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:36.891 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-04T05:34:36.891 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-04T05:34:37.513 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:37.592 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-04T05:34:37.742 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-04T05:34:37.742 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-04T05:34:38.339 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:38.355 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-04T05:34:38.361 DEBUG:teuthology.orchestra.run.smithi143:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-04T05:34:38.438 INFO:teuthology.orchestra.run.smithi143.stdout:Reading package lists... 2023-12-04T05:34:38.604 INFO:teuthology.orchestra.run.smithi143.stdout:Building dependency tree... 2023-12-04T05:34:38.605 INFO:teuthology.orchestra.run.smithi143.stdout:Reading state information... 2023-12-04T05:34:38.661 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-04T05:34:38.662 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-04T05:34:38.756 INFO:teuthology.orchestra.run.smithi143.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages were automatically installed and are no longer required: 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-04T05:34:38.757 INFO:teuthology.orchestra.run.smithi143.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-04T05:34:38.758 INFO:teuthology.orchestra.run.smithi143.stdout:The following additional packages will be installed: 2023-12-04T05:34:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-04T05:34:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-04T05:34:38.758 INFO:teuthology.orchestra.run.smithi143.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout:Suggested packages: 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-04T05:34:38.759 INFO:teuthology.orchestra.run.smithi143.stdout: libengine-pkcs11-openssl 2023-12-04T05:34:38.807 INFO:teuthology.orchestra.run.smithi143.stdout:The following NEW packages will be installed: 2023-12-04T05:34:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-04T05:34:38.808 INFO:teuthology.orchestra.run.smithi143.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-04T05:34:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-04T05:34:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-04T05:34:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-04T05:34:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-04T05:34:38.809 INFO:teuthology.orchestra.run.smithi143.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-04T05:34:38.810 INFO:teuthology.orchestra.run.smithi143.stdout:The following packages will be upgraded: 2023-12-04T05:34:38.810 INFO:teuthology.orchestra.run.smithi143.stdout: libssl3 2023-12-04T05:34:38.866 INFO:teuthology.orchestra.run.smithi143.stdout:1 upgraded, 39 newly installed, 0 to remove and 264 not upgraded. 2023-12-04T05:34:38.866 INFO:teuthology.orchestra.run.smithi143.stdout:Need to get 54.6 MB of archives. 2023-12-04T05:34:38.866 INFO:teuthology.orchestra.run.smithi143.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-04T05:34:38.866 INFO:teuthology.orchestra.run.smithi143.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-04T05:34:38.970 INFO:teuthology.orchestra.run.smithi143.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-04T05:34:39.025 INFO:teuthology.orchestra.run.smithi143.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-04T05:34:39.033 INFO:teuthology.orchestra.run.smithi143.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-04T05:34:39.034 INFO:teuthology.orchestra.run.smithi143.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-04T05:34:39.035 INFO:teuthology.orchestra.run.smithi143.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-04T05:34:39.036 INFO:teuthology.orchestra.run.smithi143.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-04T05:34:39.037 INFO:teuthology.orchestra.run.smithi143.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-12-04T05:34:39.038 INFO:teuthology.orchestra.run.smithi143.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-04T05:34:39.039 INFO:teuthology.orchestra.run.smithi143.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-04T05:34:39.040 INFO:teuthology.orchestra.run.smithi143.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-04T05:34:39.044 INFO:teuthology.orchestra.run.smithi143.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-04T05:34:39.059 INFO:teuthology.orchestra.run.smithi143.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-04T05:34:39.257 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:39.274 INFO:teuthology.orchestra.run.smithi143.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-04T05:34:39.277 INFO:teuthology.orchestra.run.smithi143.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-04T05:34:39.277 INFO:teuthology.orchestra.run.smithi143.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-04T05:34:39.279 INFO:teuthology.orchestra.run.smithi143.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-04T05:34:39.280 INFO:teuthology.orchestra.run.smithi143.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-04T05:34:39.286 INFO:teuthology.orchestra.run.smithi143.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-12-04T05:34:39.286 INFO:teuthology.orchestra.run.smithi143.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-04T05:34:39.293 INFO:teuthology.orchestra.run.smithi143.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-04T05:34:39.294 INFO:teuthology.orchestra.run.smithi143.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-04T05:34:39.315 INFO:teuthology.orchestra.run.smithi143.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-04T05:34:39.316 INFO:teuthology.orchestra.run.smithi143.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-04T05:34:39.326 INFO:teuthology.orchestra.run.smithi143.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-04T05:34:39.347 INFO:teuthology.orchestra.run.smithi143.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-04T05:34:39.351 INFO:teuthology.orchestra.run.smithi143.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-04T05:34:39.351 INFO:teuthology.orchestra.run.smithi143.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-04T05:34:39.357 INFO:teuthology.orchestra.run.smithi143.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-04T05:34:39.357 INFO:teuthology.orchestra.run.smithi143.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-12-04T05:34:39.371 INFO:teuthology.orchestra.run.smithi143.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-04T05:34:39.371 INFO:teuthology.orchestra.run.smithi143.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-12-04T05:34:39.383 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:39.512 INFO:teuthology.orchestra.run.smithi143.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-04T05:34:39.513 INFO:teuthology.orchestra.run.smithi143.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-04T05:34:39.513 INFO:teuthology.orchestra.run.smithi143.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-04T05:34:39.513 INFO:teuthology.orchestra.run.smithi143.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-04T05:34:39.513 INFO:teuthology.orchestra.run.smithi143.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-04T05:34:39.514 INFO:teuthology.orchestra.run.smithi143.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-04T05:34:39.530 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-04T05:34:39.531 INFO:teuthology.orchestra.run.smithi143.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-04T05:34:39.726 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-04T05:34:39.727 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-04T05:34:39.905 INFO:teuthology.orchestra.run.smithi143.stdout:Preconfiguring packages ... 2023-12-04T05:34:40.049 INFO:teuthology.orchestra.run.smithi143.stdout:Fetched 54.6 MB in 1s (77.0 MB/s) 2023-12-04T05:34:40.191 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package flex. 2023-12-04T05:34:40.265 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-12-04T05:34:40.268 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:40.306 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-04T05:34:40.402 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:40.536 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:40.663 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:40.807 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-12-04T05:34:40.868 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-04T05:34:41.029 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-04T05:34:41.166 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-04T05:34:41.269 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-04T05:34:41.413 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:34:41.420 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-04T05:34:41.991 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package bison. 2023-12-04T05:34:42.061 INFO:teuthology.orchestra.run.smithi143.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-12-04T05:34:42.065 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-04T05:34:42.133 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-04T05:34:42.509 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-04T05:34:42.524 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-04T05:34:42.528 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-04T05:34:42.585 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-04T05:34:42.845 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package dump. 2023-12-04T05:34:42.860 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-04T05:34:42.895 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking dump (0.4b47-3) ... 2023-12-04T05:34:43.158 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package indent. 2023-12-04T05:34:43.172 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:43.216 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-04T05:34:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-04T05:34:43.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-04T05:34:43.306 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2023-12-04T05:34:43.472 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2023-12-04T05:34:43.473 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2023-12-04T05:34:43.477 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-04T05:34:43.492 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-04T05:34:43.537 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-04T05:34:43.626 INFO:teuthology.orchestra.run.smithi097.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-04T05:34:43.626 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-04T05:34:43.626 INFO:teuthology.orchestra.run.smithi097.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-04T05:34:43.626 INFO:teuthology.orchestra.run.smithi097.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-04T05:34:43.627 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-04T05:34:43.628 INFO:teuthology.orchestra.run.smithi097.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-04T05:34:43.629 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2023-12-04T05:34:43.629 INFO:teuthology.orchestra.run.smithi097.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-04T05:34:43.629 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-04T05:34:43.629 INFO:teuthology.orchestra.run.smithi097.stdout: libengine-pkcs11-openssl 2023-12-04T05:34:43.676 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-04T05:34:43.677 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-04T05:34:43.678 INFO:teuthology.orchestra.run.smithi097.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-04T05:34:43.678 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2023-12-04T05:34:43.679 INFO:teuthology.orchestra.run.smithi097.stdout: libssl3 2023-12-04T05:34:43.840 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-04T05:34:43.855 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-12-04T05:34:43.890 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-12-04T05:34:44.126 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-04T05:34:44.141 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-04T05:34:44.184 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-04T05:34:44.365 INFO:teuthology.orchestra.run.smithi097.stdout:1 upgraded, 39 newly installed, 0 to remove and 264 not upgraded. 2023-12-04T05:34:44.365 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 54.6 MB of archives. 2023-12-04T05:34:44.365 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-04T05:34:44.365 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-04T05:34:44.504 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-04T05:34:44.520 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:44.565 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-04T05:34:44.807 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-04T05:34:44.823 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:44.857 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-04T05:34:44.860 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-04T05:34:45.085 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libjson-perl. 2023-12-04T05:34:45.101 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-04T05:34:45.117 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-04T05:34:45.143 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-04T05:34:45.152 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-04T05:34:45.153 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-04T05:34:45.163 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-04T05:34:45.163 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-04T05:34:45.163 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-12-04T05:34:45.165 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-04T05:34:45.168 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-04T05:34:45.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-04T05:34:45.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-04T05:34:45.455 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-04T05:34:45.470 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-04T05:34:45.515 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-04T05:34:45.596 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-04T05:34:46.613 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-04T05:34:46.616 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-04T05:34:46.616 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-04T05:34:46.641 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-04T05:34:46.641 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-04T05:34:46.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-12-04T05:34:46.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-04T05:34:46.677 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-04T05:34:46.841 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-04T05:34:46.900 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-04T05:34:46.915 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-04T05:34:46.958 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:34:47.218 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-04T05:34:47.234 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-04T05:34:47.269 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:34:47.579 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-04T05:34:47.579 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-04T05:34:47.579 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-04T05:34:47.587 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-04T05:34:47.605 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-04T05:34:47.634 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:34:47.683 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-04T05:34:47.691 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-04T05:34:47.694 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-04T05:34:47.694 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-04T05:34:47.694 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-12-04T05:34:47.722 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-04T05:34:47.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-12-04T05:34:47.991 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-04T05:34:48.007 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-04T05:34:48.049 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-04T05:34:48.350 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-04T05:34:48.377 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-04T05:34:48.393 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-04T05:34:48.432 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-04T05:34:48.433 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-04T05:34:48.433 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-04T05:34:48.439 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-04T05:34:48.525 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-04T05:34:48.541 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-04T05:34:48.780 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-04T05:34:48.796 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:48.840 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:34:48.991 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-04T05:34:48.992 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-04T05:34:49.183 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-04T05:34:49.199 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:49.242 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:34:49.377 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2023-12-04T05:34:49.522 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 54.6 MB in 5s (10.3 MB/s) 2023-12-04T05:34:49.538 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-04T05:34:49.551 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:49.596 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:34:49.686 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package flex. 2023-12-04T05:34:49.760 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-12-04T05:34:49.764 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:49.810 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-04T05:34:49.855 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-04T05:34:49.871 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-04T05:34:49.905 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:34:50.392 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-04T05:34:50.397 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-04T05:34:50.406 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-04T05:34:50.450 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-04T05:34:50.583 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-04T05:34:50.803 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package modemmanager. 2023-12-04T05:34:50.818 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-04T05:34:50.861 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:34:51.014 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:34:51.485 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager. 2023-12-04T05:34:51.500 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-04T05:34:51.551 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-04T05:34:51.592 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package bison. 2023-12-04T05:34:51.665 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-12-04T05:34:51.668 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-04T05:34:51.711 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-04T05:34:52.192 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package ppp. 2023-12-04T05:34:52.207 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-04T05:34:52.537 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-04T05:34:52.546 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-04T05:34:52.552 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-04T05:34:52.595 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-04T05:34:52.864 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package pptp-linux. 2023-12-04T05:34:52.878 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-04T05:34:52.915 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package dump. 2023-12-04T05:34:52.922 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-04T05:34:52.929 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-04T05:34:52.973 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking dump (0.4b47-3) ... 2023-12-04T05:34:53.184 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-04T05:34:53.198 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-04T05:34:53.242 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-04T05:34:53.243 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package indent. 2023-12-04T05:34:53.264 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:53.294 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-04T05:34:53.520 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-04T05:34:53.534 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-04T05:34:53.554 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-04T05:34:53.569 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-04T05:34:53.570 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-common (238) ... 2023-12-04T05:34:53.612 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-04T05:34:53.907 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-04T05:34:53.922 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:53.974 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:34:53.983 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-04T05:34:53.997 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-12-04T05:34:54.041 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-12-04T05:34:54.318 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-04T05:34:54.333 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-04T05:34:54.377 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-04T05:34:54.537 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-common. 2023-12-04T05:34:54.552 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-04T05:34:54.613 INFO:teuthology.orchestra.run.smithi143.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-04T05:34:54.645 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-common (238) ... 2023-12-04T05:34:54.671 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-04T05:34:54.685 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:54.730 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-04T05:34:54.990 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-04T05:34:55.006 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-04T05:34:55.057 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-04T05:34:55.112 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-14. 2023-12-04T05:34:55.127 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:55.181 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:34:55.310 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjson-perl. 2023-12-04T05:34:55.324 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-04T05:34:55.368 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-04T05:34:55.696 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-04T05:34:55.710 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-04T05:34:55.754 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-04T05:34:56.216 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql. 2023-12-04T05:34:56.234 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-04T05:34:56.275 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql (14+238) ... 2023-12-04T05:34:56.503 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-client. 2023-12-04T05:34:56.517 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-04T05:34:56.562 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-client (14+238) ... 2023-12-04T05:34:56.796 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-04T05:34:56.810 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-04T05:34:56.846 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-04T05:34:57.132 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-04T05:34:57.169 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-04T05:34:57.184 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl8.6. 2023-12-04T05:34:57.199 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-04T05:34:57.223 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:34:57.244 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-04T05:34:57.527 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-04T05:34:57.528 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package tcl. 2023-12-04T05:34:57.542 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-04T05:34:57.544 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-04T05:34:57.586 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:34:57.591 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-04T05:34:57.922 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package wpasupplicant. 2023-12-04T05:34:57.930 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-04T05:34:57.938 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-04T05:34:57.945 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-04T05:34:57.990 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:34:58.005 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-04T05:34:58.351 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-04T05:34:58.357 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-04T05:34:58.367 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-04T05:34:58.373 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-04T05:34:58.414 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-04T05:34:58.427 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-04T05:34:58.744 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-04T05:34:58.759 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-04T05:34:58.788 INFO:teuthology.orchestra.run.smithi143.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-04T05:34:58.794 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-04T05:34:58.803 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-04T05:34:58.854 INFO:teuthology.orchestra.run.smithi143.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-04T05:34:59.171 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-04T05:34:59.172 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-common (238) ... 2023-12-04T05:34:59.187 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:59.230 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:34:59.368 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-04T05:34:59.497 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-04T05:34:59.574 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-04T05:34:59.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:59.619 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:34:59.641 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:34:59.745 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-04T05:34:59.872 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-04T05:34:59.935 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-04T05:34:59.951 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:34:59.995 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:35:00.028 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:00.245 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-04T05:35:00.261 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-04T05:35:00.296 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:35:00.857 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-04T05:35:00.872 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-04T05:35:00.917 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-04T05:35:01.039 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-04T05:35:01.144 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-04T05:35:01.260 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package modemmanager. 2023-12-04T05:35:01.276 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-04T05:35:01.310 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:35:01.522 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-04T05:35:01.522 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-04T05:35:01.941 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager. 2023-12-04T05:35:01.956 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-04T05:35:02.007 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-04T05:35:02.597 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-04T05:35:02.725 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:35:02.749 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ppp. 2023-12-04T05:35:02.764 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-04T05:35:02.849 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-04T05:35:02.984 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-04T05:35:03.084 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-04T05:35:03.089 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-04T05:35:03.252 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-04T05:35:03.377 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-04T05:35:03.396 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pptp-linux. 2023-12-04T05:35:03.413 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-04T05:35:03.454 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-04T05:35:03.731 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-04T05:35:03.750 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-04T05:35:03.790 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-04T05:35:04.032 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-04T05:35:04.135 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-04T05:35:04.149 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-04T05:35:04.184 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up dump (0.4b47-3) ... 2023-12-04T05:35:04.196 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-common (238) ... 2023-12-04T05:35:04.270 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-04T05:35:04.326 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:35:04.452 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-12-04T05:35:04.463 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-04T05:35:04.477 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:35:04.513 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:04.578 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-04T05:35:04.721 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-04T05:35:04.846 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-04T05:35:04.940 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-04T05:35:04.998 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-04T05:35:05.102 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-common. 2023-12-04T05:35:05.115 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-04T05:35:05.126 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-04T05:35:05.176 INFO:teuthology.orchestra.run.smithi097.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-04T05:35:05.199 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-common (238) ... 2023-12-04T05:35:05.317 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-04T05:35:05.427 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:35:05.535 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-04T05:35:05.683 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-14. 2023-12-04T05:35:05.698 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-12-04T05:35:05.703 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-client (14+238) ... 2023-12-04T05:35:05.745 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:05.829 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-04T05:35:06.441 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout:which means they are currently configured by ifupdown: 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout:- enp3s0f1 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout:remove their configuration from /etc/network/interfaces. 2023-12-04T05:35:06.442 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:06.573 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-04T05:35:06.967 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-04T05:35:06.981 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql. 2023-12-04T05:35:06.992 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-04T05:35:07.036 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql (14+238) ... 2023-12-04T05:35:07.288 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-client. 2023-12-04T05:35:07.302 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-04T05:35:07.338 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-client (14+238) ... 2023-12-04T05:35:07.403 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-04T05:35:07.531 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-04T05:35:07.546 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-04T05:35:07.590 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-04T05:35:07.959 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl8.6. 2023-12-04T05:35:07.974 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-04T05:35:08.017 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-04T05:35:08.124 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:35:08.266 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-04T05:35:08.329 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package tcl. 2023-12-04T05:35:08.343 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-04T05:35:08.394 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-04T05:35:08.409 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-04T05:35:08.528 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-common (238) ... 2023-12-04T05:35:08.689 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package wpasupplicant. 2023-12-04T05:35:08.704 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-04T05:35:08.739 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-04T05:35:09.119 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-04T05:35:09.133 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-04T05:35:09.194 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-04T05:35:09.498 INFO:teuthology.orchestra.run.smithi143.stdout:Adding user postgres to group ssl-cert 2023-12-04T05:35:09.613 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-04T05:35:09.628 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-04T05:35:09.679 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-04T05:35:09.769 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:09.770 INFO:teuthology.orchestra.run.smithi143.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-04T05:35:09.964 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-common (238) ... 2023-12-04T05:35:10.023 INFO:teuthology.orchestra.run.smithi143.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-04T05:35:10.023 INFO:teuthology.orchestra.run.smithi143.stdout:Removing obsolete dictionary files: 2023-12-04T05:35:10.169 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-04T05:35:10.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-04T05:35:10.421 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:10.579 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-04T05:35:10.704 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-04T05:35:10.706 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-04T05:35:10.832 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:11.177 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:11.516 INFO:teuthology.orchestra.run.smithi143.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-04T05:35:11.536 INFO:teuthology.orchestra.run.smithi143.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:This user must also own the server process. 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:The database cluster will be initialized with locale "en_US". 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:The default text search configuration will be set to "english". 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:Data page checksums are disabled. 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:11.586 INFO:teuthology.orchestra.run.smithi143.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-04T05:35:11.587 INFO:teuthology.orchestra.run.smithi143.stdout:creating subdirectories ... ok 2023-12-04T05:35:11.587 INFO:teuthology.orchestra.run.smithi143.stdout:selecting dynamic shared memory implementation ... posix 2023-12-04T05:35:11.610 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default max_connections ... 100 2023-12-04T05:35:11.648 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default shared_buffers ... 128MB 2023-12-04T05:35:11.664 INFO:teuthology.orchestra.run.smithi143.stdout:selecting default time zone ... Etc/UTC 2023-12-04T05:35:11.664 INFO:teuthology.orchestra.run.smithi143.stdout:creating configuration files ... ok 2023-12-04T05:35:11.828 INFO:teuthology.orchestra.run.smithi143.stdout:running bootstrap script ... ok 2023-12-04T05:35:11.838 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-04T05:35:11.938 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-04T05:35:12.317 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-04T05:35:12.318 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-04T05:35:12.459 INFO:teuthology.orchestra.run.smithi143.stdout:performing post-bootstrap initialization ... ok 2023-12-04T05:35:12.999 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-04T05:35:13.108 INFO:teuthology.orchestra.run.smithi143.stdout:syncing data to disk ... ok 2023-12-04T05:35:13.134 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-04T05:35:13.244 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-04T05:35:13.345 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-04T05:35:13.495 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-04T05:35:13.617 INFO:teuthology.orchestra.run.smithi143.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-04T05:35:13.621 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-04T05:35:13.750 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-04T05:35:14.519 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-04T05:35:14.661 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up dump (0.4b47-3) ... 2023-12-04T05:35:14.756 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-04T05:35:14.821 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:35:14.947 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-12-04T05:35:15.074 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-04T05:35:15.233 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-04T05:35:15.358 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-04T05:35:15.457 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-04T05:35:15.527 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-04T05:35:15.628 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-04T05:35:15.829 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-04T05:35:15.955 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:35:16.081 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-04T05:35:16.249 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-client (14+238) ... 2023-12-04T05:35:16.400 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-04T05:35:16.893 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:35:17.010 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-04T05:35:17.013 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:17.013 INFO:teuthology.orchestra.run.smithi097.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-04T05:35:17.013 INFO:teuthology.orchestra.run.smithi097.stdout:which means they are currently configured by ifupdown: 2023-12-04T05:35:17.014 INFO:teuthology.orchestra.run.smithi097.stdout:- enp3s0f1 2023-12-04T05:35:17.014 INFO:teuthology.orchestra.run.smithi097.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-04T05:35:17.014 INFO:teuthology.orchestra.run.smithi097.stdout:remove their configuration from /etc/network/interfaces. 2023-12-04T05:35:17.014 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:17.128 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up postgresql (14+238) ... 2023-12-04T05:35:17.148 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-04T05:35:17.254 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:35:17.380 INFO:teuthology.orchestra.run.smithi143.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:35:17.546 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-04T05:35:17.639 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-04T05:35:17.640 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-04T05:35:17.974 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-04T05:35:18.382 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-04T05:35:18.652 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-04T05:35:18.727 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-04T05:35:18.839 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-04T05:35:18.877 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-04T05:35:18.963 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-04T05:35:19.091 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-common (238) ... 2023-12-04T05:35:20.046 INFO:teuthology.orchestra.run.smithi097.stdout:Adding user postgres to group ssl-cert 2023-12-04T05:35:20.254 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-04T05:35:20.323 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:20.324 INFO:teuthology.orchestra.run.smithi097.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-04T05:35:20.354 INFO:teuthology.orchestra.run.smithi143.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-04T05:35:20.576 INFO:teuthology.orchestra.run.smithi097.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-04T05:35:20.577 INFO:teuthology.orchestra.run.smithi097.stdout:Removing obsolete dictionary files: 2023-12-04T05:35:20.893 INFO:teuthology.orchestra.run.smithi143.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-04T05:35:20.898 DEBUG:teuthology.parallel:result is None 2023-12-04T05:35:21.270 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-04T05:35:21.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-12-04T05:35:22.201 INFO:teuthology.orchestra.run.smithi097.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-04T05:35:22.220 INFO:teuthology.orchestra.run.smithi097.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:This user must also own the server process. 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:The database cluster will be initialized with locale "en_US". 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:The default text search configuration will be set to "english". 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout:Data page checksums are disabled. 2023-12-04T05:35:22.271 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:22.272 INFO:teuthology.orchestra.run.smithi097.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-04T05:35:22.272 INFO:teuthology.orchestra.run.smithi097.stdout:creating subdirectories ... ok 2023-12-04T05:35:22.272 INFO:teuthology.orchestra.run.smithi097.stdout:selecting dynamic shared memory implementation ... posix 2023-12-04T05:35:22.296 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default max_connections ... 100 2023-12-04T05:35:22.332 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default shared_buffers ... 128MB 2023-12-04T05:35:22.346 INFO:teuthology.orchestra.run.smithi097.stdout:selecting default time zone ... Etc/UTC 2023-12-04T05:35:22.346 INFO:teuthology.orchestra.run.smithi097.stdout:creating configuration files ... ok 2023-12-04T05:35:22.518 INFO:teuthology.orchestra.run.smithi097.stdout:running bootstrap script ... ok 2023-12-04T05:35:23.173 INFO:teuthology.orchestra.run.smithi097.stdout:performing post-bootstrap initialization ... ok 2023-12-04T05:35:23.975 INFO:teuthology.orchestra.run.smithi097.stdout:syncing data to disk ... ok 2023-12-04T05:35:24.479 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-04T05:35:27.449 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:35:27.575 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-04T05:35:27.695 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up postgresql (14+238) ... 2023-12-04T05:35:27.820 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-04T05:35:27.980 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-04T05:35:28.241 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-04T05:35:28.241 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-04T05:35:28.990 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-04T05:35:29.292 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-04T05:35:29.435 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-04T05:35:30.939 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-04T05:35:31.041 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-04T05:35:31.567 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-04T05:35:31.571 DEBUG:teuthology.parallel:result is None 2023-12-04T05:35:31.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-12-04T05:35:31.713 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2023-12-04T05:35:31.736 INFO:teuthology.orchestra.run.smithi097.stdout:18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:35:31.736 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:35:31.736 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-12-04T05:35:31.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-12-04T05:35:31.957 DEBUG:teuthology.orchestra.run.smithi143:> dpkg-query -W -f '${Version}' ceph 2023-12-04T05:35:31.982 INFO:teuthology.orchestra.run.smithi143.stdout:18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:35:31.982 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-12-04T05:35:31.982 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-12-04T05:35:31.982 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-04T05:35:31.983 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:31.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-04T05:35:32.008 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:32.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-04T05:35:32.051 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-04T05:35:32.052 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:32.052 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2023-12-04T05:35:32.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-04T05:35:32.134 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:32.134 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2023-12-04T05:35:32.156 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-04T05:35:32.222 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-04T05:35:32.222 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:32.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-04T05:35:32.242 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-04T05:35:32.307 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:32.307 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-04T05:35:32.329 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-04T05:35:32.398 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-04T05:35:32.398 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:32.398 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2023-12-04T05:35:32.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-04T05:35:32.483 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:32.483 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2023-12-04T05:35:32.505 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-04T05:35:32.570 INFO:teuthology.run_tasks:Running task ceph... 2023-12-04T05:35:32.684 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-04T05:35:32.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2023-12-04T05:35:32.691 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2023-12-04T05:35:32.723 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-04T05:35:32.723 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-04T05:35:32.754 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-04T05:35:32.786 INFO:tasks.ceph:Creating extra log directories... 2023-12-04T05:35:32.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-04T05:35:32.814 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-04T05:35:32.857 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-04T05:35:32.857 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-04T05:35:32.858 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-04T05:35:32.858 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:32.858 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-04T05:35:32.885 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-04T05:35:32.973 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:32.973 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-04T05:35:32.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-04T05:35:33.082 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-04T05:35:33.082 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-04T05:35:33.083 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632', 'branch': 'wip-vshankar-testing-20231127.102654', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7476632', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102654'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102654', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1098, 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'sleep_before_teardown': 0, 'subset': '854/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102654', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB3bTo/PTgMXf3A1uSBugWKWKj700MOlex9DrpUHxR/0It3S5nisaOnkBFAPZPFGuvUuzYPGEiKV3JsO4vPqI=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPCSXg8+31216oRUvI2Qnin8aZkRTRTomhx2/8zkEKtXVrI+MjRKBIL/irBi/IxOyPzxSuYoVVzzkF/0g128+/8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-04_05:06:51', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-04T05:35:33.083 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-04T05:35:33.088 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-04T05:35:33.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2023-12-04T05:35:33.139 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2023-12-04T05:35:33.173 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:33.174 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2023-12-04T05:35:33.211 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-04T05:35:33.211 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-04 05:28:08.468145742 +0000 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-04 05:28:08.464145783 +0000 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-04 05:28:08.464145783 +0000 2023-12-04T05:35:33.264 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-04 05:28:08.464145783 +0000 2023-12-04T05:35:33.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-04T05:35:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-04T05:35:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-04T05:35:33.327 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000408623 s, 1.3 MB/s 2023-12-04T05:35:33.327 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-04T05:35:33.380 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2023-12-04T05:35:33.431 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-04 05:28:11.640112965 +0000 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-04 05:28:10.128128582 +0000 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-04 05:28:10.128128582 +0000 2023-12-04T05:35:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-04 05:28:10.128128582 +0000 2023-12-04T05:35:33.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-04T05:35:33.492 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-04T05:35:33.492 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-04T05:35:33.492 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000353149 s, 1.4 MB/s 2023-12-04T05:35:33.494 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-04T05:35:33.551 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-04 05:28:13.280096038 +0000 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-04 05:28:11.892110362 +0000 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-04 05:28:11.892110362 +0000 2023-12-04T05:35:33.604 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-04 05:28:11.892110362 +0000 2023-12-04T05:35:33.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-04T05:35:33.667 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-04T05:35:33.667 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-04T05:35:33.667 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00063115 s, 811 kB/s 2023-12-04T05:35:33.667 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-04T05:35:33.720 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 954 Links: 1 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2023-12-04 05:28:15.340074793 +0000 2023-12-04T05:35:33.771 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2023-12-04 05:28:13.572093024 +0000 2023-12-04T05:35:33.772 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2023-12-04 05:28:13.572093024 +0000 2023-12-04T05:35:33.772 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2023-12-04 05:28:13.572093024 +0000 2023-12-04T05:35:33.772 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-04T05:35:33.837 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2023-12-04T05:35:33.837 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2023-12-04T05:35:33.837 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000626243 s, 818 kB/s 2023-12-04T05:35:33.839 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-04T05:35:33.894 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:33.894 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:33.895 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2023-12-04T05:35:33.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-04T05:35:33.908 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2023-12-04T05:35:33.957 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-04T05:35:33.957 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-04 05:27:58.828038076 +0000 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-04 05:27:57.256059285 +0000 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-04 05:27:57.256059285 +0000 2023-12-04T05:35:33.958 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-04 05:27:57.256059285 +0000 2023-12-04T05:35:33.958 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-04T05:35:34.023 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-04T05:35:34.023 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-04T05:35:34.023 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000384536 s, 1.3 MB/s 2023-12-04T05:35:34.023 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-04T05:35:34.075 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-04 05:28:00.656013461 +0000 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-04 05:27:59.096034464 +0000 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-04 05:27:59.096034464 +0000 2023-12-04T05:35:34.127 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-04 05:27:59.096034464 +0000 2023-12-04T05:35:34.128 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-04T05:35:34.192 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-04T05:35:34.193 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-04T05:35:34.193 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000425873 s, 1.2 MB/s 2023-12-04T05:35:34.197 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-04T05:35:34.257 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2023-12-04T05:35:34.313 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-04 05:28:02.415989811 +0000 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-04 05:28:00.920009909 +0000 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-04 05:28:00.920009909 +0000 2023-12-04T05:35:34.314 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-04 05:28:00.920009909 +0000 2023-12-04T05:35:34.314 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-04T05:35:34.383 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-04T05:35:34.383 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-04T05:35:34.383 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00037981 s, 1.3 MB/s 2023-12-04T05:35:34.384 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-04T05:35:34.439 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2023-12-04 05:28:04.227965513 +0000 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2023-12-04 05:28:02.679986268 +0000 2023-12-04T05:35:34.494 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2023-12-04 05:28:02.679986268 +0000 2023-12-04T05:35:34.495 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2023-12-04 05:28:02.679986268 +0000 2023-12-04T05:35:34.495 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-04T05:35:34.559 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2023-12-04T05:35:34.559 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2023-12-04T05:35:34.559 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000413569 s, 1.2 MB/s 2023-12-04T05:35:34.559 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-04T05:35:34.616 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:34.616 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-04T05:35:34.616 INFO:tasks.ceph:Generating config... 2023-12-04T05:35:34.617 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-04T05:35:34.617 INFO:tasks.ceph:[client] debug client = 20 2023-12-04T05:35:34.617 INFO:tasks.ceph:[client] debug ms = 1 2023-12-04T05:35:34.617 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-04T05:35:34.617 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-04T05:35:34.617 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-04T05:35:34.618 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-04T05:35:34.619 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-04T05:35:34.619 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-04T05:35:34.620 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-04T05:35:34.621 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-04T05:35:34.621 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-04T05:35:34.621 INFO:tasks.ceph:Setting up mon.a... 2023-12-04T05:35:34.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-04T05:35:34.666 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2023-12-04T05:35:34.691 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-04T05:35:34.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T05:35:34.802 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.b', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]')] 2023-12-04T05:35:34.802 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-04T05:35:34.803 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:34.803 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-04T05:35:34.851 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --add b 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:34.945 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:34.945 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid 76f28696-8109-44bf-b432-6ecc5796b8c9 2023-12-04T05:35:34.945 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = pacific 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 76f28696-8109-44bf-b432-6ecc5796b8c9 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2023-12-04T05:35:34.947140+0000 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:created 2023-12-04T05:35:34.947140+0000 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 16 (pacific) 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.b 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2023-12-04T05:35:34.946 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-04T05:35:34.948 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-04T05:35:34.961 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 76f28696-8109-44bf-b432-6ecc5796b8c9... 2023-12-04T05:35:34.962 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-04T05:35:35.012 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2023-12-04T05:35:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2023-12-04T05:35:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2023-12-04T05:35:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on skipped message = False 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 76f28696-8109-44bf-b432-6ecc5796b8c9 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2023-12-04T05:35:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2023-12-04T05:35:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-12-04T05:35:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2023-12-04T05:35:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2023-12-04T05:35:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: mon op complaint time = 120 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: client mount timeout = 600 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: debug client = 20 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-04T05:35:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:[mds] 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds = 20 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: debug mds balancer = 20 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug frag = True 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: mds debug scatterstat = True 2023-12-04T05:35:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: mds op complaint time = 180 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: mds verify scatter = True 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: osd op complaint time = 180 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: rados mon op timeout = 900 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: rados osd op timeout = 900 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-04T05:35:35.063 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2023-12-04T05:35:35.064 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2023-12-04T05:35:35.066 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.066 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-04T05:35:35.066 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2023-12-04T05:35:35.066 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.066 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2023-12-04T05:35:35.067 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.97,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2023-12-04T05:35:35.068 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 76f28696-8109-44bf-b432-6ecc5796b8c9 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2023-12-04T05:35:35.069 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2023-12-04T05:35:35.070 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bdev async discard = True 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bdev enable discard = True 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore allocator = bitmap 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 1/20 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 1/20 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 4/10 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2023-12-04T05:35:35.071 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-04T05:35:35.072 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2023-12-04T05:35:35.073 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2023-12-04T05:35:35.074 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2023-12-04T05:35:35.075 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-12-04T05:35:35.076 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-12-04T05:35:35.083 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2023-12-04T05:35:35.084 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2023-12-04T05:35:35.089 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-04T05:35:35.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-04T05:35:35.189 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-04T05:35:35.189 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:35.190 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-04T05:35:35.198 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:35.199 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-04T05:35:35.251 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:35:35.251 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:35.251 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-04T05:35:35.251 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T05:35:35.327 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:35:35.328 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:35.383 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:35:35.383 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:35.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-04T05:35:35.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T05:35:35.453 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:35:35.453 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:35.559 INFO:tasks.ceph:Setting up mon nodes... 2023-12-04T05:35:35.559 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-04T05:35:35.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-04T05:35:35.620 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-04T05:35:35.621 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-04T05:35:35.683 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-04T05:35:35.701 INFO:tasks.ceph:Setting up mds nodes... 2023-12-04T05:35:35.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-04T05:35:35.763 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-04T05:35:35.763 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-04T05:35:35.784 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-04T05:35:35.882 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-04T05:35:35.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-04T05:35:35.914 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-04T05:35:35.976 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-04T05:35:35.985 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-04T05:35:36.006 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-04T05:35:36.104 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-04T05:35:36.108 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-04T05:35:36.129 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-04T05:35:36.130 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-04T05:35:36.173 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-04T05:35:36.190 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-04T05:35:36.233 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-04T05:35:36.250 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-04T05:35:36.250 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-04T05:35:36.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-04T05:35:36.270 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:36.270 INFO:tasks.ceph:role: osd.0 2023-12-04T05:35:36.270 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:35:36.270 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:36.343 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:36.819 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-04T05:35:36.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-04T05:35:36.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-04T05:35:36.975 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-04T05:35:36.997 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:36.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:36.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-04T05:35:37.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:37.065 INFO:tasks.ceph:role: osd.1 2023-12-04T05:35:37.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:35:37.065 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-04T05:35:37.140 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:37.140 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:37.140 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:37.140 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:37.140 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:37.141 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:37.141 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:37.141 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:37.141 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:37.141 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:37.576 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-04T05:35:37.580 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-04T05:35:37.580 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-04T05:35:37.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-04T05:35:37.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:37.709 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:37.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-04T05:35:37.775 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:37.775 INFO:tasks.ceph:role: osd.2 2023-12-04T05:35:37.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:35:37.775 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-04T05:35:37.853 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:37.853 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:37.853 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:37.853 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:37.853 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:37.854 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:37.854 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:37.854 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:37.854 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:37.854 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:38.317 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-04T05:35:38.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-04T05:35:38.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-04T05:35:38.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-04T05:35:38.504 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:38.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:38.505 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-04T05:35:38.572 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:38.572 INFO:tasks.ceph:role: osd.3 2023-12-04T05:35:38.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:35:38.573 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:39.142 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2023-12-04T05:35:39.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2023-12-04T05:35:39.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-04T05:35:39.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-04T05:35:39.318 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:39.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:39.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:39.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.453+0000 7f6b48f65640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-04T05:35:39.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.453+0000 7f6b48f65640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-04T05:35:39.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.453+0000 7f6b48f65640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T05:35:39.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.453+0000 7f6b48f65640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T05:35:39.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.453+0000 7f6b48f65640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T05:35:39.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:39.457+0000 7f6b48f65640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-04T05:35:42.467 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-04T05:35:42.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:42.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.581+0000 7fb2a0687640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-04T05:35:42.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.581+0000 7fb2a0687640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-04T05:35:42.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.581+0000 7fb2a0687640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T05:35:42.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.581+0000 7fb2a0687640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T05:35:42.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.581+0000 7fb2a0687640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T05:35:42.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:42.585+0000 7fb2a0687640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-04T05:35:45.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-04T05:35:45.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.685+0000 7fd659859640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-04T05:35:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.689+0000 7fd659859640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-04T05:35:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.689+0000 7fd659859640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T05:35:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.689+0000 7fd659859640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T05:35:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.689+0000 7fd659859640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T05:35:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:45.689+0000 7fd659859640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-04T05:35:48.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-04T05:35:48.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:48.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.797+0000 7fbe3f582640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-04T05:35:48.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.797+0000 7fbe3f582640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-04T05:35:48.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.797+0000 7fbe3f582640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T05:35:48.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.797+0000 7fbe3f582640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T05:35:48.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.797+0000 7fbe3f582640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T05:35:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:35:48.801+0000 7fbe3f582640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-04T05:35:51.798 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-04T05:35:51.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-04T05:35:51.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:51.842 INFO:tasks.ceph:role: osd.4 2023-12-04T05:35:51.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:35:51.843 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-04T05:35:51.914 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:51.914 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:51.915 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:52.381 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-04T05:35:52.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-04T05:35:52.387 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-04T05:35:52.546 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-04T05:35:52.565 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:52.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:52.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-04T05:35:52.629 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:52.629 INFO:tasks.ceph:role: osd.5 2023-12-04T05:35:52.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:35:52.629 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-04T05:35:52.701 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:52.701 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:52.701 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:52.702 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:53.144 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-04T05:35:53.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-04T05:35:53.146 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-04T05:35:53.241 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-04T05:35:53.259 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:53.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:53.260 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-04T05:35:53.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:53.326 INFO:tasks.ceph:role: osd.6 2023-12-04T05:35:53.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:35:53.326 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:53.399 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:53.400 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:53.400 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:53.400 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:53.875 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-04T05:35:53.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-04T05:35:53.875 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-04T05:35:54.027 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-04T05:35:54.047 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:54.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:54.048 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-04T05:35:54.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T05:35:54.113 INFO:tasks.ceph:role: osd.7 2023-12-04T05:35:54.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:35:54.114 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T05:35:54.187 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2023-12-04T05:35:54.188 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T05:35:54.188 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-04T05:35:54.188 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T05:35:54.188 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T05:35:54.677 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2023-12-04T05:35:54.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2023-12-04T05:35:54.680 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-04T05:35:54.842 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-04T05:35:54.861 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: /sbin/restorecon: command not found 2023-12-04T05:35:54.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:35:54.862 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:54.993 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-04T05:35:54.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-04T05:35:54.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T05:35:54.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T05:35:54.994 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T05:35:54.996 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:54.993+0000 7f748cb43640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-04T05:35:57.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-04T05:35:58.010 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:35:58.106 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.105+0000 7fb100869640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-04T05:35:58.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.105+0000 7fb100869640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-04T05:35:58.107 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.105+0000 7fb100869640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T05:35:58.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.105+0000 7fb100869640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T05:35:58.108 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.105+0000 7fb100869640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T05:35:58.110 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:35:58.109+0000 7fb100869640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-04T05:36:01.100 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-04T05:36:01.121 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:36:01.223 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.221+0000 7f647076e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-04T05:36:01.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.221+0000 7f647076e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-04T05:36:01.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.221+0000 7f647076e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T05:36:01.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.221+0000 7f647076e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T05:36:01.224 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.221+0000 7f647076e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T05:36:01.225 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:01.225+0000 7f647076e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-04T05:36:03.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:36:03.095 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:36:04.203 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-04T05:36:04.224 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:36:04.319 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.317+0000 7fad923b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-04T05:36:04.320 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.317+0000 7fad923b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-04T05:36:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.317+0000 7fad923b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T05:36:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.317+0000 7fad923b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T05:36:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.317+0000 7fad923b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T05:36:04.321 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:04.321+0000 7fad923b2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-04T05:36:07.323 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-04T05:36:07.344 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-04T05:36:07.344 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.344 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-04T05:36:07.367 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-04T05:36:07.432 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-04T05:36:07.496 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.496 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-04T05:36:07.560 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-04T05:36:07.624 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.625 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-04T05:36:07.687 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:07.687 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-04T05:36:07.751 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:07.751 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-04T05:36:07.772 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:07.772 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-04T05:36:07.836 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:07.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-04T05:36:07.900 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:07.900 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-04T05:36:07.963 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:07.963 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-04T05:36:08.024 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:08.024 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-04T05:36:08.084 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:08.084 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-04T05:36:08.144 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:08.144 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-04T05:36:08.157 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:08.157 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-04T05:36:08.193 INFO:tasks.ceph:Adding keys to all mons... 2023-12-04T05:36:08.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-04T05:36:08.202 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-04T05:36:08.244 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAnZW1l8dDaJBAANHBgEjKz2FTTo8OrJVB1pw== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAnZW1lOIFILRAAicRg3crgxeVlsV7NM1n7mw== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.c] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAnZW1ljoayNBAA5Quugau8ZuP7purlpz5Ilw== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQArZW1lgv9DGxAAESL7fT3cBtlDP3ZL+8SiEQ== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAuZW1lpkkDIxAAemUKa7Rs4XiY7eaOnzCZRw== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAxZW1lsGxCKRAAVWWNEXg7H3hUauiE4BtjfA== 2023-12-04T05:36:08.245 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA0ZW1lUFbXLxAA2YUaH5LIpJU8Qq2k64ARFg== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAnZW1lLP/pKBAA0n+KwZOZL9N93B4cduwStQ== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.b] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAnZW1lYdJoOhAA/pXezZGzriXfC7PkJPYzxw== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.d] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1l86FvBhAARfh7Pfe7OxC55XiemjCXYw== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA6ZW1lJsdpOxAAtvDjgGrfndThS7iJdSYxZA== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQA+ZW1lZzyUBhAAwZO11IA60hqFX9N9osxCXA== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBBZW1lZbuLDRAAPQBdTdQHhezNoymtejlsvA== 2023-12-04T05:36:08.246 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2023-12-04T05:36:08.247 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBEZW1l1q8+ExAAaoF2kTbzNXGmjW03HTVXeA== 2023-12-04T05:36:08.247 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-12-04T05:36:08.247 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg== 2023-12-04T05:36:08.247 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-12-04T05:36:08.247 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ== 2023-12-04T05:36:08.258 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnZW1l8dDaJBAANHBgEjKz2FTTo8OrJVB1pw== 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnZW1lOIFILRAAicRg3crgxeVlsV7NM1n7mw== 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnZW1ljoayNBAA5Quugau8ZuP7purlpz5Ilw== 2023-12-04T05:36:08.259 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQArZW1lgv9DGxAAESL7fT3cBtlDP3ZL+8SiEQ== 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAuZW1lpkkDIxAAemUKa7Rs4XiY7eaOnzCZRw== 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAxZW1lsGxCKRAAVWWNEXg7H3hUauiE4BtjfA== 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2023-12-04T05:36:08.260 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA0ZW1lUFbXLxAA2YUaH5LIpJU8Qq2k64ARFg== 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnZW1lLP/pKBAA0n+KwZOZL9N93B4cduwStQ== 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAnZW1lYdJoOhAA/pXezZGzriXfC7PkJPYzxw== 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAoZW1l86FvBhAARfh7Pfe7OxC55XiemjCXYw== 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2023-12-04T05:36:08.261 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA6ZW1lJsdpOxAAtvDjgGrfndThS7iJdSYxZA== 2023-12-04T05:36:08.262 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2023-12-04T05:36:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQA+ZW1lZzyUBhAAwZO11IA60hqFX9N9osxCXA== 2023-12-04T05:36:08.262 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2023-12-04T05:36:08.262 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBBZW1lZbuLDRAAPQBdTdQHhezNoymtejlsvA== 2023-12-04T05:36:08.262 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2023-12-04T05:36:08.263 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBEZW1l1q8+ExAAaoF2kTbzNXGmjW03HTVXeA== 2023-12-04T05:36:08.264 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2023-12-04T05:36:08.264 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg== 2023-12-04T05:36:08.265 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2023-12-04T05:36:08.265 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ== 2023-12-04T05:36:08.266 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T05:36:08.294 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T05:36:08.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.368 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.428 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.489 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.604 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.608 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.662 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.665 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T05:36:08.725 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T05:36:08.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.841 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T05:36:08.902 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.905 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:08.963 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:09.017 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:09.021 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:09.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:09.078 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T05:36:09.133 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T05:36:09.136 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T05:36:09.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T05:36:09.197 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T05:36:09.253 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-04T05:36:09.253 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-04T05:36:09.275 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T05:36:09.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-04T05:36:09.412 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-04T05:36:09.434 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T05:36:09.551 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-04T05:36:09.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-04T05:36:09.636 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T05:36:09.751 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-04T05:36:09.771 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:36:09.775 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-04T05:36:09.821 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-04T05:36:09.821 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-04T05:36:09.821 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-04T05:36:09.825 INFO:tasks.ceph.mon.a:Started 2023-12-04T05:36:09.826 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-04T05:36:09.826 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-04T05:36:09.872 INFO:tasks.ceph.mon.b:Started 2023-12-04T05:36:09.872 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-04T05:36:09.872 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-04T05:36:09.876 INFO:tasks.ceph.mon.c:Started 2023-12-04T05:36:09.876 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-04T05:36:09.877 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-04T05:36:09.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-04T05:36:09.881 INFO:tasks.ceph.mgr.y:Started 2023-12-04T05:36:09.881 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-04T05:36:09.881 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-04T05:36:09.884 INFO:tasks.ceph.mgr.x:Started 2023-12-04T05:36:09.884 INFO:tasks.ceph:Setting crush tunables to default 2023-12-04T05:36:09.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2023-12-04T05:36:10.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 Processor -- start 2023-12-04T05:36:10.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 -- start start 2023-12-04T05:36:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc158cc0 con 0x7fdcdc0c7f00 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c5700 con 0x7fdcdc0cac10 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce3c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ca780 con 0x7fdcdc151f10 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1235640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1235640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56374/0 (socket says 172.21.15.97:56374) 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 learned_addr learned my addr 172.21.15.97:0/2770394804 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.021+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-04T05:36:10.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T05:36:10.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-04T05:36:10.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.025+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-04T05:36:10.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-04T05:36:10.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.229+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:10.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:10.633+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1235640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-04T05:36:11.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-04T05:36:11.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:11.437+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc0c4980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc0c4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 msgr2=0x7fdcdc154c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.143:3300/0 conn(0x7fdcdc0cac10 0x7fdcdc154c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 -- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 msgr2=0x7fdcdc154720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 --2- 172.21.15.97:0/2770394804 >> v2:172.21.15.97:3300/0 conn(0x7fdcdc0c7f00 0x7fdcdc154720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 -- 172.21.15.97:0/2770394804 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc158720 con 0x7fdcc80036c0 2023-12-04T05:36:13.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:13.021+0000 7fdcd37fe640 1 -- 172.21.15.97:0/2770394804 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc800c130 con 0x7fdcc80073d0 2023-12-04T05:36:15.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155676198 0 0) 0x7fdcdc158720 con 0x7fdcc80036c0 2023-12-04T05:36:15.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc0003530 con 0x7fdcc80036c0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399570205 0 0) 0x7fdcc800c130 con 0x7fdcc80073d0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc158720 con 0x7fdcc80073d0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741550541 0 0) 0x7fdcc0003530 con 0x7fdcc80036c0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 >> v1:172.21.15.143:6789/0 conn(0x7fdcc80073d0 legacy=0x7fdcc8009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc800d330 con 0x7fdcc80036c0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fdcd800e510 con 0x7fdcc80036c0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 >> v1:172.21.15.97:6789/0 conn(0x7fdcc80036c0 legacy=0x7fdcc8005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce2237640 1 -- 172.21.15.97:0/2770394804 reap_dead start 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcc0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0005680 con 0x7fdcc0003be0 2023-12-04T05:36:15.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc000bf00 con 0x7fdcc00047d0 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.204+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc000c090 con 0x7fdcdc151f10 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcc0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1235640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce2237640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 msgr2=0x7fdcc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:15.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.208+0000 7fdce1a36640 1 -- 172.21.15.97:0/2770394804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0003530 con 0x7fdcc0003be0 2023-12-04T05:36:15.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce1a36640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcc0003fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800ef70 tx=0x7fdcd801d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a281091b00f826af server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:15.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8004020 con 0x7fdcc0003be0 2023-12-04T05:36:15.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800c040 con 0x7fdcc0003be0 2023-12-04T05:36:15.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce0a34640 1 -- 172.21.15.97:0/2770394804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80043c0 con 0x7fdcc0003be0 2023-12-04T05:36:15.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 -- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 msgr2=0x7fdcc0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcc0003fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800ef70 tx=0x7fdcd801d760 comp rx=0 tx=0).stop 2023-12-04T05:36:15.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 -- 172.21.15.97:0/2770394804 shutdown_connections 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcc0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/2770394804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcc0003fc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 -- 172.21.15.97:0/2770394804 >> 172.21.15.97:0/2770394804 conn(0x7fdcdc073950 msgr2=0x7fdcdc073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 -- 172.21.15.97:0/2770394804 shutdown_connections 2023-12-04T05:36:15.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.212+0000 7fdce3c9a640 1 -- 172.21.15.97:0/2770394804 wait complete. 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 Processor -- start 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- start start 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcdc1f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1f0ad0 con 0x7fdcc0003be0 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14c250 con 0x7fdcc00047d0 2023-12-04T05:36:15.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0bdb10 con 0x7fdcdc151f10 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1235640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcdc1f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce2237640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50166/0 (socket says 172.21.15.97:50166) 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 -- 172.21.15.97:0/417961891 learned_addr learned my addr 172.21.15.97:0/417961891 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 -- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 msgr2=0x7fdcdc1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 -- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 msgr2=0x7fdcdc1f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcdc1f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 -- 172.21.15.97:0/417961891 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0bddf0 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce2237640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1235640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcdc1f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce1a36640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcd801ed70 tx=0x7fdcc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800e510 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8003620 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc0be0d0 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd80039d0 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.216+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0be690 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.220+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc068440 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.220+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdcd80b9070 con 0x7fdcc0003be0 2023-12-04T05:36:15.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.220+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdcd80ab450 con 0x7fdcc0003be0 2023-12-04T05:36:15.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.224+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdcd80c1020 con 0x7fdcc0003be0 2023-12-04T05:36:15.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.284+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdcdc068440 con 0x7fdcc0003be0 2023-12-04T05:36:15.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdcd27fc640 1 -- 172.21.15.97:0/417961891 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fdcd800f040 con 0x7fdcc0003be0 2023-12-04T05:36:15.289 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 msgr2=0x7fdcdc0bf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcd801ed70 tx=0x7fdcc0005800 comp rx=0 tx=0).stop 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 shutdown_connections 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcdc151f10 0x7fdcdc1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc00047d0 0x7fdcdc1f0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 --2- 172.21.15.97:0/417961891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcc0003be0 0x7fdcdc0bf320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 >> 172.21.15.97:0/417961891 conn(0x7fdcdc073950 msgr2=0x7fdcdc0c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 shutdown_connections 2023-12-04T05:36:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:15.288+0000 7fdce3c9a640 1 -- 172.21.15.97:0/417961891 wait complete. 2023-12-04T05:36:15.309 INFO:tasks.ceph:check_enable_crimson: False 2023-12-04T05:36:15.309 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-04T05:36:15.310 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:15.310 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-04T05:36:15.330 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:15.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-04T05:36:15.391 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:15.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-04T05:36:15.424 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:15.423+0000 7efc7c344180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-04T05:36:15.449 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:15.448+0000 7f398122c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-04T05:36:15.458 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:15.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-04T05:36:15.519 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:15.519 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-04T05:36:15.539 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:15.540 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-04T05:36:15.601 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:15.601 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-04T05:36:15.665 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:15.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-04T05:36:15.731 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new a25fb4dd-28ea-44ea-b824-6949ae00164b 0 2023-12-04T05:36:15.910 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 Processor -- start 2023-12-04T05:36:15.911 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 -- start start 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff07c151f10 0x7ff07c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff07c0cac10 0x7ff07c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c0ca780 con 0x7ff07c0c7f00 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c158cc0 con 0x7ff07c151f10 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff083a9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c0c5700 con 0x7ff07c0cac10 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff07c0cac10 0x7ff07c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff07c0cac10 0x7ff07c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48622/0 (socket says 172.21.15.143:48622) 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 -- 172.21.15.143:0/1331211492 learned_addr learned my addr 172.21.15.143:0/1331211492 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:15.912 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff081836640 1 --2- 172.21.15.143:0/1331211492 >> v2:172.21.15.97:3300/0 conn(0x7ff07c151f10 0x7ff07c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 -- 172.21.15.143:0/1331211492 >> v2:172.21.15.97:3300/0 conn(0x7ff07c151f10 msgr2=0x7ff07c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:15.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 --2- 172.21.15.143:0/1331211492 >> v2:172.21.15.97:3300/0 conn(0x7ff07c151f10 0x7ff07c0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 -- 172.21.15.143:0/1331211492 >> v1:172.21.15.97:6789/0 conn(0x7ff07c0c7f00 legacy=0x7ff07c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.913 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.911+0000 7ff082037640 1 -- 172.21.15.143:0/1331211492 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c158720 con 0x7ff07c0cac10 2023-12-04T05:36:15.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff082037640 1 --2- 172.21.15.143:0/1331211492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c15f0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06bcd0 tx=0x7ff07401c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2fe2d7deec3b747 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:15.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff080834640 1 -- 172.21.15.143:0/1331211492 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740a5740 con 0x7ff07c0cac10 2023-12-04T05:36:15.915 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff080834640 1 -- 172.21.15.143:0/1331211492 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0740a58a0 con 0x7ff07c0cac10 2023-12-04T05:36:15.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff080834640 1 -- 172.21.15.143:0/1331211492 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0740a5c30 con 0x7ff07c0cac10 2023-12-04T05:36:15.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 -- 172.21.15.143:0/1331211492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 msgr2=0x7ff07c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 --2- 172.21.15.143:0/1331211492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c15f0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06bcd0 tx=0x7ff07401c880 comp rx=0 tx=0).stop 2023-12-04T05:36:15.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 -- 172.21.15.143:0/1331211492 shutdown_connections 2023-12-04T05:36:15.916 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 --2- 172.21.15.143:0/1331211492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c15f0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 --2- 172.21.15.143:0/1331211492 >> v2:172.21.15.97:3300/0 conn(0x7ff07c151f10 0x7ff07c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 -- 172.21.15.143:0/1331211492 >> 172.21.15.143:0/1331211492 conn(0x7ff07c073950 msgr2=0x7ff07c073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:15.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 -- 172.21.15.143:0/1331211492 shutdown_connections 2023-12-04T05:36:15.917 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.915+0000 7ff083a9a640 1 -- 172.21.15.143:0/1331211492 wait complete. 2023-12-04T05:36:15.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 Processor -- start 2023-12-04T05:36:15.918 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- start start 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 0x7ff07c152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff07c151f10 0x7ff07c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c1edc60 con 0x7ff07c151f10 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c154ae0 con 0x7ff07c0cac10 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c152b70 con 0x7ff07c0c7f00 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081836640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 0x7ff07c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081836640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 0x7ff07c152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44476/0 (socket says 172.21.15.143:44476) 2023-12-04T05:36:15.921 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081836640 1 -- 172.21.15.143:0/2218680558 learned_addr learned my addr 172.21.15.143:0/2218680558 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48630/0 (socket says 172.21.15.143:48630) 2023-12-04T05:36:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff082037640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff07c151f10 0x7ff07c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 -- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 msgr2=0x7ff07c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.922 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 0x7ff07c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 -- 172.21.15.143:0/2218680558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff07c151f10 msgr2=0x7ff07c14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff07c151f10 0x7ff07c14c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 -- 172.21.15.143:0/2218680558 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009b30 con 0x7ff07c0cac10 2023-12-04T05:36:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff081035640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c390 tx=0x7ff06c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:15.923 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0052d0 con 0x7ff07c0cac10 2023-12-04T05:36:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c005430 con 0x7ff07c0cac10 2023-12-04T05:36:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c1ee080 con 0x7ff07c0cac10 2023-12-04T05:36:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c003840 con 0x7ff07c0cac10 2023-12-04T05:36:15.924 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c1ed5a0 con 0x7ff07c0cac10 2023-12-04T05:36:15.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff06c003ca0 con 0x7ff07c0cac10 2023-12-04T05:36:15.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff06c01c780 con 0x7ff07c0cac10 2023-12-04T05:36:15.925 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.919+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c1edda0 con 0x7ff07c0cac10 2023-12-04T05:36:15.950 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:15.947+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff07c1edda0 con 0x7ff07c0cac10 2023-12-04T05:36:15.974 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:15.975+0000 7efc7c344180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-04T05:36:16.008 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:16.008+0000 7f398122c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-04T05:36:16.015 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.015+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a25fb4dd-28ea-44ea-b824-6949ae00164b", "id": 0} v 0) v1 -- 0x7ff07c068440 con 0x7ff07c0cac10 2023-12-04T05:36:16.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff0727fc640 1 -- 172.21.15.143:0/2218680558 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a25fb4dd-28ea-44ea-b824-6949ae00164b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff06c017070 con 0x7ff07c0cac10 2023-12-04T05:36:16.020 INFO:teuthology.orchestra.run.smithi143.stdout:0 2023-12-04T05:36:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 msgr2=0x7ff07c1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c390 tx=0x7ff06c00c850 comp rx=0 tx=0).stop 2023-12-04T05:36:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 shutdown_connections 2023-12-04T05:36:16.021 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff07c151f10 0x7ff07c14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff07c0cac10 0x7ff07c1545a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 --2- 172.21.15.143:0/2218680558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff07c0c7f00 0x7ff07c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 >> 172.21.15.143:0/2218680558 conn(0x7ff07c073950 msgr2=0x7ff07c148f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 shutdown_connections 2023-12-04T05:36:16.022 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.019+0000 7ff083a9a640 1 -- 172.21.15.143:0/2218680558 wait complete. 2023-12-04T05:36:16.041 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 198553e2-3fed-46d8-9784-3d16a4bf0715 1 2023-12-04T05:36:16.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.175+0000 7f42ba90f640 1 Processor -- start 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.175+0000 7f42ba90f640 1 -- start start 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42ba90f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42ba90f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42b40c7f00 0x7f42b4154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42ba90f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40ca780 con 0x7f42b40cac10 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42ba90f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b4158cc0 con 0x7f42b40c7f00 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42ba90f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c5700 con 0x7f42b4151f10 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b8eac640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f42b40cac10 0x7f42b40c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:59192/0 (socket says 172.21.15.143:59192) 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b8eac640 1 -- 172.21.15.143:0/2027747524 learned_addr learned my addr 172.21.15.143:0/2027747524 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b37fe640 1 --2- 172.21.15.143:0/2027747524 >> v2:172.21.15.97:3300/0 conn(0x7f42b40c7f00 0x7f42b4154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b2ffd640 1 -- 172.21.15.143:0/2027747524 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515660381 0 0) 0x7f42b40ca780 con 0x7f42b40cac10 2023-12-04T05:36:16.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b2ffd640 1 -- 172.21.15.143:0/2027747524 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f429c003530 con 0x7f42b40cac10 2023-12-04T05:36:16.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b3fff640 1 -- 172.21.15.143:0/2027747524 >> v2:172.21.15.97:3300/0 conn(0x7f42b40c7f00 msgr2=0x7f42b4154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:16.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b3fff640 1 --2- 172.21.15.143:0/2027747524 >> v2:172.21.15.97:3300/0 conn(0x7f42b40c7f00 0x7f42b4154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b3fff640 1 -- 172.21.15.143:0/2027747524 >> v1:172.21.15.143:6789/0 conn(0x7f42b40cac10 legacy=0x7f42b40c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.179+0000 7f42b3fff640 1 -- 172.21.15.143:0/2027747524 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4158720 con 0x7f42b4151f10 2023-12-04T05:36:16.182 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42b3fff640 1 --2- 172.21.15.143:0/2027747524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40c4980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42a40097c0 tx=0x7f42a401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b14fc66d1605eb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42b2ffd640 1 -- 172.21.15.143:0/2027747524 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40ab600 con 0x7f42b4151f10 2023-12-04T05:36:16.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42b2ffd640 1 -- 172.21.15.143:0/2027747524 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a40a7050 con 0x7f42b4151f10 2023-12-04T05:36:16.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42b2ffd640 1 -- 172.21.15.143:0/2027747524 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40ab960 con 0x7f42b4151f10 2023-12-04T05:36:16.183 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- 172.21.15.143:0/2027747524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 msgr2=0x7f42b40c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2027747524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40c4980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42a40097c0 tx=0x7f42a401c330 comp rx=0 tx=0).stop 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- 172.21.15.143:0/2027747524 shutdown_connections 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2027747524 >> v2:172.21.15.97:3300/0 conn(0x7f42b40c7f00 0x7f42b4154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2027747524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40c4980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- 172.21.15.143:0/2027747524 >> 172.21.15.143:0/2027747524 conn(0x7f42b4073950 msgr2=0x7f42b4073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- 172.21.15.143:0/2027747524 shutdown_connections 2023-12-04T05:36:16.184 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- 172.21.15.143:0/2027747524 wait complete. 2023-12-04T05:36:16.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 Processor -- start 2023-12-04T05:36:16.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.183+0000 7f42ba90f640 1 -- start start 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40cac10 0x7f42b40aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c6f00 con 0x7f42b40c7f00 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b41f11a0 con 0x7f42b40cac10 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c6b90 con 0x7f42b4151f10 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b8eac640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b37fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40cac10 0x7f42b40aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.143:60920/0 (socket says 172.21.15.143:60920) 2023-12-04T05:36:16.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 -- 172.21.15.143:0/2583796344 learned_addr learned my addr 172.21.15.143:0/2583796344 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 -- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 msgr2=0x7f42b40ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 -- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40cac10 msgr2=0x7f42b40aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40cac10 0x7f42b40aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 -- 172.21.15.143:0/2583796344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009420 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b3fff640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42a401a9e0 tx=0x7f42a40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4006e20 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4004020 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40c1370 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4004390 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40c3900 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f42a40b2040 con 0x7f42b40c7f00 2023-12-04T05:36:16.189 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f42a40b69c0 con 0x7f42b40c7f00 2023-12-04T05:36:16.190 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.187+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b40c1590 con 0x7f42b40c7f00 2023-12-04T05:36:16.192 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.191+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f42a40dece0 con 0x7f42b40c7f00 2023-12-04T05:36:16.209 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:16.208+0000 7f398122c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-04T05:36:16.222 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:16.223+0000 7efc7c344180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-04T05:36:16.278 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.275+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd new", "uuid": "198553e2-3fed-46d8-9784-3d16a4bf0715", "id": 1} v 0) v1 -- 0x7f42b40c6990 con 0x7f42b40c7f00 2023-12-04T05:36:16.282 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.279+0000 7f42b0ff9640 1 -- 172.21.15.143:0/2583796344 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "198553e2-3fed-46d8-9784-3d16a4bf0715", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42a40cd030 con 0x7f42b40c7f00 2023-12-04T05:36:16.282 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 msgr2=0x7f42b41f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42a401a9e0 tx=0x7f42a40190d0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 shutdown_connections 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4151f10 0x7f42b40ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40cac10 0x7f42b40aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 --2- 172.21.15.143:0/2583796344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42b40c7f00 0x7f42b41f0710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.283 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 >> 172.21.15.143:0/2583796344 conn(0x7f42b4073950 msgr2=0x7f42b40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 shutdown_connections 2023-12-04T05:36:16.284 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.283+0000 7f42ba90f640 1 -- 172.21.15.143:0/2583796344 wait complete. 2023-12-04T05:36:16.303 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new f47993fe-6e63-4ff1-b886-d53358bbb0b9 2 2023-12-04T05:36:16.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 Processor -- start 2023-12-04T05:36:16.439 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 -- start start 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4c2c0c7f00 0x7f4c2c154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c0ca780 con 0x7f4c2c0cac10 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c158cc0 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c31046640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0c5700 con 0x7f4c2c151f10 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2a59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4c2c0c7f00 0x7f4c2c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.440 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44510/0 (socket says 172.21.15.143:44510) 2023-12-04T05:36:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2ad9d640 1 -- 172.21.15.143:0/2692741204 learned_addr learned my addr 172.21.15.143:0/2692741204 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.441 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2a59c640 1 -- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 msgr2=0x7f4c2c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2a59c640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2a59c640 1 -- 172.21.15.143:0/2692741204 >> v1:172.21.15.97:6789/0 conn(0x7f4c2c0cac10 legacy=0x7f4c2c0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2a59c640 1 -- 172.21.15.143:0/2692741204 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c158720 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.442 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.439+0000 7f4c2ad9d640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c2a59c640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c154720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c200097c0 tx=0x7f4c2001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744742f893e044d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c29d9b640 1 -- 172.21.15.143:0/2692741204 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200ab600 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c29d9b640 1 -- 172.21.15.143:0/2692741204 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c200a7050 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.443 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c29d9b640 1 -- 172.21.15.143:0/2692741204 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200ab980 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 -- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 msgr2=0x7f4c2c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c154720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c200097c0 tx=0x7f4c2001c330 comp rx=0 tx=0).stop 2023-12-04T05:36:16.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 -- 172.21.15.143:0/2692741204 shutdown_connections 2023-12-04T05:36:16.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c154720 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.446 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 --2- 172.21.15.143:0/2692741204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c151f10 0x7f4c2c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 -- 172.21.15.143:0/2692741204 >> 172.21.15.143:0/2692741204 conn(0x7f4c2c073950 msgr2=0x7f4c2c073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 -- 172.21.15.143:0/2692741204 shutdown_connections 2023-12-04T05:36:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.443+0000 7f4c31046640 1 -- 172.21.15.143:0/2692741204 wait complete. 2023-12-04T05:36:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 Processor -- start 2023-12-04T05:36:16.447 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- start start 2023-12-04T05:36:16.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c2c151f10 0x7f4c2c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.450 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c15f610 con 0x7f4c2c151f10 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0a9f80 con 0x7f4c2c0c7f00 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c14e1a0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44520/0 (socket says 172.21.15.143:44520) 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 -- 172.21.15.143:0/1079389208 learned_addr learned my addr 172.21.15.143:0/1079389208 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2b59e640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c2c151f10 0x7f4c2c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 -- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 msgr2=0x7f4c2c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.451 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 -- 172.21.15.143:0/1079389208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c2c151f10 msgr2=0x7f4c2c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c2c151f10 0x7f4c2c14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 -- 172.21.15.143:0/1079389208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0094d0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2ad9d640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c2a59c640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c20019f60 tx=0x7f4c2001ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200b7450 con 0x7f4c2c0cac10 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c200b75b0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20009420 con 0x7f4c2c0cac10 2023-12-04T05:36:16.452 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200b7960 con 0x7f4c2c0cac10 2023-12-04T05:36:16.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0a9ca0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4c200c0400 con 0x7f4c2c0cac10 2023-12-04T05:36:16.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.447+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4c200b7dc0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.453 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.451+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c151a60 con 0x7f4c2c0cac10 2023-12-04T05:36:16.454 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.451+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4c200dece0 con 0x7f4c2c0cac10 2023-12-04T05:36:16.519 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.519+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f47993fe-6e63-4ff1-b886-d53358bbb0b9", "id": 2} v 0) v1 -- 0x7f4c2c0a9b00 con 0x7f4c2c0cac10 2023-12-04T05:36:16.525 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.523+0000 7f4c137fe640 1 -- 172.21.15.143:0/1079389208 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f47993fe-6e63-4ff1-b886-d53358bbb0b9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c2c0a9b00 con 0x7f4c2c0cac10 2023-12-04T05:36:16.526 INFO:teuthology.orchestra.run.smithi143.stdout:2 2023-12-04T05:36:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 msgr2=0x7f4c2c0ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c20019f60 tx=0x7f4c2001ab70 comp rx=0 tx=0).stop 2023-12-04T05:36:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 shutdown_connections 2023-12-04T05:36:16.527 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c2c151f10 0x7f4c2c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c2c0cac10 0x7f4c2c0ac180 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 --2- 172.21.15.143:0/1079389208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c2c0c7f00 0x7f4c2c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 >> 172.21.15.143:0/1079389208 conn(0x7f4c2c073950 msgr2=0x7f4c2c0c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 shutdown_connections 2023-12-04T05:36:16.528 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.527+0000 7f4c31046640 1 -- 172.21.15.143:0/1079389208 wait complete. 2023-12-04T05:36:16.546 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 6c598c28-9951-4ae0-8ab4-dafca272838f 3 2023-12-04T05:36:16.683 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 Processor -- start 2023-12-04T05:36:16.684 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 -- start start 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bb0157690 0x7f4bb00aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4bb006e360 0x7f4bb00a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb0157a70 con 0x7f4bb00c22b0 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00c6910 con 0x7f4bb006e360 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.683+0000 7f4bb54d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00c52e0 con 0x7f4bb0157690 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bb0157690 0x7f4bb00aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bb0157690 0x7f4bb00aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48658/0 (socket says 172.21.15.143:48658) 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 -- 172.21.15.143:0/3228937727 learned_addr learned my addr 172.21.15.143:0/3228937727 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.686 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4bae7fc640 1 --2- 172.21.15.143:0/3228937727 >> v2:172.21.15.97:3300/0 conn(0x7f4bb006e360 0x7f4bb00a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 -- 172.21.15.143:0/3228937727 >> v2:172.21.15.97:3300/0 conn(0x7f4bb006e360 msgr2=0x7f4bb00a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:16.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 --2- 172.21.15.143:0/3228937727 >> v2:172.21.15.97:3300/0 conn(0x7f4bb006e360 0x7f4bb00a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 -- 172.21.15.143:0/3228937727 >> v1:172.21.15.143:6789/0 conn(0x7f4bb00c22b0 legacy=0x7f4bb00c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.687 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 -- 172.21.15.143:0/3228937727 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00c55c0 con 0x7f4bb0157690 2023-12-04T05:36:16.690 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4baeffd640 1 --2- 172.21.15.143:0/3228937727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00aa590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bb006b100 tx=0x7f4ba001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67cd4fd211333b6c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4badffb640 1 -- 172.21.15.143:0/3228937727 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00ab600 con 0x7f4bb0157690 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4badffb640 1 -- 172.21.15.143:0/3228937727 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba00ab760 con 0x7f4bb0157690 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.687+0000 7f4badffb640 1 -- 172.21.15.143:0/3228937727 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00abaf0 con 0x7f4bb0157690 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- 172.21.15.143:0/3228937727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 msgr2=0x7f4bb00aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/3228937727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00aa590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bb006b100 tx=0x7f4ba001c470 comp rx=0 tx=0).stop 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- 172.21.15.143:0/3228937727 shutdown_connections 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/3228937727 >> v2:172.21.15.97:3300/0 conn(0x7f4bb006e360 0x7f4bb00a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/3228937727 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00aa590 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- 172.21.15.143:0/3228937727 >> 172.21.15.143:0/3228937727 conn(0x7f4bb0072760 msgr2=0x7f4bb006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- 172.21.15.143:0/3228937727 shutdown_connections 2023-12-04T05:36:16.691 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- 172.21.15.143:0/3228937727 wait complete. 2023-12-04T05:36:16.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 Processor -- start 2023-12-04T05:36:16.692 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- start start 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb00c2c10 0x7f4bb01503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00aac70 con 0x7f4bb00c2c10 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f1580 con 0x7f4bb0157690 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bb54d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01f1ab0 con 0x7f4bb00c22b0 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4baeffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4baeffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44530/0 (socket says 172.21.15.143:44530) 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4baeffd640 1 -- 172.21.15.143:0/2850958808 learned_addr learned my addr 172.21.15.143:0/2850958808 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.691+0000 7f4baf7fe640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb00c2c10 0x7f4bb01503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.694 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 -- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 msgr2=0x7f4bb00c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 -- 172.21.15.143:0/2850958808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb00c2c10 msgr2=0x7f4bb01503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb00c2c10 0x7f4bb01503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 -- 172.21.15.143:0/2850958808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00094d0 con 0x7f4bb00c22b0 2023-12-04T05:36:16.695 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4bae7fc640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:16.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4baeffd640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ad040 tx=0x7f4ba001acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00b4800 con 0x7f4bb00c22b0 2023-12-04T05:36:16.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba00b4980 con 0x7f4bb00c22b0 2023-12-04T05:36:16.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00b4d30 con 0x7f4bb00c22b0 2023-12-04T05:36:16.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb01f17d0 con 0x7f4bb00c22b0 2023-12-04T05:36:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb00aba40 con 0x7f4bb00c22b0 2023-12-04T05:36:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ba00c7740 con 0x7f4bb00c22b0 2023-12-04T05:36:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4ba00be8d0 con 0x7f4bb00c22b0 2023-12-04T05:36:16.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.695+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb00c3020 con 0x7f4bb00c22b0 2023-12-04T05:36:16.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.699+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4ba00be440 con 0x7f4bb00c22b0 2023-12-04T05:36:16.764 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.763+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c598c28-9951-4ae0-8ab4-dafca272838f", "id": 3} v 0) v1 -- 0x7f4bb0068440 con 0x7f4bb00c22b0 2023-12-04T05:36:16.769 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.767+0000 7f4b977fe640 1 -- 172.21.15.143:0/2850958808 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c598c28-9951-4ae0-8ab4-dafca272838f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ba00be680 con 0x7f4bb00c22b0 2023-12-04T05:36:16.769 INFO:teuthology.orchestra.run.smithi143.stdout:3 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 msgr2=0x7f4bb0157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ad040 tx=0x7f4ba001acb0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 shutdown_connections 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bb00c2c10 0x7f4bb01503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bb0157690 0x7f4bb00c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 --2- 172.21.15.143:0/2850958808 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bb00c22b0 0x7f4bb0157ec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 >> 172.21.15.143:0/2850958808 conn(0x7f4bb0072760 msgr2=0x7f4bb006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 shutdown_connections 2023-12-04T05:36:16.771 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.771+0000 7f4bb54d6640 1 -- 172.21.15.143:0/2850958808 wait complete. 2023-12-04T05:36:16.791 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new dff3a4e2-bc3e-462d-8351-ec30355b14c1 4 2023-12-04T05:36:16.846 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:16.844+0000 7f398122c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-04T05:36:16.884 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:16.883+0000 7efc7c344180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-04T05:36:16.909 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:16.908+0000 7f398122c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-04T05:36:16.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 Processor -- start 2023-12-04T05:36:16.930 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 -- start start 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f262c151f10 0x7f262c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 0x7f262c154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0ca780 con 0x7f262c0cac10 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c158cc0 con 0x7f262c151f10 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f26320fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c5700 con 0x7f262c0c7f00 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 0x7f262c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f262c0cac10 0x7f262c0c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:59210/0 (socket says 172.21.15.143:59210) 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262bfff640 1 -- 172.21.15.143:0/3133863077 learned_addr learned my addr 172.21.15.143:0/3133863077 (peer_addr_for_me v1:172.21.15.143:0/0) 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262b7fe640 1 --2- 172.21.15.143:0/3133863077 >> v2:172.21.15.97:3300/0 conn(0x7f262c151f10 0x7f262c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.932 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262a7fc640 1 -- 172.21.15.143:0/3133863077 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350765433 0 0) 0x7f262c0ca780 con 0x7f262c0cac10 2023-12-04T05:36:16.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262affd640 1 -- 172.21.15.143:0/3133863077 >> v2:172.21.15.97:3300/0 conn(0x7f262c151f10 msgr2=0x7f262c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:16.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262affd640 1 --2- 172.21.15.143:0/3133863077 >> v2:172.21.15.97:3300/0 conn(0x7f262c151f10 0x7f262c0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262affd640 1 -- 172.21.15.143:0/3133863077 >> v1:172.21.15.143:6789/0 conn(0x7f262c0cac10 legacy=0x7f262c0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.933 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.931+0000 7f262affd640 1 -- 172.21.15.143:0/3133863077 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c158720 con 0x7f262c0c7f00 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f262affd640 1 --2- 172.21.15.143:0/3133863077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 0x7f262c154720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26200097c0 tx=0x7f262001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb66e8a4b4cf30a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f262a7fc640 1 -- 172.21.15.143:0/3133863077 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ab600 con 0x7f262c0c7f00 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f262a7fc640 1 -- 172.21.15.143:0/3133863077 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200a7050 con 0x7f262c0c7f00 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f262a7fc640 1 -- 172.21.15.143:0/3133863077 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ab980 con 0x7f262c0c7f00 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 -- 172.21.15.143:0/3133863077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 msgr2=0x7f262c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 --2- 172.21.15.143:0/3133863077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 0x7f262c154720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f26200097c0 tx=0x7f262001c330 comp rx=0 tx=0).stop 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 -- 172.21.15.143:0/3133863077 shutdown_connections 2023-12-04T05:36:16.937 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 --2- 172.21.15.143:0/3133863077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0c7f00 0x7f262c154720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 --2- 172.21.15.143:0/3133863077 >> v2:172.21.15.97:3300/0 conn(0x7f262c151f10 0x7f262c0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 -- 172.21.15.143:0/3133863077 >> 172.21.15.143:0/3133863077 conn(0x7f262c073950 msgr2=0x7f262c073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:16.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 -- 172.21.15.143:0/3133863077 shutdown_connections 2023-12-04T05:36:16.938 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 -- 172.21.15.143:0/3133863077 wait complete. 2023-12-04T05:36:16.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.935+0000 7f26320fe640 1 Processor -- start 2023-12-04T05:36:16.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- start start 2023-12-04T05:36:16.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f262c0c7f00 0x7f262c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.939 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f262c151f10 0x7f262c1f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c3bb0 con 0x7f262c0c7f00 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1f11b0 con 0x7f262c151f10 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1f1470 con 0x7f262c0cac10 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44544/0 (socket says 172.21.15.143:44544) 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 -- 172.21.15.143:0/3789635890 learned_addr learned my addr 172.21.15.143:0/3789635890 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262bfff640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f262c151f10 0x7f262c1f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262b7fe640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f262c0c7f00 0x7f262c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 -- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f262c151f10 msgr2=0x7f262c1f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f262c151f10 0x7f262c1f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 -- 172.21.15.143:0/3789635890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f262c0c7f00 msgr2=0x7f262c148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f262c0c7f00 0x7f262c148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:16.940 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 -- 172.21.15.143:0/3789635890 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009420 con 0x7f262c0cac10 2023-12-04T05:36:16.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f262affd640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2620019f60 tx=0x7f262001ab70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:16.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200b7450 con 0x7f262c0cac10 2023-12-04T05:36:16.941 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200b75b0 con 0x7f262c0cac10 2023-12-04T05:36:16.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200b7960 con 0x7f262c0cac10 2023-12-04T05:36:16.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c1492f0 con 0x7f262c0cac10 2023-12-04T05:36:16.942 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c14f160 con 0x7f262c0cac10 2023-12-04T05:36:16.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f26200c0400 con 0x7f262c0cac10 2023-12-04T05:36:16.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f26200b7dc0 con 0x7f262c0cac10 2023-12-04T05:36:16.946 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.939+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c1524c0 con 0x7f262c0cac10 2023-12-04T05:36:16.947 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:16.943+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f26200dece0 con 0x7f262c0cac10 2023-12-04T05:36:16.954 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:16.951+0000 7efc7c344180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-04T05:36:16.969 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:16.968+0000 7f398122c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-04T05:36:17.011 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.011+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dff3a4e2-bc3e-462d-8351-ec30355b14c1", "id": 4} v 0) v1 -- 0x7f262c068440 con 0x7f262c0cac10 2023-12-04T05:36:17.011 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.011+0000 7efc7c344180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-04T05:36:17.018 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.015+0000 7f2613fff640 1 -- 172.21.15.143:0/3789635890 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dff3a4e2-bc3e-462d-8351-ec30355b14c1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26200cd030 con 0x7f262c0cac10 2023-12-04T05:36:17.018 INFO:teuthology.orchestra.run.smithi143.stdout:4 2023-12-04T05:36:17.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 msgr2=0x7f262c1f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2620019f60 tx=0x7f262001ab70 comp rx=0 tx=0).stop 2023-12-04T05:36:17.019 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 shutdown_connections 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f262c151f10 0x7f262c1f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f262c0cac10 0x7f262c1f0730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 --2- 172.21.15.143:0/3789635890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f262c0c7f00 0x7f262c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 >> 172.21.15.143:0/3789635890 conn(0x7f262c073950 msgr2=0x7f262c15f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 shutdown_connections 2023-12-04T05:36:17.020 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.019+0000 7f26320fe640 1 -- 172.21.15.143:0/3789635890 wait complete. 2023-12-04T05:36:17.037 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 8eb9702b-1026-4b07-acd4-bb9e365f2b4d 5 2023-12-04T05:36:17.057 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.056+0000 7f398122c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-04T05:36:17.104 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.103+0000 7efc7c344180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-04T05:36:17.116 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.116+0000 7f398122c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-04T05:36:17.166 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.167+0000 7efc7c344180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-04T05:36:17.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.171+0000 7f28cc0ea640 1 Processor -- start 2023-12-04T05:36:17.173 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.171+0000 7f28cc0ea640 1 -- start start 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28cc0ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f28c4151f10 0x7f28c40c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28cc0ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f28c40cac10 0x7f28c415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28cc0ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c40ca780 con 0x7f28c40c7f00 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28cc0ea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c4158cc0 con 0x7f28c4151f10 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28cc0ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c40c5700 con 0x7f28c40cac10 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f28c40cac10 0x7f28c415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f28c40cac10 0x7f28c415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48690/0 (socket says 172.21.15.143:48690) 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 -- 172.21.15.143:0/1110915020 learned_addr learned my addr 172.21.15.143:0/1110915020 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28c9685640 1 --1- 172.21.15.143:0/1110915020 >> v1:172.21.15.97:6789/0 conn(0x7f28c40c7f00 0x7f28c4154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.143:56712/0 (socket says 172.21.15.143:56712) 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28c9e86640 1 --2- 172.21.15.143:0/1110915020 >> v2:172.21.15.97:3300/0 conn(0x7f28c4151f10 0x7f28c40c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 -- 172.21.15.143:0/1110915020 >> v2:172.21.15.97:3300/0 conn(0x7f28c4151f10 msgr2=0x7f28c40c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:17.176 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 --2- 172.21.15.143:0/1110915020 >> v2:172.21.15.97:3300/0 conn(0x7f28c4151f10 0x7f28c40c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 -- 172.21.15.143:0/1110915020 >> v1:172.21.15.97:6789/0 conn(0x7f28c40c7f00 legacy=0x7f28c4154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28ca687640 1 -- 172.21.15.143:0/1110915020 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4158720 con 0x7f28c40cac10 2023-12-04T05:36:17.177 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.175+0000 7f28c8e84640 1 -- 172.21.15.143:0/1110915020 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915265048 0 0) 0x7f28c40ca780 con 0x7f28c40c7f00 2023-12-04T05:36:17.178 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28ca687640 1 --2- 172.21.15.143:0/1110915020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40cac10 0x7f28c415f0a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f28c406bcd0 tx=0x7f28bc01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5141af4199ac8761 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28c8e84640 1 -- 172.21.15.143:0/1110915020 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0a5740 con 0x7f28c40cac10 2023-12-04T05:36:17.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28c8e84640 1 -- 172.21.15.143:0/1110915020 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0a58a0 con 0x7f28c40cac10 2023-12-04T05:36:17.179 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28c8e84640 1 -- 172.21.15.143:0/1110915020 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0a5c30 con 0x7f28c40cac10 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- 172.21.15.143:0/1110915020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40cac10 msgr2=0x7f28c415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/1110915020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40cac10 0x7f28c415f0a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f28c406bcd0 tx=0x7f28bc01c880 comp rx=0 tx=0).stop 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- 172.21.15.143:0/1110915020 shutdown_connections 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/1110915020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40cac10 0x7f28c415f0a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/1110915020 >> v2:172.21.15.97:3300/0 conn(0x7f28c4151f10 0x7f28c40c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- 172.21.15.143:0/1110915020 >> 172.21.15.143:0/1110915020 conn(0x7f28c4073950 msgr2=0x7f28c4073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.180 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- 172.21.15.143:0/1110915020 shutdown_connections 2023-12-04T05:36:17.181 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- 172.21.15.143:0/1110915020 wait complete. 2023-12-04T05:36:17.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 Processor -- start 2023-12-04T05:36:17.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.179+0000 7f28cc0ea640 1 -- start start 2023-12-04T05:36:17.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28c40cac10 0x7f28c4145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.185 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28c4151f10 0x7f28c41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40bead0 con 0x7f28c4151f10 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4146a30 con 0x7f28c40c7f00 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c414c4d0 con 0x7f28c40cac10 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48702/0 (socket says 172.21.15.143:48702) 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 -- 172.21.15.143:0/2775326308 learned_addr learned my addr 172.21.15.143:0/2775326308 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9685640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28c40cac10 0x7f28c4145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ca687640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28c4151f10 0x7f28c41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 -- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28c40cac10 msgr2=0x7f28c4145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28c40cac10 0x7f28c4145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 -- 172.21.15.143:0/2775326308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28c4151f10 msgr2=0x7f28c41464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28c4151f10 0x7f28c41464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.186 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 -- 172.21.15.143:0/2775326308 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc009b30 con 0x7f28c40c7f00 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28c9e86640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28c000e960 tx=0x7f28c000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0009690 con 0x7f28c40c7f00 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c000ca00 con 0x7f28c40c7f00 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000cd70 con 0x7f28c40c7f00 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c414c720 con 0x7f28c40c7f00 2023-12-04T05:36:17.187 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c4154450 con 0x7f28c40c7f00 2023-12-04T05:36:17.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28c0013770 con 0x7f28c40c7f00 2023-12-04T05:36:17.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f28c001c450 con 0x7f28c40c7f00 2023-12-04T05:36:17.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.183+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c4154670 con 0x7f28c40c7f00 2023-12-04T05:36:17.188 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.187+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f28c0021060 con 0x7f28c40c7f00 2023-12-04T05:36:17.205 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.204+0000 7f398122c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-04T05:36:17.257 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.255+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8eb9702b-1026-4b07-acd4-bb9e365f2b4d", "id": 5} v 0) v1 -- 0x7f28c4068440 con 0x7f28c40c7f00 2023-12-04T05:36:17.261 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.259+0000 7efc7c344180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-04T05:36:17.263 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28ba7fc640 1 -- 172.21.15.143:0/2775326308 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8eb9702b-1026-4b07-acd4-bb9e365f2b4d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28c0017070 con 0x7f28c40c7f00 2023-12-04T05:36:17.263 INFO:teuthology.orchestra.run.smithi143.stdout:5 2023-12-04T05:36:17.264 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 msgr2=0x7f28c414b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28c000e960 tx=0x7f28c000ee20 comp rx=0 tx=0).stop 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 shutdown_connections 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f28c4151f10 0x7f28c41464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28c40cac10 0x7f28c4145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 --2- 172.21.15.143:0/2775326308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28c40c7f00 0x7f28c414b6f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 >> 172.21.15.143:0/2775326308 conn(0x7f28c4073950 msgr2=0x7f28c40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 shutdown_connections 2023-12-04T05:36:17.265 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.263+0000 7f28cc0ea640 1 -- 172.21.15.143:0/2775326308 wait complete. 2023-12-04T05:36:17.265 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.264+0000 7f398122c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-04T05:36:17.282 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new be0dafe0-752d-4cfd-99cf-67de99dd1c8c 6 2023-12-04T05:36:17.324 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.323+0000 7efc7c344180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-04T05:36:17.422 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.420+0000 7f398122c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 Processor -- start 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 -- start start 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9db40c8940 0x7f9db40c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40c84b0 con 0x7f9db40c4760 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40c9740 con 0x7f9db40c8940 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4154600 con 0x7f9db4151bd0 2023-12-04T05:36:17.423 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db259c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db259c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44562/0 (socket says 172.21.15.143:44562) 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.419+0000 7f9db259c640 1 -- 172.21.15.143:0/678447627 learned_addr learned my addr 172.21.15.143:0/678447627 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db2d9d640 1 --2- 172.21.15.143:0/678447627 >> v2:172.21.15.97:3300/0 conn(0x7f9db40c8940 0x7f9db40c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db259c640 1 -- 172.21.15.143:0/678447627 >> v2:172.21.15.97:3300/0 conn(0x7f9db40c8940 msgr2=0x7f9db40c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db259c640 1 --2- 172.21.15.143:0/678447627 >> v2:172.21.15.97:3300/0 conn(0x7f9db40c8940 0x7f9db40c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db259c640 1 -- 172.21.15.143:0/678447627 >> v1:172.21.15.97:6789/0 conn(0x7f9db40c4760 legacy=0x7f9db406b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.424 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db259c640 1 -- 172.21.15.143:0/678447627 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40c7e60 con 0x7f9db4151bd0 2023-12-04T05:36:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db259c640 1 --2- 172.21.15.143:0/678447627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da401cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1326bfa35d44650f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db159a640 1 -- 172.21.15.143:0/678447627 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40a95f0 con 0x7f9db4151bd0 2023-12-04T05:36:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db159a640 1 -- 172.21.15.143:0/678447627 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da40a9750 con 0x7f9db4151bd0 2023-12-04T05:36:17.425 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.423+0000 7f9db159a640 1 -- 172.21.15.143:0/678447627 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40a9ae0 con 0x7f9db4151bd0 2023-12-04T05:36:17.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- 172.21.15.143:0/678447627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 msgr2=0x7f9db406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.426 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- 172.21.15.143:0/678447627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009870 tx=0x7f9da401cf70 comp rx=0 tx=0).stop 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- 172.21.15.143:0/678447627 shutdown_connections 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- 172.21.15.143:0/678447627 >> v2:172.21.15.97:3300/0 conn(0x7f9db40c8940 0x7f9db40c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- 172.21.15.143:0/678447627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db4151bd0 0x7f9db406ac40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- 172.21.15.143:0/678447627 >> 172.21.15.143:0/678447627 conn(0x7f9db40ab8d0 msgr2=0x7f9db40abce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- 172.21.15.143:0/678447627 shutdown_connections 2023-12-04T05:36:17.427 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- 172.21.15.143:0/678447627 wait complete. 2023-12-04T05:36:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 Processor -- start 2023-12-04T05:36:17.428 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- start start 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40c4760 0x7f9db4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db4151bd0 0x7f9db40aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40acd40 con 0x7f9db4151bd0 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40aea90 con 0x7f9db40c4760 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4155d90 con 0x7f9db40c8940 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40c4760 0x7f9db4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44578/0 (socket says 172.21.15.143:44578) 2023-12-04T05:36:17.430 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 -- 172.21.15.143:0/29558218 learned_addr learned my addr 172.21.15.143:0/29558218 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db2d9d640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db4151bd0 0x7f9db40aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 -- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40c4760 msgr2=0x7f9db4155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40c4760 0x7f9db4155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 -- 172.21.15.143:0/29558218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db4151bd0 msgr2=0x7f9db40aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db4151bd0 0x7f9db40aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.427+0000 7f9db1d9b640 1 -- 172.21.15.143:0/29558218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40094d0 con 0x7f9db40c8940 2023-12-04T05:36:17.431 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9db1d9b640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c500 tx=0x7f9da800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005220 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8005380 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40aca60 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8007270 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40ae720 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9da80067e0 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9da8006a90 con 0x7f9db40c8940 2023-12-04T05:36:17.432 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.431+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db40ae2a0 con 0x7f9db40c8940 2023-12-04T05:36:17.438 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.435+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9db40ae2a0 con 0x7f9db40c8940 2023-12-04T05:36:17.485 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.483+0000 7efc7c344180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-04T05:36:17.488 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:17.488+0000 7f398122c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-04T05:36:17.503 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.499+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be0dafe0-752d-4cfd-99cf-67de99dd1c8c", "id": 6} v 0) v1 -- 0x7f9db404e890 con 0x7f9db40c8940 2023-12-04T05:36:17.504 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9da2ffd640 1 -- 172.21.15.143:0/29558218 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be0dafe0-752d-4cfd-99cf-67de99dd1c8c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9da802a0b0 con 0x7f9db40c8940 2023-12-04T05:36:17.505 INFO:teuthology.orchestra.run.smithi143.stdout:6 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 msgr2=0x7f9db41534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9da800c500 tx=0x7f9da800c9c0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 shutdown_connections 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db4151bd0 0x7f9db40aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40c8940 0x7f9db41534b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 --2- 172.21.15.143:0/29558218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40c4760 0x7f9db4155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.503+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 >> 172.21.15.143:0/29558218 conn(0x7f9db40ab8d0 msgr2=0x7f9db4150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.507+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 shutdown_connections 2023-12-04T05:36:17.506 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.507+0000 7f9db359e640 1 -- 172.21.15.143:0/29558218 wait complete. 2023-12-04T05:36:17.524 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new ca28238f-e4d6-4e33-9e3b-f838e0ede706 7 2023-12-04T05:36:17.557 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:17.555+0000 7efc7c344180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-04T05:36:17.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 Processor -- start 2023-12-04T05:36:17.696 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 -- start start 2023-12-04T05:36:17.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.697 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5eb00bd690 0x7f5eb0154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb0157d10 con 0x7f5eb00c8050 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb006c8a0 con 0x7f5eb00bd690 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb73c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb0157ff0 con 0x7f5eb0151df0 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:44594/0 (socket says 172.21.15.143:44594) 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 -- 172.21.15.143:0/2870945820 learned_addr learned my addr 172.21.15.143:0/2870945820 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5961640 1 --1- 172.21.15.143:0/2870945820 >> v1:172.21.15.143:6789/0 conn(0x7f5eb00c8050 0x7f5eb0154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:59214/0 (socket says 172.21.15.143:59214) 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb495f640 1 --2- 172.21.15.143:0/2870945820 >> v2:172.21.15.97:3300/0 conn(0x7f5eb00bd690 0x7f5eb0154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 -- 172.21.15.143:0/2870945820 >> v2:172.21.15.97:3300/0 conn(0x7f5eb00bd690 msgr2=0x7f5eb0154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 --2- 172.21.15.143:0/2870945820 >> v2:172.21.15.97:3300/0 conn(0x7f5eb00bd690 0x7f5eb0154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 -- 172.21.15.143:0/2870945820 >> v1:172.21.15.143:6789/0 conn(0x7f5eb00c8050 legacy=0x7f5eb0154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.698 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.695+0000 7f5eb5160640 1 -- 172.21.15.143:0/2870945820 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb01582d0 con 0x7f5eb0151df0 2023-12-04T05:36:17.700 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb5160640 1 --2- 172.21.15.143:0/2870945820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009870 tx=0x7f5eac01ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4961279fed88bb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5ea7fff640 1 -- 172.21.15.143:0/2870945820 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0ab640 con 0x7f5eb0151df0 2023-12-04T05:36:17.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5ea7fff640 1 -- 172.21.15.143:0/2870945820 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac0a7070 con 0x7f5eb0151df0 2023-12-04T05:36:17.701 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5ea7fff640 1 -- 172.21.15.143:0/2870945820 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0ab9c0 con 0x7f5eb0151df0 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2870945820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 msgr2=0x7f5eb00c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2870945820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009870 tx=0x7f5eac01ce80 comp rx=0 tx=0).stop 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2870945820 shutdown_connections 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2870945820 >> v2:172.21.15.97:3300/0 conn(0x7f5eb00bd690 0x7f5eb0154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2870945820 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c4980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2870945820 >> 172.21.15.143:0/2870945820 conn(0x7f5eb0073950 msgr2=0x7f5eb0073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2870945820 shutdown_connections 2023-12-04T05:36:17.702 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.699+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2870945820 wait complete. 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 Processor -- start 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 -- start start 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 0x7f5eb0145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:17.707 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00c1490 con 0x7f5eb00c8050 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01513d0 con 0x7f5eb00bd690 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00c16e0 con 0x7f5eb0151df0 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:48726/0 (socket says 172.21.15.143:48726) 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 -- 172.21.15.143:0/2225537411 learned_addr learned my addr 172.21.15.143:0/2225537411 (peer_addr_for_me v2:172.21.15.143:0/0) 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5961640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb495f640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 0x7f5eb0145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 -- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 msgr2=0x7f5eb00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 -- 172.21.15.143:0/2225537411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 msgr2=0x7f5eb0145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 0x7f5eb0145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 -- 172.21.15.143:0/2225537411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0094d0 con 0x7f5eb00bd690 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb495f640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 0x7f5eb0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:17.708 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb5160640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0ad040 tx=0x7f5eac0191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0bf410 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac0bf5b0 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0bf960 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.703+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb00c19c0 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.707+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb00c1f80 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.707+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5eac0b5400 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.707+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5eac0b5d10 con 0x7f5eb00bd690 2023-12-04T05:36:17.709 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.707+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb0068440 con 0x7f5eb00bd690 2023-12-04T05:36:17.710 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.707+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5eac0c4020 con 0x7f5eb00bd690 2023-12-04T05:36:17.777 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.775+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca28238f-e4d6-4e33-9e3b-f838e0ede706", "id": 7} v 0) v1 -- 0x7f5eb00ab920 con 0x7f5eb00bd690 2023-12-04T05:36:17.782 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5ea5ffb640 1 -- 172.21.15.143:0/2225537411 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca28238f-e4d6-4e33-9e3b-f838e0ede706", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5eac0b56b0 con 0x7f5eb00bd690 2023-12-04T05:36:17.783 INFO:teuthology.orchestra.run.smithi143.stdout:7 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 msgr2=0x7f5eb01ede30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0ad040 tx=0x7f5eac0191c0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 shutdown_connections 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5eb0151df0 0x7f5eb00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5eb00c8050 0x7f5eb0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 --2- 172.21.15.143:0/2225537411 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5eb00bd690 0x7f5eb01ede30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 >> 172.21.15.143:0/2225537411 conn(0x7f5eb0073950 msgr2=0x7f5eb015e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 shutdown_connections 2023-12-04T05:36:17.784 INFO:teuthology.orchestra.run.smithi143.stderr:2023-12-04T05:36:17.783+0000 7f5eb73c4640 1 -- 172.21.15.143:0/2225537411 wait complete. 2023-12-04T05:36:17.802 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-04T05:36:17.803 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-04T05:36:17.818 INFO:tasks.ceph.osd.0:Started 2023-12-04T05:36:17.819 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-04T05:36:17.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-04T05:36:17.825 INFO:tasks.ceph.osd.1:Started 2023-12-04T05:36:17.826 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-04T05:36:17.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-04T05:36:17.838 INFO:tasks.ceph.osd.2:Started 2023-12-04T05:36:17.838 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-04T05:36:17.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-04T05:36:17.850 INFO:tasks.ceph.osd.3:Started 2023-12-04T05:36:17.850 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-04T05:36:17.850 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-04T05:36:17.854 INFO:tasks.ceph.osd.4:Started 2023-12-04T05:36:17.854 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-04T05:36:17.855 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-04T05:36:17.858 INFO:tasks.ceph.osd.5:Started 2023-12-04T05:36:17.858 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-04T05:36:17.858 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-04T05:36:17.862 INFO:tasks.ceph.osd.6:Started 2023-12-04T05:36:17.862 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-04T05:36:17.862 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-04T05:36:17.866 INFO:tasks.ceph.osd.7:Started 2023-12-04T05:36:17.866 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:18.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 Processor -- start 2023-12-04T05:36:18.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 -- start start 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 0x7f85c0158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85c00a7290 0x7f85c00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00c3cd0 con 0x7f85c00c5d40 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c0157dc0 con 0x7f85c00a7290 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85c4d65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01521f0 con 0x7f85c0151e10 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85b7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 0x7f85c0158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85bed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85c00a7290 0x7f85c00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:33412/0 (socket says 172.21.15.97:33412) 2023-12-04T05:36:18.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 -- 172.21.15.97:0/3257104612 learned_addr learned my addr 172.21.15.97:0/3257104612 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:18.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 -- 172.21.15.97:0/3257104612 >> v2:172.21.15.143:3300/0 conn(0x7f85c00a7290 msgr2=0x7f85c00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:18.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 --2- 172.21.15.97:0/3257104612 >> v2:172.21.15.143:3300/0 conn(0x7f85c00a7290 0x7f85c00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 -- 172.21.15.97:0/3257104612 >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 msgr2=0x7f85c0158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:18.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 --2- 172.21.15.97:0/3257104612 >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 0x7f85c0158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85be59c640 1 -- 172.21.15.97:0/3257104612 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00704a0 con 0x7f85c0151e10 2023-12-04T05:36:18.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.036+0000 7f85b7fff640 1 --2- 172.21.15.97:0/3257104612 >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 0x7f85c0158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:18.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85be59c640 1 --2- 172.21.15.97:0/3257104612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c006d840 tx=0x7f85b001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4de97a8cff8b98 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:18.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85bdd9b640 1 -- 172.21.15.97:0/3257104612 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00ac640 con 0x7f85c0151e10 2023-12-04T05:36:18.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85bdd9b640 1 -- 172.21.15.97:0/3257104612 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00ac7a0 con 0x7f85c0151e10 2023-12-04T05:36:18.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85bdd9b640 1 -- 172.21.15.97:0/3257104612 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00acb30 con 0x7f85c0151e10 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 -- 172.21.15.97:0/3257104612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 msgr2=0x7f85c00c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3257104612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85c006d840 tx=0x7f85b001c440 comp rx=0 tx=0).stop 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 -- 172.21.15.97:0/3257104612 shutdown_connections 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3257104612 >> v2:172.21.15.143:3300/0 conn(0x7f85c00a7290 0x7f85c00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3257104612 >> v2:172.21.15.97:3300/0 conn(0x7f85c00c5d40 0x7f85c0158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3257104612 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c00c1270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 -- 172.21.15.97:0/3257104612 >> 172.21.15.97:0/3257104612 conn(0x7f85c00c7e40 msgr2=0x7f85c00c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 -- 172.21.15.97:0/3257104612 shutdown_connections 2023-12-04T05:36:18.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.040+0000 7f85c4d65640 1 -- 172.21.15.97:0/3257104612 wait complete. 2023-12-04T05:36:18.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 Processor -- start 2023-12-04T05:36:18.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- start start 2023-12-04T05:36:18.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c00c5d40 0x7f85c014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c0150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0066850 con 0x7f85c00a7290 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01ed6f0 con 0x7f85c00c5d40 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01ece20 con 0x7f85c0151e10 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50208/0 (socket says 172.21.15.97:50208) 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 -- 172.21.15.97:0/3138612095 learned_addr learned my addr 172.21.15.97:0/3138612095 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b7fff640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c00c5d40 0x7f85c014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85bed9d640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c0150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 -- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 msgr2=0x7f85c0150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c0150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 -- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c00c5d40 msgr2=0x7f85c014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c00c5d40 0x7f85c014ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 -- 172.21.15.97:0/3138612095 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009420 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85be59c640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85b00af040 tx=0x7f85c0155780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00b7620 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00b77a0 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00b7b50 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b00094d0 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c01ed0a0 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85b00b3040 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.044+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f85b00c0bd0 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.048+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c0068440 con 0x7f85c00a7290 2023-12-04T05:36:18.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.048+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f85b00c5060 con 0x7f85c00a7290 2023-12-04T05:36:18.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c0158a60 con 0x7f85c00a7290 2023-12-04T05:36:18.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85b6ffd640 1 -- 172.21.15.97:0/3138612095 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f85b00bb070 con 0x7f85c00a7290 2023-12-04T05:36:18.107 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:18.107 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:17.778139+0000","last_up_change":"0.000000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:18.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 msgr2=0x7f85c006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85b00af040 tx=0x7f85c0155780 comp rx=0 tx=0).stop 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 shutdown_connections 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c0151e10 0x7f85c0150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c00c5d40 0x7f85c014ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 --2- 172.21.15.97:0/3138612095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c00a7290 0x7f85c006f890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 >> 172.21.15.97:0/3138612095 conn(0x7f85c00c7e40 msgr2=0x7f85c00c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 shutdown_connections 2023-12-04T05:36:18.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:18.104+0000 7f85c4d65640 1 -- 172.21.15.97:0/3138612095 wait complete. 2023-12-04T05:36:18.131 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-04T05:36:18.131 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-04T05:36:18.135 INFO:tasks.ceph.mgr.y.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-04T05:36:18.135 INFO:tasks.ceph.mgr.y.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-04T05:36:18.135 INFO:tasks.ceph.mgr.y.smithi097.stderr: from numpy import show_config as show_numpy_config 2023-12-04T05:36:18.198 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:18.196+0000 7f398122c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-04T05:36:18.238 INFO:tasks.ceph.mgr.x.smithi143.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-04T05:36:18.238 INFO:tasks.ceph.mgr.x.smithi143.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-04T05:36:18.238 INFO:tasks.ceph.mgr.x.smithi143.stderr: from numpy import show_config as show_numpy_config 2023-12-04T05:36:18.286 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:18.283+0000 7efc7c344180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-04T05:36:18.334 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:18.332+0000 7f398122c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-04T05:36:18.420 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:18.419+0000 7efc7c344180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-04T05:36:18.516 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:18.516+0000 7f398122c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-04T05:36:18.517 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-12-04T05:36:18.516+0000 7fab9cf92640 -1 Falling back to public interface 2023-12-04T05:36:18.519 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-04T05:36:18.519+0000 7ff6c0e9e640 -1 Falling back to public interface 2023-12-04T05:36:18.524 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-12-04T05:36:18.524+0000 7f44c94ba640 -1 Falling back to public interface 2023-12-04T05:36:18.525 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-12-04T05:36:18.524+0000 7f37415a4640 -1 Falling back to public interface 2023-12-04T05:36:18.544 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-12-04T05:36:18.544+0000 7f31e07fd640 -1 Falling back to public interface 2023-12-04T05:36:18.547 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-04T05:36:18.547+0000 7ff57cda2640 -1 Falling back to public interface 2023-12-04T05:36:18.555 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-04T05:36:18.555+0000 7ff659436640 -1 Falling back to public interface 2023-12-04T05:36:18.588 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:18.587+0000 7efc7c344180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-04T05:36:18.591 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:18.588+0000 7f398122c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-04T05:36:18.591 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-04T05:36:18.591+0000 7f420b32d640 -1 Falling back to public interface 2023-12-04T05:36:18.661 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:18.659+0000 7efc7c344180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-04T05:36:18.728 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:18.728+0000 7f398122c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-04T05:36:18.798 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:18.799+0000 7efc7c344180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-04T05:36:18.935 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:19.064 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 Processor -- start 2023-12-04T05:36:19.064 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 -- start start 2023-12-04T05:36:19.065 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab98156070 0x7fab980c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:19.065 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab98070860 0x7fab9806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:19.065 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980c0d40 con 0x7fab9806bde0 2023-12-04T05:36:19.065 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab981589d0 con 0x7fab98156070 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9fb1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab98158c70 con 0x7fab98070860 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab98156070 0x7fab980c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab98156070 0x7fab980c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50222/0 (socket says 172.21.15.97:50222) 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 -- 172.21.15.97:0/2341875864 learned_addr learned my addr 172.21.15.97:0/2341875864 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9e0ba640 1 --2- 172.21.15.97:0/2341875864 >> v2:172.21.15.143:3300/0 conn(0x7fab98070860 0x7fab9806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 -- 172.21.15.97:0/2341875864 >> v2:172.21.15.143:3300/0 conn(0x7fab98070860 msgr2=0x7fab9806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:19.066 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 --2- 172.21.15.97:0/2341875864 >> v2:172.21.15.143:3300/0 conn(0x7fab98070860 0x7fab9806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.067 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 -- 172.21.15.97:0/2341875864 >> v1:172.21.15.143:6789/0 conn(0x7fab9806bde0 legacy=0x7fab98071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:19.067 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.064+0000 7fab9d8b9640 1 -- 172.21.15.97:0/2341875864 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab98070fc0 con 0x7fab98156070 2023-12-04T05:36:19.068 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9d8b9640 1 --2- 172.21.15.97:0/2341875864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab98156070 0x7fab980c0800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab9806d260 tx=0x7fab9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee2f463d0ab9b4e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:19.069 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9c8b7640 1 -- 172.21.15.97:0/2341875864 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940ab600 con 0x7fab98156070 2023-12-04T05:36:19.069 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9c8b7640 1 -- 172.21.15.97:0/2341875864 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940a7050 con 0x7fab98156070 2023-12-04T05:36:19.069 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9c8b7640 1 -- 172.21.15.97:0/2341875864 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940ab980 con 0x7fab98156070 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 -- 172.21.15.97:0/2341875864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab98156070 msgr2=0x7fab980c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/2341875864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab98156070 0x7fab980c0800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab9806d260 tx=0x7fab9401c500 comp rx=0 tx=0).stop 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 -- 172.21.15.97:0/2341875864 shutdown_connections 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/2341875864 >> v2:172.21.15.143:3300/0 conn(0x7fab98070860 0x7fab9806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/2341875864 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab98156070 0x7fab980c0800 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 -- 172.21.15.97:0/2341875864 >> 172.21.15.97:0/2341875864 conn(0x7fab980c5e00 msgr2=0x7fab980c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 -- 172.21.15.97:0/2341875864 shutdown_connections 2023-12-04T05:36:19.070 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.068+0000 7fab9fb1d640 1 -- 172.21.15.97:0/2341875864 wait complete. 2023-12-04T05:36:19.072 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 Processor -- start 2023-12-04T05:36:19.072 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 -- start start 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab98070860 0x7fab98152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab98156070 0x7fab981525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98148d60 con 0x7fab9806bde0 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab981533c0 con 0x7fab98070860 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9fb1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab98150f30 con 0x7fab98156070 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50232/0 (socket says 172.21.15.97:50232) 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 -- 172.21.15.97:0/3155200151 learned_addr learned my addr 172.21.15.97:0/3155200151 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d0b8640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab98070860 0x7fab98152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9e0ba640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab98156070 0x7fab981525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 -- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab98156070 msgr2=0x7fab981525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:19.075 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab98156070 0x7fab981525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.076 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 -- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab98070860 msgr2=0x7fab98152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:19.076 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab98070860 0x7fab98152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.076 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 -- 172.21.15.97:0/3155200151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940094d0 con 0x7fab9806bde0 2023-12-04T05:36:19.076 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab9d8b9640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab940ae040 tx=0x7fab940192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:19.077 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940b4620 con 0x7fab9806bde0 2023-12-04T05:36:19.077 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.072+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940b4780 con 0x7fab9806bde0 2023-12-04T05:36:19.077 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab98150320 con 0x7fab9806bde0 2023-12-04T05:36:19.077 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940b4b30 con 0x7fab9806bde0 2023-12-04T05:36:19.077 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab981508e0 con 0x7fab9806bde0 2023-12-04T05:36:19.078 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fab940b2070 con 0x7fab9806bde0 2023-12-04T05:36:19.078 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fab940b3a90 con 0x7fab9806bde0 2023-12-04T05:36:19.078 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab98068440 con 0x7fab9806bde0 2023-12-04T05:36:19.079 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.076+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fab940ba070 con 0x7fab9806bde0 2023-12-04T05:36:19.148 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab98070640 con 0x7fab9806bde0 2023-12-04T05:36:19.149 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab8e7fc640 1 -- 172.21.15.97:0/3155200151 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fab940b0070 con 0x7fab9806bde0 2023-12-04T05:36:19.150 INFO:teuthology.misc.health.smithi097.stdout: 2023-12-04T05:36:19.150 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:17.778139+0000","last_up_change":"0.000000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 msgr2=0x7fab98156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab940ae040 tx=0x7fab940192a0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 shutdown_connections 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab98156070 0x7fab981525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab98070860 0x7fab98152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 --2- 172.21.15.97:0/3155200151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab9806bde0 0x7fab98156aa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:19.152 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 >> 172.21.15.97:0/3155200151 conn(0x7fab980c5e00 msgr2=0x7fab98162580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:19.153 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 shutdown_connections 2023-12-04T05:36:19.153 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:19.148+0000 7fab9fb1d640 1 -- 172.21.15.97:0/3155200151 wait complete. 2023-12-04T05:36:19.167 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-04T05:36:19.423 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:19.420+0000 7f398122c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-04T05:36:19.470 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:19.467+0000 7efc7c344180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-04T05:36:19.509 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:19.508+0000 7f398122c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-04T05:36:19.557 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:19.555+0000 7efc7c344180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-04T05:36:19.697 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:19.696+0000 7f398122c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-04T05:36:19.746 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:19.747+0000 7efc7c344180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-04T05:36:19.782 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:19.780+0000 7f398122c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-04T05:36:19.832 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:19.831+0000 7efc7c344180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-04T05:36:20.108 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:20.108+0000 7f398122c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-04T05:36:20.161 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:20.159+0000 7efc7c344180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-04T05:36:20.175 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:20.172+0000 7f398122c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-04T05:36:20.236 INFO:tasks.ceph.mgr.x.smithi143.stderr:2023-12-04T05:36:20.235+0000 7efc7c344180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-04T05:36:21.196 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:21.196+0000 7f3927ac7640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-04T05:36:21.196 INFO:tasks.ceph.mgr.y.smithi097.stderr:2023-12-04T05:36:21.196+0000 7f3927ac7640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-04T05:36:22.352 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-12-04T05:36:22.352+0000 7f44c94ba640 -1 osd.1 0 log_to_monitors true 2023-12-04T05:36:22.382 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-04T05:36:22.379+0000 7f420b32d640 -1 osd.7 0 log_to_monitors true 2023-12-04T05:36:22.456 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-12-04T05:36:22.456+0000 7fab9cf92640 -1 osd.0 0 log_to_monitors true 2023-12-04T05:36:22.516 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-04T05:36:22.515+0000 7ff6c0e9e640 -1 osd.5 0 log_to_monitors true 2023-12-04T05:36:22.544 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-04T05:36:22.543+0000 7ff57cda2640 -1 osd.6 0 log_to_monitors true 2023-12-04T05:36:22.552 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-04T05:36:22.551+0000 7ff659436640 -1 osd.4 0 log_to_monitors true 2023-12-04T05:36:22.718 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-12-04T05:36:22.716+0000 7f37415a4640 -1 osd.3 0 log_to_monitors true 2023-12-04T05:36:22.744 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-12-04T05:36:22.744+0000 7f31e07fd640 -1 osd.2 0 log_to_monitors true 2023-12-04T05:36:25.978 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:26.208 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 Processor -- start 2023-12-04T05:36:26.211 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 -- start start 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5ce40c7800 0x7f5ce4155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5ce40c81e0 0x7f5ce40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce40c6ad0 con 0x7f5ce4151eb0 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40c7370 con 0x7f5ce40c7800 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.208+0000 7f5ce9ff8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40c5270 con 0x7f5ce40c81e0 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.212+0000 7f5ce37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5ce4151eb0 0x7f5ce40c4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52146/0 (socket says 172.21.15.97:52146) 2023-12-04T05:36:26.212 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.212+0000 7f5ce37fe640 1 -- 172.21.15.97:0/2607965414 learned_addr learned my addr 172.21.15.97:0/2607965414 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:26.218 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.212+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057503950 0 0) 0x7f5ce40c6ad0 con 0x7f5ce4151eb0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.212+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc003530 con 0x7f5ce4151eb0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.212+0000 7f5ce3fff640 1 --2- 172.21.15.97:0/2607965414 >> v2:172.21.15.143:3300/0 conn(0x7f5ce40c81e0 0x7f5ce40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094580108 0 0) 0x7f5ccc003530 con 0x7f5ce4151eb0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 >> v2:172.21.15.143:3300/0 conn(0x7f5ce40c81e0 msgr2=0x7f5ce40c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 --2- 172.21.15.97:0/2607965414 >> v2:172.21.15.143:3300/0 conn(0x7f5ce40c81e0 0x7f5ce40c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 >> v2:172.21.15.97:3300/0 conn(0x7f5ce40c7800 msgr2=0x7f5ce4155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce2ffd640 1 --2- 172.21.15.97:0/2607965414 >> v2:172.21.15.97:3300/0 conn(0x7f5ce40c7800 0x7f5ce4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 --2- 172.21.15.97:0/2607965414 >> v2:172.21.15.97:3300/0 conn(0x7f5ce40c7800 0x7f5ce4155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40c6d20 con 0x7f5ce4151eb0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f5cd4001680 con 0x7f5ce4151eb0 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 >> v1:172.21.15.97:6789/0 conn(0x7f5ce4151eb0 legacy=0x7f5ce40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.219 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 0x7f5ccc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.220 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc0047d0 0x7f5ccc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.220 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc0052b0 0x7f5ccc0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.220 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c7370 con 0x7f5ccc0047d0 2023-12-04T05:36:26.220 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c5270 con 0x7f5ccc003980 2023-12-04T05:36:26.220 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc014a10 con 0x7f5ccc0052b0 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 0x7f5ccc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce2ffd640 1 --2- 172.21.15.97:0/2607965414 >> v2:172.21.15.97:3300/0 conn(0x7f5ce40c7800 0x7f5ce4155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 -- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc0052b0 msgr2=0x7f5ccc0141a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc0052b0 0x7f5ccc0141a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce2ffd640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc0047d0 0x7f5ccc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.221 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 -- 172.21.15.97:0/2607965414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc0047d0 msgr2=0x7f5ccc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:26.223 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc0047d0 0x7f5ccc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.223 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce37fe640 1 -- 172.21.15.97:0/2607965414 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc003530 con 0x7f5ccc003980 2023-12-04T05:36:26.223 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce2ffd640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ccc0047d0 0x7f5ccc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:26.223 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.216+0000 7f5ce3fff640 1 -- 172.21.15.97:0/2607965414 reap_dead start 2023-12-04T05:36:26.223 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 0x7f5ccc003da0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5cd401d250 tx=0x7f5cd402dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0dee49e4f6e45ff server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:26.225 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40b6b00 con 0x7f5ccc003980 2023-12-04T05:36:26.225 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd40b6c80 con 0x7f5ccc003980 2023-12-04T05:36:26.225 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce27fc640 1 -- 172.21.15.97:0/2607965414 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40058e0 con 0x7f5ccc003980 2023-12-04T05:36:26.225 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 msgr2=0x7f5ccc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.225 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 0x7f5ccc003da0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5cd401d250 tx=0x7f5cd402dc00 comp rx=0 tx=0).stop 2023-12-04T05:36:26.226 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/2607965414 shutdown_connections 2023-12-04T05:36:26.226 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 --2- 172.21.15.97:0/2607965414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ccc003980 0x7f5ccc003da0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.226 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/2607965414 >> 172.21.15.97:0/2607965414 conn(0x7f5ce40abc50 msgr2=0x7f5ce40ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:26.226 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/2607965414 shutdown_connections 2023-12-04T05:36:26.227 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.224+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/2607965414 wait complete. 2023-12-04T05:36:26.229 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 Processor -- start 2023-12-04T05:36:26.229 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 -- start start 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc003980 0x7f5ce4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce4157340 0x7f5ce4146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4146d80 con 0x7f5ce4157340 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4071880 con 0x7f5ce414df40 2023-12-04T05:36:26.230 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce9ff8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce4070a20 con 0x7f5ccc003980 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:52064/0 (socket says 172.21.15.97:52064) 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 -- 172.21.15.97:0/1400497036 learned_addr learned my addr 172.21.15.97:0/1400497036 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc003980 0x7f5ce4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 -- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc003980 msgr2=0x7f5ce4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc003980 0x7f5ce4155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 -- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce4157340 msgr2=0x7f5ce4146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.228+0000 7f5ce3fff640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce4157340 0x7f5ce4146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.232 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ce3fff640 1 -- 172.21.15.97:0/1400497036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4070460 con 0x7f5ce414df40 2023-12-04T05:36:26.234 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ce3fff640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40c7c40 tx=0x7f5cdc00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:26.234 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc010040 con 0x7f5ce414df40 2023-12-04T05:36:26.234 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc00bc80 con 0x7f5ce414df40 2023-12-04T05:36:26.234 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc014400 con 0x7f5ce414df40 2023-12-04T05:36:26.234 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/1400497036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce4070740 con 0x7f5ce414df40 2023-12-04T05:36:26.235 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ce9ff8640 1 -- 172.21.15.97:0/1400497036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce4071570 con 0x7f5ce414df40 2023-12-04T05:36:26.236 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc005260 con 0x7f5ce414df40 2023-12-04T05:36:26.236 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.232+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 4) v1 ==== 86114+0+0 (secure 0 0 0) 0x7f5cdc014560 con 0x7f5ce414df40 2023-12-04T05:36:26.237 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.236+0000 7f5ccbfff640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 0x7f5cd0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:26.237 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.236+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f5cdc083e90 con 0x7f5ce414df40 2023-12-04T05:36:26.237 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.236+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 0x7f5cd0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:26.238 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.236+0000 7f5ce37fe640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 0x7f5cd0068d50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40bc000 tx=0x7f5cd4007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:26.250 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.248+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cdc0520b0 con 0x7f5ce414df40 2023-12-04T05:36:26.561 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.560+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cbc0057e0 con 0x7f5ce414df40 2023-12-04T05:36:26.563 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.560+0000 7f5ccbfff640 1 -- 172.21.15.97:0/1400497036 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5cdc0556d0 con 0x7f5ce414df40 2023-12-04T05:36:26.566 INFO:teuthology.misc.health.smithi097.stdout: 2023-12-04T05:36:26.566 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":12,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:24.199324+0000","last_up_change":"0.000000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:26.568 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 msgr2=0x7f5cd0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.568 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 0x7f5cd0068d50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40bc000 tx=0x7f5cd4007040 comp rx=0 tx=0).stop 2023-12-04T05:36:26.568 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 msgr2=0x7f5ce4146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:26.568 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40c7c40 tx=0x7f5cdc00b480 comp rx=0 tx=0).stop 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 shutdown_connections 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5cd0066890 0x7f5cd0068d50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ce414df40 0x7f5ce4146840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5ce4157340 0x7f5ce4146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 --2- 172.21.15.97:0/1400497036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5ccc003980 0x7f5ce4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 >> 172.21.15.97:0/1400497036 conn(0x7f5ce40abc50 msgr2=0x7f5ce414b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 shutdown_connections 2023-12-04T05:36:26.569 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:26.568+0000 7f5cc9ffb640 1 -- 172.21.15.97:0/1400497036 wait complete. 2023-12-04T05:36:26.586 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-04T05:36:26.587+0000 7ff6bc624640 -1 osd.5 0 waiting for initial osdmap 2023-12-04T05:36:26.599 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-04T05:36:26.600 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-04T05:36:26.599+0000 7ff578528640 -1 osd.6 0 waiting for initial osdmap 2023-12-04T05:36:26.617 INFO:tasks.ceph.osd.5.smithi143.stderr:2023-12-04T05:36:26.615+0000 7ff6b4c71640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.644 INFO:tasks.ceph.osd.6.smithi143.stderr:2023-12-04T05:36:26.643+0000 7ff570b75640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.652 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-04T05:36:26.651+0000 7f4206ab5640 -1 osd.7 0 waiting for initial osdmap 2023-12-04T05:36:26.675 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-04T05:36:26.675+0000 7ff654bbc640 -1 osd.4 0 waiting for initial osdmap 2023-12-04T05:36:26.682 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-12-04T05:36:26.680+0000 7fab98718640 -1 osd.0 0 waiting for initial osdmap 2023-12-04T05:36:26.682 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-12-04T05:36:26.680+0000 7f31dbf85640 -1 osd.2 0 waiting for initial osdmap 2023-12-04T05:36:26.700 INFO:tasks.ceph.osd.7.smithi143.stderr:2023-12-04T05:36:26.699+0000 7f41ff102640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.704 INFO:tasks.ceph.osd.4.smithi143.stderr:2023-12-04T05:36:26.703+0000 7ff64d209640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.709 INFO:tasks.ceph.osd.2.smithi097.stderr:2023-12-04T05:36:26.708+0000 7f31d45d2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.725 INFO:tasks.ceph.osd.0.smithi097.stderr:2023-12-04T05:36:26.724+0000 7fab90d65640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.728 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-12-04T05:36:26.728+0000 7f44c4c42640 -1 osd.1 0 waiting for initial osdmap 2023-12-04T05:36:26.734 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-12-04T05:36:26.732+0000 7f373cd2a640 -1 osd.3 0 waiting for initial osdmap 2023-12-04T05:36:26.773 INFO:tasks.ceph.osd.1.smithi097.stderr:2023-12-04T05:36:26.772+0000 7f44bd28f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:26.773 INFO:tasks.ceph.osd.3.smithi097.stderr:2023-12-04T05:36:26.772+0000 7f3735377640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T05:36:33.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:36:33.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:36:33.411 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:33.548 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 Processor -- start 2023-12-04T05:36:33.548 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 -- start start 2023-12-04T05:36:33.550 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa0f40ca460 0x7fa0f40c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.550 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0f4155150 0x7fa0f40c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40c5210 con 0x7fa0f414e2b0 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40c82e0 con 0x7fa0f4155150 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f949c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f406cc20 con 0x7fa0f40ca460 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0f4155150 0x7fa0f40c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0f4155150 0x7fa0f40c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39166/0 (socket says 172.21.15.97:39166) 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 -- 172.21.15.97:0/1291279988 learned_addr learned my addr 172.21.15.97:0/1291279988 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f3fff640 1 --2- 172.21.15.97:0/1291279988 >> v2:172.21.15.143:3300/0 conn(0x7fa0f40ca460 0x7fa0f40c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 -- 172.21.15.97:0/1291279988 >> v2:172.21.15.143:3300/0 conn(0x7fa0f40ca460 msgr2=0x7fa0f40c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/1291279988 >> v2:172.21.15.143:3300/0 conn(0x7fa0f40ca460 0x7fa0f40c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 -- 172.21.15.97:0/1291279988 >> v1:172.21.15.143:6789/0 conn(0x7fa0f414e2b0 legacy=0x7fa0f4157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:33.551 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.548+0000 7fa0f37fe640 1 -- 172.21.15.97:0/1291279988 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40c4c50 con 0x7fa0f4155150 2023-12-04T05:36:33.553 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/1291279988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f4155150 0x7fa0f40c7170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cada0 tx=0x7fa0e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934f3c31a0b71d74 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.553 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f2ffd640 1 -- 172.21.15.97:0/1291279988 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80aa5f0 con 0x7fa0f4155150 2023-12-04T05:36:33.553 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f2ffd640 1 -- 172.21.15.97:0/1291279988 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80aa750 con 0x7fa0f4155150 2023-12-04T05:36:33.553 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f2ffd640 1 -- 172.21.15.97:0/1291279988 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80aaae0 con 0x7fa0f4155150 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 -- 172.21.15.97:0/1291279988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f4155150 msgr2=0x7fa0f40c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 --2- 172.21.15.97:0/1291279988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f4155150 0x7fa0f40c7170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cada0 tx=0x7fa0e801c490 comp rx=0 tx=0).stop 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 -- 172.21.15.97:0/1291279988 shutdown_connections 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 --2- 172.21.15.97:0/1291279988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f4155150 0x7fa0f40c7170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 --2- 172.21.15.97:0/1291279988 >> v2:172.21.15.143:3300/0 conn(0x7fa0f40ca460 0x7fa0f40c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 -- 172.21.15.97:0/1291279988 >> 172.21.15.97:0/1291279988 conn(0x7fa0f4071ef0 msgr2=0x7fa0f4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 -- 172.21.15.97:0/1291279988 shutdown_connections 2023-12-04T05:36:33.554 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 -- 172.21.15.97:0/1291279988 wait complete. 2023-12-04T05:36:33.555 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.552+0000 7fa0f949c640 1 Processor -- start 2023-12-04T05:36:33.555 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- start start 2023-12-04T05:36:33.558 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.558 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 0x7fa0f40c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.558 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0f4155150 0x7fa0f40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.558 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40c2400 con 0x7fa0f40ca460 2023-12-04T05:36:33.558 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41507e0 con 0x7fa0f4155150 2023-12-04T05:36:33.559 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4150ac0 con 0x7fa0f414e2b0 2023-12-04T05:36:33.559 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.559 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39180/0 (socket says 172.21.15.97:39180) 2023-12-04T05:36:33.559 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 -- 172.21.15.97:0/2383540791 learned_addr learned my addr 172.21.15.97:0/2383540791 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:33.559 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f8c9b640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0f4155150 0x7fa0f40aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 0x7fa0f40c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 -- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 msgr2=0x7fa0f40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 0x7fa0f40c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 -- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0f4155150 msgr2=0x7fa0f40aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0f4155150 0x7fa0f40aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 -- 172.21.15.97:0/2383540791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80094d0 con 0x7fa0f40ca460 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 0x7fa0f40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f3fff640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400d800 tx=0x7fa0e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400b6c0 con 0x7fa0f40ca460 2023-12-04T05:36:33.560 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400b820 con 0x7fa0f40ca460 2023-12-04T05:36:33.561 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400bb90 con 0x7fa0f40ca460 2023-12-04T05:36:33.561 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f40c1d40 con 0x7fa0f40ca460 2023-12-04T05:36:33.561 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f414dbb0 con 0x7fa0f40ca460 2023-12-04T05:36:33.562 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.556+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f404e890 con 0x7fa0f40ca460 2023-12-04T05:36:33.562 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.560+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0e400bcf0 con 0x7fa0f40ca460 2023-12-04T05:36:33.562 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.560+0000 7fa0f0ff9640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 0x7fa0e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.563 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.560+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0e4084720 con 0x7fa0f40ca460 2023-12-04T05:36:33.563 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.560+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 0x7fa0e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.563 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.560+0000 7fa0f37fe640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 0x7fa0e0068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80ae000 tx=0x7fa0e80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.566 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.564+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0e4051c10 con 0x7fa0f40ca460 2023-12-04T05:36:33.720 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.712+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f40afc80 con 0x7fa0f40ca460 2023-12-04T05:36:33.720 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f0ff9640 1 -- 172.21.15.97:0/2383540791 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa0e4055230 con 0x7fa0f40ca460 2023-12-04T05:36:33.721 INFO:teuthology.misc.health.smithi097.stdout: 2023-12-04T05:36:33.721 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":16,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:30.959511+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 msgr2=0x7fa0e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 0x7fa0e0068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80ae000 tx=0x7fa0e80a7000 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 msgr2=0x7fa0f414d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400d800 tx=0x7fa0e400dcc0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 shutdown_connections 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0e00668d0 0x7fa0e0068d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0f4155150 0x7fa0f40aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0f414e2b0 0x7fa0f40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 --2- 172.21.15.97:0/2383540791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0f40ca460 0x7fa0f414d670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 >> 172.21.15.97:0/2383540791 conn(0x7fa0f4071ef0 msgr2=0x7fa0f4157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 shutdown_connections 2023-12-04T05:36:33.722 INFO:teuthology.misc.health.smithi097.stderr:2023-12-04T05:36:33.716+0000 7fa0f949c640 1 -- 172.21.15.97:0/2383540791 wait complete. 2023-12-04T05:36:33.736 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-04T05:36:33.736 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-04T05:36:33.736 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T05:36:33.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T05:36:33.740 INFO:tasks.ceph.mds.a:Started 2023-12-04T05:36:33.740 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T05:36:33.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T05:36:33.743 INFO:tasks.ceph.mds.c:Started 2023-12-04T05:36:33.743 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T05:36:33.744 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T05:36:33.748 INFO:tasks.ceph.mds.b:Started 2023-12-04T05:36:33.748 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T05:36:33.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T05:36:33.751 INFO:tasks.ceph.mds.d:Started 2023-12-04T05:36:33.752 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-04T05:36:33.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:33.840 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:36:33.840 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:36:33.861 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-04T05:36:33.861 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-04T05:36:33.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.896+0000 7f4a3549a640 1 Processor -- start 2023-12-04T05:36:33.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.896+0000 7f4a3549a640 1 -- start start 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a3549a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4a300c48b0 0x7f4a300c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a3549a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300c9960 con 0x7f4a3013d1f0 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a3549a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3013d920 con 0x7f4a3013dc20 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a3549a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a30155120 con 0x7f4a300c48b0 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a2effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4a3013d1f0 0x7f4a300ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:52148/0 (socket says 172.21.15.97:52148) 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a2effd640 1 -- 172.21.15.97:0/2255634466 learned_addr learned my addr 172.21.15.97:0/2255634466 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a267fc640 1 --2- 172.21.15.97:0/2255634466 >> v2:172.21.15.97:3300/0 conn(0x7f4a300c48b0 0x7f4a300c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a2e7fc640 1 -- 172.21.15.97:0/2255634466 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282579567 0 0) 0x7f4a300c9960 con 0x7f4a3013d1f0 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a2e7fc640 1 -- 172.21.15.97:0/2255634466 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c003530 con 0x7f4a3013d1f0 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a267fc640 1 -- 172.21.15.97:0/2255634466 >> v1:172.21.15.143:6789/0 conn(0x7f4a3013dc20 legacy=0x7f4a3015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a267fc640 1 -- 172.21.15.97:0/2255634466 >> v1:172.21.15.97:6789/0 conn(0x7f4a3013d1f0 legacy=0x7f4a300ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a267fc640 1 -- 172.21.15.97:0/2255634466 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30154a60 con 0x7f4a300c48b0 2023-12-04T05:36:33.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.900+0000 7f4a267fc640 1 --2- 172.21.15.97:0/2255634466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c7e30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a180097c0 tx=0x7f4a1801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab6fff51de15cfe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2e7fc640 1 -- 172.21.15.97:0/2255634466 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180ab600 con 0x7f4a300c48b0 2023-12-04T05:36:33.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2e7fc640 1 -- 172.21.15.97:0/2255634466 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180a7050 con 0x7f4a300c48b0 2023-12-04T05:36:33.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2e7fc640 1 -- 172.21.15.97:0/2255634466 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180ab980 con 0x7f4a300c48b0 2023-12-04T05:36:33.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- 172.21.15.97:0/2255634466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 msgr2=0x7f4a300c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 --2- 172.21.15.97:0/2255634466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c7e30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a180097c0 tx=0x7f4a1801c2f0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- 172.21.15.97:0/2255634466 shutdown_connections 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 --2- 172.21.15.97:0/2255634466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c7e30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- 172.21.15.97:0/2255634466 >> 172.21.15.97:0/2255634466 conn(0x7f4a300ac160 msgr2=0x7f4a300c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- 172.21.15.97:0/2255634466 shutdown_connections 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- 172.21.15.97:0/2255634466 wait complete. 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 Processor -- start 2023-12-04T05:36:33.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- start start 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a3013d1f0 0x7f4a30139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a3013dc20 0x7f4a301398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c6350 con 0x7f4a300c48b0 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30134aa0 con 0x7f4a3013d1f0 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a3549a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300c6540 con 0x7f4a3013dc20 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39236/0 (socket says 172.21.15.97:39236) 2023-12-04T05:36:33.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.904+0000 7f4a2effd640 1 -- 172.21.15.97:0/219197721 learned_addr learned my addr 172.21.15.97:0/219197721 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2f7fe640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a3013dc20 0x7f4a301398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a267fc640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a3013d1f0 0x7f4a30139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 -- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a3013dc20 msgr2=0x7f4a301398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a3013dc20 0x7f4a301398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 -- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a3013d1f0 msgr2=0x7f4a30139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a3013d1f0 0x7f4a30139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 -- 172.21.15.97:0/219197721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009420 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a2effd640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c4d0 tx=0x7f4a2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20005cf0 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20005e50 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007270 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300caed0 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300c6de0 con 0x7f4a300c48b0 2023-12-04T05:36:33.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a30068440 con 0x7f4a300c48b0 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4a200073d0 con 0x7f4a300c48b0 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 0x7f4a10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.908+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a20083640 con 0x7f4a300c48b0 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.912+0000 7f4a267fc640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 0x7f4a10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.912+0000 7f4a267fc640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 0x7f4a10068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a180ad000 tx=0x7f4a18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:33.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:33.916+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a20050c80 con 0x7f4a300c48b0 2023-12-04T05:36:34.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a300c9b50 con 0x7f4a300c48b0 2023-12-04T05:36:34.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a27fff640 1 -- 172.21.15.97:0/219197721 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f4a20017090 con 0x7f4a300c48b0 2023-12-04T05:36:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:34.066 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":16,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:30.959511+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 msgr2=0x7f4a10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 0x7f4a10068d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a180ad000 tx=0x7f4a18008040 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 msgr2=0x7f4a300c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c4d0 tx=0x7f4a2000c990 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.064+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 shutdown_connections 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4a100668d0 0x7f4a10068d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a3013dc20 0x7f4a301398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a3013d1f0 0x7f4a30139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 --2- 172.21.15.97:0/219197721 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a300c48b0 0x7f4a300c5e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 >> 172.21.15.97:0/219197721 conn(0x7f4a300ac160 msgr2=0x7f4a300aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:34.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 shutdown_connections 2023-12-04T05:36:34.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.068+0000 7f4a3549a640 1 -- 172.21.15.97:0/219197721 wait complete. 2023-12-04T05:36:34.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:36:34.090 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.228+0000 7fa5f9467640 1 Processor -- start 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.228+0000 7fa5f9467640 1 -- start start 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f9467640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa5f406da10 0x7fa5f4151400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f9467640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f4072a20 con 0x7fa5f414e400 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f9467640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f4151940 con 0x7fa5f40c5270 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f9467640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f40a5510 con 0x7fa5f406da10 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa5f414e400 0x7fa5f40c3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32892/0 (socket says 172.21.15.97:32892) 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f37fe640 1 -- 172.21.15.97:0/1449487143 learned_addr learned my addr 172.21.15.97:0/1449487143 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f8c66640 1 --2- 172.21.15.97:0/1449487143 >> v2:172.21.15.143:3300/0 conn(0x7fa5f406da10 0x7fa5f4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642631035 0 0) 0x7fa5f4072a20 con 0x7fa5f414e400 2023-12-04T05:36:34.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003530 con 0x7fa5f414e400 2023-12-04T05:36:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f8c66640 1 -- 172.21.15.97:0/1449487143 >> v1:172.21.15.143:6789/0 conn(0x7fa5f40c5270 legacy=0x7fa5f414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f8c66640 1 -- 172.21.15.97:0/1449487143 >> v1:172.21.15.97:6789/0 conn(0x7fa5f414e400 legacy=0x7fa5f40c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22162746 0 0) 0x7fa5dc003530 con 0x7fa5f414e400 2023-12-04T05:36:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.232+0000 7fa5f8c66640 1 -- 172.21.15.97:0/1449487143 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f406c4f0 con 0x7fa5f406da10 2023-12-04T05:36:34.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f8c66640 1 --2- 172.21.15.97:0/1449487143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f406da10 0x7fa5f4151400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00aea0 tx=0x7fa5ec01d8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c554f00d820b85 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8001680 con 0x7fa5f406da10 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00a0d0 con 0x7fa5f406da10 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f2ffd640 1 -- 172.21.15.97:0/1449487143 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0a6580 con 0x7fa5f406da10 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- 172.21.15.97:0/1449487143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f406da10 msgr2=0x7fa5f4151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1449487143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f406da10 0x7fa5f4151400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00aea0 tx=0x7fa5ec01d8e0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- 172.21.15.97:0/1449487143 shutdown_connections 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1449487143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f406da10 0x7fa5f4151400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- 172.21.15.97:0/1449487143 >> 172.21.15.97:0/1449487143 conn(0x7fa5f406ad80 msgr2=0x7fa5f40c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:34.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- 172.21.15.97:0/1449487143 shutdown_connections 2023-12-04T05:36:34.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- 172.21.15.97:0/1449487143 wait complete. 2023-12-04T05:36:34.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 Processor -- start 2023-12-04T05:36:34.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.236+0000 7fa5f9467640 1 -- start start 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 0x7fa5f41eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 0x7fa5f41ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40a6f40 con 0x7fa5f406da10 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41ec810 con 0x7fa5f414e400 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40a6190 con 0x7fa5f40c5270 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48704/0 (socket says 172.21.15.97:48704) 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 -- 172.21.15.97:0/1889400811 learned_addr learned my addr 172.21.15.97:0/1889400811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f37fe640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 0x7fa5f41eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f8c66640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 0x7fa5f41ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 -- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 msgr2=0x7fa5f41eccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 0x7fa5f41eccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 -- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 msgr2=0x7fa5f41ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 0x7fa5f41ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 -- 172.21.15.97:0/1889400811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec00ab80 con 0x7fa5f406da10 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f37fe640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 0x7fa5f41eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f8c66640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 0x7fa5f41ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f3fff640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c500 tx=0x7fa5e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4005220 con 0x7fa5f406da10 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4005380 con 0x7fa5f406da10 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f40a58f0 con 0x7fa5f406da10 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4007270 con 0x7fa5f406da10 2023-12-04T05:36:34.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40a5eb0 con 0x7fa5f406da10 2023-12-04T05:36:34.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f41ec670 con 0x7fa5f406da10 2023-12-04T05:36:34.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.240+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa5e40073d0 con 0x7fa5f406da10 2023-12-04T05:36:34.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.244+0000 7fa5f0ff9640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 0x7fa5e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.244+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa5e4083a50 con 0x7fa5f406da10 2023-12-04T05:36:34.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.244+0000 7fa5f37fe640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 0x7fa5e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.244+0000 7fa5f37fe640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 0x7fa5e0068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.248+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5f41ec670 con 0x7fa5f406da10 2023-12-04T05:36:34.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.396+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f41ec670 con 0x7fa5f406da10 2023-12-04T05:36:34.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.396+0000 7fa5f0ff9640 1 -- 172.21.15.97:0/1889400811 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5f41ec670 con 0x7fa5f406da10 2023-12-04T05:36:34.399 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 msgr2=0x7fa5e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 0x7fa5e0068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80011f0 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 msgr2=0x7fa5f414ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c500 tx=0x7fa5e400c9c0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 shutdown_connections 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa5e00668d0 0x7fa5e0068d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f414e400 0x7fa5f41ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f40c5270 0x7fa5f41eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 --2- 172.21.15.97:0/1889400811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5f406da10 0x7fa5f414ca00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 >> 172.21.15.97:0/1889400811 conn(0x7fa5f406ad80 msgr2=0x7fa5f414a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:34.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 shutdown_connections 2023-12-04T05:36:34.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.400+0000 7fa5f9467640 1 -- 172.21.15.97:0/1889400811 wait complete. 2023-12-04T05:36:34.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:34.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 Processor -- start 2023-12-04T05:36:34.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 -- start start 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f60f8071e10 0x7f60f80c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80707c0 con 0x7f60f8071390 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f8159470 con 0x7f60f80c1880 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60ffcc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f806dd10 con 0x7f60f8071e10 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fd264640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f60f8071e10 0x7f60f80c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fe266640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f60f8071390 0x7f60f8163370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32902/0 (socket says 172.21.15.97:32902) 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fd264640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f60f8071e10 0x7f60f80c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48720/0 (socket says 172.21.15.97:48720) 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fe266640 1 -- 172.21.15.97:0/2857211852 learned_addr learned my addr 172.21.15.97:0/2857211852 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fd264640 1 -- 172.21.15.97:0/2857211852 >> v1:172.21.15.143:6789/0 conn(0x7f60f80c1880 legacy=0x7f60f806be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fd264640 1 -- 172.21.15.97:0/2857211852 >> v1:172.21.15.97:6789/0 conn(0x7f60f8071390 legacy=0x7f60f8163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.556+0000 7f60fd264640 1 -- 172.21.15.97:0/2857211852 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8159750 con 0x7f60f8071e10 2023-12-04T05:36:34.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60fd264640 1 --2- 172.21.15.97:0/2857211852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071e10 0x7f60f80c1c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097c0 tx=0x7f60e801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fbd7f07850e25 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60fca63640 1 -- 172.21.15.97:0/2857211852 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80ab600 con 0x7f60f8071e10 2023-12-04T05:36:34.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60fca63640 1 -- 172.21.15.97:0/2857211852 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e80a7050 con 0x7f60f8071e10 2023-12-04T05:36:34.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60fca63640 1 -- 172.21.15.97:0/2857211852 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80ab980 con 0x7f60f8071e10 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 -- 172.21.15.97:0/2857211852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071e10 msgr2=0x7f60f80c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/2857211852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071e10 0x7f60f80c1c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097c0 tx=0x7f60e801c440 comp rx=0 tx=0).stop 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 -- 172.21.15.97:0/2857211852 shutdown_connections 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/2857211852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071e10 0x7f60f80c1c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 -- 172.21.15.97:0/2857211852 >> 172.21.15.97:0/2857211852 conn(0x7f60f80c2970 msgr2=0x7f60f80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 -- 172.21.15.97:0/2857211852 shutdown_connections 2023-12-04T05:36:34.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.560+0000 7f60ffcc9640 1 -- 172.21.15.97:0/2857211852 wait complete. 2023-12-04T05:36:34.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 Processor -- start 2023-12-04T05:36:34.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- start start 2023-12-04T05:36:34.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60f8071e10 0x7f60f8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60f80c1880 0x7f60f8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81f1df0 con 0x7f60f8071390 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8148a20 con 0x7f60f80c1880 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8148740 con 0x7f60f8071e10 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48726/0 (socket says 172.21.15.97:48726) 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 -- 172.21.15.97:0/3647005016 learned_addr learned my addr 172.21.15.97:0/3647005016 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fe266640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60f80c1880 0x7f60f8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fd264640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60f8071e10 0x7f60f8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 -- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60f8071e10 msgr2=0x7f60f8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60f8071e10 0x7f60f8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 -- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60f80c1880 msgr2=0x7f60f8144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60f80c1880 0x7f60f8144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 -- 172.21.15.97:0/3647005016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009420 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60fda65640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60f400b410 tx=0x7f60f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4004020 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4004180 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f8147240 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4011630 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.564+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f8147800 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f81f5360 con 0x7f60f8071390 2023-12-04T05:36:34.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60f4011790 con 0x7f60f8071390 2023-12-04T05:36:34.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60ee7fc640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 0x7f60dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:34.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60f4083d00 con 0x7f60f8071390 2023-12-04T05:36:34.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60fd264640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 0x7f60dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:34.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.568+0000 7f60fd264640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 0x7f60dc068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ad000 tx=0x7f60e80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:34.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.572+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60f81f5360 con 0x7f60f8071390 2023-12-04T05:36:34.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.748+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60f81f5360 con 0x7f60f8071390 2023-12-04T05:36:34.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.748+0000 7f60ee7fc640 1 -- 172.21.15.97:0/3647005016 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f60f4015540 con 0x7f60f8071390 2023-12-04T05:36:34.755 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:34.755 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 2 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 msgr2=0x7f60dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 0x7f60dc068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60e80ad000 tx=0x7f60e80a6000 comp rx=0 tx=0).stop 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 msgr2=0x7f60f80bfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60f400b410 tx=0x7f60f400b8d0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 shutdown_connections 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60dc066900 0x7f60dc068dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60f80c1880 0x7f60f8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60f8071e10 0x7f60f8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 --2- 172.21.15.97:0/3647005016 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60f8071390 0x7f60f80bfb90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:34.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 >> 172.21.15.97:0/3647005016 conn(0x7f60f80c2970 msgr2=0x7f60f8148f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:34.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 shutdown_connections 2023-12-04T05:36:34.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:34.752+0000 7f60ffcc9640 1 -- 172.21.15.97:0/3647005016 wait complete. 2023-12-04T05:36:36.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:36.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.920+0000 7f4bd292a640 1 Processor -- start 2023-12-04T05:36:36.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.920+0000 7f4bd292a640 1 -- start start 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd292a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 0x7f4bcc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd292a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4bcc06ca50 0x7f4bcc0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd292a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc152300 con 0x7f4bcc14e970 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd292a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc071580 con 0x7f4bcc06ca50 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd292a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc14ed50 con 0x7f4bcc06be00 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bcbfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4bcc14e970 0x7f4bcc071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32912/0 (socket says 172.21.15.97:32912) 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bcbfff640 1 -- 172.21.15.97:0/1617693189 learned_addr learned my addr 172.21.15.97:0/1617693189 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:36.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd0ec7640 1 --2- 172.21.15.97:0/1617693189 >> v2:172.21.15.97:3300/0 conn(0x7f4bcc06ca50 0x7f4bcc0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bcb7fe640 1 --2- 172.21.15.97:0/1617693189 >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 0x7f4bcc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd0ec7640 1 -- 172.21.15.97:0/1617693189 >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 msgr2=0x7f4bcc06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd0ec7640 1 --2- 172.21.15.97:0/1617693189 >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 0x7f4bcc06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bcaffd640 1 -- 172.21.15.97:0/1617693189 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783646297 0 0) 0x7f4bbc001120 con 0x7f4bcc14e970 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd0ec7640 1 -- 172.21.15.97:0/1617693189 >> v1:172.21.15.97:6789/0 conn(0x7f4bcc14e970 legacy=0x7f4bcc071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bd0ec7640 1 -- 172.21.15.97:0/1617693189 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc151d60 con 0x7f4bcc06ca50 2023-12-04T05:36:36.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.924+0000 7f4bcb7fe640 1 --2- 172.21.15.97:0/1617693189 >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 0x7f4bcc06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:36.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd0ec7640 1 --2- 172.21.15.97:0/1617693189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc0c1880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0a93f0 tx=0x7f4bc401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b087f8d91ba7bbfe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:36.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bcaffd640 1 -- 172.21.15.97:0/1617693189 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40a5940 con 0x7f4bcc06ca50 2023-12-04T05:36:36.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bcaffd640 1 -- 172.21.15.97:0/1617693189 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc40a5aa0 con 0x7f4bcc06ca50 2023-12-04T05:36:36.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bcaffd640 1 -- 172.21.15.97:0/1617693189 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40a5e30 con 0x7f4bcc06ca50 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- 172.21.15.97:0/1617693189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06ca50 msgr2=0x7f4bcc0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1617693189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc0c1880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0a93f0 tx=0x7f4bc401c880 comp rx=0 tx=0).stop 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- 172.21.15.97:0/1617693189 shutdown_connections 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1617693189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc0c1880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1617693189 >> v2:172.21.15.143:3300/0 conn(0x7f4bcc06be00 0x7f4bcc06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- 172.21.15.97:0/1617693189 >> 172.21.15.97:0/1617693189 conn(0x7f4bcc0c2970 msgr2=0x7f4bcc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- 172.21.15.97:0/1617693189 shutdown_connections 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- 172.21.15.97:0/1617693189 wait complete. 2023-12-04T05:36:36.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 Processor -- start 2023-12-04T05:36:36.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.928+0000 7f4bd292a640 1 -- start start 2023-12-04T05:36:36.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bcc14e970 0x7f4bcc141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc140880 con 0x7f4bcc06be00 2023-12-04T05:36:36.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc143610 con 0x7f4bcc06ca50 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc14c920 con 0x7f4bcc14e970 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48744/0 (socket says 172.21.15.97:48744) 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 -- 172.21.15.97:0/1569816048 learned_addr learned my addr 172.21.15.97:0/1569816048 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcb7fe640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd0ec7640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bcc14e970 0x7f4bcc141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 -- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bcc14e970 msgr2=0x7f4bcc141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bcc14e970 0x7f4bcc141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 -- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bcc06ca50 msgr2=0x7f4bcc141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 -- 172.21.15.97:0/1569816048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009a70 con 0x7f4bcc06be00 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bcbfff640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c4b0 tx=0x7f4bbc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0074e0 con 0x7f4bcc06be00 2023-12-04T05:36:36.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc007660 con 0x7f4bcc06be00 2023-12-04T05:36:36.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc004a30 con 0x7f4bcc06be00 2023-12-04T05:36:36.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc143b90 con 0x7f4bcc06be00 2023-12-04T05:36:36.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc140b80 con 0x7f4bcc06be00 2023-12-04T05:36:36.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc068440 con 0x7f4bcc06be00 2023-12-04T05:36:36.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.932+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4bbc004b90 con 0x7f4bcc06be00 2023-12-04T05:36:36.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.936+0000 7f4bc8ff9640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 0x7f4bb8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:36.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.936+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4bbc082f80 con 0x7f4bcc06be00 2023-12-04T05:36:36.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.936+0000 7f4bcb7fe640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 0x7f4bb8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:36.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.936+0000 7f4bcb7fe640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 0x7f4bb8068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc15bbc0 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:36.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:36.940+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bbc0505b0 con 0x7f4bcc06be00 2023-12-04T05:36:37.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bcc152300 con 0x7f4bcc06be00 2023-12-04T05:36:37.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bc8ff9640 1 -- 172.21.15.97:0/1569816048 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f4bcc152300 con 0x7f4bcc06be00 2023-12-04T05:36:37.121 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:37.121 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-04T05:36:37.122 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 3 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 msgr2=0x7f4bb8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 0x7f4bb8068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc15bbc0 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 msgr2=0x7f4bcc14c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c4b0 tx=0x7f4bbc00c970 comp rx=0 tx=0).stop 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 shutdown_connections 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4bb8066900 0x7f4bb8068dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4bcc14e970 0x7f4bcc141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4bcc06ca50 0x7f4bcc141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 --2- 172.21.15.97:0/1569816048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4bcc06be00 0x7f4bcc14c3e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 >> 172.21.15.97:0/1569816048 conn(0x7f4bcc0c2970 msgr2=0x7f4bcc06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 shutdown_connections 2023-12-04T05:36:37.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.120+0000 7f4bd292a640 1 -- 172.21.15.97:0/1569816048 wait complete. 2023-12-04T05:36:37.143 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:37.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 Processor -- start 2023-12-04T05:36:37.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 -- start start 2023-12-04T05:36:37.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 0x7fa890157d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa890154fd0 0x7fa890155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900c4570 con 0x7fa8900a6b40 2023-12-04T05:36:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900c2cc0 con 0x7fa890154fd0 2023-12-04T05:36:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa8952d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890155960 con 0x7fa8900c12f0 2023-12-04T05:36:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa890154fd0 0x7fa890155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa890154fd0 0x7fa890155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48746/0 (socket says 172.21.15.97:48746) 2023-12-04T05:36:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 -- 172.21.15.97:0/3154325948 learned_addr learned my addr 172.21.15.97:0/3154325948 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88effd640 1 --2- 172.21.15.97:0/3154325948 >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 0x7fa890157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 -- 172.21.15.97:0/3154325948 >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 msgr2=0x7fa890157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 --2- 172.21.15.97:0/3154325948 >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 0x7fa890157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 -- 172.21.15.97:0/3154325948 >> v1:172.21.15.143:6789/0 conn(0x7fa8900a6b40 legacy=0x7fa8900c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88f7fe640 1 -- 172.21.15.97:0/3154325948 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900c22e0 con 0x7fa890154fd0 2023-12-04T05:36:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.280+0000 7fa88effd640 1 --2- 172.21.15.97:0/3154325948 >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 0x7fa890157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:37.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa88f7fe640 1 --2- 172.21.15.97:0/3154325948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa890155420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa890073ef0 tx=0x7fa88801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc1c0f00bbff6de server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa88dffb640 1 -- 172.21.15.97:0/3154325948 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880a57d0 con 0x7fa890154fd0 2023-12-04T05:36:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa88dffb640 1 -- 172.21.15.97:0/3154325948 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880a5930 con 0x7fa890154fd0 2023-12-04T05:36:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa88dffb640 1 -- 172.21.15.97:0/3154325948 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880a5cc0 con 0x7fa890154fd0 2023-12-04T05:36:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- 172.21.15.97:0/3154325948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 msgr2=0x7fa890155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 --2- 172.21.15.97:0/3154325948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa890155420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa890073ef0 tx=0x7fa88801c910 comp rx=0 tx=0).stop 2023-12-04T05:36:37.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- 172.21.15.97:0/3154325948 shutdown_connections 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 --2- 172.21.15.97:0/3154325948 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa890155420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 --2- 172.21.15.97:0/3154325948 >> v2:172.21.15.143:3300/0 conn(0x7fa8900c12f0 0x7fa890157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- 172.21.15.97:0/3154325948 >> 172.21.15.97:0/3154325948 conn(0x7fa8900c4760 msgr2=0x7fa8900c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- 172.21.15.97:0/3154325948 shutdown_connections 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- 172.21.15.97:0/3154325948 wait complete. 2023-12-04T05:36:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 Processor -- start 2023-12-04T05:36:37.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.284+0000 7fa8952d6640 1 -- start start 2023-12-04T05:36:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 0x7fa890151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8900c12f0 0x7fa89014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901efcd0 con 0x7fa890154fd0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901effb0 con 0x7fa8900a6b40 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8901f0290 con 0x7fa8900c12f0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48758/0 (socket says 172.21.15.97:48758) 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 -- 172.21.15.97:0/4203605555 learned_addr learned my addr 172.21.15.97:0/4203605555 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88effd640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 0x7fa890151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88e7fc640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8900c12f0 0x7fa89014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 -- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8900c12f0 msgr2=0x7fa89014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8900c12f0 0x7fa89014f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 -- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 msgr2=0x7fa890151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 0x7fa890151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 -- 172.21.15.97:0/4203605555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009b30 con 0x7fa890154fd0 2023-12-04T05:36:37.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88effd640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 0x7fa890151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa88f7fe640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa888019520 tx=0x7fa8880196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880b8670 con 0x7fa890154fd0 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880b87d0 con 0x7fa890154fd0 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880b8b60 con 0x7fa890154fd0 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8901f0570 con 0x7fa890154fd0 2023-12-04T05:36:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8901500e0 con 0x7fa890154fd0 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.288+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8900708f0 con 0x7fa890154fd0 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.292+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8880b8cc0 con 0x7fa890154fd0 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.292+0000 7fa8777fe640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 0x7fa87c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.292+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa88811f7f0 con 0x7fa890154fd0 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.292+0000 7fa88effd640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 0x7fa87c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.292+0000 7fa88effd640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 0x7fa87c068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa880006fd0 tx=0x7fa880008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.296+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8880ece10 con 0x7fa890154fd0 2023-12-04T05:36:37.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.444+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa89004e890 con 0x7fa890154fd0 2023-12-04T05:36:37.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.444+0000 7fa8777fe640 1 -- 172.21.15.97:0/4203605555 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa8880f0430 con 0x7fa890154fd0 2023-12-04T05:36:37.447 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:37.447 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":16,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:30.959511+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 msgr2=0x7fa87c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 0x7fa87c068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa880006fd0 tx=0x7fa880008040 comp rx=0 tx=0).stop 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 msgr2=0x7fa89014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa888019520 tx=0x7fa8880196b0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 shutdown_connections 2023-12-04T05:36:37.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa87c0668d0 0x7fa87c068d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa890154fd0 0x7fa89014fba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8900c12f0 0x7fa89014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 --2- 172.21.15.97:0/4203605555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8900a6b40 0x7fa890151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 >> 172.21.15.97:0/4203605555 conn(0x7fa8900c4760 msgr2=0x7fa8900c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 shutdown_connections 2023-12-04T05:36:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.448+0000 7fa8952d6640 1 -- 172.21.15.97:0/4203605555 wait complete. 2023-12-04T05:36:37.468 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:36:37.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:36:37.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 Processor -- start 2023-12-04T05:36:37.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 -- start start 2023-12-04T05:36:37.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14eb30 0x7f850c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f850c14f790 0x7f850c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f850c154e10 0x7f850c151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c0c0bd0 con 0x7f850c14f790 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c154640 con 0x7f850c154e10 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f85147b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c14ef10 con 0x7f850c14eb30 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f850c14f790 0x7f850c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f850c14f790 0x7f850c1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48768/0 (socket says 172.21.15.97:48768) 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 -- 172.21.15.97:0/337313878 learned_addr learned my addr 172.21.15.97:0/337313878 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8512d55640 1 --2- 172.21.15.97:0/337313878 >> v2:172.21.15.143:3300/0 conn(0x7f850c154e10 0x7f850c151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8512554640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14eb30 0x7f850c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 -- 172.21.15.97:0/337313878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14eb30 msgr2=0x7f850c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14eb30 0x7f850c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 -- 172.21.15.97:0/337313878 >> v2:172.21.15.143:3300/0 conn(0x7f850c154e10 msgr2=0x7f850c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 --2- 172.21.15.97:0/337313878 >> v2:172.21.15.143:3300/0 conn(0x7f850c154e10 0x7f850c151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.608+0000 7f8511d53640 1 -- 172.21.15.97:0/337313878 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c1535a0 con 0x7f850c14f790 2023-12-04T05:36:37.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f8511d53640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14f790 0x7f850c1548d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f850c0a8950 tx=0x7f84fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a405c1685ec3e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f8511552640 1 -- 172.21.15.97:0/337313878 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0ac600 con 0x7f850c14f790 2023-12-04T05:36:37.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f8511552640 1 -- 172.21.15.97:0/337313878 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0a8050 con 0x7f850c14f790 2023-12-04T05:36:37.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f8511552640 1 -- 172.21.15.97:0/337313878 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0ac980 con 0x7f850c14f790 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 -- 172.21.15.97:0/337313878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14f790 msgr2=0x7f850c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14f790 0x7f850c1548d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f850c0a8950 tx=0x7f84fc01c4d0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 -- 172.21.15.97:0/337313878 shutdown_connections 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 --2- 172.21.15.97:0/337313878 >> v2:172.21.15.143:3300/0 conn(0x7f850c154e10 0x7f850c151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14f790 0x7f850c1548d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 --2- 172.21.15.97:0/337313878 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14eb30 0x7f850c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 -- 172.21.15.97:0/337313878 >> 172.21.15.97:0/337313878 conn(0x7f850c0c5e70 msgr2=0x7f850c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 -- 172.21.15.97:0/337313878 shutdown_connections 2023-12-04T05:36:37.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 -- 172.21.15.97:0/337313878 wait complete. 2023-12-04T05:36:37.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.612+0000 7f85147b8640 1 Processor -- start 2023-12-04T05:36:37.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- start start 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 0x7f850c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 0x7f850c1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c1edee0 con 0x7f850c14eb30 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c1ee180 con 0x7f850c154e10 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0c5a40 con 0x7f850c14f790 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48780/0 (socket says 172.21.15.97:48780) 2023-12-04T05:36:37.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 -- 172.21.15.97:0/2052641078 learned_addr learned my addr 172.21.15.97:0/2052641078 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512d55640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 0x7f850c1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8511d53640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 0x7f850c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 -- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 msgr2=0x7f850c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 0x7f850c15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 -- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 msgr2=0x7f850c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 0x7f850c1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 -- 172.21.15.97:0/2052641078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0094d0 con 0x7f850c14eb30 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512d55640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 0x7f850c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8511d53640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 0x7f850c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8512554640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f850800d620 tx=0x7f850800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800b620 con 0x7f850c14eb30 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850800b780 con 0x7f850c14eb30 2023-12-04T05:36:37.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c15be20 con 0x7f850c14eb30 2023-12-04T05:36:37.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800bb10 con 0x7f850c14eb30 2023-12-04T05:36:37.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c15a7e0 con 0x7f850c14eb30 2023-12-04T05:36:37.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.616+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c15bc60 con 0x7f850c14eb30 2023-12-04T05:36:37.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.620+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f850800bc70 con 0x7f850c14eb30 2023-12-04T05:36:37.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.620+0000 7f8502ffd640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 0x7f84f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.620+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8508084660 con 0x7f850c14eb30 2023-12-04T05:36:37.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.620+0000 7f8511d53640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 0x7f84f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.620+0000 7f8511d53640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 0x7f84f0068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0ae000 tx=0x7f84fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.624+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8508051be0 con 0x7f850c14eb30 2023-12-04T05:36:37.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.772+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f850c15c010 con 0x7f850c14eb30 2023-12-04T05:36:37.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f8502ffd640 1 -- 172.21.15.97:0/2052641078 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8508007380 con 0x7f850c14eb30 2023-12-04T05:36:37.776 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 msgr2=0x7f84f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 0x7f84f0068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0ae000 tx=0x7f84fc008040 comp rx=0 tx=0).stop 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 msgr2=0x7f850c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f850800d620 tx=0x7f850800dae0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 shutdown_connections 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84f00668d0 0x7f84f0068d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f850c154e10 0x7f850c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f850c14f790 0x7f850c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 --2- 172.21.15.97:0/2052641078 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f850c14eb30 0x7f850c0700b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 >> 172.21.15.97:0/2052641078 conn(0x7f850c0c5e70 msgr2=0x7f850c14bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 shutdown_connections 2023-12-04T05:36:37.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.776+0000 7f85147b8640 1 -- 172.21.15.97:0/2052641078 wait complete. 2023-12-04T05:36:37.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:36:37.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 Processor -- start 2023-12-04T05:36:37.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 -- start start 2023-12-04T05:36:37.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb0c4155180 0x7fb0c4158440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c41545e0 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c40ca2d0 con 0x7fb0c40bd480 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.932+0000 7fb0c9438640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40af8a0 con 0x7fb0c4155180 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb0c40af4c0 0x7fb0c40c4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32918/0 (socket says 172.21.15.97:32918) 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c3fff640 1 -- 172.21.15.97:0/2721134877 learned_addr learned my addr 172.21.15.97:0/2721134877 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987498564 0 0) 0x7fb0c41545e0 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c8c37640 1 --2- 172.21.15.97:0/2721134877 >> v2:172.21.15.143:3300/0 conn(0x7fb0c4155180 0x7fb0c4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ac003530 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905743661 0 0) 0x7fb0ac003530 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 >> v2:172.21.15.143:3300/0 conn(0x7fb0c4155180 msgr2=0x7fb0c4158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 --2- 172.21.15.97:0/2721134877 >> v2:172.21.15.143:3300/0 conn(0x7fb0c4155180 0x7fb0c4158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 >> v1:172.21.15.143:6789/0 conn(0x7fb0c40bd480 legacy=0x7fb0c4154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c406cc90 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fb0b4001680 con 0x7fb0c40af4c0 2023-12-04T05:36:37.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 >> v1:172.21.15.97:6789/0 conn(0x7fb0c40af4c0 legacy=0x7fb0c40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ac003980 0x7fb0ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ac005190 0x7fb0ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40af8a0 con 0x7fb0ac0047d0 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac00c130 con 0x7fb0ac003980 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac00c2f0 con 0x7fb0ac005190 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c3fff640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ac003980 0x7fb0ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c8c37640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ac005190 0x7fb0ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 -- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ac005190 msgr2=0x7fb0ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ac005190 0x7fb0ac00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 -- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ac003980 msgr2=0x7fb0ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ac003980 0x7fb0ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c37fe640 1 -- 172.21.15.97:0/2721134877 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac003530 con 0x7fb0ac0047d0 2023-12-04T05:36:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.936+0000 7fb0c8c37640 1 -- 172.21.15.97:0/2721134877 reap_dead start 2023-12-04T05:36:37.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0ac004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8001780 tx=0x7fb0b801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7fbddadb17c771 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80052d0 con 0x7fb0ac0047d0 2023-12-04T05:36:37.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b80a7050 con 0x7fb0ac0047d0 2023-12-04T05:36:37.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c2ffd640 1 -- 172.21.15.97:0/2721134877 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8003600 con 0x7fb0ac0047d0 2023-12-04T05:36:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 msgr2=0x7fb0ac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0ac004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8001780 tx=0x7fb0b801c3e0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- 172.21.15.97:0/2721134877 shutdown_connections 2023-12-04T05:36:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 --2- 172.21.15.97:0/2721134877 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0ac004c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- 172.21.15.97:0/2721134877 >> 172.21.15.97:0/2721134877 conn(0x7fb0c4073950 msgr2=0x7fb0c4073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- 172.21.15.97:0/2721134877 shutdown_connections 2023-12-04T05:36:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- 172.21.15.97:0/2721134877 wait complete. 2023-12-04T05:36:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 Processor -- start 2023-12-04T05:36:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.940+0000 7fb0c9438640 1 -- start start 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0c40c9170 0x7fb0c40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0c4156700 0x7fb0c4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c41ee000 con 0x7fb0ac0047d0 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c9b30 con 0x7fb0c40c9170 2023-12-04T05:36:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c41ee420 con 0x7fb0c4156700 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48802/0 (socket says 172.21.15.97:48802) 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 -- 172.21.15.97:0/295595279 learned_addr learned my addr 172.21.15.97:0/295595279 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c8c37640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0c4156700 0x7fb0c4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0c40c9170 0x7fb0c40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 -- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0c4156700 msgr2=0x7fb0c4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0c4156700 0x7fb0c4156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 -- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0c40c9170 msgr2=0x7fb0c40c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0c40c9170 0x7fb0c40c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 -- 172.21.15.97:0/295595279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40c2450 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c3fff640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40072c0 tx=0x7fb0b4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4001660 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b400f940 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b400fcf0 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c41ed660 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c41edc20 con 0x7fb0ac0047d0 2023-12-04T05:36:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c404e890 con 0x7fb0ac0047d0 2023-12-04T05:36:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.944+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb0b401d460 con 0x7fb0ac0047d0 2023-12-04T05:36:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.948+0000 7fb0c0ff9640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 0x7fb0b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.948+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0b4083ff0 con 0x7fb0ac0047d0 2023-12-04T05:36:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.948+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 0x7fb0b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.948+0000 7fb0c37fe640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 0x7fb0b0068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8001750 tx=0x7fb0b80011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:37.952+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0b4051680 con 0x7fb0ac0047d0 2023-12-04T05:36:38.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.100+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0c40aab80 con 0x7fb0ac0047d0 2023-12-04T05:36:38.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.100+0000 7fb0c0ff9640 1 -- 172.21.15.97:0/295595279 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb0b4054ca0 con 0x7fb0ac0047d0 2023-12-04T05:36:38.103 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:38.103 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:36:38.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:36:38.103 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:36:38.104 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:36:38.104 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:36:38.104 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:36:38.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 msgr2=0x7fb0b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 0x7fb0b0068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8001750 tx=0x7fb0b80011a0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 msgr2=0x7fb0c40c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40072c0 tx=0x7fb0b4007780 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 shutdown_connections 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0b00668d0 0x7fb0b0068d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0c4156700 0x7fb0c4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0c40c9170 0x7fb0c40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 --2- 172.21.15.97:0/295595279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0ac0047d0 0x7fb0c40c3350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 >> 172.21.15.97:0/295595279 conn(0x7fb0c4073950 msgr2=0x7fb0c41522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:38.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 shutdown_connections 2023-12-04T05:36:38.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.104+0000 7fb0c9438640 1 -- 172.21.15.97:0/295595279 wait complete. 2023-12-04T05:36:38.124 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T05:36:38.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T05:36:38.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.264+0000 7f4fd4017640 1 Processor -- start 2023-12-04T05:36:38.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.264+0000 7f4fd4017640 1 -- start start 2023-12-04T05:36:38.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd4017640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4fcc0aa830 0x7f4fcc0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd4017640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd4017640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc0700b0 con 0x7f4fcc0725b0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd4017640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc06c990 con 0x7f4fcc0aa830 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd4017640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc06bff0 con 0x7f4fcc1515e0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd15b2640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4fcc0725b0 0x7f4fcc06cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32930/0 (socket says 172.21.15.97:32930) 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd15b2640 1 -- 172.21.15.97:0/643582856 learned_addr learned my addr 172.21.15.97:0/643582856 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd25b4640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/643582856 >> v2:172.21.15.143:3300/0 conn(0x7f4fcc0aa830 0x7f4fcc0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189952552 0 0) 0x7f4fcc0700b0 con 0x7f4fcc0725b0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb8005740 con 0x7f4fcc0725b0 2023-12-04T05:36:38.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd1db3640 1 -- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 msgr2=0x7f4fcc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc06d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944144874 0 0) 0x7f4fb8005740 con 0x7f4fcc0725b0 2023-12-04T05:36:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd1db3640 1 -- 172.21.15.97:0/643582856 >> v1:172.21.15.97:6789/0 conn(0x7f4fcc0725b0 legacy=0x7f4fcc06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.268+0000 7f4fd1db3640 1 -- 172.21.15.97:0/643582856 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc06c2d0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc0ab0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097c0 tx=0x7f4fc801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af7c1d683cef7941 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:38.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc001680 con 0x7f4fcc0aa830 2023-12-04T05:36:38.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc80a7050 con 0x7f4fcc0aa830 2023-12-04T05:36:38.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd0db1640 1 -- 172.21.15.97:0/643582856 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80ab620 con 0x7f4fcc0aa830 2023-12-04T05:36:38.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0aa830 msgr2=0x7f4fcc0ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc0ab0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097c0 tx=0x7f4fc801c2e0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- 172.21.15.97:0/643582856 shutdown_connections 2023-12-04T05:36:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc06d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 --2- 172.21.15.97:0/643582856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc0ab0b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- 172.21.15.97:0/643582856 >> 172.21.15.97:0/643582856 conn(0x7f4fcc0c2a50 msgr2=0x7f4fcc0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- 172.21.15.97:0/643582856 shutdown_connections 2023-12-04T05:36:38.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- 172.21.15.97:0/643582856 wait complete. 2023-12-04T05:36:38.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 Processor -- start 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.272+0000 7f4fd4017640 1 -- start start 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0725b0 0x7f4fcc1edab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc148be0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc155a60 con 0x7f4fcc0725b0 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc155710 con 0x7f4fcc1515e0 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48808/0 (socket says 172.21.15.97:48808) 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 -- 172.21.15.97:0/3818682479 learned_addr learned my addr 172.21.15.97:0/3818682479 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0725b0 0x7f4fcc1edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd25b4640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 -- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 msgr2=0x7f4fcc159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 -- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0725b0 msgr2=0x7f4fcc1edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0725b0 0x7f4fcc1edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 -- 172.21.15.97:0/3818682479 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009420 con 0x7f4fcc0aa830 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd15b2640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c730 tx=0x7f4fbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:38.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc005ae0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc005c40 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc1edff0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc007070 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc1526a0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc148d20 con 0x7f4fcc0aa830 2023-12-04T05:36:38.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.276+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4fbc0073e0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.280+0000 7f4fc27fc640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 0x7f4fb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:38.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.280+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fbc083e00 con 0x7f4fcc0aa830 2023-12-04T05:36:38.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.280+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 0x7f4fb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:38.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.280+0000 7f4fd1db3640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 0x7f4fb0068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80ad000 tx=0x7f4fc80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:38.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.284+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fcc148d20 con 0x7f4fcc0aa830 2023-12-04T05:36:38.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.432+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4fcc1edff0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fc27fc640 1 -- 172.21.15.97:0/3818682479 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4fcc1edff0 con 0x7f4fcc0aa830 2023-12-04T05:36:38.877 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 msgr2=0x7f4fb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 0x7f4fb0068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80ad000 tx=0x7f4fc80a6000 comp rx=0 tx=0).stop 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 msgr2=0x7f4fcc1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c730 tx=0x7f4fbc00cbf0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 shutdown_connections 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4fb00668d0 0x7f4fb0068d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fcc1515e0 0x7f4fcc159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4fcc0aa830 0x7f4fcc1549d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 --2- 172.21.15.97:0/3818682479 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fcc0725b0 0x7f4fcc1edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:38.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 >> 172.21.15.97:0/3818682479 conn(0x7f4fcc0c2a50 msgr2=0x7f4fcc14ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:38.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 shutdown_connections 2023-12-04T05:36:38.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:38.876+0000 7f4fd4017640 1 -- 172.21.15.97:0/3818682479 wait complete. 2023-12-04T05:36:38.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:36:39.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 Processor -- start 2023-12-04T05:36:39.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 -- start start 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0868154fe0 0x7f086815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0868154640 con 0x7f086814eb30 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086814ef10 con 0x7f086814f960 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.048+0000 7f086fdaa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680c0bd0 con 0x7f0868154fe0 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086db46640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f086814eb30 0x7f086814f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32934/0 (socket says 172.21.15.97:32934) 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086db46640 1 -- 172.21.15.97:0/914932607 learned_addr learned my addr 172.21.15.97:0/914932607 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 --2- 172.21.15.97:0/914932607 >> v2:172.21.15.143:3300/0 conn(0x7f0868154fe0 0x7f086815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724875410 0 0) 0x7f0868154640 con 0x7f086814eb30 2023-12-04T05:36:39.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003530 con 0x7f086814eb30 2023-12-04T05:36:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 534384428 0 0) 0x7f0854003530 con 0x7f086814eb30 2023-12-04T05:36:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 >> v2:172.21.15.143:3300/0 conn(0x7f0868154fe0 msgr2=0x7f086815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 --2- 172.21.15.97:0/914932607 >> v2:172.21.15.143:3300/0 conn(0x7f0868154fe0 0x7f086815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 >> v1:172.21.15.143:6789/0 conn(0x7f086814f960 legacy=0x7f08681548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08681535a0 con 0x7f086814eb30 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f0864001680 con 0x7f086814eb30 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 >> v1:172.21.15.97:6789/0 conn(0x7f086814eb30 legacy=0x7f086814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0854003980 0x7f0854003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f085400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c0bd0 con 0x7f0854005190 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c030 con 0x7f0854003980 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c1f0 con 0x7f08540047d0 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f085400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086db46640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0854003980 0x7f0854003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086d345640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 -- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08540047d0 msgr2=0x7f0854004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 -- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0854003980 msgr2=0x7f0854003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:39.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0854003980 0x7f0854003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086e347640 1 -- 172.21.15.97:0/914932607 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854003530 con 0x7f0854005190 2023-12-04T05:36:39.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.052+0000 7f086d345640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08540047d0 0x7f0854004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:39.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086e347640 1 -- 172.21.15.97:0/914932607 reap_dead start 2023-12-04T05:36:39.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086e347640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f085400b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0860010350 tx=0x7f086001eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef4f4566bfe929 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:39.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000b0d0 con 0x7f0854005190 2023-12-04T05:36:39.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860011040 con 0x7f0854005190 2023-12-04T05:36:39.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086cb44640 1 -- 172.21.15.97:0/914932607 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600039a0 con 0x7f0854005190 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 msgr2=0x7f085400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f085400b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0860010350 tx=0x7f086001eea0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- 172.21.15.97:0/914932607 shutdown_connections 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 --2- 172.21.15.97:0/914932607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f085400b990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- 172.21.15.97:0/914932607 >> 172.21.15.97:0/914932607 conn(0x7f08680c5e70 msgr2=0x7f08680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- 172.21.15.97:0/914932607 shutdown_connections 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- 172.21.15.97:0/914932607 wait complete. 2023-12-04T05:36:39.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 Processor -- start 2023-12-04T05:36:39.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.056+0000 7f086fdaa640 1 -- start start 2023-12-04T05:36:39.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08681419f0 0x7f086806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0868140ca0 0x7f0868141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681ea380 con 0x7f0854005190 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681ea660 con 0x7f08681419f0 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08681ea940 con 0x7f0868140ca0 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48834/0 (socket says 172.21.15.97:48834) 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 -- 172.21.15.97:0/1643565409 learned_addr learned my addr 172.21.15.97:0/1643565409 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086e347640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0868140ca0 0x7f0868141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086d345640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08681419f0 0x7f086806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 -- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0868140ca0 msgr2=0x7f0868141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0868140ca0 0x7f0868141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 -- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08681419f0 msgr2=0x7f086806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08681419f0 0x7f086806d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 -- 172.21.15.97:0/1643565409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08681eac20 con 0x7f0854005190 2023-12-04T05:36:39.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086db46640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0864007290 tx=0x7f0864007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400f9c0 con 0x7f0854005190 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400fb40 con 0x7f0854005190 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640133f0 con 0x7f0854005190 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086806dce0 con 0x7f0854005190 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08681ea030 con 0x7f0854005190 2023-12-04T05:36:39.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868150f80 con 0x7f0854005190 2023-12-04T05:36:39.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.060+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0864013550 con 0x7f0854005190 2023-12-04T05:36:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.064+0000 7f085e7fc640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 0x7f084c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:39.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.064+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0864084d70 con 0x7f0854005190 2023-12-04T05:36:39.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.064+0000 7f086d345640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 0x7f084c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:39.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.064+0000 7f086d345640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 0x7f084c068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f086806d2c0 tx=0x7f0858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:39.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.064+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0864052200 con 0x7f0854005190 2023-12-04T05:36:39.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.216+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0868150f80 con 0x7f0854005190 2023-12-04T05:36:39.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f085e7fc640 1 -- 172.21.15.97:0/1643565409 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0868150f80 con 0x7f0854005190 2023-12-04T05:36:39.886 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-12-04T05:36:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 msgr2=0x7f084c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 0x7f084c068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f086806d2c0 tx=0x7f0858009040 comp rx=0 tx=0).stop 2023-12-04T05:36:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 msgr2=0x7f0868141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:39.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0864007290 tx=0x7f0864007750 comp rx=0 tx=0).stop 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 shutdown_connections 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f084c0668d0 0x7f084c068d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0868140ca0 0x7f0868141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08681419f0 0x7f086806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.884+0000 7f086fdaa640 1 --2- 172.21.15.97:0/1643565409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0854005190 0x7f0868141f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.888+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 >> 172.21.15.97:0/1643565409 conn(0x7f08680c5e70 msgr2=0x7f086814f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:39.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.888+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 shutdown_connections 2023-12-04T05:36:39.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:39.888+0000 7f086fdaa640 1 -- 172.21.15.97:0/1643565409 wait complete. 2023-12-04T05:36:39.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T05:36:40.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 Processor -- start 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 -- start start 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc151f10 0x7f30dc0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30dc0cac10 0x7f30dc15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30dc0ca780 con 0x7f30dc0c7f00 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30dc158cc0 con 0x7f30dc0cac10 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30e1a17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0c5700 con 0x7f30dc151f10 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30dc0cac10 0x7f30dc15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f30dc0cac10 0x7f30dc15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48844/0 (socket says 172.21.15.97:48844) 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30d27fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f30dc0c7f00 0x7f30dc154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32944/0 (socket says 172.21.15.97:32944) 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 -- 172.21.15.97:0/3054868307 learned_addr learned my addr 172.21.15.97:0/3054868307 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30daffd640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc151f10 0x7f30dc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 -- 172.21.15.97:0/3054868307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc151f10 msgr2=0x7f30dc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:40.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc151f10 0x7f30dc0c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 -- 172.21.15.97:0/3054868307 >> v1:172.21.15.97:6789/0 conn(0x7f30dc0c7f00 legacy=0x7f30dc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.068+0000 7f30db7fe640 1 -- 172.21.15.97:0/3054868307 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc158720 con 0x7f30dc0cac10 2023-12-04T05:36:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30db7fe640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc15f0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009e50 tx=0x7f30d401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ca172afe466198 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30da7fc640 1 -- 172.21.15.97:0/3054868307 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40a5780 con 0x7f30dc0cac10 2023-12-04T05:36:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30da7fc640 1 -- 172.21.15.97:0/3054868307 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d40a58e0 con 0x7f30dc0cac10 2023-12-04T05:36:40.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30da7fc640 1 -- 172.21.15.97:0/3054868307 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40a5c70 con 0x7f30dc0cac10 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 -- 172.21.15.97:0/3054868307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 msgr2=0x7f30dc15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc15f0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009e50 tx=0x7f30d401c8c0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 -- 172.21.15.97:0/3054868307 shutdown_connections 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc15f0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 --2- 172.21.15.97:0/3054868307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc151f10 0x7f30dc0c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 -- 172.21.15.97:0/3054868307 >> 172.21.15.97:0/3054868307 conn(0x7f30dc073950 msgr2=0x7f30dc073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:40.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 -- 172.21.15.97:0/3054868307 shutdown_connections 2023-12-04T05:36:40.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.072+0000 7f30e1a17640 1 -- 172.21.15.97:0/3054868307 wait complete. 2023-12-04T05:36:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 Processor -- start 2023-12-04T05:36:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- start start 2023-12-04T05:36:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc0c7f00 0x7f30dc1ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30dc151f10 0x7f30dc0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0c1e80 con 0x7f30dc0cac10 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0c1270 con 0x7f30dc151f10 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0c1550 con 0x7f30dc0c7f00 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48854/0 (socket says 172.21.15.97:48854) 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 -- 172.21.15.97:0/2854624474 learned_addr learned my addr 172.21.15.97:0/2854624474 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30daffd640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc0c7f00 0x7f30dc1ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30db7fe640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30dc151f10 0x7f30dc0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 -- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc0c7f00 msgr2=0x7f30dc1ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc0c7f00 0x7f30dc1ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 -- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30dc151f10 msgr2=0x7f30dc0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30dc151f10 0x7f30dc0c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 -- 172.21.15.97:0/2854624474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4009b30 con 0x7f30dc0cac10 2023-12-04T05:36:40.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d27fc640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c490 tx=0x7f30c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007480 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c40075e0 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004a10 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc0c1830 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc0c0df0 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.076+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc068440 con 0x7f30dc0cac10 2023-12-04T05:36:40.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.080+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30c4004b70 con 0x7f30dc0cac10 2023-12-04T05:36:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.080+0000 7f30d8ff9640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 0x7f30bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.080+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f30c40835d0 con 0x7f30dc0cac10 2023-12-04T05:36:40.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.080+0000 7f30daffd640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 0x7f30bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:40.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.080+0000 7f30daffd640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 0x7f30bc068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0acb40 tx=0x7f30cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:40.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.084+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30c4050860 con 0x7f30dc0cac10 2023-12-04T05:36:40.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.268+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f30dc06c9c0 con 0x7f30dc0cac10 2023-12-04T05:36:40.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.964+0000 7f30d8ff9640 1 -- 172.21.15.97:0/2854624474 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f30c4053e80 con 0x7f30dc0cac10 2023-12-04T05:36:40.968 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 2 and data pool 3 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 msgr2=0x7f30bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 0x7f30bc068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0acb40 tx=0x7f30cc008040 comp rx=0 tx=0).stop 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 msgr2=0x7f30dc0c37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c490 tx=0x7f30c400c950 comp rx=0 tx=0).stop 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 shutdown_connections 2023-12-04T05:36:40.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30bc0668d0 0x7f30bc068d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30dc151f10 0x7f30dc0c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30dc0cac10 0x7f30dc0c37e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 --2- 172.21.15.97:0/2854624474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30dc0c7f00 0x7f30dc1ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 >> 172.21.15.97:0/2854624474 conn(0x7f30dc073950 msgr2=0x7f30dc14de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 shutdown_connections 2023-12-04T05:36:40.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:40.968+0000 7f30e1a17640 1 -- 172.21.15.97:0/2854624474 wait complete. 2023-12-04T05:36:40.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 Processor -- start 2023-12-04T05:36:41.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 -- start start 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4860151cb0 0x7f486006aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48600c4740 0x7f48600c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48600c4c50 0x7f4860157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48601550f0 con 0x7f48600c4740 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600c52b0 con 0x7f4860151cb0 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f4864b10640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c5590 con 0x7f48600c4c50 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48600c4740 0x7f48600c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f48600c4740 0x7f48600c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48860/0 (socket says 172.21.15.97:48860) 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 -- 172.21.15.97:0/1658199960 learned_addr learned my addr 172.21.15.97:0/1658199960 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485f7fe640 1 --2- 172.21.15.97:0/1658199960 >> v2:172.21.15.143:3300/0 conn(0x7f4860151cb0 0x7f486006aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485ffff640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48600c4c50 0x7f4860157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 -- 172.21.15.97:0/1658199960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48600c4c50 msgr2=0x7f4860157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48600c4c50 0x7f4860157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 -- 172.21.15.97:0/1658199960 >> v2:172.21.15.143:3300/0 conn(0x7f4860151cb0 msgr2=0x7f486006aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 --2- 172.21.15.97:0/1658199960 >> v2:172.21.15.143:3300/0 conn(0x7f4860151cb0 0x7f486006aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.132+0000 7f485effd640 1 -- 172.21.15.97:0/1658199960 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600c5870 con 0x7f48600c4740 2023-12-04T05:36:41.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f485effd640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4740 0x7f48600c5d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4860066d40 tx=0x7f485401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecbeb762070c988 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f485e7fc640 1 -- 172.21.15.97:0/1658199960 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ac620 con 0x7f48600c4740 2023-12-04T05:36:41.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f485e7fc640 1 -- 172.21.15.97:0/1658199960 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540ac780 con 0x7f48600c4740 2023-12-04T05:36:41.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f485e7fc640 1 -- 172.21.15.97:0/1658199960 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540acb10 con 0x7f48600c4740 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- 172.21.15.97:0/1658199960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4740 msgr2=0x7f48600c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4740 0x7f48600c5d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4860066d40 tx=0x7f485401c3e0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- 172.21.15.97:0/1658199960 shutdown_connections 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f48600c4c50 0x7f4860157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 --2- 172.21.15.97:0/1658199960 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4740 0x7f48600c5d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 --2- 172.21.15.97:0/1658199960 >> v2:172.21.15.143:3300/0 conn(0x7f4860151cb0 0x7f486006aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- 172.21.15.97:0/1658199960 >> 172.21.15.97:0/1658199960 conn(0x7f48600ab8b0 msgr2=0x7f48600abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:41.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- 172.21.15.97:0/1658199960 shutdown_connections 2023-12-04T05:36:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- 172.21.15.97:0/1658199960 wait complete. 2023-12-04T05:36:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 Processor -- start 2023-12-04T05:36:41.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.136+0000 7f4864b10640 1 -- start start 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48600c4740 0x7f4860156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4860151cb0 0x7f48601504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486014fac0 con 0x7f48600c4c50 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600bccf0 con 0x7f48600c4740 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48601ee2a0 con 0x7f4860151cb0 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48874/0 (socket says 172.21.15.97:48874) 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 -- 172.21.15.97:0/1515074146 learned_addr learned my addr 172.21.15.97:0/1515074146 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485ffff640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4860151cb0 0x7f48601504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485f7fe640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48600c4740 0x7f4860156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 -- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4860151cb0 msgr2=0x7f48601504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4860151cb0 0x7f48601504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 -- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48600c4740 msgr2=0x7f4860156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48600c4740 0x7f4860156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 -- 172.21.15.97:0/1515074146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540094d0 con 0x7f48600c4c50 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f485effd640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485401aa90 tx=0x7f4854019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ac620 con 0x7f48600c4c50 2023-12-04T05:36:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540b6440 con 0x7f48600c4c50 2023-12-04T05:36:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600bcfb0 con 0x7f48600c4c50 2023-12-04T05:36:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540b67d0 con 0x7f48600c4c50 2023-12-04T05:36:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4860156990 con 0x7f48600c4c50 2023-12-04T05:36:41.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.140+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486004e890 con 0x7f48600c4c50 2023-12-04T05:36:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.144+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f48540aa070 con 0x7f48600c4c50 2023-12-04T05:36:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.144+0000 7f4847fff640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 0x7f484c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.144+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f485411e870 con 0x7f48600c4c50 2023-12-04T05:36:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.144+0000 7f485f7fe640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 0x7f484c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.144+0000 7f485f7fe640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 0x7f484c068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48500079c0 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.148+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48540ebbe0 con 0x7f48600c4c50 2023-12-04T05:36:41.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.300+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4860154640 con 0x7f48600c4c50 2023-12-04T05:36:41.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.300+0000 7f4847fff640 1 -- 172.21.15.97:0/1515074146 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f48540ef200 con 0x7f48600c4c50 2023-12-04T05:36:41.302 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:41.302 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":19,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:40.271525+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 msgr2=0x7f484c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 0x7f484c068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f48500079c0 tx=0x7f4850008040 comp rx=0 tx=0).stop 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 msgr2=0x7f486014ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485401aa90 tx=0x7f4854019180 comp rx=0 tx=0).stop 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 shutdown_connections 2023-12-04T05:36:41.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f484c0668d0 0x7f484c068d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4860151cb0 0x7f48601504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48600c4c50 0x7f486014ffa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 --2- 172.21.15.97:0/1515074146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48600c4740 0x7f4860156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 >> 172.21.15.97:0/1515074146 conn(0x7f48600ab8b0 msgr2=0x7f48601533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 shutdown_connections 2023-12-04T05:36:41.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.304+0000 7f4864b10640 1 -- 172.21.15.97:0/1515074146 wait complete. 2023-12-04T05:36:41.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.456+0000 7f822a9aa640 1 Processor -- start 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.456+0000 7f822a9aa640 1 -- start start 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f822a9aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f822414fbb0 0x7f82240a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f822a9aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82240a9770 con 0x7f82240a8460 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f822a9aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8224071730 con 0x7f82240a88e0 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f822a9aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822414ff90 con 0x7f822414fbb0 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f82237fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f82240a8460 0x7f8224152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32946/0 (socket says 172.21.15.97:32946) 2023-12-04T05:36:41.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f82237fe640 1 -- 172.21.15.97:0/1571088444 learned_addr learned my addr 172.21.15.97:0/1571088444 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8223fff640 1 --2- 172.21.15.97:0/1571088444 >> v2:172.21.15.143:3300/0 conn(0x7f822414fbb0 0x7f82240a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962245403 0 0) 0x7f82240a9770 con 0x7f82240a8460 2023-12-04T05:36:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c003530 con 0x7f82240a8460 2023-12-04T05:36:41.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8223fff640 1 -- 172.21.15.97:0/1571088444 >> v1:172.21.15.143:6789/0 conn(0x7f82240a88e0 legacy=0x7f8224152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975415543 0 0) 0x7f8224071730 con 0x7f82240a88e0 2023-12-04T05:36:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8223fff640 1 -- 172.21.15.97:0/1571088444 >> v1:172.21.15.97:6789/0 conn(0x7f82240a8460 legacy=0x7f8224152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.460+0000 7f8223fff640 1 -- 172.21.15.97:0/1571088444 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224071a10 con 0x7f822414fbb0 2023-12-04T05:36:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f8223fff640 1 --2- 172.21.15.97:0/1571088444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240a8f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f82140097c0 tx=0x7f821401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b57271b805ecc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140ab600 con 0x7f822414fbb0 2023-12-04T05:36:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140a7050 con 0x7f822414fbb0 2023-12-04T05:36:41.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f8222ffd640 1 -- 172.21.15.97:0/1571088444 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140ab960 con 0x7f822414fbb0 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- 172.21.15.97:0/1571088444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 msgr2=0x7f82240a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 --2- 172.21.15.97:0/1571088444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240a8f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f82140097c0 tx=0x7f821401c360 comp rx=0 tx=0).stop 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- 172.21.15.97:0/1571088444 shutdown_connections 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 --2- 172.21.15.97:0/1571088444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240a8f20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- 172.21.15.97:0/1571088444 >> 172.21.15.97:0/1571088444 conn(0x7f82240c2970 msgr2=0x7f82240c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- 172.21.15.97:0/1571088444 shutdown_connections 2023-12-04T05:36:41.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- 172.21.15.97:0/1571088444 wait complete. 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 Processor -- start 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.464+0000 7f822a9aa640 1 -- start start 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82240a8460 0x7f82240bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822406df00 con 0x7f82240a88e0 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224153a20 con 0x7f822414fbb0 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8224153eb0 con 0x7f82240a8460 2023-12-04T05:36:41.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48882/0 (socket says 172.21.15.97:48882) 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 -- 172.21.15.97:0/793502519 learned_addr learned my addr 172.21.15.97:0/793502519 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8223fff640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82240a8460 0x7f82240bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8228f47640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 -- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82240a8460 msgr2=0x7f82240bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82240a8460 0x7f82240bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 -- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 msgr2=0x7f82240c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 -- 172.21.15.97:0/793502519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009420 con 0x7f82240a88e0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f82237fe640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f821800c3c0 tx=0x7f821800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218005cf0 con 0x7f82240a88e0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218005e50 con 0x7f82240a88e0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822406dc20 con 0x7f82240a88e0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180072f0 con 0x7f82240a88e0 2023-12-04T05:36:41.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8224155450 con 0x7f82240a88e0 2023-12-04T05:36:41.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8224154170 con 0x7f82240a88e0 2023-12-04T05:36:41.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.468+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8218007450 con 0x7f82240a88e0 2023-12-04T05:36:41.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.472+0000 7f8220ff9640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 0x7f8210068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.472+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82180839a0 con 0x7f82240a88e0 2023-12-04T05:36:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.472+0000 7f8223fff640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 0x7f8210068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.472+0000 7f8223fff640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 0x7f8210068dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82140ad000 tx=0x7f82140a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.476+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8224154170 con 0x7f82240a88e0 2023-12-04T05:36:41.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.624+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8224154170 con 0x7f82240a88e0 2023-12-04T05:36:41.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.624+0000 7f8220ff9640 1 -- 172.21.15.97:0/793502519 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f8224154170 con 0x7f82240a88e0 2023-12-04T05:36:41.628 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:41.628 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":19,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:40.271525+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 msgr2=0x7f8210068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 0x7f8210068dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82140ad000 tx=0x7f82140a6000 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 msgr2=0x7f822406bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f821800c3c0 tx=0x7f821800c880 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 shutdown_connections 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8210066900 0x7f8210068dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f822414fbb0 0x7f82240c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82240a88e0 0x7f822406bf00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 --2- 172.21.15.97:0/793502519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82240a8460 0x7f82240bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 >> 172.21.15.97:0/793502519 conn(0x7f82240c2970 msgr2=0x7f82240aade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 shutdown_connections 2023-12-04T05:36:41.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.628+0000 7f822a9aa640 1 -- 172.21.15.97:0/793502519 wait complete. 2023-12-04T05:36:41.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T05:36:41.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 Processor -- start 2023-12-04T05:36:41.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 -- start start 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2a41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa2a406d210 0x7fa2a406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40aa240 con 0x7fa2a406c440 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a406c0c0 con 0x7fa2a406d210 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2ab4d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40aa500 con 0x7fa2a40c1e70 2023-12-04T05:36:41.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a8a71640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa2a406c440 0x7fa2a40a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32952/0 (socket says 172.21.15.97:32952) 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a8a71640 1 -- 172.21.15.97:0/1693341957 learned_addr learned my addr 172.21.15.97:0/1693341957 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9a73640 1 --2- 172.21.15.97:0/1693341957 >> v2:172.21.15.143:3300/0 conn(0x7fa2a406d210 0x7fa2a406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2a41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262203342 0 0) 0x7fa2a40aa240 con 0x7fa2a406c440 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa290003530 con 0x7fa2a406c440 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101357511 0 0) 0x7fa290003530 con 0x7fa2a406c440 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 msgr2=0x7fa2a41524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2a41524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 >> v2:172.21.15.143:3300/0 conn(0x7fa2a406d210 msgr2=0x7fa2a406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 --2- 172.21.15.97:0/1693341957 >> v2:172.21.15.143:3300/0 conn(0x7fa2a406d210 0x7fa2a406d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40aa7e0 con 0x7fa2a406c440 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fa294001680 con 0x7fa2a406c440 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 >> v1:172.21.15.97:6789/0 conn(0x7fa2a406c440 legacy=0x7fa2a40a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa290003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa290004d10 0x7fa290005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a406c0c0 con 0x7fa290003980 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40aa500 con 0x7fa290004d10 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29000fda0 con 0x7fa2a40c1e70 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa290003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9a73640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa290004d10 0x7fa290005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 -- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 msgr2=0x7fa2900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 -- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa290004d10 msgr2=0x7fa290005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa290004d10 0x7fa290005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a9272640 1 -- 172.21.15.97:0/1693341957 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290003530 con 0x7fa290003980 2023-12-04T05:36:41.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.788+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a40c1e70 0x7fa2900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa290003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009ae0 tx=0x7fa2a001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c094b708c4a997fc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00a5610 con 0x7fa290003980 2023-12-04T05:36:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00a5770 con 0x7fa290003980 2023-12-04T05:36:41.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa29bfff640 1 -- 172.21.15.97:0/1693341957 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00a5b20 con 0x7fa290003980 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1693341957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 msgr2=0x7fa290003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1693341957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa290003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009ae0 tx=0x7fa2a001ca20 comp rx=0 tx=0).stop 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2a9a73640 1 -- 172.21.15.97:0/1693341957 reap_dead start 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1693341957 shutdown_connections 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1693341957 >> 172.21.15.97:0/1693341957 conn(0x7fa2a40c5e70 msgr2=0x7fa2a40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1693341957 shutdown_connections 2023-12-04T05:36:41.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.792+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1693341957 wait complete. 2023-12-04T05:36:41.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 Processor -- start 2023-12-04T05:36:41.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- start start 2023-12-04T05:36:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 0x7fa2a41ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2a40c5970 0x7fa2a41ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a413d240 con 0x7fa290003980 2023-12-04T05:36:41.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a41e0a20 con 0x7fa2a40c5970 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a41dee50 con 0x7fa2a41dff10 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48904/0 (socket says 172.21.15.97:48904) 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 -- 172.21.15.97:0/1061162846 learned_addr learned my addr 172.21.15.97:0/1061162846 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 0x7fa2a41ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9a73640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2a40c5970 0x7fa2a41ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 -- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 msgr2=0x7fa2a41ec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 0x7fa2a41ec700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 -- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2a40c5970 msgr2=0x7fa2a41ecc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2a40c5970 0x7fa2a41ecc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:41.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 -- 172.21.15.97:0/1061162846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a41ed180 con 0x7fa290003980 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 0x7fa2a41ec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2a9272640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009ae0 tx=0x7fa290005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0004020 con 0x7fa290003980 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a0004180 con 0x7fa290003980 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a41ddfd0 con 0x7fa290003980 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00044f0 con 0x7fa290003980 2023-12-04T05:36:41.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.796+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a41e0740 con 0x7fa290003980 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4142460 con 0x7fa290003980 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2a00b4040 con 0x7fa290003980 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa299ffb640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2a011e470 con 0x7fa290003980 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:41.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.800+0000 7fa2a8a71640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 0x7fa288068dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4146900 tx=0x7fa294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:41.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.804+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2a00eb750 con 0x7fa290003980 2023-12-04T05:36:41.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:41.996+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa2a4068440 con 0x7fa290003980 2023-12-04T05:36:42.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.980+0000 7fa299ffb640 1 -- 172.21.15.97:0/1061162846 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa2a00eed70 con 0x7fa290003980 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 msgr2=0x7fa288068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 0x7fa288068dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4146900 tx=0x7fa294009040 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 msgr2=0x7fa2a4151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009ae0 tx=0x7fa290005800 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 shutdown_connections 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa288066900 0x7fa288068dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2a40c5970 0x7fa2a41ecc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2a41dff10 0x7fa2a41ec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 --2- 172.21.15.97:0/1061162846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa290003980 0x7fa2a4151480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:42.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 >> 172.21.15.97:0/1061162846 conn(0x7fa2a40c5e70 msgr2=0x7fa2a40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 shutdown_connections 2023-12-04T05:36:42.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:42.984+0000 7fa2ab4d6640 1 -- 172.21.15.97:0/1061162846 wait complete. 2023-12-04T05:36:43.009 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:36:43.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T05:36:43.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.152+0000 7fb0fa46b640 1 Processor -- start 2023-12-04T05:36:43.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.152+0000 7fb0fa46b640 1 -- start start 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0fa46b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb0f40c1fb0 0x7fb0f40c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0fa46b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f4158800 0x7fb0f406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0fa46b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f4154880 con 0x7fb0f4072800 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0fa46b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4158c90 con 0x7fb0f4158800 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0fa46b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f406e160 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f4158800 0x7fb0f406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f4158800 0x7fb0f406b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48906/0 (socket says 172.21.15.97:48906) 2023-12-04T05:36:43.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 -- 172.21.15.97:0/1890558878 learned_addr learned my addr 172.21.15.97:0/1890558878 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:43.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/1890558878 >> v2:172.21.15.143:3300/0 conn(0x7fb0f40c1fb0 0x7fb0f40c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 -- 172.21.15.97:0/1890558878 >> v2:172.21.15.143:3300/0 conn(0x7fb0f40c1fb0 msgr2=0x7fb0f40c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:43.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 --2- 172.21.15.97:0/1890558878 >> v2:172.21.15.143:3300/0 conn(0x7fb0f40c1fb0 0x7fb0f40c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 -- 172.21.15.97:0/1890558878 >> v1:172.21.15.143:6789/0 conn(0x7fb0f4072800 legacy=0x7fb0f4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:43.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 -- 172.21.15.97:0/1890558878 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f406e440 con 0x7fb0f4158800 2023-12-04T05:36:43.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.156+0000 7fb0f8a08640 1 --2- 172.21.15.97:0/1890558878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f4158800 0x7fb0f406b600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40ac220 tx=0x7fb0ec01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3252d406ef1dea server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:43.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/1890558878 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5700 con 0x7fb0f4158800 2023-12-04T05:36:43.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/1890558878 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0a5860 con 0x7fb0f4158800 2023-12-04T05:36:43.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/1890558878 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5bf0 con 0x7fb0f4158800 2023-12-04T05:36:43.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1890558878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f4158800 msgr2=0x7fb0f406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:43.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1890558878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f4158800 0x7fb0f406b600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40ac220 tx=0x7fb0ec01c840 comp rx=0 tx=0).stop 2023-12-04T05:36:43.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1890558878 shutdown_connections 2023-12-04T05:36:43.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1890558878 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f4158800 0x7fb0f406b600 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1890558878 >> v2:172.21.15.143:3300/0 conn(0x7fb0f40c1fb0 0x7fb0f40c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1890558878 >> 172.21.15.97:0/1890558878 conn(0x7fb0f40c31c0 msgr2=0x7fb0f40c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1890558878 shutdown_connections 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1890558878 wait complete. 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 Processor -- start 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- start start 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f4072800 0x7fb0f4147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4158800 0x7fb0f4156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40aaeb0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40aa8f0 con 0x7fb0f4072800 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0fa46b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40aabd0 con 0x7fb0f4158800 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48916/0 (socket says 172.21.15.97:48916) 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f37fe640 1 -- 172.21.15.97:0/1730422315 learned_addr learned my addr 172.21.15.97:0/1730422315 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f4072800 0x7fb0f4147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.160+0000 7fb0f8a08640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4158800 0x7fb0f4156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 -- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4158800 msgr2=0x7fb0f4156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4158800 0x7fb0f4156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 -- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f4072800 msgr2=0x7fb0f4147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f4072800 0x7fb0f4147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 -- 172.21.15.97:0/1730422315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009b30 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800b410 tx=0x7fb0e800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8004020 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8004180 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011630 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f40ab5c0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4156a80 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40abae0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb0e8011790 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 0x7fb0e0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:43.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e8083ff0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.164+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 0x7fb0e0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:43.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.168+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 0x7fb0e0068dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4151980 tx=0x7fb0e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:43.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.168+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0f40abae0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.352+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb0f40abae0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.983+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/1730422315 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0f40abae0 con 0x7fb0f40c1fb0 2023-12-04T05:36:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 msgr2=0x7fb0e0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 0x7fb0e0068dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4151980 tx=0x7fb0e4008040 comp rx=0 tx=0).stop 2023-12-04T05:36:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 msgr2=0x7fb0f41578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800b410 tx=0x7fb0e800b8d0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 shutdown_connections 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0e0066900 0x7fb0e0068dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4158800 0x7fb0f4156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1fb0 0x7fb0f41578f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 --2- 172.21.15.97:0/1730422315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f4072800 0x7fb0f4147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 >> 172.21.15.97:0/1730422315 conn(0x7fb0f40c31c0 msgr2=0x7fb0f414b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 shutdown_connections 2023-12-04T05:36:43.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:43.987+0000 7fb0fa46b640 1 -- 172.21.15.97:0/1730422315 wait complete. 2023-12-04T05:36:44.009 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T05:36:44.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:44.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.143+0000 7fcccfb1d640 1 Processor -- start 2023-12-04T05:36:44.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.143+0000 7fcccfb1d640 1 -- start start 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fccc8151bf0 0x7fccc80abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc80c7ef0 0x7fccc8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc8158630 0x7fccc81551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc81547d0 con 0x7fccc80c7ef0 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc8158b80 con 0x7fccc8151bf0 2023-12-04T05:36:44.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccfb1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80c4aa0 con 0x7fccc8158630 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc80c7ef0 0x7fccc8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fccc80c7ef0 0x7fccc8154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48920/0 (socket says 172.21.15.97:48920) 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 -- 172.21.15.97:0/1354420917 learned_addr learned my addr 172.21.15.97:0/1354420917 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd8b9640 1 --2- 172.21.15.97:0/1354420917 >> v2:172.21.15.143:3300/0 conn(0x7fccc8151bf0 0x7fccc80abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fccce0ba640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc8158630 0x7fccc81551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 -- 172.21.15.97:0/1354420917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc8158630 msgr2=0x7fccc81551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc8158630 0x7fccc81551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 -- 172.21.15.97:0/1354420917 >> v2:172.21.15.143:3300/0 conn(0x7fccc8151bf0 msgr2=0x7fccc80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 --2- 172.21.15.97:0/1354420917 >> v2:172.21.15.143:3300/0 conn(0x7fccc8151bf0 0x7fccc80abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.147+0000 7fcccd0b8640 1 -- 172.21.15.97:0/1354420917 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80c4d40 con 0x7fccc80c7ef0 2023-12-04T05:36:44.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccd0b8640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80c7ef0 0x7fccc8154c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccc80b01e0 tx=0x7fccb801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1e988132e5dda6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccc8b7640 1 -- 172.21.15.97:0/1354420917 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb80a48c0 con 0x7fccc80c7ef0 2023-12-04T05:36:44.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccc8b7640 1 -- 172.21.15.97:0/1354420917 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb80a4a20 con 0x7fccc80c7ef0 2023-12-04T05:36:44.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccc8b7640 1 -- 172.21.15.97:0/1354420917 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb80a4db0 con 0x7fccc80c7ef0 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1354420917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80c7ef0 msgr2=0x7fccc8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80c7ef0 0x7fccc8154c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccc80b01e0 tx=0x7fccb801c0c0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1354420917 shutdown_connections 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc8158630 0x7fccc81551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1354420917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc80c7ef0 0x7fccc8154c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1354420917 >> v2:172.21.15.143:3300/0 conn(0x7fccc8151bf0 0x7fccc80abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1354420917 >> 172.21.15.97:0/1354420917 conn(0x7fccc8073550 msgr2=0x7fccc8073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:44.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1354420917 shutdown_connections 2023-12-04T05:36:44.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1354420917 wait complete. 2023-12-04T05:36:44.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 Processor -- start 2023-12-04T05:36:44.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.151+0000 7fcccfb1d640 1 -- start start 2023-12-04T05:36:44.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc80c7ef0 0x7fccc80c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc8151bf0 0x7fccc80c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc814eda0 con 0x7fccc8158630 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc81eeb90 con 0x7fccc8151bf0 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80c3660 con 0x7fccc80c7ef0 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48934/0 (socket says 172.21.15.97:48934) 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 -- 172.21.15.97:0/1860293613 learned_addr learned my addr 172.21.15.97:0/1860293613 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccd8b9640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc80c7ef0 0x7fccc80c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccd0b8640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc8151bf0 0x7fccc80c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 -- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc80c7ef0 msgr2=0x7fccc80c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc80c7ef0 0x7fccc80c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 -- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc8151bf0 msgr2=0x7fccc80c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc8151bf0 0x7fccc80c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 -- 172.21.15.97:0/1860293613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb80094d0 con 0x7fccc8158630 2023-12-04T05:36:44.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccce0ba640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009dd0 tx=0x7fccc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0014480 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000f040 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc81ef0c0 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0014840 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc81eede0 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc814ef10 con 0x7fccc8158630 2023-12-04T05:36:44.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.155+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fccc00149a0 con 0x7fccc8158630 2023-12-04T05:36:44.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.159+0000 7fccbe7fc640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 0x7fccac068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.159+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccc0084da0 con 0x7fccc8158630 2023-12-04T05:36:44.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.159+0000 7fcccd8b9640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 0x7fccac068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.159+0000 7fcccd8b9640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 0x7fccac068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009ac0 tx=0x7fccc4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.163+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccc814ef10 con 0x7fccc8158630 2023-12-04T05:36:44.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc814eee0 con 0x7fccc8158630 2023-12-04T05:36:44.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fccbe7fc640 1 -- 172.21.15.97:0/1860293613 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fccc0018090 con 0x7fccc8158630 2023-12-04T05:36:44.346 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:44.346 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:36:44.346 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:36:44.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 msgr2=0x7fccac068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 0x7fccac068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009ac0 tx=0x7fccc4009190 comp rx=0 tx=0).stop 2023-12-04T05:36:44.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 msgr2=0x7fccc814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009dd0 tx=0x7fccc000c490 comp rx=0 tx=0).stop 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 shutdown_connections 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fccac066900 0x7fccac068dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc8158630 0x7fccc814a790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc8151bf0 0x7fccc80c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 --2- 172.21.15.97:0/1860293613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc80c7ef0 0x7fccc80c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 >> 172.21.15.97:0/1860293613 conn(0x7fccc8073550 msgr2=0x7fccc80bfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 shutdown_connections 2023-12-04T05:36:44.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.343+0000 7fcccfb1d640 1 -- 172.21.15.97:0/1860293613 wait complete. 2023-12-04T05:36:44.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:44.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.499+0000 7f6f41580640 1 Processor -- start 2023-12-04T05:36:44.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.499+0000 7f6f41580640 1 -- start start 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f41580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f41580640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c1547d0 con 0x7f6f3c155370 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f41580640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c158b80 con 0x7f6f3c0c7ef0 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f41580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c4aa0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49720/0 (socket says 172.21.15.97:49720) 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 -- 172.21.15.97:0/3827869621 learned_addr learned my addr 172.21.15.97:0/3827869621 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3b7fe640 1 --1- 172.21.15.97:0/3827869621 >> v1:172.21.15.97:6789/0 conn(0x7f6f3c155370 0x7f6f3c15efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41648/0 (socket says 172.21.15.97:41648) 2023-12-04T05:36:44.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 -- 172.21.15.97:0/3827869621 >> v1:172.21.15.143:6789/0 conn(0x7f6f3c0c7ef0 legacy=0x7f6f3c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 -- 172.21.15.97:0/3827869621 >> v1:172.21.15.97:6789/0 conn(0x7f6f3c155370 legacy=0x7f6f3c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3affd640 1 -- 172.21.15.97:0/3827869621 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0c4d40 con 0x7f6f3c151bf0 2023-12-04T05:36:44.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.503+0000 7f6f3a7fc640 1 -- 172.21.15.97:0/3827869621 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667449154 0 0) 0x7f6f3c1547d0 con 0x7f6f3c155370 2023-12-04T05:36:44.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f3affd640 1 --2- 172.21.15.97:0/3827869621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009870 tx=0x7f6f2c01c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfdc6a91e053d6c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f3a7fc640 1 -- 172.21.15.97:0/3827869621 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0a4940 con 0x7f6f3c151bf0 2023-12-04T05:36:44.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f3a7fc640 1 -- 172.21.15.97:0/3827869621 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0a4aa0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f3a7fc640 1 -- 172.21.15.97:0/3827869621 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0a4e30 con 0x7f6f3c151bf0 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- 172.21.15.97:0/3827869621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 msgr2=0x7f6f3c0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 --2- 172.21.15.97:0/3827869621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009870 tx=0x7f6f2c01c100 comp rx=0 tx=0).stop 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- 172.21.15.97:0/3827869621 shutdown_connections 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 --2- 172.21.15.97:0/3827869621 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c0abbb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- 172.21.15.97:0/3827869621 >> 172.21.15.97:0/3827869621 conn(0x7f6f3c073550 msgr2=0x7f6f3c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:44.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- 172.21.15.97:0/3827869621 shutdown_connections 2023-12-04T05:36:44.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- 172.21.15.97:0/3827869621 wait complete. 2023-12-04T05:36:44.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 Processor -- start 2023-12-04T05:36:44.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.507+0000 7f6f41580640 1 -- start start 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 0x7f6f3c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c155370 0x7f6f3c1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c14b0b0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c14f060 con 0x7f6f3c155370 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c149010 con 0x7f6f3c0c7ef0 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49732/0 (socket says 172.21.15.97:49732) 2023-12-04T05:36:44.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 -- 172.21.15.97:0/15134337 learned_addr learned my addr 172.21.15.97:0/15134337 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f3affd640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 0x7f6f3c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f3b7fe640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c155370 0x7f6f3c1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 -- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 msgr2=0x7f6f3c14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 0x7f6f3c14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 -- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c155370 msgr2=0x7f6f3c1f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c155370 0x7f6f3c1f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 -- 172.21.15.97:0/15134337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0094d0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f3affd640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 0x7f6f3c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f327fc640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c4d0 tx=0x7f6f2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240052d0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24005430 con 0x7f6f3c151bf0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c1492f0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24012830 con 0x7f6f3c151bf0 2023-12-04T05:36:44.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c14acd0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c14b1f0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.511+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6f24012990 con 0x7f6f3c151bf0 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.515+0000 7f6f33fff640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 0x7f6f1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.515+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f24083fb0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.515+0000 7f6f3affd640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 0x7f6f1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.515+0000 7f6f3affd640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 0x7f6f1c068d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0ae000 tx=0x7f6f2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.519+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f3c14b1f0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.667+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f3c14b1f0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.667+0000 7f6f33fff640 1 -- 172.21.15.97:0/15134337 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f6f3c14b1f0 con 0x7f6f3c151bf0 2023-12-04T05:36:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:44.742 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:44.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 msgr2=0x7f6f1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 0x7f6f1c068d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0ae000 tx=0x7f6f2c008040 comp rx=0 tx=0).stop 2023-12-04T05:36:44.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 msgr2=0x7f6f3c146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c4d0 tx=0x7f6f2400c990 comp rx=0 tx=0).stop 2023-12-04T05:36:44.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 shutdown_connections 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6f1c0668d0 0x7f6f1c068d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c155370 0x7f6f3c1f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f3c151bf0 0x7f6f3c146b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 --2- 172.21.15.97:0/15134337 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0c7ef0 0x7f6f3c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 >> 172.21.15.97:0/15134337 conn(0x7f6f3c073550 msgr2=0x7f6f3c073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 shutdown_connections 2023-12-04T05:36:44.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.671+0000 7f6f41580640 1 -- 172.21.15.97:0/15134337 wait complete. 2023-12-04T05:36:44.745 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:36:44.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:36:44.868 INFO:tasks.ceph.mds.b.smithi143.stderr:2023-12-04T05:36:44.866+0000 7f99e75d7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:36:44.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.879+0000 7f4882f8d640 1 Processor -- start 2023-12-04T05:36:44.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.879+0000 7f4882f8d640 1 -- start start 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4882f8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 0x7f487c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4882f8d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0739b0 con 0x7f487c06b860 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4882f8d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c155710 con 0x7f487c0c1030 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4882f8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0c15a0 con 0x7f487c0c2a00 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4880d29640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f487c06b860 0x7f487c151b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41654/0 (socket says 172.21.15.97:41654) 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f4880d29640 1 -- 172.21.15.97:0/2348315440 learned_addr learned my addr 172.21.15.97:0/2348315440 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:44.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f488152a640 1 --2- 172.21.15.97:0/2348315440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 0x7f487c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271212482 0 0) 0x7f487c0739b0 con 0x7f487c06b860 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4864003530 con 0x7f487c06b860 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151225819 0 0) 0x7f487c155710 con 0x7f487c0c1030 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f487c0739b0 con 0x7f487c0c1030 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f488152a640 1 -- 172.21.15.97:0/2348315440 >> v1:172.21.15.143:6789/0 conn(0x7f487c0c1030 legacy=0x7f487c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f488152a640 1 -- 172.21.15.97:0/2348315440 >> v1:172.21.15.97:6789/0 conn(0x7f487c06b860 legacy=0x7f487c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.883+0000 7f488152a640 1 -- 172.21.15.97:0/2348315440 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c073680 con 0x7f487c0c2a00 2023-12-04T05:36:44.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f488152a640 1 --2- 172.21.15.97:0/2348315440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 0x7f487c1584b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4874009dc0 tx=0x7f487401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780036204bc40a3b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740a58b0 con 0x7f487c0c2a00 2023-12-04T05:36:44.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740a5a10 con 0x7f487c0c2a00 2023-12-04T05:36:44.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f48737fe640 1 -- 172.21.15.97:0/2348315440 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740a5da0 con 0x7f487c0c2a00 2023-12-04T05:36:44.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- 172.21.15.97:0/2348315440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 msgr2=0x7f487c1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 --2- 172.21.15.97:0/2348315440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 0x7f487c1584b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4874009dc0 tx=0x7f487401c8e0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- 172.21.15.97:0/2348315440 shutdown_connections 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 --2- 172.21.15.97:0/2348315440 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c0c2a00 0x7f487c1584b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- 172.21.15.97:0/2348315440 >> 172.21.15.97:0/2348315440 conn(0x7f487c0c3130 msgr2=0x7f487c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- 172.21.15.97:0/2348315440 shutdown_connections 2023-12-04T05:36:44.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- 172.21.15.97:0/2348315440 wait complete. 2023-12-04T05:36:44.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 Processor -- start 2023-12-04T05:36:44.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.887+0000 7f4882f8d640 1 -- start start 2023-12-04T05:36:44.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c06b860 0x7f487c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 0x7f487c147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1ec7e0 con 0x7f487c0c2a00 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14c810 con 0x7f487c0c1030 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c1f0ca0 con 0x7f487c06b860 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49738/0 (socket says 172.21.15.97:49738) 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 -- 172.21.15.97:0/264439608 learned_addr learned my addr 172.21.15.97:0/264439608 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4880d29640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c06b860 0x7f487c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4873fff640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 0x7f487c147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 -- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c06b860 msgr2=0x7f487c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c06b860 0x7f487c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 -- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 msgr2=0x7f487c147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 0x7f487c147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 -- 172.21.15.97:0/264439608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009a70 con 0x7f487c0c2a00 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4873fff640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 0x7f487c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f488152a640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f487401a510 tx=0x7f4874019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740b9650 con 0x7f487c0c2a00 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740b97b0 con 0x7f487c0c2a00 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740b9b40 con 0x7f487c0c2a00 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c148530 con 0x7f487c0c2a00 2023-12-04T05:36:44.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c1f0400 con 0x7f487c0c2a00 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c1ec920 con 0x7f487c0c2a00 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.891+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f48740b9ca0 con 0x7f487c0c2a00 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.895+0000 7f48717fa640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 0x7f4868068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.895+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f487411f5d0 con 0x7f487c0c2a00 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.895+0000 7f4880d29640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 0x7f4868068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:44.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.895+0000 7f4880d29640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 0x7f4868068d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fd0 tx=0x7f4878007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:44.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:44.899+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48740ec800 con 0x7f487c0c2a00 2023-12-04T05:36:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.047+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f487c06bc40 con 0x7f48680668d0 2023-12-04T05:36:45.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.055+0000 7f48717fa640 1 -- 172.21.15.97:0/264439608 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264649 (secure 0 0 0) 0x7f4878001510 con 0x7f48680668d0 2023-12-04T05:36:45.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:45.063 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 msgr2=0x7f4868068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 0x7f4868068d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fd0 tx=0x7f4878007d80 comp rx=0 tx=0).stop 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 msgr2=0x7f487c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f487401a510 tx=0x7f4874019680 comp rx=0 tx=0).stop 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 shutdown_connections 2023-12-04T05:36:45.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48680668d0 0x7f4868068d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f487c0c2a00 0x7f487c147ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f487c0c1030 0x7f487c147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 --2- 172.21.15.97:0/264439608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f487c06b860 0x7f487c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 >> 172.21.15.97:0/264439608 conn(0x7f487c0c3130 msgr2=0x7f487c0c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 shutdown_connections 2023-12-04T05:36:45.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.059+0000 7f4882f8d640 1 -- 172.21.15.97:0/264439608 wait complete. 2023-12-04T05:36:45.081 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-04T05:36:44.191916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2830336,"data_stored":1721336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.313425"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929075+0000","last_change":"2023-12-04T05:36:40.924610+0000","last_active":"2023-12-04T05:36:40.929075+0000","last_peered":"2023-12-04T05:36:40.929075+0000","last_clean":"2023-12-04T05:36:40.929075+0000","last_became_active":"2023-12-04T05:36:40.924042+0000","last_became_peered":"2023-12-04T05:36:40.924042+0000","last_unstale":"2023-12-04T05:36:40.929075+0000","last_undegraded":"2023-12-04T05:36:40.929075+0000","last_fullsized":"2023-12-04T05:36:40.929075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894819+0000","last_change":"2023-12-04T05:36:40.915527+0000","last_active":"2023-12-04T05:36:41.894819+0000","last_peered":"2023-12-04T05:36:41.894819+0000","last_clean":"2023-12-04T05:36:41.894819+0000","last_became_active":"2023-12-04T05:36:40.915173+0000","last_became_peered":"2023-12-04T05:36:40.915173+0000","last_unstale":"2023-12-04T05:36:41.894819+0000","last_undegraded":"2023-12-04T05:36:41.894819+0000","last_fullsized":"2023-12-04T05:36:41.894819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915392+0000","last_change":"2023-12-04T05:36:40.913206+0000","last_active":"2023-12-04T05:36:40.915392+0000","last_peered":"2023-12-04T05:36:40.915392+0000","last_clean":"2023-12-04T05:36:40.915392+0000","last_became_active":"2023-12-04T05:36:40.912745+0000","last_became_peered":"2023-12-04T05:36:40.912745+0000","last_unstale":"2023-12-04T05:36:40.915392+0000","last_undegraded":"2023-12-04T05:36:40.915392+0000","last_fullsized":"2023-12-04T05:36:40.915392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929244+0000","last_change":"2023-12-04T05:36:40.922261+0000","last_active":"2023-12-04T05:36:40.929244+0000","last_peered":"2023-12-04T05:36:40.929244+0000","last_clean":"2023-12-04T05:36:40.929244+0000","last_became_active":"2023-12-04T05:36:40.920113+0000","last_became_peered":"2023-12-04T05:36:40.920113+0000","last_unstale":"2023-12-04T05:36:40.929244+0000","last_undegraded":"2023-12-04T05:36:40.929244+0000","last_fullsized":"2023-12-04T05:36:40.929244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929088+0000","last_change":"2023-12-04T05:36:40.919483+0000","last_active":"2023-12-04T05:36:40.929088+0000","last_peered":"2023-12-04T05:36:40.929088+0000","last_clean":"2023-12-04T05:36:40.929088+0000","last_became_active":"2023-12-04T05:36:40.919062+0000","last_became_peered":"2023-12-04T05:36:40.919062+0000","last_unstale":"2023-12-04T05:36:40.929088+0000","last_undegraded":"2023-12-04T05:36:40.929088+0000","last_fullsized":"2023-12-04T05:36:40.929088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925897+0000","last_change":"2023-12-04T05:36:40.918746+0000","last_active":"2023-12-04T05:36:40.925897+0000","last_peered":"2023-12-04T05:36:40.925897+0000","last_clean":"2023-12-04T05:36:40.925897+0000","last_became_active":"2023-12-04T05:36:40.918449+0000","last_became_peered":"2023-12-04T05:36:40.918449+0000","last_unstale":"2023-12-04T05:36:40.925897+0000","last_undegraded":"2023-12-04T05:36:40.925897+0000","last_fullsized":"2023-12-04T05:36:40.925897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923592+0000","last_change":"2023-12-04T05:36:40.917608+0000","last_active":"2023-12-04T05:36:40.923592+0000","last_peered":"2023-12-04T05:36:40.923592+0000","last_clean":"2023-12-04T05:36:40.923592+0000","last_became_active":"2023-12-04T05:36:40.917298+0000","last_became_peered":"2023-12-04T05:36:40.917298+0000","last_unstale":"2023-12-04T05:36:40.923592+0000","last_undegraded":"2023-12-04T05:36:40.923592+0000","last_fullsized":"2023-12-04T05:36:40.923592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:21.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928031+0000","last_change":"2023-12-04T05:36:40.925544+0000","last_active":"2023-12-04T05:36:40.928031+0000","last_peered":"2023-12-04T05:36:40.928031+0000","last_clean":"2023-12-04T05:36:40.928031+0000","last_became_active":"2023-12-04T05:36:40.925230+0000","last_became_peered":"2023-12-04T05:36:40.925230+0000","last_unstale":"2023-12-04T05:36:40.928031+0000","last_undegraded":"2023-12-04T05:36:40.928031+0000","last_fullsized":"2023-12-04T05:36:40.928031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929096+0000","last_change":"2023-12-04T05:36:40.924730+0000","last_active":"2023-12-04T05:36:40.929096+0000","last_peered":"2023-12-04T05:36:40.929096+0000","last_clean":"2023-12-04T05:36:40.929096+0000","last_became_active":"2023-12-04T05:36:40.924315+0000","last_became_peered":"2023-12-04T05:36:40.924315+0000","last_unstale":"2023-12-04T05:36:40.929096+0000","last_undegraded":"2023-12-04T05:36:40.929096+0000","last_fullsized":"2023-12-04T05:36:40.929096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897856+0000","last_change":"2023-12-04T05:36:40.919533+0000","last_active":"2023-12-04T05:36:41.897856+0000","last_peered":"2023-12-04T05:36:41.897856+0000","last_clean":"2023-12-04T05:36:41.897856+0000","last_became_active":"2023-12-04T05:36:40.919231+0000","last_became_peered":"2023-12-04T05:36:40.919231+0000","last_unstale":"2023-12-04T05:36:41.897856+0000","last_undegraded":"2023-12-04T05:36:41.897856+0000","last_fullsized":"2023-12-04T05:36:41.897856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897623+0000","last_change":"2023-12-04T05:36:40.926975+0000","last_active":"2023-12-04T05:36:41.897623+0000","last_peered":"2023-12-04T05:36:41.897623+0000","last_clean":"2023-12-04T05:36:41.897623+0000","last_became_active":"2023-12-04T05:36:40.926698+0000","last_became_peered":"2023-12-04T05:36:40.926698+0000","last_unstale":"2023-12-04T05:36:41.897623+0000","last_undegraded":"2023-12-04T05:36:41.897623+0000","last_fullsized":"2023-12-04T05:36:41.897623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899008+0000","last_change":"2023-12-04T05:36:40.898383+0000","last_active":"2023-12-04T05:36:41.899008+0000","last_peered":"2023-12-04T05:36:41.899008+0000","last_clean":"2023-12-04T05:36:41.899008+0000","last_became_active":"2023-12-04T05:36:40.898076+0000","last_became_peered":"2023-12-04T05:36:40.898076+0000","last_unstale":"2023-12-04T05:36:41.899008+0000","last_undegraded":"2023-12-04T05:36:41.899008+0000","last_fullsized":"2023-12-04T05:36:41.899008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923790+0000","last_change":"2023-12-04T05:36:40.917782+0000","last_active":"2023-12-04T05:36:40.923790+0000","last_peered":"2023-12-04T05:36:40.923790+0000","last_clean":"2023-12-04T05:36:40.923790+0000","last_became_active":"2023-12-04T05:36:40.917501+0000","last_became_peered":"2023-12-04T05:36:40.917501+0000","last_unstale":"2023-12-04T05:36:40.923790+0000","last_undegraded":"2023-12-04T05:36:40.923790+0000","last_fullsized":"2023-12-04T05:36:40.923790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.919366+0000","last_change":"2023-12-04T05:36:40.914405+0000","last_active":"2023-12-04T05:36:40.919366+0000","last_peered":"2023-12-04T05:36:40.919366+0000","last_clean":"2023-12-04T05:36:40.919366+0000","last_became_active":"2023-12-04T05:36:40.913309+0000","last_became_peered":"2023-12-04T05:36:40.913309+0000","last_unstale":"2023-12-04T05:36:40.919366+0000","last_undegraded":"2023-12-04T05:36:40.919366+0000","last_fullsized":"2023-12-04T05:36:40.919366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:56.645765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894524+0000","last_change":"2023-12-04T05:36:40.913295+0000","last_active":"2023-12-04T05:36:41.894524+0000","last_peered":"2023-12-04T05:36:41.894524+0000","last_clean":"2023-12-04T05:36:41.894524+0000","last_became_active":"2023-12-04T05:36:40.913033+0000","last_became_peered":"2023-12-04T05:36:40.913033+0000","last_unstale":"2023-12-04T05:36:41.894524+0000","last_undegraded":"2023-12-04T05:36:41.894524+0000","last_fullsized":"2023-12-04T05:36:41.894524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928398+0000","last_change":"2023-12-04T05:36:40.919008+0000","last_active":"2023-12-04T05:36:40.928398+0000","last_peered":"2023-12-04T05:36:40.928398+0000","last_clean":"2023-12-04T05:36:40.928398+0000","last_became_active":"2023-12-04T05:36:40.918703+0000","last_became_peered":"2023-12-04T05:36:40.918703+0000","last_unstale":"2023-12-04T05:36:40.928398+0000","last_undegraded":"2023-12-04T05:36:40.928398+0000","last_fullsized":"2023-12-04T05:36:40.928398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931622+0000","last_change":"2023-12-04T05:36:40.924655+0000","last_active":"2023-12-04T05:36:40.931622+0000","last_peered":"2023-12-04T05:36:40.931622+0000","last_clean":"2023-12-04T05:36:40.931622+0000","last_became_active":"2023-12-04T05:36:40.924415+0000","last_became_peered":"2023-12-04T05:36:40.924415+0000","last_unstale":"2023-12-04T05:36:40.931622+0000","last_undegraded":"2023-12-04T05:36:40.931622+0000","last_fullsized":"2023-12-04T05:36:40.931622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915795+0000","last_change":"2023-12-04T05:36:40.911088+0000","last_active":"2023-12-04T05:36:40.915795+0000","last_peered":"2023-12-04T05:36:40.915795+0000","last_clean":"2023-12-04T05:36:40.915795+0000","last_became_active":"2023-12-04T05:36:40.910145+0000","last_became_peered":"2023-12-04T05:36:40.910145+0000","last_unstale":"2023-12-04T05:36:40.915795+0000","last_undegraded":"2023-12-04T05:36:40.915795+0000","last_fullsized":"2023-12-04T05:36:40.915795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929191+0000","last_change":"2023-12-04T05:36:40.918175+0000","last_active":"2023-12-04T05:36:40.929191+0000","last_peered":"2023-12-04T05:36:40.929191+0000","last_clean":"2023-12-04T05:36:40.929191+0000","last_became_active":"2023-12-04T05:36:40.917878+0000","last_became_peered":"2023-12-04T05:36:40.917878+0000","last_unstale":"2023-12-04T05:36:40.929191+0000","last_undegraded":"2023-12-04T05:36:40.929191+0000","last_fullsized":"2023-12-04T05:36:40.929191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897513+0000","last_change":"2023-12-04T05:36:40.898605+0000","last_active":"2023-12-04T05:36:41.897513+0000","last_peered":"2023-12-04T05:36:41.897513+0000","last_clean":"2023-12-04T05:36:41.897513+0000","last_became_active":"2023-12-04T05:36:40.898258+0000","last_became_peered":"2023-12-04T05:36:40.898258+0000","last_unstale":"2023-12-04T05:36:41.897513+0000","last_undegraded":"2023-12-04T05:36:41.897513+0000","last_fullsized":"2023-12-04T05:36:41.897513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923195+0000","last_change":"2023-12-04T05:36:40.916797+0000","last_active":"2023-12-04T05:36:40.923195+0000","last_peered":"2023-12-04T05:36:40.923195+0000","last_clean":"2023-12-04T05:36:40.923195+0000","last_became_active":"2023-12-04T05:36:40.916495+0000","last_became_peered":"2023-12-04T05:36:40.916495+0000","last_unstale":"2023-12-04T05:36:40.923195+0000","last_undegraded":"2023-12-04T05:36:40.923195+0000","last_fullsized":"2023-12-04T05:36:40.923195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929195+0000","last_change":"2023-12-04T05:36:40.922172+0000","last_active":"2023-12-04T05:36:40.929195+0000","last_peered":"2023-12-04T05:36:40.929195+0000","last_clean":"2023-12-04T05:36:40.929195+0000","last_became_active":"2023-12-04T05:36:40.921340+0000","last_became_peered":"2023-12-04T05:36:40.921340+0000","last_unstale":"2023-12-04T05:36:40.929195+0000","last_undegraded":"2023-12-04T05:36:40.929195+0000","last_fullsized":"2023-12-04T05:36:40.929195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.927983+0000","last_change":"2023-12-04T05:36:40.924182+0000","last_active":"2023-12-04T05:36:40.927983+0000","last_peered":"2023-12-04T05:36:40.927983+0000","last_clean":"2023-12-04T05:36:40.927983+0000","last_became_active":"2023-12-04T05:36:40.923964+0000","last_became_peered":"2023-12-04T05:36:40.923964+0000","last_unstale":"2023-12-04T05:36:40.927983+0000","last_undegraded":"2023-12-04T05:36:40.927983+0000","last_fullsized":"2023-12-04T05:36:40.927983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931645+0000","last_change":"2023-12-04T05:36:40.925487+0000","last_active":"2023-12-04T05:36:40.931645+0000","last_peered":"2023-12-04T05:36:40.931645+0000","last_clean":"2023-12-04T05:36:40.931645+0000","last_became_active":"2023-12-04T05:36:40.925100+0000","last_became_peered":"2023-12-04T05:36:40.925100+0000","last_unstale":"2023-12-04T05:36:40.931645+0000","last_undegraded":"2023-12-04T05:36:40.931645+0000","last_fullsized":"2023-12-04T05:36:40.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923626+0000","last_change":"2023-12-04T05:36:40.917356+0000","last_active":"2023-12-04T05:36:40.923626+0000","last_peered":"2023-12-04T05:36:40.923626+0000","last_clean":"2023-12-04T05:36:40.923626+0000","last_became_active":"2023-12-04T05:36:40.917079+0000","last_became_peered":"2023-12-04T05:36:40.917079+0000","last_unstale":"2023-12-04T05:36:40.923626+0000","last_undegraded":"2023-12-04T05:36:40.923626+0000","last_fullsized":"2023-12-04T05:36:40.923626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897895+0000","last_change":"2023-12-04T05:36:40.923445+0000","last_active":"2023-12-04T05:36:41.897895+0000","last_peered":"2023-12-04T05:36:41.897895+0000","last_clean":"2023-12-04T05:36:41.897895+0000","last_became_active":"2023-12-04T05:36:40.923197+0000","last_became_peered":"2023-12-04T05:36:40.923197+0000","last_unstale":"2023-12-04T05:36:41.897895+0000","last_undegraded":"2023-12-04T05:36:41.897895+0000","last_fullsized":"2023-12-04T05:36:41.897895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894822+0000","last_change":"2023-12-04T05:36:40.925226+0000","last_active":"2023-12-04T05:36:41.894822+0000","last_peered":"2023-12-04T05:36:41.894822+0000","last_clean":"2023-12-04T05:36:41.894822+0000","last_became_active":"2023-12-04T05:36:40.924880+0000","last_became_peered":"2023-12-04T05:36:40.924880+0000","last_unstale":"2023-12-04T05:36:41.894822+0000","last_undegraded":"2023-12-04T05:36:41.894822+0000","last_fullsized":"2023-12-04T05:36:41.894822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923746+0000","last_change":"2023-12-04T05:36:40.917579+0000","last_active":"2023-12-04T05:36:40.923746+0000","last_peered":"2023-12-04T05:36:40.923746+0000","last_clean":"2023-12-04T05:36:40.923746+0000","last_became_active":"2023-12-04T05:36:40.917049+0000","last_became_peered":"2023-12-04T05:36:40.917049+0000","last_unstale":"2023-12-04T05:36:40.923746+0000","last_undegraded":"2023-12-04T05:36:40.923746+0000","last_fullsized":"2023-12-04T05:36:40.923746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923214+0000","last_change":"2023-12-04T05:36:40.919114+0000","last_active":"2023-12-04T05:36:40.923214+0000","last_peered":"2023-12-04T05:36:40.923214+0000","last_clean":"2023-12-04T05:36:40.923214+0000","last_became_active":"2023-12-04T05:36:40.918821+0000","last_became_peered":"2023-12-04T05:36:40.918821+0000","last_unstale":"2023-12-04T05:36:40.923214+0000","last_undegraded":"2023-12-04T05:36:40.923214+0000","last_fullsized":"2023-12-04T05:36:40.923214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929118+0000","last_change":"2023-12-04T05:36:40.920720+0000","last_active":"2023-12-04T05:36:40.929118+0000","last_peered":"2023-12-04T05:36:40.929118+0000","last_clean":"2023-12-04T05:36:40.929118+0000","last_became_active":"2023-12-04T05:36:40.920392+0000","last_became_peered":"2023-12-04T05:36:40.920392+0000","last_unstale":"2023-12-04T05:36:40.929118+0000","last_undegraded":"2023-12-04T05:36:40.929118+0000","last_fullsized":"2023-12-04T05:36:40.929118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930684+0000","last_change":"2023-12-04T05:36:40.920292+0000","last_active":"2023-12-04T05:36:40.930684+0000","last_peered":"2023-12-04T05:36:40.930684+0000","last_clean":"2023-12-04T05:36:40.930684+0000","last_became_active":"2023-12-04T05:36:40.919985+0000","last_became_peered":"2023-12-04T05:36:40.919985+0000","last_unstale":"2023-12-04T05:36:40.930684+0000","last_undegraded":"2023-12-04T05:36:40.930684+0000","last_fullsized":"2023-12-04T05:36:40.930684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897439+0000","last_change":"2023-12-04T05:36:40.902425+0000","last_active":"2023-12-04T05:36:41.897439+0000","last_peered":"2023-12-04T05:36:41.897439+0000","last_clean":"2023-12-04T05:36:41.897439+0000","last_became_active":"2023-12-04T05:36:40.902138+0000","last_became_peered":"2023-12-04T05:36:40.902138+0000","last_unstale":"2023-12-04T05:36:41.897439+0000","last_undegraded":"2023-12-04T05:36:41.897439+0000","last_fullsized":"2023-12-04T05:36:41.897439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.898859+0000","last_change":"2023-12-04T05:36:40.918990+0000","last_active":"2023-12-04T05:36:41.898859+0000","last_peered":"2023-12-04T05:36:41.898859+0000","last_clean":"2023-12-04T05:36:41.898859+0000","last_became_active":"2023-12-04T05:36:40.916920+0000","last_became_peered":"2023-12-04T05:36:40.916920+0000","last_unstale":"2023-12-04T05:36:41.898859+0000","last_undegraded":"2023-12-04T05:36:41.898859+0000","last_fullsized":"2023-12-04T05:36:41.898859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981288+0000","last_change":"2023-12-04T05:36:39.916724+0000","last_active":"2023-12-04T05:36:40.981288+0000","last_peered":"2023-12-04T05:36:40.981288+0000","last_clean":"2023-12-04T05:36:40.981288+0000","last_became_active":"2023-12-04T05:36:39.916408+0000","last_became_peered":"2023-12-04T05:36:39.916408+0000","last_unstale":"2023-12-04T05:36:40.981288+0000","last_undegraded":"2023-12-04T05:36:40.981288+0000","last_fullsized":"2023-12-04T05:36:40.981288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.913088+0000","last_change":"2023-12-04T05:36:40.908915+0000","last_active":"2023-12-04T05:36:40.913088+0000","last_peered":"2023-12-04T05:36:40.913088+0000","last_clean":"2023-12-04T05:36:40.913088+0000","last_became_active":"2023-12-04T05:36:40.908571+0000","last_became_peered":"2023-12-04T05:36:40.908571+0000","last_unstale":"2023-12-04T05:36:40.913088+0000","last_undegraded":"2023-12-04T05:36:40.913088+0000","last_fullsized":"2023-12-04T05:36:40.913088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897458+0000","last_change":"2023-12-04T05:36:39.912675+0000","last_active":"2023-12-04T05:36:41.897458+0000","last_peered":"2023-12-04T05:36:41.897458+0000","last_clean":"2023-12-04T05:36:41.897458+0000","last_became_active":"2023-12-04T05:36:39.912299+0000","last_became_peered":"2023-12-04T05:36:39.912299+0000","last_unstale":"2023-12-04T05:36:41.897458+0000","last_undegraded":"2023-12-04T05:36:41.897458+0000","last_fullsized":"2023-12-04T05:36:41.897458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.918093+0000","last_change":"2023-12-04T05:36:39.906738+0000","last_active":"2023-12-04T05:36:40.918093+0000","last_peered":"2023-12-04T05:36:40.918093+0000","last_clean":"2023-12-04T05:36:40.918093+0000","last_became_active":"2023-12-04T05:36:39.906463+0000","last_became_peered":"2023-12-04T05:36:39.906463+0000","last_unstale":"2023-12-04T05:36:40.918093+0000","last_undegraded":"2023-12-04T05:36:40.918093+0000","last_fullsized":"2023-12-04T05:36:40.918093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923852+0000","last_change":"2023-12-04T05:36:40.919035+0000","last_active":"2023-12-04T05:36:40.923852+0000","last_peered":"2023-12-04T05:36:40.923852+0000","last_clean":"2023-12-04T05:36:40.923852+0000","last_became_active":"2023-12-04T05:36:40.914346+0000","last_became_peered":"2023-12-04T05:36:40.914346+0000","last_unstale":"2023-12-04T05:36:40.923852+0000","last_undegraded":"2023-12-04T05:36:40.923852+0000","last_fullsized":"2023-12-04T05:36:40.923852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:11.444282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914466+0000","last_change":"2023-12-04T05:36:39.920898+0000","last_active":"2023-12-04T05:36:40.914466+0000","last_peered":"2023-12-04T05:36:40.914466+0000","last_clean":"2023-12-04T05:36:40.914466+0000","last_became_active":"2023-12-04T05:36:39.920625+0000","last_became_peered":"2023-12-04T05:36:39.920625+0000","last_unstale":"2023-12-04T05:36:40.914466+0000","last_undegraded":"2023-12-04T05:36:40.914466+0000","last_fullsized":"2023-12-04T05:36:40.914466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894571+0000","last_change":"2023-12-04T05:36:40.925470+0000","last_active":"2023-12-04T05:36:41.894571+0000","last_peered":"2023-12-04T05:36:41.894571+0000","last_clean":"2023-12-04T05:36:41.894571+0000","last_became_active":"2023-12-04T05:36:40.925129+0000","last_became_peered":"2023-12-04T05:36:40.925129+0000","last_unstale":"2023-12-04T05:36:41.894571+0000","last_undegraded":"2023-12-04T05:36:41.894571+0000","last_fullsized":"2023-12-04T05:36:41.894571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897835+0000","last_change":"2023-12-04T05:36:39.912643+0000","last_active":"2023-12-04T05:36:41.897835+0000","last_peered":"2023-12-04T05:36:41.897835+0000","last_clean":"2023-12-04T05:36:41.897835+0000","last_became_active":"2023-12-04T05:36:39.909337+0000","last_became_peered":"2023-12-04T05:36:39.909337+0000","last_unstale":"2023-12-04T05:36:41.897835+0000","last_undegraded":"2023-12-04T05:36:41.897835+0000","last_fullsized":"2023-12-04T05:36:41.897835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930216+0000","last_change":"2023-12-04T05:36:40.921153+0000","last_active":"2023-12-04T05:36:40.930216+0000","last_peered":"2023-12-04T05:36:40.930216+0000","last_clean":"2023-12-04T05:36:40.930216+0000","last_became_active":"2023-12-04T05:36:40.920456+0000","last_became_peered":"2023-12-04T05:36:40.920456+0000","last_unstale":"2023-12-04T05:36:40.930216+0000","last_undegraded":"2023-12-04T05:36:40.930216+0000","last_fullsized":"2023-12-04T05:36:40.930216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915353+0000","last_change":"2023-12-04T05:36:39.918009+0000","last_active":"2023-12-04T05:36:40.915353+0000","last_peered":"2023-12-04T05:36:40.915353+0000","last_clean":"2023-12-04T05:36:40.915353+0000","last_became_active":"2023-12-04T05:36:39.917694+0000","last_became_peered":"2023-12-04T05:36:39.917694+0000","last_unstale":"2023-12-04T05:36:40.915353+0000","last_undegraded":"2023-12-04T05:36:40.915353+0000","last_fullsized":"2023-12-04T05:36:40.915353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:22.492160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930728+0000","last_change":"2023-12-04T05:36:40.919239+0000","last_active":"2023-12-04T05:36:40.930728+0000","last_peered":"2023-12-04T05:36:40.930728+0000","last_clean":"2023-12-04T05:36:40.930728+0000","last_became_active":"2023-12-04T05:36:40.918774+0000","last_became_peered":"2023-12-04T05:36:40.918774+0000","last_unstale":"2023-12-04T05:36:40.930728+0000","last_undegraded":"2023-12-04T05:36:40.930728+0000","last_fullsized":"2023-12-04T05:36:40.930728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894788+0000","last_change":"2023-12-04T05:36:39.921145+0000","last_active":"2023-12-04T05:36:41.894788+0000","last_peered":"2023-12-04T05:36:41.894788+0000","last_clean":"2023-12-04T05:36:41.894788+0000","last_became_active":"2023-12-04T05:36:39.920191+0000","last_became_peered":"2023-12-04T05:36:39.920191+0000","last_unstale":"2023-12-04T05:36:41.894788+0000","last_undegraded":"2023-12-04T05:36:41.894788+0000","last_fullsized":"2023-12-04T05:36:41.894788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899199+0000","last_change":"2023-12-04T05:36:40.917431+0000","last_active":"2023-12-04T05:36:41.899199+0000","last_peered":"2023-12-04T05:36:41.899199+0000","last_clean":"2023-12-04T05:36:41.899199+0000","last_became_active":"2023-12-04T05:36:40.917118+0000","last_became_peered":"2023-12-04T05:36:40.917118+0000","last_unstale":"2023-12-04T05:36:41.899199+0000","last_undegraded":"2023-12-04T05:36:41.899199+0000","last_fullsized":"2023-12-04T05:36:41.899199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897552+0000","last_change":"2023-12-04T05:36:39.916187+0000","last_active":"2023-12-04T05:36:41.897552+0000","last_peered":"2023-12-04T05:36:41.897552+0000","last_clean":"2023-12-04T05:36:41.897552+0000","last_became_active":"2023-12-04T05:36:39.915832+0000","last_became_peered":"2023-12-04T05:36:39.915832+0000","last_unstale":"2023-12-04T05:36:41.897552+0000","last_undegraded":"2023-12-04T05:36:41.897552+0000","last_fullsized":"2023-12-04T05:36:41.897552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931479+0000","last_change":"2023-12-04T05:36:40.929289+0000","last_active":"2023-12-04T05:36:40.931479+0000","last_peered":"2023-12-04T05:36:40.931479+0000","last_clean":"2023-12-04T05:36:40.931479+0000","last_became_active":"2023-12-04T05:36:40.929006+0000","last_became_peered":"2023-12-04T05:36:40.929006+0000","last_unstale":"2023-12-04T05:36:40.931479+0000","last_undegraded":"2023-12-04T05:36:40.931479+0000","last_fullsized":"2023-12-04T05:36:40.931479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.982383+0000","last_change":"2023-12-04T05:36:39.909850+0000","last_active":"2023-12-04T05:36:40.982383+0000","last_peered":"2023-12-04T05:36:40.982383+0000","last_clean":"2023-12-04T05:36:40.982383+0000","last_became_active":"2023-12-04T05:36:39.909515+0000","last_became_peered":"2023-12-04T05:36:39.909515+0000","last_unstale":"2023-12-04T05:36:40.982383+0000","last_undegraded":"2023-12-04T05:36:40.982383+0000","last_fullsized":"2023-12-04T05:36:40.982383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923241+0000","last_change":"2023-12-04T05:36:40.917716+0000","last_active":"2023-12-04T05:36:40.923241+0000","last_peered":"2023-12-04T05:36:40.923241+0000","last_clean":"2023-12-04T05:36:40.923241+0000","last_became_active":"2023-12-04T05:36:40.917449+0000","last_became_peered":"2023-12-04T05:36:40.917449+0000","last_unstale":"2023-12-04T05:36:40.923241+0000","last_undegraded":"2023-12-04T05:36:40.923241+0000","last_fullsized":"2023-12-04T05:36:40.923241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914808+0000","last_change":"2023-12-04T05:36:39.919474+0000","last_active":"2023-12-04T05:36:40.914808+0000","last_peered":"2023-12-04T05:36:40.914808+0000","last_clean":"2023-12-04T05:36:40.914808+0000","last_became_active":"2023-12-04T05:36:39.919051+0000","last_became_peered":"2023-12-04T05:36:39.919051+0000","last_unstale":"2023-12-04T05:36:40.914808+0000","last_undegraded":"2023-12-04T05:36:40.914808+0000","last_fullsized":"2023-12-04T05:36:40.914808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:12.727217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929110+0000","last_change":"2023-12-04T05:36:40.919992+0000","last_active":"2023-12-04T05:36:40.929110+0000","last_peered":"2023-12-04T05:36:40.929110+0000","last_clean":"2023-12-04T05:36:40.929110+0000","last_became_active":"2023-12-04T05:36:40.919720+0000","last_became_peered":"2023-12-04T05:36:40.919720+0000","last_unstale":"2023-12-04T05:36:40.929110+0000","last_undegraded":"2023-12-04T05:36:40.929110+0000","last_fullsized":"2023-12-04T05:36:40.929110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897599+0000","last_change":"2023-12-04T05:36:39.908368+0000","last_active":"2023-12-04T05:36:41.897599+0000","last_peered":"2023-12-04T05:36:41.897599+0000","last_clean":"2023-12-04T05:36:41.897599+0000","last_became_active":"2023-12-04T05:36:39.907946+0000","last_became_peered":"2023-12-04T05:36:39.907946+0000","last_unstale":"2023-12-04T05:36:41.897599+0000","last_undegraded":"2023-12-04T05:36:41.897599+0000","last_fullsized":"2023-12-04T05:36:41.897599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897271+0000","last_change":"2023-12-04T05:36:40.907233+0000","last_active":"2023-12-04T05:36:41.897271+0000","last_peered":"2023-12-04T05:36:41.897271+0000","last_clean":"2023-12-04T05:36:41.897271+0000","last_became_active":"2023-12-04T05:36:40.906854+0000","last_became_peered":"2023-12-04T05:36:40.906854+0000","last_unstale":"2023-12-04T05:36:41.897271+0000","last_undegraded":"2023-12-04T05:36:41.897271+0000","last_fullsized":"2023-12-04T05:36:41.897271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983130+0000","last_change":"2023-12-04T05:36:39.901154+0000","last_active":"2023-12-04T05:36:40.983130+0000","last_peered":"2023-12-04T05:36:40.983130+0000","last_clean":"2023-12-04T05:36:40.983130+0000","last_became_active":"2023-12-04T05:36:39.900871+0000","last_became_peered":"2023-12-04T05:36:39.900871+0000","last_unstale":"2023-12-04T05:36:40.983130+0000","last_undegraded":"2023-12-04T05:36:40.983130+0000","last_fullsized":"2023-12-04T05:36:40.983130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923609+0000","last_change":"2023-12-04T05:36:40.918025+0000","last_active":"2023-12-04T05:36:40.923609+0000","last_peered":"2023-12-04T05:36:40.923609+0000","last_clean":"2023-12-04T05:36:40.923609+0000","last_became_active":"2023-12-04T05:36:40.917722+0000","last_became_peered":"2023-12-04T05:36:40.917722+0000","last_unstale":"2023-12-04T05:36:40.923609+0000","last_undegraded":"2023-12-04T05:36:40.923609+0000","last_fullsized":"2023-12-04T05:36:40.923609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899228+0000","last_change":"2023-12-04T05:36:39.913527+0000","last_active":"2023-12-04T05:36:41.899228+0000","last_peered":"2023-12-04T05:36:41.899228+0000","last_clean":"2023-12-04T05:36:41.899228+0000","last_became_active":"2023-12-04T05:36:39.911602+0000","last_became_peered":"2023-12-04T05:36:39.911602+0000","last_unstale":"2023-12-04T05:36:41.899228+0000","last_undegraded":"2023-12-04T05:36:41.899228+0000","last_fullsized":"2023-12-04T05:36:41.899228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:10.437590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929532+0000","last_change":"2023-12-04T05:36:40.926649+0000","last_active":"2023-12-04T05:36:40.929532+0000","last_peered":"2023-12-04T05:36:40.929532+0000","last_clean":"2023-12-04T05:36:40.929532+0000","last_became_active":"2023-12-04T05:36:40.926316+0000","last_became_peered":"2023-12-04T05:36:40.926316+0000","last_unstale":"2023-12-04T05:36:40.929532+0000","last_undegraded":"2023-12-04T05:36:40.929532+0000","last_fullsized":"2023-12-04T05:36:40.929532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983020+0000","last_change":"2023-12-04T05:36:39.915096+0000","last_active":"2023-12-04T05:36:40.983020+0000","last_peered":"2023-12-04T05:36:40.983020+0000","last_clean":"2023-12-04T05:36:40.983020+0000","last_became_active":"2023-12-04T05:36:39.914743+0000","last_became_peered":"2023-12-04T05:36:39.914743+0000","last_unstale":"2023-12-04T05:36:40.983020+0000","last_undegraded":"2023-12-04T05:36:40.983020+0000","last_fullsized":"2023-12-04T05:36:40.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:21.177051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929116+0000","last_change":"2023-12-04T05:36:40.925949+0000","last_active":"2023-12-04T05:36:40.929116+0000","last_peered":"2023-12-04T05:36:40.929116+0000","last_clean":"2023-12-04T05:36:40.929116+0000","last_became_active":"2023-12-04T05:36:40.925684+0000","last_became_peered":"2023-12-04T05:36:40.925684+0000","last_unstale":"2023-12-04T05:36:40.929116+0000","last_undegraded":"2023-12-04T05:36:40.929116+0000","last_fullsized":"2023-12-04T05:36:40.929116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894872+0000","last_change":"2023-12-04T05:36:39.906214+0000","last_active":"2023-12-04T05:36:41.894872+0000","last_peered":"2023-12-04T05:36:41.894872+0000","last_clean":"2023-12-04T05:36:41.894872+0000","last_became_active":"2023-12-04T05:36:39.905868+0000","last_became_peered":"2023-12-04T05:36:39.905868+0000","last_unstale":"2023-12-04T05:36:41.894872+0000","last_undegraded":"2023-12-04T05:36:41.894872+0000","last_fullsized":"2023-12-04T05:36:41.894872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929225+0000","last_change":"2023-12-04T05:36:40.921297+0000","last_active":"2023-12-04T05:36:40.929225+0000","last_peered":"2023-12-04T05:36:40.929225+0000","last_clean":"2023-12-04T05:36:40.929225+0000","last_became_active":"2023-12-04T05:36:40.919804+0000","last_became_peered":"2023-12-04T05:36:40.919804+0000","last_unstale":"2023-12-04T05:36:40.929225+0000","last_undegraded":"2023-12-04T05:36:40.929225+0000","last_fullsized":"2023-12-04T05:36:40.929225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.906630+0000","last_change":"2023-12-04T05:36:39.920708+0000","last_active":"2023-12-04T05:36:40.906630+0000","last_peered":"2023-12-04T05:36:40.906630+0000","last_clean":"2023-12-04T05:36:40.906630+0000","last_became_active":"2023-12-04T05:36:39.920411+0000","last_became_peered":"2023-12-04T05:36:39.920411+0000","last_unstale":"2023-12-04T05:36:40.906630+0000","last_undegraded":"2023-12-04T05:36:40.906630+0000","last_fullsized":"2023-12-04T05:36:40.906630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931462+0000","last_change":"2023-12-04T05:36:40.929211+0000","last_active":"2023-12-04T05:36:40.931462+0000","last_peered":"2023-12-04T05:36:40.931462+0000","last_clean":"2023-12-04T05:36:40.931462+0000","last_became_active":"2023-12-04T05:36:40.928878+0000","last_became_peered":"2023-12-04T05:36:40.928878+0000","last_unstale":"2023-12-04T05:36:40.931462+0000","last_undegraded":"2023-12-04T05:36:40.931462+0000","last_fullsized":"2023-12-04T05:36:40.931462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-04T05:36:39.909071+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:36:39.909071+0000","last_peered":"2023-12-04T05:36:39.909071+0000","last_clean":"2023-12-04T05:36:39.909071+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:36:39.909071+0000","last_undegraded":"2023-12-04T05:36:39.909071+0000","last_fullsized":"2023-12-04T05:36:39.909071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915024+0000","last_change":"2023-12-04T05:36:39.909994+0000","last_active":"2023-12-04T05:36:40.915024+0000","last_peered":"2023-12-04T05:36:40.915024+0000","last_clean":"2023-12-04T05:36:40.915024+0000","last_became_active":"2023-12-04T05:36:39.909676+0000","last_became_peered":"2023-12-04T05:36:39.909676+0000","last_unstale":"2023-12-04T05:36:40.915024+0000","last_undegraded":"2023-12-04T05:36:40.915024+0000","last_fullsized":"2023-12-04T05:36:40.915024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:26.127153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.924350+0000","last_change":"2023-12-04T05:36:40.922315+0000","last_active":"2023-12-04T05:36:40.924350+0000","last_peered":"2023-12-04T05:36:40.924350+0000","last_clean":"2023-12-04T05:36:40.924350+0000","last_became_active":"2023-12-04T05:36:40.922017+0000","last_became_peered":"2023-12-04T05:36:40.922017+0000","last_unstale":"2023-12-04T05:36:40.924350+0000","last_undegraded":"2023-12-04T05:36:40.924350+0000","last_fullsized":"2023-12-04T05:36:40.924350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907794+0000","last_change":"2023-12-04T05:36:39.917047+0000","last_active":"2023-12-04T05:36:40.907794+0000","last_peered":"2023-12-04T05:36:40.907794+0000","last_clean":"2023-12-04T05:36:40.907794+0000","last_became_active":"2023-12-04T05:36:39.915737+0000","last_became_peered":"2023-12-04T05:36:39.915737+0000","last_unstale":"2023-12-04T05:36:40.907794+0000","last_undegraded":"2023-12-04T05:36:40.907794+0000","last_fullsized":"2023-12-04T05:36:40.907794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.913946+0000","last_change":"2023-12-04T05:36:40.909850+0000","last_active":"2023-12-04T05:36:40.913946+0000","last_peered":"2023-12-04T05:36:40.913946+0000","last_clean":"2023-12-04T05:36:40.913946+0000","last_became_active":"2023-12-04T05:36:40.908954+0000","last_became_peered":"2023-12-04T05:36:40.908954+0000","last_unstale":"2023-12-04T05:36:40.913946+0000","last_undegraded":"2023-12-04T05:36:40.913946+0000","last_fullsized":"2023-12-04T05:36:40.913946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:11.444282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.906386+0000","last_change":"2023-12-04T05:36:39.900716+0000","last_active":"2023-12-04T05:36:40.906386+0000","last_peered":"2023-12-04T05:36:40.906386+0000","last_clean":"2023-12-04T05:36:40.906386+0000","last_became_active":"2023-12-04T05:36:39.898450+0000","last_became_peered":"2023-12-04T05:36:39.898450+0000","last_unstale":"2023-12-04T05:36:40.906386+0000","last_undegraded":"2023-12-04T05:36:40.906386+0000","last_fullsized":"2023-12-04T05:36:40.906386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894542+0000","last_change":"2023-12-04T05:36:40.912304+0000","last_active":"2023-12-04T05:36:41.894542+0000","last_peered":"2023-12-04T05:36:41.894542+0000","last_clean":"2023-12-04T05:36:41.894542+0000","last_became_active":"2023-12-04T05:36:40.912044+0000","last_became_peered":"2023-12-04T05:36:40.912044+0000","last_unstale":"2023-12-04T05:36:41.894542+0000","last_undegraded":"2023-12-04T05:36:41.894542+0000","last_fullsized":"2023-12-04T05:36:41.894542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914836+0000","last_change":"2023-12-04T05:36:39.911421+0000","last_active":"2023-12-04T05:36:40.914836+0000","last_peered":"2023-12-04T05:36:40.914836+0000","last_clean":"2023-12-04T05:36:40.914836+0000","last_became_active":"2023-12-04T05:36:39.910797+0000","last_became_peered":"2023-12-04T05:36:39.910797+0000","last_unstale":"2023-12-04T05:36:40.914836+0000","last_undegraded":"2023-12-04T05:36:40.914836+0000","last_fullsized":"2023-12-04T05:36:40.914836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899038+0000","last_change":"2023-12-04T05:36:40.902536+0000","last_active":"2023-12-04T05:36:41.899038+0000","last_peered":"2023-12-04T05:36:41.899038+0000","last_clean":"2023-12-04T05:36:41.899038+0000","last_became_active":"2023-12-04T05:36:40.902158+0000","last_became_peered":"2023-12-04T05:36:40.902158+0000","last_unstale":"2023-12-04T05:36:41.899038+0000","last_undegraded":"2023-12-04T05:36:41.899038+0000","last_fullsized":"2023-12-04T05:36:41.899038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894718+0000","last_change":"2023-12-04T05:36:39.911969+0000","last_active":"2023-12-04T05:36:41.894718+0000","last_peered":"2023-12-04T05:36:41.894718+0000","last_clean":"2023-12-04T05:36:41.894718+0000","last_became_active":"2023-12-04T05:36:39.911783+0000","last_became_peered":"2023-12-04T05:36:39.911783+0000","last_unstale":"2023-12-04T05:36:41.894718+0000","last_undegraded":"2023-12-04T05:36:41.894718+0000","last_fullsized":"2023-12-04T05:36:41.894718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931694+0000","last_change":"2023-12-04T05:36:40.925817+0000","last_active":"2023-12-04T05:36:40.931694+0000","last_peered":"2023-12-04T05:36:40.931694+0000","last_clean":"2023-12-04T05:36:40.931694+0000","last_became_active":"2023-12-04T05:36:40.925448+0000","last_became_peered":"2023-12-04T05:36:40.925448+0000","last_unstale":"2023-12-04T05:36:40.931694+0000","last_undegraded":"2023-12-04T05:36:40.931694+0000","last_fullsized":"2023-12-04T05:36:40.931694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.910552+0000","last_change":"2023-12-04T05:36:39.921497+0000","last_active":"2023-12-04T05:36:40.910552+0000","last_peered":"2023-12-04T05:36:40.910552+0000","last_clean":"2023-12-04T05:36:40.910552+0000","last_became_active":"2023-12-04T05:36:39.921175+0000","last_became_peered":"2023-12-04T05:36:39.921175+0000","last_unstale":"2023-12-04T05:36:40.910552+0000","last_undegraded":"2023-12-04T05:36:40.910552+0000","last_fullsized":"2023-12-04T05:36:40.910552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894588+0000","last_change":"2023-12-04T05:36:40.913041+0000","last_active":"2023-12-04T05:36:41.894588+0000","last_peered":"2023-12-04T05:36:41.894588+0000","last_clean":"2023-12-04T05:36:41.894588+0000","last_became_active":"2023-12-04T05:36:40.912719+0000","last_became_peered":"2023-12-04T05:36:40.912719+0000","last_unstale":"2023-12-04T05:36:41.894588+0000","last_undegraded":"2023-12-04T05:36:41.894588+0000","last_fullsized":"2023-12-04T05:36:41.894588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894902+0000","last_change":"2023-12-04T05:36:39.908161+0000","last_active":"2023-12-04T05:36:41.894902+0000","last_peered":"2023-12-04T05:36:41.894902+0000","last_clean":"2023-12-04T05:36:41.894902+0000","last_became_active":"2023-12-04T05:36:39.907857+0000","last_became_peered":"2023-12-04T05:36:39.907857+0000","last_unstale":"2023-12-04T05:36:41.894902+0000","last_undegraded":"2023-12-04T05:36:41.894902+0000","last_fullsized":"2023-12-04T05:36:41.894902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.934014+0000","last_change":"2023-12-04T05:36:40.929459+0000","last_active":"2023-12-04T05:36:40.934014+0000","last_peered":"2023-12-04T05:36:40.934014+0000","last_clean":"2023-12-04T05:36:40.934014+0000","last_became_active":"2023-12-04T05:36:40.929278+0000","last_became_peered":"2023-12-04T05:36:40.929278+0000","last_unstale":"2023-12-04T05:36:40.934014+0000","last_undegraded":"2023-12-04T05:36:40.934014+0000","last_fullsized":"2023-12-04T05:36:40.934014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897952+0000","last_change":"2023-12-04T05:36:39.916327+0000","last_active":"2023-12-04T05:36:41.897952+0000","last_peered":"2023-12-04T05:36:41.897952+0000","last_clean":"2023-12-04T05:36:41.897952+0000","last_became_active":"2023-12-04T05:36:39.916042+0000","last_became_peered":"2023-12-04T05:36:39.916042+0000","last_unstale":"2023-12-04T05:36:41.897952+0000","last_undegraded":"2023-12-04T05:36:41.897952+0000","last_fullsized":"2023-12-04T05:36:41.897952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931270+0000","last_change":"2023-12-04T05:36:40.924060+0000","last_active":"2023-12-04T05:36:40.931270+0000","last_peered":"2023-12-04T05:36:40.931270+0000","last_clean":"2023-12-04T05:36:40.931270+0000","last_became_active":"2023-12-04T05:36:40.923821+0000","last_became_peered":"2023-12-04T05:36:40.923821+0000","last_unstale":"2023-12-04T05:36:40.931270+0000","last_undegraded":"2023-12-04T05:36:40.931270+0000","last_fullsized":"2023-12-04T05:36:40.931270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907629+0000","last_change":"2023-12-04T05:36:39.921359+0000","last_active":"2023-12-04T05:36:40.907629+0000","last_peered":"2023-12-04T05:36:40.907629+0000","last_clean":"2023-12-04T05:36:40.907629+0000","last_became_active":"2023-12-04T05:36:39.921108+0000","last_became_peered":"2023-12-04T05:36:39.921108+0000","last_unstale":"2023-12-04T05:36:40.907629+0000","last_undegraded":"2023-12-04T05:36:40.907629+0000","last_fullsized":"2023-12-04T05:36:40.907629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899095+0000","last_change":"2023-12-04T05:36:40.909278+0000","last_active":"2023-12-04T05:36:41.899095+0000","last_peered":"2023-12-04T05:36:41.899095+0000","last_clean":"2023-12-04T05:36:41.899095+0000","last_became_active":"2023-12-04T05:36:40.908988+0000","last_became_peered":"2023-12-04T05:36:40.908988+0000","last_unstale":"2023-12-04T05:36:41.899095+0000","last_undegraded":"2023-12-04T05:36:41.899095+0000","last_fullsized":"2023-12-04T05:36:41.899095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894616+0000","last_change":"2023-12-04T05:36:39.913809+0000","last_active":"2023-12-04T05:36:41.894616+0000","last_peered":"2023-12-04T05:36:41.894616+0000","last_clean":"2023-12-04T05:36:41.894616+0000","last_became_active":"2023-12-04T05:36:39.913417+0000","last_became_peered":"2023-12-04T05:36:39.913417+0000","last_unstale":"2023-12-04T05:36:41.894616+0000","last_undegraded":"2023-12-04T05:36:41.894616+0000","last_fullsized":"2023-12-04T05:36:41.894616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928017+0000","last_change":"2023-12-04T05:36:40.925195+0000","last_active":"2023-12-04T05:36:40.928017+0000","last_peered":"2023-12-04T05:36:40.928017+0000","last_clean":"2023-12-04T05:36:40.928017+0000","last_became_active":"2023-12-04T05:36:40.924744+0000","last_became_peered":"2023-12-04T05:36:40.924744+0000","last_unstale":"2023-12-04T05:36:40.928017+0000","last_undegraded":"2023-12-04T05:36:40.928017+0000","last_fullsized":"2023-12-04T05:36:40.928017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894682+0000","last_change":"2023-12-04T05:36:39.904596+0000","last_active":"2023-12-04T05:36:41.894682+0000","last_peered":"2023-12-04T05:36:41.894682+0000","last_clean":"2023-12-04T05:36:41.894682+0000","last_became_active":"2023-12-04T05:36:39.904323+0000","last_became_peered":"2023-12-04T05:36:39.904323+0000","last_unstale":"2023-12-04T05:36:41.894682+0000","last_undegraded":"2023-12-04T05:36:41.894682+0000","last_fullsized":"2023-12-04T05:36:41.894682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923774+0000","last_change":"2023-12-04T05:36:40.917184+0000","last_active":"2023-12-04T05:36:40.923774+0000","last_peered":"2023-12-04T05:36:40.923774+0000","last_clean":"2023-12-04T05:36:40.923774+0000","last_became_active":"2023-12-04T05:36:40.916879+0000","last_became_peered":"2023-12-04T05:36:40.916879+0000","last_unstale":"2023-12-04T05:36:40.923774+0000","last_undegraded":"2023-12-04T05:36:40.923774+0000","last_fullsized":"2023-12-04T05:36:40.923774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.980774+0000","last_change":"2023-12-04T05:36:39.918909+0000","last_active":"2023-12-04T05:36:40.980774+0000","last_peered":"2023-12-04T05:36:40.980774+0000","last_clean":"2023-12-04T05:36:40.980774+0000","last_became_active":"2023-12-04T05:36:39.918583+0000","last_became_peered":"2023-12-04T05:36:39.918583+0000","last_unstale":"2023-12-04T05:36:40.980774+0000","last_undegraded":"2023-12-04T05:36:40.980774+0000","last_fullsized":"2023-12-04T05:36:40.980774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897340+0000","last_change":"2023-12-04T05:36:40.899019+0000","last_active":"2023-12-04T05:36:41.897340+0000","last_peered":"2023-12-04T05:36:41.897340+0000","last_clean":"2023-12-04T05:36:41.897340+0000","last_became_active":"2023-12-04T05:36:40.898523+0000","last_became_peered":"2023-12-04T05:36:40.898523+0000","last_unstale":"2023-12-04T05:36:41.897340+0000","last_undegraded":"2023-12-04T05:36:41.897340+0000","last_fullsized":"2023-12-04T05:36:41.897340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925510+0000","last_change":"2023-12-04T05:36:40.918106+0000","last_active":"2023-12-04T05:36:40.925510+0000","last_peered":"2023-12-04T05:36:40.925510+0000","last_clean":"2023-12-04T05:36:40.925510+0000","last_became_active":"2023-12-04T05:36:40.917745+0000","last_became_peered":"2023-12-04T05:36:40.917745+0000","last_unstale":"2023-12-04T05:36:40.925510+0000","last_undegraded":"2023-12-04T05:36:40.925510+0000","last_fullsized":"2023-12-04T05:36:40.925510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981426+0000","last_change":"2023-12-04T05:36:39.924371+0000","last_active":"2023-12-04T05:36:40.981426+0000","last_peered":"2023-12-04T05:36:40.981426+0000","last_clean":"2023-12-04T05:36:40.981426+0000","last_became_active":"2023-12-04T05:36:39.924054+0000","last_became_peered":"2023-12-04T05:36:39.924054+0000","last_unstale":"2023-12-04T05:36:40.981426+0000","last_undegraded":"2023-12-04T05:36:40.981426+0000","last_fullsized":"2023-12-04T05:36:40.981426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925657+0000","last_change":"2023-12-04T05:36:40.917939+0000","last_active":"2023-12-04T05:36:40.925657+0000","last_peered":"2023-12-04T05:36:40.925657+0000","last_clean":"2023-12-04T05:36:40.925657+0000","last_became_active":"2023-12-04T05:36:40.917669+0000","last_became_peered":"2023-12-04T05:36:40.917669+0000","last_unstale":"2023-12-04T05:36:40.925657+0000","last_undegraded":"2023-12-04T05:36:40.925657+0000","last_fullsized":"2023-12-04T05:36:40.925657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:21.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981758+0000","last_change":"2023-12-04T05:36:39.920721+0000","last_active":"2023-12-04T05:36:40.981758+0000","last_peered":"2023-12-04T05:36:40.981758+0000","last_clean":"2023-12-04T05:36:40.981758+0000","last_became_active":"2023-12-04T05:36:39.920453+0000","last_became_peered":"2023-12-04T05:36:39.920453+0000","last_unstale":"2023-12-04T05:36:40.981758+0000","last_undegraded":"2023-12-04T05:36:40.981758+0000","last_fullsized":"2023-12-04T05:36:40.981758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923286+0000","last_change":"2023-12-04T05:36:40.919075+0000","last_active":"2023-12-04T05:36:40.923286+0000","last_peered":"2023-12-04T05:36:40.923286+0000","last_clean":"2023-12-04T05:36:40.923286+0000","last_became_active":"2023-12-04T05:36:40.918364+0000","last_became_peered":"2023-12-04T05:36:40.918364+0000","last_unstale":"2023-12-04T05:36:40.923286+0000","last_undegraded":"2023-12-04T05:36:40.923286+0000","last_fullsized":"2023-12-04T05:36:40.923286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981396+0000","last_change":"2023-12-04T05:36:39.920745+0000","last_active":"2023-12-04T05:36:40.981396+0000","last_peered":"2023-12-04T05:36:40.981396+0000","last_clean":"2023-12-04T05:36:40.981396+0000","last_became_active":"2023-12-04T05:36:39.920421+0000","last_became_peered":"2023-12-04T05:36:39.920421+0000","last_unstale":"2023-12-04T05:36:40.981396+0000","last_undegraded":"2023-12-04T05:36:40.981396+0000","last_fullsized":"2023-12-04T05:36:40.981396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.924302+0000","last_change":"2023-12-04T05:36:40.920955+0000","last_active":"2023-12-04T05:36:40.924302+0000","last_peered":"2023-12-04T05:36:40.924302+0000","last_clean":"2023-12-04T05:36:40.924302+0000","last_became_active":"2023-12-04T05:36:40.920651+0000","last_became_peered":"2023-12-04T05:36:40.920651+0000","last_unstale":"2023-12-04T05:36:40.924302+0000","last_undegraded":"2023-12-04T05:36:40.924302+0000","last_fullsized":"2023-12-04T05:36:40.924302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983296+0000","last_change":"2023-12-04T05:36:39.913939+0000","last_active":"2023-12-04T05:36:40.983296+0000","last_peered":"2023-12-04T05:36:40.983296+0000","last_clean":"2023-12-04T05:36:40.983296+0000","last_became_active":"2023-12-04T05:36:39.913586+0000","last_became_peered":"2023-12-04T05:36:39.913586+0000","last_unstale":"2023-12-04T05:36:40.983296+0000","last_undegraded":"2023-12-04T05:36:40.983296+0000","last_fullsized":"2023-12-04T05:36:40.983296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:36:45.086 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:36:45.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 Processor -- start 2023-12-04T05:36:45.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 -- start start 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1c1c14e970 0x7f1c1c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c1c06ca50 0x7f1c1c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c152300 con 0x7f1c1c06be00 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c071580 con 0x7f1c1c06ca50 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c21c79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c14ed50 con 0x7f1c1c14e970 2023-12-04T05:36:45.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c1bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c1c06ca50 0x7f1c1c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c1bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c1c06ca50 0x7f1c1c0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49748/0 (socket says 172.21.15.97:49748) 2023-12-04T05:36:45.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.263+0000 7f1c1bfff640 1 -- 172.21.15.97:0/3347183313 learned_addr learned my addr 172.21.15.97:0/3347183313 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:45.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1b7fe640 1 --2- 172.21.15.97:0/3347183313 >> v2:172.21.15.143:3300/0 conn(0x7f1c1c14e970 0x7f1c1c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1bfff640 1 -- 172.21.15.97:0/3347183313 >> v2:172.21.15.143:3300/0 conn(0x7f1c1c14e970 msgr2=0x7f1c1c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:45.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1bfff640 1 --2- 172.21.15.97:0/3347183313 >> v2:172.21.15.143:3300/0 conn(0x7f1c1c14e970 0x7f1c1c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1bfff640 1 -- 172.21.15.97:0/3347183313 >> v1:172.21.15.143:6789/0 conn(0x7f1c1c06be00 legacy=0x7f1c1c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:45.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1bfff640 1 -- 172.21.15.97:0/3347183313 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c151d60 con 0x7f1c1c06ca50 2023-12-04T05:36:45.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1bfff640 1 --2- 172.21.15.97:0/3347183313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06ca50 0x7f1c1c0c1880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c072510 tx=0x7f1c1401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51986dc1163ad715 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1a7fc640 1 -- 172.21.15.97:0/3347183313 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a57c0 con 0x7f1c1c06ca50 2023-12-04T05:36:45.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1a7fc640 1 -- 172.21.15.97:0/3347183313 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140a5920 con 0x7f1c1c06ca50 2023-12-04T05:36:45.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c1a7fc640 1 -- 172.21.15.97:0/3347183313 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a5cb0 con 0x7f1c1c06ca50 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 -- 172.21.15.97:0/3347183313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06ca50 msgr2=0x7f1c1c0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 --2- 172.21.15.97:0/3347183313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06ca50 0x7f1c1c0c1880 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c072510 tx=0x7f1c1401c900 comp rx=0 tx=0).stop 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 -- 172.21.15.97:0/3347183313 shutdown_connections 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 --2- 172.21.15.97:0/3347183313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06ca50 0x7f1c1c0c1880 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 --2- 172.21.15.97:0/3347183313 >> v2:172.21.15.143:3300/0 conn(0x7f1c1c14e970 0x7f1c1c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.267+0000 7f1c21c79640 1 -- 172.21.15.97:0/3347183313 >> 172.21.15.97:0/3347183313 conn(0x7f1c1c0c2970 msgr2=0x7f1c1c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- 172.21.15.97:0/3347183313 shutdown_connections 2023-12-04T05:36:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- 172.21.15.97:0/3347183313 wait complete. 2023-12-04T05:36:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 Processor -- start 2023-12-04T05:36:45.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- start start 2023-12-04T05:36:45.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c1c06ca50 0x7f1c1c1ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c1c14e970 0x7f1c1c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1ebb30 con 0x7f1c1c06be00 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1ee130 con 0x7f1c1c14e970 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c21c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c147ef0 con 0x7f1c1c06ca50 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49756/0 (socket says 172.21.15.97:49756) 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 -- 172.21.15.97:0/711083209 learned_addr learned my addr 172.21.15.97:0/711083209 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1affd640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c1c06ca50 0x7f1c1c1ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1bfff640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c1c14e970 0x7f1c1c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 -- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c1c06ca50 msgr2=0x7f1c1c1ee8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c1c06ca50 0x7f1c1c1ee8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 -- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c1c14e970 msgr2=0x7f1c1c14fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c1c14e970 0x7f1c1c14fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.271+0000 7f1c1b7fe640 1 -- 172.21.15.97:0/711083209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009b30 con 0x7f1c1c06be00 2023-12-04T05:36:45.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c1b7fe640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d650 tx=0x7f1c0c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00b6c0 con 0x7f1c1c06be00 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c00b820 con 0x7f1c1c06be00 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00bbb0 con 0x7f1c1c06be00 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c152fd0 con 0x7f1c1c06be00 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c1ee380 con 0x7f1c1c06be00 2023-12-04T05:36:45.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c1ee510 con 0x7f1c1c06be00 2023-12-04T05:36:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c0c00bd10 con 0x7f1c1c06be00 2023-12-04T05:36:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 0x7f1c08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c0c0847d0 con 0x7f1c1c06be00 2023-12-04T05:36:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c1affd640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 0x7f1c08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.275+0000 7f1c1affd640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 0x7f1c08068d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0707f0 tx=0x7f1c10009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.279+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c0c051ab0 con 0x7f1c1c06be00 2023-12-04T05:36:45.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.427+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c1c0a85f0 con 0x7f1c080668d0 2023-12-04T05:36:45.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c03fff640 1 -- 172.21.15.97:0/711083209 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264649 (secure 0 0 0) 0x7f1c10009530 con 0x7f1c080668d0 2023-12-04T05:36:45.438 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:45.440 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 msgr2=0x7f1c08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 0x7f1c08068d90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0707f0 tx=0x7f1c10009060 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 msgr2=0x7f1c1c1479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d650 tx=0x7f1c0c00db10 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 shutdown_connections 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c080668d0 0x7f1c08068d90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c1c14e970 0x7f1c1c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c1c06ca50 0x7f1c1c1ee8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 --2- 172.21.15.97:0/711083209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c1c06be00 0x7f1c1c1479b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.435+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 >> 172.21.15.97:0/711083209 conn(0x7f1c1c0c2970 msgr2=0x7f1c1c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.439+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 shutdown_connections 2023-12-04T05:36:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.439+0000 7f1c21c79640 1 -- 172.21.15.97:0/711083209 wait complete. 2023-12-04T05:36:45.459 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-04T05:36:44.191916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2830336,"data_stored":1721336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.313425"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929075+0000","last_change":"2023-12-04T05:36:40.924610+0000","last_active":"2023-12-04T05:36:40.929075+0000","last_peered":"2023-12-04T05:36:40.929075+0000","last_clean":"2023-12-04T05:36:40.929075+0000","last_became_active":"2023-12-04T05:36:40.924042+0000","last_became_peered":"2023-12-04T05:36:40.924042+0000","last_unstale":"2023-12-04T05:36:40.929075+0000","last_undegraded":"2023-12-04T05:36:40.929075+0000","last_fullsized":"2023-12-04T05:36:40.929075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894819+0000","last_change":"2023-12-04T05:36:40.915527+0000","last_active":"2023-12-04T05:36:41.894819+0000","last_peered":"2023-12-04T05:36:41.894819+0000","last_clean":"2023-12-04T05:36:41.894819+0000","last_became_active":"2023-12-04T05:36:40.915173+0000","last_became_peered":"2023-12-04T05:36:40.915173+0000","last_unstale":"2023-12-04T05:36:41.894819+0000","last_undegraded":"2023-12-04T05:36:41.894819+0000","last_fullsized":"2023-12-04T05:36:41.894819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915392+0000","last_change":"2023-12-04T05:36:40.913206+0000","last_active":"2023-12-04T05:36:40.915392+0000","last_peered":"2023-12-04T05:36:40.915392+0000","last_clean":"2023-12-04T05:36:40.915392+0000","last_became_active":"2023-12-04T05:36:40.912745+0000","last_became_peered":"2023-12-04T05:36:40.912745+0000","last_unstale":"2023-12-04T05:36:40.915392+0000","last_undegraded":"2023-12-04T05:36:40.915392+0000","last_fullsized":"2023-12-04T05:36:40.915392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929244+0000","last_change":"2023-12-04T05:36:40.922261+0000","last_active":"2023-12-04T05:36:40.929244+0000","last_peered":"2023-12-04T05:36:40.929244+0000","last_clean":"2023-12-04T05:36:40.929244+0000","last_became_active":"2023-12-04T05:36:40.920113+0000","last_became_peered":"2023-12-04T05:36:40.920113+0000","last_unstale":"2023-12-04T05:36:40.929244+0000","last_undegraded":"2023-12-04T05:36:40.929244+0000","last_fullsized":"2023-12-04T05:36:40.929244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929088+0000","last_change":"2023-12-04T05:36:40.919483+0000","last_active":"2023-12-04T05:36:40.929088+0000","last_peered":"2023-12-04T05:36:40.929088+0000","last_clean":"2023-12-04T05:36:40.929088+0000","last_became_active":"2023-12-04T05:36:40.919062+0000","last_became_peered":"2023-12-04T05:36:40.919062+0000","last_unstale":"2023-12-04T05:36:40.929088+0000","last_undegraded":"2023-12-04T05:36:40.929088+0000","last_fullsized":"2023-12-04T05:36:40.929088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925897+0000","last_change":"2023-12-04T05:36:40.918746+0000","last_active":"2023-12-04T05:36:40.925897+0000","last_peered":"2023-12-04T05:36:40.925897+0000","last_clean":"2023-12-04T05:36:40.925897+0000","last_became_active":"2023-12-04T05:36:40.918449+0000","last_became_peered":"2023-12-04T05:36:40.918449+0000","last_unstale":"2023-12-04T05:36:40.925897+0000","last_undegraded":"2023-12-04T05:36:40.925897+0000","last_fullsized":"2023-12-04T05:36:40.925897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923592+0000","last_change":"2023-12-04T05:36:40.917608+0000","last_active":"2023-12-04T05:36:40.923592+0000","last_peered":"2023-12-04T05:36:40.923592+0000","last_clean":"2023-12-04T05:36:40.923592+0000","last_became_active":"2023-12-04T05:36:40.917298+0000","last_became_peered":"2023-12-04T05:36:40.917298+0000","last_unstale":"2023-12-04T05:36:40.923592+0000","last_undegraded":"2023-12-04T05:36:40.923592+0000","last_fullsized":"2023-12-04T05:36:40.923592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:21.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928031+0000","last_change":"2023-12-04T05:36:40.925544+0000","last_active":"2023-12-04T05:36:40.928031+0000","last_peered":"2023-12-04T05:36:40.928031+0000","last_clean":"2023-12-04T05:36:40.928031+0000","last_became_active":"2023-12-04T05:36:40.925230+0000","last_became_peered":"2023-12-04T05:36:40.925230+0000","last_unstale":"2023-12-04T05:36:40.928031+0000","last_undegraded":"2023-12-04T05:36:40.928031+0000","last_fullsized":"2023-12-04T05:36:40.928031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929096+0000","last_change":"2023-12-04T05:36:40.924730+0000","last_active":"2023-12-04T05:36:40.929096+0000","last_peered":"2023-12-04T05:36:40.929096+0000","last_clean":"2023-12-04T05:36:40.929096+0000","last_became_active":"2023-12-04T05:36:40.924315+0000","last_became_peered":"2023-12-04T05:36:40.924315+0000","last_unstale":"2023-12-04T05:36:40.929096+0000","last_undegraded":"2023-12-04T05:36:40.929096+0000","last_fullsized":"2023-12-04T05:36:40.929096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897856+0000","last_change":"2023-12-04T05:36:40.919533+0000","last_active":"2023-12-04T05:36:41.897856+0000","last_peered":"2023-12-04T05:36:41.897856+0000","last_clean":"2023-12-04T05:36:41.897856+0000","last_became_active":"2023-12-04T05:36:40.919231+0000","last_became_peered":"2023-12-04T05:36:40.919231+0000","last_unstale":"2023-12-04T05:36:41.897856+0000","last_undegraded":"2023-12-04T05:36:41.897856+0000","last_fullsized":"2023-12-04T05:36:41.897856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897623+0000","last_change":"2023-12-04T05:36:40.926975+0000","last_active":"2023-12-04T05:36:41.897623+0000","last_peered":"2023-12-04T05:36:41.897623+0000","last_clean":"2023-12-04T05:36:41.897623+0000","last_became_active":"2023-12-04T05:36:40.926698+0000","last_became_peered":"2023-12-04T05:36:40.926698+0000","last_unstale":"2023-12-04T05:36:41.897623+0000","last_undegraded":"2023-12-04T05:36:41.897623+0000","last_fullsized":"2023-12-04T05:36:41.897623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899008+0000","last_change":"2023-12-04T05:36:40.898383+0000","last_active":"2023-12-04T05:36:41.899008+0000","last_peered":"2023-12-04T05:36:41.899008+0000","last_clean":"2023-12-04T05:36:41.899008+0000","last_became_active":"2023-12-04T05:36:40.898076+0000","last_became_peered":"2023-12-04T05:36:40.898076+0000","last_unstale":"2023-12-04T05:36:41.899008+0000","last_undegraded":"2023-12-04T05:36:41.899008+0000","last_fullsized":"2023-12-04T05:36:41.899008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923790+0000","last_change":"2023-12-04T05:36:40.917782+0000","last_active":"2023-12-04T05:36:40.923790+0000","last_peered":"2023-12-04T05:36:40.923790+0000","last_clean":"2023-12-04T05:36:40.923790+0000","last_became_active":"2023-12-04T05:36:40.917501+0000","last_became_peered":"2023-12-04T05:36:40.917501+0000","last_unstale":"2023-12-04T05:36:40.923790+0000","last_undegraded":"2023-12-04T05:36:40.923790+0000","last_fullsized":"2023-12-04T05:36:40.923790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.919366+0000","last_change":"2023-12-04T05:36:40.914405+0000","last_active":"2023-12-04T05:36:40.919366+0000","last_peered":"2023-12-04T05:36:40.919366+0000","last_clean":"2023-12-04T05:36:40.919366+0000","last_became_active":"2023-12-04T05:36:40.913309+0000","last_became_peered":"2023-12-04T05:36:40.913309+0000","last_unstale":"2023-12-04T05:36:40.919366+0000","last_undegraded":"2023-12-04T05:36:40.919366+0000","last_fullsized":"2023-12-04T05:36:40.919366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:56.645765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894524+0000","last_change":"2023-12-04T05:36:40.913295+0000","last_active":"2023-12-04T05:36:41.894524+0000","last_peered":"2023-12-04T05:36:41.894524+0000","last_clean":"2023-12-04T05:36:41.894524+0000","last_became_active":"2023-12-04T05:36:40.913033+0000","last_became_peered":"2023-12-04T05:36:40.913033+0000","last_unstale":"2023-12-04T05:36:41.894524+0000","last_undegraded":"2023-12-04T05:36:41.894524+0000","last_fullsized":"2023-12-04T05:36:41.894524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928398+0000","last_change":"2023-12-04T05:36:40.919008+0000","last_active":"2023-12-04T05:36:40.928398+0000","last_peered":"2023-12-04T05:36:40.928398+0000","last_clean":"2023-12-04T05:36:40.928398+0000","last_became_active":"2023-12-04T05:36:40.918703+0000","last_became_peered":"2023-12-04T05:36:40.918703+0000","last_unstale":"2023-12-04T05:36:40.928398+0000","last_undegraded":"2023-12-04T05:36:40.928398+0000","last_fullsized":"2023-12-04T05:36:40.928398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931622+0000","last_change":"2023-12-04T05:36:40.924655+0000","last_active":"2023-12-04T05:36:40.931622+0000","last_peered":"2023-12-04T05:36:40.931622+0000","last_clean":"2023-12-04T05:36:40.931622+0000","last_became_active":"2023-12-04T05:36:40.924415+0000","last_became_peered":"2023-12-04T05:36:40.924415+0000","last_unstale":"2023-12-04T05:36:40.931622+0000","last_undegraded":"2023-12-04T05:36:40.931622+0000","last_fullsized":"2023-12-04T05:36:40.931622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915795+0000","last_change":"2023-12-04T05:36:40.911088+0000","last_active":"2023-12-04T05:36:40.915795+0000","last_peered":"2023-12-04T05:36:40.915795+0000","last_clean":"2023-12-04T05:36:40.915795+0000","last_became_active":"2023-12-04T05:36:40.910145+0000","last_became_peered":"2023-12-04T05:36:40.910145+0000","last_unstale":"2023-12-04T05:36:40.915795+0000","last_undegraded":"2023-12-04T05:36:40.915795+0000","last_fullsized":"2023-12-04T05:36:40.915795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929191+0000","last_change":"2023-12-04T05:36:40.918175+0000","last_active":"2023-12-04T05:36:40.929191+0000","last_peered":"2023-12-04T05:36:40.929191+0000","last_clean":"2023-12-04T05:36:40.929191+0000","last_became_active":"2023-12-04T05:36:40.917878+0000","last_became_peered":"2023-12-04T05:36:40.917878+0000","last_unstale":"2023-12-04T05:36:40.929191+0000","last_undegraded":"2023-12-04T05:36:40.929191+0000","last_fullsized":"2023-12-04T05:36:40.929191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897513+0000","last_change":"2023-12-04T05:36:40.898605+0000","last_active":"2023-12-04T05:36:41.897513+0000","last_peered":"2023-12-04T05:36:41.897513+0000","last_clean":"2023-12-04T05:36:41.897513+0000","last_became_active":"2023-12-04T05:36:40.898258+0000","last_became_peered":"2023-12-04T05:36:40.898258+0000","last_unstale":"2023-12-04T05:36:41.897513+0000","last_undegraded":"2023-12-04T05:36:41.897513+0000","last_fullsized":"2023-12-04T05:36:41.897513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923195+0000","last_change":"2023-12-04T05:36:40.916797+0000","last_active":"2023-12-04T05:36:40.923195+0000","last_peered":"2023-12-04T05:36:40.923195+0000","last_clean":"2023-12-04T05:36:40.923195+0000","last_became_active":"2023-12-04T05:36:40.916495+0000","last_became_peered":"2023-12-04T05:36:40.916495+0000","last_unstale":"2023-12-04T05:36:40.923195+0000","last_undegraded":"2023-12-04T05:36:40.923195+0000","last_fullsized":"2023-12-04T05:36:40.923195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929195+0000","last_change":"2023-12-04T05:36:40.922172+0000","last_active":"2023-12-04T05:36:40.929195+0000","last_peered":"2023-12-04T05:36:40.929195+0000","last_clean":"2023-12-04T05:36:40.929195+0000","last_became_active":"2023-12-04T05:36:40.921340+0000","last_became_peered":"2023-12-04T05:36:40.921340+0000","last_unstale":"2023-12-04T05:36:40.929195+0000","last_undegraded":"2023-12-04T05:36:40.929195+0000","last_fullsized":"2023-12-04T05:36:40.929195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.927983+0000","last_change":"2023-12-04T05:36:40.924182+0000","last_active":"2023-12-04T05:36:40.927983+0000","last_peered":"2023-12-04T05:36:40.927983+0000","last_clean":"2023-12-04T05:36:40.927983+0000","last_became_active":"2023-12-04T05:36:40.923964+0000","last_became_peered":"2023-12-04T05:36:40.923964+0000","last_unstale":"2023-12-04T05:36:40.927983+0000","last_undegraded":"2023-12-04T05:36:40.927983+0000","last_fullsized":"2023-12-04T05:36:40.927983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931645+0000","last_change":"2023-12-04T05:36:40.925487+0000","last_active":"2023-12-04T05:36:40.931645+0000","last_peered":"2023-12-04T05:36:40.931645+0000","last_clean":"2023-12-04T05:36:40.931645+0000","last_became_active":"2023-12-04T05:36:40.925100+0000","last_became_peered":"2023-12-04T05:36:40.925100+0000","last_unstale":"2023-12-04T05:36:40.931645+0000","last_undegraded":"2023-12-04T05:36:40.931645+0000","last_fullsized":"2023-12-04T05:36:40.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923626+0000","last_change":"2023-12-04T05:36:40.917356+0000","last_active":"2023-12-04T05:36:40.923626+0000","last_peered":"2023-12-04T05:36:40.923626+0000","last_clean":"2023-12-04T05:36:40.923626+0000","last_became_active":"2023-12-04T05:36:40.917079+0000","last_became_peered":"2023-12-04T05:36:40.917079+0000","last_unstale":"2023-12-04T05:36:40.923626+0000","last_undegraded":"2023-12-04T05:36:40.923626+0000","last_fullsized":"2023-12-04T05:36:40.923626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897895+0000","last_change":"2023-12-04T05:36:40.923445+0000","last_active":"2023-12-04T05:36:41.897895+0000","last_peered":"2023-12-04T05:36:41.897895+0000","last_clean":"2023-12-04T05:36:41.897895+0000","last_became_active":"2023-12-04T05:36:40.923197+0000","last_became_peered":"2023-12-04T05:36:40.923197+0000","last_unstale":"2023-12-04T05:36:41.897895+0000","last_undegraded":"2023-12-04T05:36:41.897895+0000","last_fullsized":"2023-12-04T05:36:41.897895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894822+0000","last_change":"2023-12-04T05:36:40.925226+0000","last_active":"2023-12-04T05:36:41.894822+0000","last_peered":"2023-12-04T05:36:41.894822+0000","last_clean":"2023-12-04T05:36:41.894822+0000","last_became_active":"2023-12-04T05:36:40.924880+0000","last_became_peered":"2023-12-04T05:36:40.924880+0000","last_unstale":"2023-12-04T05:36:41.894822+0000","last_undegraded":"2023-12-04T05:36:41.894822+0000","last_fullsized":"2023-12-04T05:36:41.894822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923746+0000","last_change":"2023-12-04T05:36:40.917579+0000","last_active":"2023-12-04T05:36:40.923746+0000","last_peered":"2023-12-04T05:36:40.923746+0000","last_clean":"2023-12-04T05:36:40.923746+0000","last_became_active":"2023-12-04T05:36:40.917049+0000","last_became_peered":"2023-12-04T05:36:40.917049+0000","last_unstale":"2023-12-04T05:36:40.923746+0000","last_undegraded":"2023-12-04T05:36:40.923746+0000","last_fullsized":"2023-12-04T05:36:40.923746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923214+0000","last_change":"2023-12-04T05:36:40.919114+0000","last_active":"2023-12-04T05:36:40.923214+0000","last_peered":"2023-12-04T05:36:40.923214+0000","last_clean":"2023-12-04T05:36:40.923214+0000","last_became_active":"2023-12-04T05:36:40.918821+0000","last_became_peered":"2023-12-04T05:36:40.918821+0000","last_unstale":"2023-12-04T05:36:40.923214+0000","last_undegraded":"2023-12-04T05:36:40.923214+0000","last_fullsized":"2023-12-04T05:36:40.923214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929118+0000","last_change":"2023-12-04T05:36:40.920720+0000","last_active":"2023-12-04T05:36:40.929118+0000","last_peered":"2023-12-04T05:36:40.929118+0000","last_clean":"2023-12-04T05:36:40.929118+0000","last_became_active":"2023-12-04T05:36:40.920392+0000","last_became_peered":"2023-12-04T05:36:40.920392+0000","last_unstale":"2023-12-04T05:36:40.929118+0000","last_undegraded":"2023-12-04T05:36:40.929118+0000","last_fullsized":"2023-12-04T05:36:40.929118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:22.183743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930684+0000","last_change":"2023-12-04T05:36:40.920292+0000","last_active":"2023-12-04T05:36:40.930684+0000","last_peered":"2023-12-04T05:36:40.930684+0000","last_clean":"2023-12-04T05:36:40.930684+0000","last_became_active":"2023-12-04T05:36:40.919985+0000","last_became_peered":"2023-12-04T05:36:40.919985+0000","last_unstale":"2023-12-04T05:36:40.930684+0000","last_undegraded":"2023-12-04T05:36:40.930684+0000","last_fullsized":"2023-12-04T05:36:40.930684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897439+0000","last_change":"2023-12-04T05:36:40.902425+0000","last_active":"2023-12-04T05:36:41.897439+0000","last_peered":"2023-12-04T05:36:41.897439+0000","last_clean":"2023-12-04T05:36:41.897439+0000","last_became_active":"2023-12-04T05:36:40.902138+0000","last_became_peered":"2023-12-04T05:36:40.902138+0000","last_unstale":"2023-12-04T05:36:41.897439+0000","last_undegraded":"2023-12-04T05:36:41.897439+0000","last_fullsized":"2023-12-04T05:36:41.897439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.898859+0000","last_change":"2023-12-04T05:36:40.918990+0000","last_active":"2023-12-04T05:36:41.898859+0000","last_peered":"2023-12-04T05:36:41.898859+0000","last_clean":"2023-12-04T05:36:41.898859+0000","last_became_active":"2023-12-04T05:36:40.916920+0000","last_became_peered":"2023-12-04T05:36:40.916920+0000","last_unstale":"2023-12-04T05:36:41.898859+0000","last_undegraded":"2023-12-04T05:36:41.898859+0000","last_fullsized":"2023-12-04T05:36:41.898859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981288+0000","last_change":"2023-12-04T05:36:39.916724+0000","last_active":"2023-12-04T05:36:40.981288+0000","last_peered":"2023-12-04T05:36:40.981288+0000","last_clean":"2023-12-04T05:36:40.981288+0000","last_became_active":"2023-12-04T05:36:39.916408+0000","last_became_peered":"2023-12-04T05:36:39.916408+0000","last_unstale":"2023-12-04T05:36:40.981288+0000","last_undegraded":"2023-12-04T05:36:40.981288+0000","last_fullsized":"2023-12-04T05:36:40.981288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.913088+0000","last_change":"2023-12-04T05:36:40.908915+0000","last_active":"2023-12-04T05:36:40.913088+0000","last_peered":"2023-12-04T05:36:40.913088+0000","last_clean":"2023-12-04T05:36:40.913088+0000","last_became_active":"2023-12-04T05:36:40.908571+0000","last_became_peered":"2023-12-04T05:36:40.908571+0000","last_unstale":"2023-12-04T05:36:40.913088+0000","last_undegraded":"2023-12-04T05:36:40.913088+0000","last_fullsized":"2023-12-04T05:36:40.913088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897458+0000","last_change":"2023-12-04T05:36:39.912675+0000","last_active":"2023-12-04T05:36:41.897458+0000","last_peered":"2023-12-04T05:36:41.897458+0000","last_clean":"2023-12-04T05:36:41.897458+0000","last_became_active":"2023-12-04T05:36:39.912299+0000","last_became_peered":"2023-12-04T05:36:39.912299+0000","last_unstale":"2023-12-04T05:36:41.897458+0000","last_undegraded":"2023-12-04T05:36:41.897458+0000","last_fullsized":"2023-12-04T05:36:41.897458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.918093+0000","last_change":"2023-12-04T05:36:39.906738+0000","last_active":"2023-12-04T05:36:40.918093+0000","last_peered":"2023-12-04T05:36:40.918093+0000","last_clean":"2023-12-04T05:36:40.918093+0000","last_became_active":"2023-12-04T05:36:39.906463+0000","last_became_peered":"2023-12-04T05:36:39.906463+0000","last_unstale":"2023-12-04T05:36:40.918093+0000","last_undegraded":"2023-12-04T05:36:40.918093+0000","last_fullsized":"2023-12-04T05:36:40.918093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923852+0000","last_change":"2023-12-04T05:36:40.919035+0000","last_active":"2023-12-04T05:36:40.923852+0000","last_peered":"2023-12-04T05:36:40.923852+0000","last_clean":"2023-12-04T05:36:40.923852+0000","last_became_active":"2023-12-04T05:36:40.914346+0000","last_became_peered":"2023-12-04T05:36:40.914346+0000","last_unstale":"2023-12-04T05:36:40.923852+0000","last_undegraded":"2023-12-04T05:36:40.923852+0000","last_fullsized":"2023-12-04T05:36:40.923852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:11.444282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914466+0000","last_change":"2023-12-04T05:36:39.920898+0000","last_active":"2023-12-04T05:36:40.914466+0000","last_peered":"2023-12-04T05:36:40.914466+0000","last_clean":"2023-12-04T05:36:40.914466+0000","last_became_active":"2023-12-04T05:36:39.920625+0000","last_became_peered":"2023-12-04T05:36:39.920625+0000","last_unstale":"2023-12-04T05:36:40.914466+0000","last_undegraded":"2023-12-04T05:36:40.914466+0000","last_fullsized":"2023-12-04T05:36:40.914466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894571+0000","last_change":"2023-12-04T05:36:40.925470+0000","last_active":"2023-12-04T05:36:41.894571+0000","last_peered":"2023-12-04T05:36:41.894571+0000","last_clean":"2023-12-04T05:36:41.894571+0000","last_became_active":"2023-12-04T05:36:40.925129+0000","last_became_peered":"2023-12-04T05:36:40.925129+0000","last_unstale":"2023-12-04T05:36:41.894571+0000","last_undegraded":"2023-12-04T05:36:41.894571+0000","last_fullsized":"2023-12-04T05:36:41.894571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897835+0000","last_change":"2023-12-04T05:36:39.912643+0000","last_active":"2023-12-04T05:36:41.897835+0000","last_peered":"2023-12-04T05:36:41.897835+0000","last_clean":"2023-12-04T05:36:41.897835+0000","last_became_active":"2023-12-04T05:36:39.909337+0000","last_became_peered":"2023-12-04T05:36:39.909337+0000","last_unstale":"2023-12-04T05:36:41.897835+0000","last_undegraded":"2023-12-04T05:36:41.897835+0000","last_fullsized":"2023-12-04T05:36:41.897835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930216+0000","last_change":"2023-12-04T05:36:40.921153+0000","last_active":"2023-12-04T05:36:40.930216+0000","last_peered":"2023-12-04T05:36:40.930216+0000","last_clean":"2023-12-04T05:36:40.930216+0000","last_became_active":"2023-12-04T05:36:40.920456+0000","last_became_peered":"2023-12-04T05:36:40.920456+0000","last_unstale":"2023-12-04T05:36:40.930216+0000","last_undegraded":"2023-12-04T05:36:40.930216+0000","last_fullsized":"2023-12-04T05:36:40.930216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915353+0000","last_change":"2023-12-04T05:36:39.918009+0000","last_active":"2023-12-04T05:36:40.915353+0000","last_peered":"2023-12-04T05:36:40.915353+0000","last_clean":"2023-12-04T05:36:40.915353+0000","last_became_active":"2023-12-04T05:36:39.917694+0000","last_became_peered":"2023-12-04T05:36:39.917694+0000","last_unstale":"2023-12-04T05:36:40.915353+0000","last_undegraded":"2023-12-04T05:36:40.915353+0000","last_fullsized":"2023-12-04T05:36:40.915353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:22.492160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.930728+0000","last_change":"2023-12-04T05:36:40.919239+0000","last_active":"2023-12-04T05:36:40.930728+0000","last_peered":"2023-12-04T05:36:40.930728+0000","last_clean":"2023-12-04T05:36:40.930728+0000","last_became_active":"2023-12-04T05:36:40.918774+0000","last_became_peered":"2023-12-04T05:36:40.918774+0000","last_unstale":"2023-12-04T05:36:40.930728+0000","last_undegraded":"2023-12-04T05:36:40.930728+0000","last_fullsized":"2023-12-04T05:36:40.930728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894788+0000","last_change":"2023-12-04T05:36:39.921145+0000","last_active":"2023-12-04T05:36:41.894788+0000","last_peered":"2023-12-04T05:36:41.894788+0000","last_clean":"2023-12-04T05:36:41.894788+0000","last_became_active":"2023-12-04T05:36:39.920191+0000","last_became_peered":"2023-12-04T05:36:39.920191+0000","last_unstale":"2023-12-04T05:36:41.894788+0000","last_undegraded":"2023-12-04T05:36:41.894788+0000","last_fullsized":"2023-12-04T05:36:41.894788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899199+0000","last_change":"2023-12-04T05:36:40.917431+0000","last_active":"2023-12-04T05:36:41.899199+0000","last_peered":"2023-12-04T05:36:41.899199+0000","last_clean":"2023-12-04T05:36:41.899199+0000","last_became_active":"2023-12-04T05:36:40.917118+0000","last_became_peered":"2023-12-04T05:36:40.917118+0000","last_unstale":"2023-12-04T05:36:41.899199+0000","last_undegraded":"2023-12-04T05:36:41.899199+0000","last_fullsized":"2023-12-04T05:36:41.899199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897552+0000","last_change":"2023-12-04T05:36:39.916187+0000","last_active":"2023-12-04T05:36:41.897552+0000","last_peered":"2023-12-04T05:36:41.897552+0000","last_clean":"2023-12-04T05:36:41.897552+0000","last_became_active":"2023-12-04T05:36:39.915832+0000","last_became_peered":"2023-12-04T05:36:39.915832+0000","last_unstale":"2023-12-04T05:36:41.897552+0000","last_undegraded":"2023-12-04T05:36:41.897552+0000","last_fullsized":"2023-12-04T05:36:41.897552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931479+0000","last_change":"2023-12-04T05:36:40.929289+0000","last_active":"2023-12-04T05:36:40.931479+0000","last_peered":"2023-12-04T05:36:40.931479+0000","last_clean":"2023-12-04T05:36:40.931479+0000","last_became_active":"2023-12-04T05:36:40.929006+0000","last_became_peered":"2023-12-04T05:36:40.929006+0000","last_unstale":"2023-12-04T05:36:40.931479+0000","last_undegraded":"2023-12-04T05:36:40.931479+0000","last_fullsized":"2023-12-04T05:36:40.931479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:03.235719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.982383+0000","last_change":"2023-12-04T05:36:39.909850+0000","last_active":"2023-12-04T05:36:40.982383+0000","last_peered":"2023-12-04T05:36:40.982383+0000","last_clean":"2023-12-04T05:36:40.982383+0000","last_became_active":"2023-12-04T05:36:39.909515+0000","last_became_peered":"2023-12-04T05:36:39.909515+0000","last_unstale":"2023-12-04T05:36:40.982383+0000","last_undegraded":"2023-12-04T05:36:40.982383+0000","last_fullsized":"2023-12-04T05:36:40.982383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923241+0000","last_change":"2023-12-04T05:36:40.917716+0000","last_active":"2023-12-04T05:36:40.923241+0000","last_peered":"2023-12-04T05:36:40.923241+0000","last_clean":"2023-12-04T05:36:40.923241+0000","last_became_active":"2023-12-04T05:36:40.917449+0000","last_became_peered":"2023-12-04T05:36:40.917449+0000","last_unstale":"2023-12-04T05:36:40.923241+0000","last_undegraded":"2023-12-04T05:36:40.923241+0000","last_fullsized":"2023-12-04T05:36:40.923241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914808+0000","last_change":"2023-12-04T05:36:39.919474+0000","last_active":"2023-12-04T05:36:40.914808+0000","last_peered":"2023-12-04T05:36:40.914808+0000","last_clean":"2023-12-04T05:36:40.914808+0000","last_became_active":"2023-12-04T05:36:39.919051+0000","last_became_peered":"2023-12-04T05:36:39.919051+0000","last_unstale":"2023-12-04T05:36:40.914808+0000","last_undegraded":"2023-12-04T05:36:40.914808+0000","last_fullsized":"2023-12-04T05:36:40.914808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:12.727217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929110+0000","last_change":"2023-12-04T05:36:40.919992+0000","last_active":"2023-12-04T05:36:40.929110+0000","last_peered":"2023-12-04T05:36:40.929110+0000","last_clean":"2023-12-04T05:36:40.929110+0000","last_became_active":"2023-12-04T05:36:40.919720+0000","last_became_peered":"2023-12-04T05:36:40.919720+0000","last_unstale":"2023-12-04T05:36:40.929110+0000","last_undegraded":"2023-12-04T05:36:40.929110+0000","last_fullsized":"2023-12-04T05:36:40.929110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897599+0000","last_change":"2023-12-04T05:36:39.908368+0000","last_active":"2023-12-04T05:36:41.897599+0000","last_peered":"2023-12-04T05:36:41.897599+0000","last_clean":"2023-12-04T05:36:41.897599+0000","last_became_active":"2023-12-04T05:36:39.907946+0000","last_became_peered":"2023-12-04T05:36:39.907946+0000","last_unstale":"2023-12-04T05:36:41.897599+0000","last_undegraded":"2023-12-04T05:36:41.897599+0000","last_fullsized":"2023-12-04T05:36:41.897599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897271+0000","last_change":"2023-12-04T05:36:40.907233+0000","last_active":"2023-12-04T05:36:41.897271+0000","last_peered":"2023-12-04T05:36:41.897271+0000","last_clean":"2023-12-04T05:36:41.897271+0000","last_became_active":"2023-12-04T05:36:40.906854+0000","last_became_peered":"2023-12-04T05:36:40.906854+0000","last_unstale":"2023-12-04T05:36:41.897271+0000","last_undegraded":"2023-12-04T05:36:41.897271+0000","last_fullsized":"2023-12-04T05:36:41.897271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983130+0000","last_change":"2023-12-04T05:36:39.901154+0000","last_active":"2023-12-04T05:36:40.983130+0000","last_peered":"2023-12-04T05:36:40.983130+0000","last_clean":"2023-12-04T05:36:40.983130+0000","last_became_active":"2023-12-04T05:36:39.900871+0000","last_became_peered":"2023-12-04T05:36:39.900871+0000","last_unstale":"2023-12-04T05:36:40.983130+0000","last_undegraded":"2023-12-04T05:36:40.983130+0000","last_fullsized":"2023-12-04T05:36:40.983130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923609+0000","last_change":"2023-12-04T05:36:40.918025+0000","last_active":"2023-12-04T05:36:40.923609+0000","last_peered":"2023-12-04T05:36:40.923609+0000","last_clean":"2023-12-04T05:36:40.923609+0000","last_became_active":"2023-12-04T05:36:40.917722+0000","last_became_peered":"2023-12-04T05:36:40.917722+0000","last_unstale":"2023-12-04T05:36:40.923609+0000","last_undegraded":"2023-12-04T05:36:40.923609+0000","last_fullsized":"2023-12-04T05:36:40.923609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899228+0000","last_change":"2023-12-04T05:36:39.913527+0000","last_active":"2023-12-04T05:36:41.899228+0000","last_peered":"2023-12-04T05:36:41.899228+0000","last_clean":"2023-12-04T05:36:41.899228+0000","last_became_active":"2023-12-04T05:36:39.911602+0000","last_became_peered":"2023-12-04T05:36:39.911602+0000","last_unstale":"2023-12-04T05:36:41.899228+0000","last_undegraded":"2023-12-04T05:36:41.899228+0000","last_fullsized":"2023-12-04T05:36:41.899228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:10.437590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929532+0000","last_change":"2023-12-04T05:36:40.926649+0000","last_active":"2023-12-04T05:36:40.929532+0000","last_peered":"2023-12-04T05:36:40.929532+0000","last_clean":"2023-12-04T05:36:40.929532+0000","last_became_active":"2023-12-04T05:36:40.926316+0000","last_became_peered":"2023-12-04T05:36:40.926316+0000","last_unstale":"2023-12-04T05:36:40.929532+0000","last_undegraded":"2023-12-04T05:36:40.929532+0000","last_fullsized":"2023-12-04T05:36:40.929532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983020+0000","last_change":"2023-12-04T05:36:39.915096+0000","last_active":"2023-12-04T05:36:40.983020+0000","last_peered":"2023-12-04T05:36:40.983020+0000","last_clean":"2023-12-04T05:36:40.983020+0000","last_became_active":"2023-12-04T05:36:39.914743+0000","last_became_peered":"2023-12-04T05:36:39.914743+0000","last_unstale":"2023-12-04T05:36:40.983020+0000","last_undegraded":"2023-12-04T05:36:40.983020+0000","last_fullsized":"2023-12-04T05:36:40.983020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:21.177051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929116+0000","last_change":"2023-12-04T05:36:40.925949+0000","last_active":"2023-12-04T05:36:40.929116+0000","last_peered":"2023-12-04T05:36:40.929116+0000","last_clean":"2023-12-04T05:36:40.929116+0000","last_became_active":"2023-12-04T05:36:40.925684+0000","last_became_peered":"2023-12-04T05:36:40.925684+0000","last_unstale":"2023-12-04T05:36:40.929116+0000","last_undegraded":"2023-12-04T05:36:40.929116+0000","last_fullsized":"2023-12-04T05:36:40.929116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894872+0000","last_change":"2023-12-04T05:36:39.906214+0000","last_active":"2023-12-04T05:36:41.894872+0000","last_peered":"2023-12-04T05:36:41.894872+0000","last_clean":"2023-12-04T05:36:41.894872+0000","last_became_active":"2023-12-04T05:36:39.905868+0000","last_became_peered":"2023-12-04T05:36:39.905868+0000","last_unstale":"2023-12-04T05:36:41.894872+0000","last_undegraded":"2023-12-04T05:36:41.894872+0000","last_fullsized":"2023-12-04T05:36:41.894872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.929225+0000","last_change":"2023-12-04T05:36:40.921297+0000","last_active":"2023-12-04T05:36:40.929225+0000","last_peered":"2023-12-04T05:36:40.929225+0000","last_clean":"2023-12-04T05:36:40.929225+0000","last_became_active":"2023-12-04T05:36:40.919804+0000","last_became_peered":"2023-12-04T05:36:40.919804+0000","last_unstale":"2023-12-04T05:36:40.929225+0000","last_undegraded":"2023-12-04T05:36:40.929225+0000","last_fullsized":"2023-12-04T05:36:40.929225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.906630+0000","last_change":"2023-12-04T05:36:39.920708+0000","last_active":"2023-12-04T05:36:40.906630+0000","last_peered":"2023-12-04T05:36:40.906630+0000","last_clean":"2023-12-04T05:36:40.906630+0000","last_became_active":"2023-12-04T05:36:39.920411+0000","last_became_peered":"2023-12-04T05:36:39.920411+0000","last_unstale":"2023-12-04T05:36:40.906630+0000","last_undegraded":"2023-12-04T05:36:40.906630+0000","last_fullsized":"2023-12-04T05:36:40.906630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931462+0000","last_change":"2023-12-04T05:36:40.929211+0000","last_active":"2023-12-04T05:36:40.931462+0000","last_peered":"2023-12-04T05:36:40.931462+0000","last_clean":"2023-12-04T05:36:40.931462+0000","last_became_active":"2023-12-04T05:36:40.928878+0000","last_became_peered":"2023-12-04T05:36:40.928878+0000","last_unstale":"2023-12-04T05:36:40.931462+0000","last_undegraded":"2023-12-04T05:36:40.931462+0000","last_fullsized":"2023-12-04T05:36:40.931462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-04T05:36:39.909071+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:36:39.909071+0000","last_peered":"2023-12-04T05:36:39.909071+0000","last_clean":"2023-12-04T05:36:39.909071+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:36:39.909071+0000","last_undegraded":"2023-12-04T05:36:39.909071+0000","last_fullsized":"2023-12-04T05:36:39.909071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.915024+0000","last_change":"2023-12-04T05:36:39.909994+0000","last_active":"2023-12-04T05:36:40.915024+0000","last_peered":"2023-12-04T05:36:40.915024+0000","last_clean":"2023-12-04T05:36:40.915024+0000","last_became_active":"2023-12-04T05:36:39.909676+0000","last_became_peered":"2023-12-04T05:36:39.909676+0000","last_unstale":"2023-12-04T05:36:40.915024+0000","last_undegraded":"2023-12-04T05:36:40.915024+0000","last_fullsized":"2023-12-04T05:36:40.915024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:26.127153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.924350+0000","last_change":"2023-12-04T05:36:40.922315+0000","last_active":"2023-12-04T05:36:40.924350+0000","last_peered":"2023-12-04T05:36:40.924350+0000","last_clean":"2023-12-04T05:36:40.924350+0000","last_became_active":"2023-12-04T05:36:40.922017+0000","last_became_peered":"2023-12-04T05:36:40.922017+0000","last_unstale":"2023-12-04T05:36:40.924350+0000","last_undegraded":"2023-12-04T05:36:40.924350+0000","last_fullsized":"2023-12-04T05:36:40.924350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:42.532041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907794+0000","last_change":"2023-12-04T05:36:39.917047+0000","last_active":"2023-12-04T05:36:40.907794+0000","last_peered":"2023-12-04T05:36:40.907794+0000","last_clean":"2023-12-04T05:36:40.907794+0000","last_became_active":"2023-12-04T05:36:39.915737+0000","last_became_peered":"2023-12-04T05:36:39.915737+0000","last_unstale":"2023-12-04T05:36:40.907794+0000","last_undegraded":"2023-12-04T05:36:40.907794+0000","last_fullsized":"2023-12-04T05:36:40.907794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.913946+0000","last_change":"2023-12-04T05:36:40.909850+0000","last_active":"2023-12-04T05:36:40.913946+0000","last_peered":"2023-12-04T05:36:40.913946+0000","last_clean":"2023-12-04T05:36:40.913946+0000","last_became_active":"2023-12-04T05:36:40.908954+0000","last_became_peered":"2023-12-04T05:36:40.908954+0000","last_unstale":"2023-12-04T05:36:40.913946+0000","last_undegraded":"2023-12-04T05:36:40.913946+0000","last_fullsized":"2023-12-04T05:36:40.913946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:11.444282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.906386+0000","last_change":"2023-12-04T05:36:39.900716+0000","last_active":"2023-12-04T05:36:40.906386+0000","last_peered":"2023-12-04T05:36:40.906386+0000","last_clean":"2023-12-04T05:36:40.906386+0000","last_became_active":"2023-12-04T05:36:39.898450+0000","last_became_peered":"2023-12-04T05:36:39.898450+0000","last_unstale":"2023-12-04T05:36:40.906386+0000","last_undegraded":"2023-12-04T05:36:40.906386+0000","last_fullsized":"2023-12-04T05:36:40.906386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894542+0000","last_change":"2023-12-04T05:36:40.912304+0000","last_active":"2023-12-04T05:36:41.894542+0000","last_peered":"2023-12-04T05:36:41.894542+0000","last_clean":"2023-12-04T05:36:41.894542+0000","last_became_active":"2023-12-04T05:36:40.912044+0000","last_became_peered":"2023-12-04T05:36:40.912044+0000","last_unstale":"2023-12-04T05:36:41.894542+0000","last_undegraded":"2023-12-04T05:36:41.894542+0000","last_fullsized":"2023-12-04T05:36:41.894542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.914836+0000","last_change":"2023-12-04T05:36:39.911421+0000","last_active":"2023-12-04T05:36:40.914836+0000","last_peered":"2023-12-04T05:36:40.914836+0000","last_clean":"2023-12-04T05:36:40.914836+0000","last_became_active":"2023-12-04T05:36:39.910797+0000","last_became_peered":"2023-12-04T05:36:39.910797+0000","last_unstale":"2023-12-04T05:36:40.914836+0000","last_undegraded":"2023-12-04T05:36:40.914836+0000","last_fullsized":"2023-12-04T05:36:40.914836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899038+0000","last_change":"2023-12-04T05:36:40.902536+0000","last_active":"2023-12-04T05:36:41.899038+0000","last_peered":"2023-12-04T05:36:41.899038+0000","last_clean":"2023-12-04T05:36:41.899038+0000","last_became_active":"2023-12-04T05:36:40.902158+0000","last_became_peered":"2023-12-04T05:36:40.902158+0000","last_unstale":"2023-12-04T05:36:41.899038+0000","last_undegraded":"2023-12-04T05:36:41.899038+0000","last_fullsized":"2023-12-04T05:36:41.899038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894718+0000","last_change":"2023-12-04T05:36:39.911969+0000","last_active":"2023-12-04T05:36:41.894718+0000","last_peered":"2023-12-04T05:36:41.894718+0000","last_clean":"2023-12-04T05:36:41.894718+0000","last_became_active":"2023-12-04T05:36:39.911783+0000","last_became_peered":"2023-12-04T05:36:39.911783+0000","last_unstale":"2023-12-04T05:36:41.894718+0000","last_undegraded":"2023-12-04T05:36:41.894718+0000","last_fullsized":"2023-12-04T05:36:41.894718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931694+0000","last_change":"2023-12-04T05:36:40.925817+0000","last_active":"2023-12-04T05:36:40.931694+0000","last_peered":"2023-12-04T05:36:40.931694+0000","last_clean":"2023-12-04T05:36:40.931694+0000","last_became_active":"2023-12-04T05:36:40.925448+0000","last_became_peered":"2023-12-04T05:36:40.925448+0000","last_unstale":"2023-12-04T05:36:40.931694+0000","last_undegraded":"2023-12-04T05:36:40.931694+0000","last_fullsized":"2023-12-04T05:36:40.931694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.910552+0000","last_change":"2023-12-04T05:36:39.921497+0000","last_active":"2023-12-04T05:36:40.910552+0000","last_peered":"2023-12-04T05:36:40.910552+0000","last_clean":"2023-12-04T05:36:40.910552+0000","last_became_active":"2023-12-04T05:36:39.921175+0000","last_became_peered":"2023-12-04T05:36:39.921175+0000","last_unstale":"2023-12-04T05:36:40.910552+0000","last_undegraded":"2023-12-04T05:36:40.910552+0000","last_fullsized":"2023-12-04T05:36:40.910552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894588+0000","last_change":"2023-12-04T05:36:40.913041+0000","last_active":"2023-12-04T05:36:41.894588+0000","last_peered":"2023-12-04T05:36:41.894588+0000","last_clean":"2023-12-04T05:36:41.894588+0000","last_became_active":"2023-12-04T05:36:40.912719+0000","last_became_peered":"2023-12-04T05:36:40.912719+0000","last_unstale":"2023-12-04T05:36:41.894588+0000","last_undegraded":"2023-12-04T05:36:41.894588+0000","last_fullsized":"2023-12-04T05:36:41.894588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894902+0000","last_change":"2023-12-04T05:36:39.908161+0000","last_active":"2023-12-04T05:36:41.894902+0000","last_peered":"2023-12-04T05:36:41.894902+0000","last_clean":"2023-12-04T05:36:41.894902+0000","last_became_active":"2023-12-04T05:36:39.907857+0000","last_became_peered":"2023-12-04T05:36:39.907857+0000","last_unstale":"2023-12-04T05:36:41.894902+0000","last_undegraded":"2023-12-04T05:36:41.894902+0000","last_fullsized":"2023-12-04T05:36:41.894902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.934014+0000","last_change":"2023-12-04T05:36:40.929459+0000","last_active":"2023-12-04T05:36:40.934014+0000","last_peered":"2023-12-04T05:36:40.934014+0000","last_clean":"2023-12-04T05:36:40.934014+0000","last_became_active":"2023-12-04T05:36:40.929278+0000","last_became_peered":"2023-12-04T05:36:40.929278+0000","last_unstale":"2023-12-04T05:36:40.934014+0000","last_undegraded":"2023-12-04T05:36:40.934014+0000","last_fullsized":"2023-12-04T05:36:40.934014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897952+0000","last_change":"2023-12-04T05:36:39.916327+0000","last_active":"2023-12-04T05:36:41.897952+0000","last_peered":"2023-12-04T05:36:41.897952+0000","last_clean":"2023-12-04T05:36:41.897952+0000","last_became_active":"2023-12-04T05:36:39.916042+0000","last_became_peered":"2023-12-04T05:36:39.916042+0000","last_unstale":"2023-12-04T05:36:41.897952+0000","last_undegraded":"2023-12-04T05:36:41.897952+0000","last_fullsized":"2023-12-04T05:36:41.897952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.931270+0000","last_change":"2023-12-04T05:36:40.924060+0000","last_active":"2023-12-04T05:36:40.931270+0000","last_peered":"2023-12-04T05:36:40.931270+0000","last_clean":"2023-12-04T05:36:40.931270+0000","last_became_active":"2023-12-04T05:36:40.923821+0000","last_became_peered":"2023-12-04T05:36:40.923821+0000","last_unstale":"2023-12-04T05:36:40.931270+0000","last_undegraded":"2023-12-04T05:36:40.931270+0000","last_fullsized":"2023-12-04T05:36:40.931270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907629+0000","last_change":"2023-12-04T05:36:39.921359+0000","last_active":"2023-12-04T05:36:40.907629+0000","last_peered":"2023-12-04T05:36:40.907629+0000","last_clean":"2023-12-04T05:36:40.907629+0000","last_became_active":"2023-12-04T05:36:39.921108+0000","last_became_peered":"2023-12-04T05:36:39.921108+0000","last_unstale":"2023-12-04T05:36:40.907629+0000","last_undegraded":"2023-12-04T05:36:40.907629+0000","last_fullsized":"2023-12-04T05:36:40.907629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899095+0000","last_change":"2023-12-04T05:36:40.909278+0000","last_active":"2023-12-04T05:36:41.899095+0000","last_peered":"2023-12-04T05:36:41.899095+0000","last_clean":"2023-12-04T05:36:41.899095+0000","last_became_active":"2023-12-04T05:36:40.908988+0000","last_became_peered":"2023-12-04T05:36:40.908988+0000","last_unstale":"2023-12-04T05:36:41.899095+0000","last_undegraded":"2023-12-04T05:36:41.899095+0000","last_fullsized":"2023-12-04T05:36:41.899095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894616+0000","last_change":"2023-12-04T05:36:39.913809+0000","last_active":"2023-12-04T05:36:41.894616+0000","last_peered":"2023-12-04T05:36:41.894616+0000","last_clean":"2023-12-04T05:36:41.894616+0000","last_became_active":"2023-12-04T05:36:39.913417+0000","last_became_peered":"2023-12-04T05:36:39.913417+0000","last_unstale":"2023-12-04T05:36:41.894616+0000","last_undegraded":"2023-12-04T05:36:41.894616+0000","last_fullsized":"2023-12-04T05:36:41.894616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.928017+0000","last_change":"2023-12-04T05:36:40.925195+0000","last_active":"2023-12-04T05:36:40.928017+0000","last_peered":"2023-12-04T05:36:40.928017+0000","last_clean":"2023-12-04T05:36:40.928017+0000","last_became_active":"2023-12-04T05:36:40.924744+0000","last_became_peered":"2023-12-04T05:36:40.924744+0000","last_unstale":"2023-12-04T05:36:40.928017+0000","last_undegraded":"2023-12-04T05:36:40.928017+0000","last_fullsized":"2023-12-04T05:36:40.928017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:31.699369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894682+0000","last_change":"2023-12-04T05:36:39.904596+0000","last_active":"2023-12-04T05:36:41.894682+0000","last_peered":"2023-12-04T05:36:41.894682+0000","last_clean":"2023-12-04T05:36:41.894682+0000","last_became_active":"2023-12-04T05:36:39.904323+0000","last_became_peered":"2023-12-04T05:36:39.904323+0000","last_unstale":"2023-12-04T05:36:41.894682+0000","last_undegraded":"2023-12-04T05:36:41.894682+0000","last_fullsized":"2023-12-04T05:36:41.894682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923774+0000","last_change":"2023-12-04T05:36:40.917184+0000","last_active":"2023-12-04T05:36:40.923774+0000","last_peered":"2023-12-04T05:36:40.923774+0000","last_clean":"2023-12-04T05:36:40.923774+0000","last_became_active":"2023-12-04T05:36:40.916879+0000","last_became_peered":"2023-12-04T05:36:40.916879+0000","last_unstale":"2023-12-04T05:36:40.923774+0000","last_undegraded":"2023-12-04T05:36:40.923774+0000","last_fullsized":"2023-12-04T05:36:40.923774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.980774+0000","last_change":"2023-12-04T05:36:39.918909+0000","last_active":"2023-12-04T05:36:40.980774+0000","last_peered":"2023-12-04T05:36:40.980774+0000","last_clean":"2023-12-04T05:36:40.980774+0000","last_became_active":"2023-12-04T05:36:39.918583+0000","last_became_peered":"2023-12-04T05:36:39.918583+0000","last_unstale":"2023-12-04T05:36:40.980774+0000","last_undegraded":"2023-12-04T05:36:40.980774+0000","last_fullsized":"2023-12-04T05:36:40.980774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897340+0000","last_change":"2023-12-04T05:36:40.899019+0000","last_active":"2023-12-04T05:36:41.897340+0000","last_peered":"2023-12-04T05:36:41.897340+0000","last_clean":"2023-12-04T05:36:41.897340+0000","last_became_active":"2023-12-04T05:36:40.898523+0000","last_became_peered":"2023-12-04T05:36:40.898523+0000","last_unstale":"2023-12-04T05:36:41.897340+0000","last_undegraded":"2023-12-04T05:36:41.897340+0000","last_fullsized":"2023-12-04T05:36:41.897340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925510+0000","last_change":"2023-12-04T05:36:40.918106+0000","last_active":"2023-12-04T05:36:40.925510+0000","last_peered":"2023-12-04T05:36:40.925510+0000","last_clean":"2023-12-04T05:36:40.925510+0000","last_became_active":"2023-12-04T05:36:40.917745+0000","last_became_peered":"2023-12-04T05:36:40.917745+0000","last_unstale":"2023-12-04T05:36:40.925510+0000","last_undegraded":"2023-12-04T05:36:40.925510+0000","last_fullsized":"2023-12-04T05:36:40.925510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981426+0000","last_change":"2023-12-04T05:36:39.924371+0000","last_active":"2023-12-04T05:36:40.981426+0000","last_peered":"2023-12-04T05:36:40.981426+0000","last_clean":"2023-12-04T05:36:40.981426+0000","last_became_active":"2023-12-04T05:36:39.924054+0000","last_became_peered":"2023-12-04T05:36:39.924054+0000","last_unstale":"2023-12-04T05:36:40.981426+0000","last_undegraded":"2023-12-04T05:36:40.981426+0000","last_fullsized":"2023-12-04T05:36:40.981426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.925657+0000","last_change":"2023-12-04T05:36:40.917939+0000","last_active":"2023-12-04T05:36:40.925657+0000","last_peered":"2023-12-04T05:36:40.925657+0000","last_clean":"2023-12-04T05:36:40.925657+0000","last_became_active":"2023-12-04T05:36:40.917669+0000","last_became_peered":"2023-12-04T05:36:40.917669+0000","last_unstale":"2023-12-04T05:36:40.925657+0000","last_undegraded":"2023-12-04T05:36:40.925657+0000","last_fullsized":"2023-12-04T05:36:40.925657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:21.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981758+0000","last_change":"2023-12-04T05:36:39.920721+0000","last_active":"2023-12-04T05:36:40.981758+0000","last_peered":"2023-12-04T05:36:40.981758+0000","last_clean":"2023-12-04T05:36:40.981758+0000","last_became_active":"2023-12-04T05:36:39.920453+0000","last_became_peered":"2023-12-04T05:36:39.920453+0000","last_unstale":"2023-12-04T05:36:40.981758+0000","last_undegraded":"2023-12-04T05:36:40.981758+0000","last_fullsized":"2023-12-04T05:36:40.981758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.923286+0000","last_change":"2023-12-04T05:36:40.919075+0000","last_active":"2023-12-04T05:36:40.923286+0000","last_peered":"2023-12-04T05:36:40.923286+0000","last_clean":"2023-12-04T05:36:40.923286+0000","last_became_active":"2023-12-04T05:36:40.918364+0000","last_became_peered":"2023-12-04T05:36:40.918364+0000","last_unstale":"2023-12-04T05:36:40.923286+0000","last_undegraded":"2023-12-04T05:36:40.923286+0000","last_fullsized":"2023-12-04T05:36:40.923286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.981396+0000","last_change":"2023-12-04T05:36:39.920745+0000","last_active":"2023-12-04T05:36:40.981396+0000","last_peered":"2023-12-04T05:36:40.981396+0000","last_clean":"2023-12-04T05:36:40.981396+0000","last_became_active":"2023-12-04T05:36:39.920421+0000","last_became_peered":"2023-12-04T05:36:39.920421+0000","last_unstale":"2023-12-04T05:36:40.981396+0000","last_undegraded":"2023-12-04T05:36:40.981396+0000","last_fullsized":"2023-12-04T05:36:40.981396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.924302+0000","last_change":"2023-12-04T05:36:40.920955+0000","last_active":"2023-12-04T05:36:40.924302+0000","last_peered":"2023-12-04T05:36:40.924302+0000","last_clean":"2023-12-04T05:36:40.924302+0000","last_became_active":"2023-12-04T05:36:40.920651+0000","last_became_peered":"2023-12-04T05:36:40.920651+0000","last_unstale":"2023-12-04T05:36:40.924302+0000","last_undegraded":"2023-12-04T05:36:40.924302+0000","last_fullsized":"2023-12-04T05:36:40.924302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.983296+0000","last_change":"2023-12-04T05:36:39.913939+0000","last_active":"2023-12-04T05:36:40.983296+0000","last_peered":"2023-12-04T05:36:40.983296+0000","last_clean":"2023-12-04T05:36:40.983296+0000","last_became_active":"2023-12-04T05:36:39.913586+0000","last_became_peered":"2023-12-04T05:36:39.913586+0000","last_unstale":"2023-12-04T05:36:40.983296+0000","last_undegraded":"2023-12-04T05:36:40.983296+0000","last_fullsized":"2023-12-04T05:36:40.983296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:36:45.463 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:36:45.466 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-04T05:36:45.466 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-04T05:36:45.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-04T05:36:45.466 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-04T05:36:45.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.631+0000 7fdaf49b8640 1 Processor -- start 2023-12-04T05:36:45.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.631+0000 7fdaf49b8640 1 -- start start 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaf49b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf00c1880 0x7fdaf00c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaf49b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf014b440 con 0x7fdaf0155230 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaf49b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf0154670 con 0x7fdaf006be00 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaf49b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf006caf0 con 0x7fdaf00c1880 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaee59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf00c1880 0x7fdaf00c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaeed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdaf0155230 0x7fdaf015eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41660/0 (socket says 172.21.15.97:41660) 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaee59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf00c1880 0x7fdaf00c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49770/0 (socket says 172.21.15.97:49770) 2023-12-04T05:36:45.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaeed9d640 1 -- 172.21.15.97:0/3769279475 learned_addr learned my addr 172.21.15.97:0/3769279475 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:45.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaee59c640 1 -- 172.21.15.97:0/3769279475 >> v1:172.21.15.143:6789/0 conn(0x7fdaf006be00 legacy=0x7fdaf0154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaee59c640 1 -- 172.21.15.97:0/3769279475 >> v1:172.21.15.97:6789/0 conn(0x7fdaf0155230 legacy=0x7fdaf015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaee59c640 1 -- 172.21.15.97:0/3769279475 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00c02a0 con 0x7fdaf00c1880 2023-12-04T05:36:45.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.635+0000 7fdaedd9b640 1 -- 172.21.15.97:0/3769279475 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343720662 0 0) 0x7fdaf014b440 con 0x7fdaf0155230 2023-12-04T05:36:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaee59c640 1 --2- 172.21.15.97:0/3769279475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf00c1880 0x7fdaf00c1c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdae00097c0 tx=0x7fdae001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1da3acf152fb075 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaedd9b640 1 -- 172.21.15.97:0/3769279475 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00ab640 con 0x7fdaf00c1880 2023-12-04T05:36:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaedd9b640 1 -- 172.21.15.97:0/3769279475 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae00a7070 con 0x7fdaf00c1880 2023-12-04T05:36:45.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaedd9b640 1 -- 172.21.15.97:0/3769279475 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00ab9c0 con 0x7fdaf00c1880 2023-12-04T05:36:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- 172.21.15.97:0/3769279475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf00c1880 msgr2=0x7fdaf00c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/3769279475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf00c1880 0x7fdaf00c1c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdae00097c0 tx=0x7fdae001c440 comp rx=0 tx=0).stop 2023-12-04T05:36:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- 172.21.15.97:0/3769279475 shutdown_connections 2023-12-04T05:36:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/3769279475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf00c1880 0x7fdaf00c1c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- 172.21.15.97:0/3769279475 >> 172.21.15.97:0/3769279475 conn(0x7fdaf00c2970 msgr2=0x7fdaf00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:45.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- 172.21.15.97:0/3769279475 shutdown_connections 2023-12-04T05:36:45.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- 172.21.15.97:0/3769279475 wait complete. 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 Processor -- start 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.639+0000 7fdaf49b8640 1 -- start start 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf00c1880 0x7fdaf0141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 0x7fdaf0141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0143230 con 0x7fdaf006be00 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf01413b0 con 0x7fdaf0155230 2023-12-04T05:36:45.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0148270 con 0x7fdaf00c1880 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49774/0 (socket says 172.21.15.97:49774) 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 -- 172.21.15.97:0/4045182147 learned_addr learned my addr 172.21.15.97:0/4045182147 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdae7fff640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf00c1880 0x7fdaf0141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaeed9d640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 0x7fdaf0141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 -- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf00c1880 msgr2=0x7fdaf0141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf00c1880 0x7fdaf0141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 -- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 msgr2=0x7fdaf0141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 0x7fdaf0141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 -- 172.21.15.97:0/4045182147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009420 con 0x7fdaf006be00 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaeed9d640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 0x7fdaf0141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaee59c640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdae0019050 tx=0x7fdae001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00bf610 con 0x7fdaf006be00 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae00bf790 con 0x7fdaf006be00 2023-12-04T05:36:45.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00bfb40 con 0x7fdaf006be00 2023-12-04T05:36:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf01ed9b0 con 0x7fdaf006be00 2023-12-04T05:36:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf014aff0 con 0x7fdaf006be00 2023-12-04T05:36:45.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf0141760 con 0x7fdaf006be00 2023-12-04T05:36:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.643+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdae00b5400 con 0x7fdaf006be00 2023-12-04T05:36:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.647+0000 7fdae6ffd640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 0x7fdad0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.647+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdae011f750 con 0x7fdaf006be00 2023-12-04T05:36:45.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.647+0000 7fdae7fff640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 0x7fdad0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:45.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.647+0000 7fdae7fff640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 0x7fdad0068d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdaf01f14c0 tx=0x7fdad8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:45.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.651+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdae00ecb50 con 0x7fdaf006be00 2023-12-04T05:36:45.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.831+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdaf0068440 con 0x7fdaf006be00 2023-12-04T05:36:45.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.835+0000 7fdae6ffd640 1 -- 172.21.15.97:0/4045182147 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164967 (secure 0 0 0) 0x7fdae00f0170 con 0x7fdaf006be00 2023-12-04T05:36:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 msgr2=0x7fdad0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 0x7fdad0068d90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdaf01f14c0 tx=0x7fdad8009040 comp rx=0 tx=0).stop 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 msgr2=0x7fdaf013d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdae0019050 tx=0x7fdae001ac80 comp rx=0 tx=0).stop 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 shutdown_connections 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdad00668d0 0x7fdad0068d90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf0155230 0x7fdaf0141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf00c1880 0x7fdaf0141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 --2- 172.21.15.97:0/4045182147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf006be00 0x7fdaf013d1d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:45.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 >> 172.21.15.97:0/4045182147 conn(0x7fdaf00c2970 msgr2=0x7fdaf0153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:45.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 shutdown_connections 2023-12-04T05:36:45.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.839+0000 7fdaf49b8640 1 -- 172.21.15.97:0/4045182147 wait complete. 2023-12-04T05:36:45.860 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":518581836},{"type":"v1","addr":"172.21.15.97:6833","nonce":518581836}]},"active_addr":"172.21.15.97:6833/518581836","active_change":"2023-12-04T05:36:20.178394+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":4225804662}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3843262544}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2292903385}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2832385382}]}]} 2023-12-04T05:36:45.863 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-04T05:36:45.863 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-04T05:36:45.863 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 Processor -- start 2023-12-04T05:36:46.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 -- start start 2023-12-04T05:36:46.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9a40151bf0 0x7f9a400abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a401547d0 con 0x7f9a400c7ef0 2023-12-04T05:36:46.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40158b80 con 0x7f9a40151bf0 2023-12-04T05:36:46.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a46a79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400c4aa0 con 0x7f9a40155370 2023-12-04T05:36:46.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a3ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9a400c7ef0 0x7f9a40154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41666/0 (socket says 172.21.15.97:41666) 2023-12-04T05:36:46.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a3ffff640 1 -- 172.21.15.97:0/1724032308 learned_addr learned my addr 172.21.15.97:0/1724032308 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:46.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a44815640 1 --2- 172.21.15.97:0/1724032308 >> v2:172.21.15.143:3300/0 conn(0x7f9a40151bf0 0x7f9a400abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a45016640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a3f7fe640 1 -- 172.21.15.97:0/1724032308 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051179850 0 0) 0x7f9a401547d0 con 0x7f9a400c7ef0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a3f7fe640 1 -- 172.21.15.97:0/1724032308 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a30003530 con 0x7f9a400c7ef0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a44815640 1 -- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 msgr2=0x7f9a4015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a44815640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4015efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a44815640 1 -- 172.21.15.97:0/1724032308 >> v1:172.21.15.97:6789/0 conn(0x7f9a400c7ef0 legacy=0x7f9a40154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a44815640 1 -- 172.21.15.97:0/1724032308 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400c4d40 con 0x7f9a40151bf0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:45.999+0000 7f9a45016640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4015efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a44815640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a40151bf0 0x7f9a400abbb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a340097c0 tx=0x7f9a3401c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c18e6233d1f835 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a3f7fe640 1 -- 172.21.15.97:0/1724032308 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a4880 con 0x7f9a40151bf0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a3f7fe640 1 -- 172.21.15.97:0/1724032308 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340a49e0 con 0x7f9a40151bf0 2023-12-04T05:36:46.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a3f7fe640 1 -- 172.21.15.97:0/1724032308 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a4d50 con 0x7f9a40151bf0 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 -- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a40151bf0 msgr2=0x7f9a400abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a40151bf0 0x7f9a400abbb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a340097c0 tx=0x7f9a3401c040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 -- 172.21.15.97:0/1724032308 shutdown_connections 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4015efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 --2- 172.21.15.97:0/1724032308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a40151bf0 0x7f9a400abbb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 -- 172.21.15.97:0/1724032308 >> 172.21.15.97:0/1724032308 conn(0x7f9a40073550 msgr2=0x7f9a40073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 -- 172.21.15.97:0/1724032308 shutdown_connections 2023-12-04T05:36:46.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.003+0000 7f9a46a79640 1 -- 172.21.15.97:0/1724032308 wait complete. 2023-12-04T05:36:46.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 Processor -- start 2023-12-04T05:36:46.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- start start 2023-12-04T05:36:46.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a400c7ef0 0x7f9a401563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a401eeea0 con 0x7f9a40151bf0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40155f20 con 0x7f9a400c7ef0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40155910 con 0x7f9a40155370 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49790/0 (socket says 172.21.15.97:49790) 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 -- 172.21.15.97:0/631726971 learned_addr learned my addr 172.21.15.97:0/631726971 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a45016640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a44815640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a400c7ef0 0x7f9a401563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 -- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 msgr2=0x7f9a4014cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4014cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 -- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a400c7ef0 msgr2=0x7f9a401563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a400c7ef0 0x7f9a401563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 -- 172.21.15.97:0/631726971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009a70 con 0x7f9a40151bf0 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a45016640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:46.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3ffff640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c390 tx=0x7f9a2c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c005cf0 con 0x7f9a40151bf0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c005e70 con 0x7f9a40151bf0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34009420 con 0x7f9a40151bf0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0072f0 con 0x7f9a40151bf0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.007+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40157a20 con 0x7f9a40151bf0 2023-12-04T05:36:46.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40068440 con 0x7f9a40151bf0 2023-12-04T05:36:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a2c007450 con 0x7f9a40151bf0 2023-12-04T05:36:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a3d7fa640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 0x7f9a24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2c083b10 con 0x7f9a40151bf0 2023-12-04T05:36:46.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a44815640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 0x7f9a24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.011+0000 7f9a44815640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 0x7f9a24068d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a340ae000 tx=0x7f9a340a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.015+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a2c050d70 con 0x7f9a40151bf0 2023-12-04T05:36:46.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.163+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a40156060 con 0x7f9a40151bf0 2023-12-04T05:36:46.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.163+0000 7f9a3d7fa640 1 -- 172.21.15.97:0/631726971 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f9a2c017020 con 0x7f9a40151bf0 2023-12-04T05:36:46.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:46.168 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 msgr2=0x7f9a24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 0x7f9a24068d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a340ae000 tx=0x7f9a340a6070 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 msgr2=0x7f9a401ee960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c390 tx=0x7f9a2c00c850 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 shutdown_connections 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9a240668d0 0x7f9a24068d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a40155370 0x7f9a4014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a40151bf0 0x7f9a401ee960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 --2- 172.21.15.97:0/631726971 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a400c7ef0 0x7f9a401563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 >> 172.21.15.97:0/631726971 conn(0x7f9a40073550 msgr2=0x7f9a401509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 shutdown_connections 2023-12-04T05:36:46.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.167+0000 7f9a46a79640 1 -- 172.21.15.97:0/631726971 wait complete. 2023-12-04T05:36:46.189 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-04T05:36:46.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:46.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 Processor -- start 2023-12-04T05:36:46.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 -- start start 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2ebc154d50 0x7f2ebc06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 0x7f2ebc06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc06c760 con 0x7f2ebc154260 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0a8670 con 0x7f2ebc154d50 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec385a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc06c550 con 0x7f2ebc0a9470 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec15f6640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2ebc154260 0x7f2ebc154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41670/0 (socket says 172.21.15.97:41670) 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec15f6640 1 -- 172.21.15.97:0/2003158406 learned_addr learned my addr 172.21.15.97:0/2003158406 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:46.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec0df5640 1 --2- 172.21.15.97:0/2003158406 >> v2:172.21.15.97:3300/0 conn(0x7f2ebc154d50 0x7f2ebc06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2eb3fff640 1 -- 172.21.15.97:0/2003158406 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394016888 0 0) 0x7f2ebc06c760 con 0x7f2ebc154260 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2eb3fff640 1 -- 172.21.15.97:0/2003158406 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea8003450 con 0x7f2ebc154260 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec1df7640 1 --2- 172.21.15.97:0/2003158406 >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 0x7f2ebc06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec0df5640 1 -- 172.21.15.97:0/2003158406 >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 msgr2=0x7f2ebc06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec0df5640 1 --2- 172.21.15.97:0/2003158406 >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 0x7f2ebc06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec0df5640 1 -- 172.21.15.97:0/2003158406 >> v1:172.21.15.97:6789/0 conn(0x7f2ebc154260 legacy=0x7f2ebc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec0df5640 1 -- 172.21.15.97:0/2003158406 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc06ca40 con 0x7f2ebc154d50 2023-12-04T05:36:46.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.327+0000 7f2ec1df7640 1 --2- 172.21.15.97:0/2003158406 >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 0x7f2ebc06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec0df5640 1 --2- 172.21.15.97:0/2003158406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc06d800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06e360 tx=0x7f2eac01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4a2840762dffa server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2eb3fff640 1 -- 172.21.15.97:0/2003158406 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ac410 con 0x7f2ebc154d50 2023-12-04T05:36:46.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2eb3fff640 1 -- 172.21.15.97:0/2003158406 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ac570 con 0x7f2ebc154d50 2023-12-04T05:36:46.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2eb3fff640 1 -- 172.21.15.97:0/2003158406 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ac8e0 con 0x7f2ebc154d50 2023-12-04T05:36:46.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 -- 172.21.15.97:0/2003158406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 msgr2=0x7f2ebc06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 --2- 172.21.15.97:0/2003158406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc06d800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc06e360 tx=0x7f2eac01c430 comp rx=0 tx=0).stop 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 -- 172.21.15.97:0/2003158406 shutdown_connections 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 --2- 172.21.15.97:0/2003158406 >> v2:172.21.15.143:3300/0 conn(0x7f2ebc0a9470 0x7f2ebc06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 --2- 172.21.15.97:0/2003158406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc06d800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 -- 172.21.15.97:0/2003158406 >> 172.21.15.97:0/2003158406 conn(0x7f2ebc0c2970 msgr2=0x7f2ebc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 -- 172.21.15.97:0/2003158406 shutdown_connections 2023-12-04T05:36:46.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.331+0000 7f2ec385a640 1 -- 172.21.15.97:0/2003158406 wait complete. 2023-12-04T05:36:46.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 Processor -- start 2023-12-04T05:36:46.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- start start 2023-12-04T05:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ebc0a9470 0x7f2ebc0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ebc154260 0x7f2ebc13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc13e2d0 con 0x7f2ebc154d50 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc153e10 con 0x7f2ebc154260 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc1433a0 con 0x7f2ebc0a9470 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49800/0 (socket says 172.21.15.97:49800) 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 -- 172.21.15.97:0/3235191023 learned_addr learned my addr 172.21.15.97:0/3235191023 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec15f6640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ebc0a9470 0x7f2ebc0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec0df5640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ebc154260 0x7f2ebc13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 -- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ebc0a9470 msgr2=0x7f2ebc0bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ebc0a9470 0x7f2ebc0bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 -- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ebc154260 msgr2=0x7f2ebc13d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ebc154260 0x7f2ebc13d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 -- 172.21.15.97:0/3235191023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009420 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec1df7640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400cef0 tx=0x7f2eb400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400d840 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb400d9c0 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400dd70 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc143680 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc0c04a0 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.335+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc068440 con 0x7f2ebc154d50 2023-12-04T05:36:46.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.339+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2eb401e3b0 con 0x7f2ebc154d50 2023-12-04T05:36:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.339+0000 7f2eb1ffb640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 0x7f2ea0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.339+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eb4084e50 con 0x7f2ebc154d50 2023-12-04T05:36:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.339+0000 7f2ec15f6640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 0x7f2ea0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.339+0000 7f2ec15f6640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 0x7f2ea0068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8007fd0 tx=0x7f2eb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.343+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2eb40521f0 con 0x7f2ebc154d50 2023-12-04T05:36:46.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ebc14d1d0 con 0x7f2ebc154d50 2023-12-04T05:36:46.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2eb1ffb640 1 -- 172.21.15.97:0/3235191023 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f2eb401a090 con 0x7f2ebc154d50 2023-12-04T05:36:46.497 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:46.498 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:46.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 msgr2=0x7f2ea0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 0x7f2ea0068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8007fd0 tx=0x7f2eb8009040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 msgr2=0x7f2ebc13dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400cef0 tx=0x7f2eb400a710 comp rx=0 tx=0).stop 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 shutdown_connections 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2ea00668d0 0x7f2ea0068d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ebc154d50 0x7f2ebc13dd90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ebc154260 0x7f2ebc13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 --2- 172.21.15.97:0/3235191023 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ebc0a9470 0x7f2ebc0bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 >> 172.21.15.97:0/3235191023 conn(0x7f2ebc0c2970 msgr2=0x7f2ebc14b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 shutdown_connections 2023-12-04T05:36:46.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.495+0000 7f2ec385a640 1 -- 172.21.15.97:0/3235191023 wait complete. 2023-12-04T05:36:46.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-04T05:36:46.519 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-04T05:36:46.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-04T05:36:46.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-04T05:36:46.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-04T05:36:46.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-04T05:36:46.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-04T05:36:46.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-04T05:36:46.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.759+0000 7f81f1674640 1 Processor -- start 2023-12-04T05:36:46.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.759+0000 7f81f1674640 1 -- start start 2023-12-04T05:36:46.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.759+0000 7fd55f59e640 1 Processor -- start 2023-12-04T05:36:46.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.759+0000 7fd55f59e640 1 -- start start 2023-12-04T05:36:46.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81f1674640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81ec0c0450 0x7f81ec14d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5600c4c50 0x7fd5601591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55f59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56015c060 con 0x7fd5600c54d0 2023-12-04T05:36:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55f59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56015c300 con 0x7fd560156090 2023-12-04T05:36:46.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55f59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd560156470 con 0x7fd5600c4c50 2023-12-04T05:36:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81ec0c0450 0x7f81ec14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81ec0c0450 0x7f81ec14d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:47986/0 (socket says 172.21.15.97:47986) 2023-12-04T05:36:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 -- 172.21.15.97:0/2152241442 learned_addr learned my addr 172.21.15.97:0/2152241442 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec06d960 con 0x7f81ec1544f0 2023-12-04T05:36:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0a4fa0 con 0x7f81ec14dd70 2023-12-04T05:36:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec06c830 con 0x7f81ec0c0450 2023-12-04T05:36:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55e59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd560156090 0x7fd5600c24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38016/0 (socket says 172.21.15.97:38016) 2023-12-04T05:36:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55e59c640 1 -- 172.21.15.97:0/1971980940 learned_addr learned my addr 172.21.15.97:0/1971980940 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:46.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55ed9d640 1 --2- 172.21.15.97:0/1971980940 >> v2:172.21.15.143:3300/0 conn(0x7fd5600c4c50 0x7fd5601591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55ed9d640 1 -- 172.21.15.97:0/1971980940 >> v1:172.21.15.143:6789/0 conn(0x7fd560156090 legacy=0x7fd5600c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55ed9d640 1 -- 172.21.15.97:0/1971980940 >> v1:172.21.15.97:6789/0 conn(0x7fd5600c54d0 legacy=0x7fd560158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7fd55ed9d640 1 -- 172.21.15.97:0/1971980940 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56015c5e0 con 0x7fd5600c4c50 2023-12-04T05:36:46.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 -- 172.21.15.97:0/2152241442 >> v1:172.21.15.143:6789/0 conn(0x7f81ec14dd70 legacy=0x7f81ec0c24e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 -- 172.21.15.97:0/2152241442 >> v1:172.21.15.97:6789/0 conn(0x7f81ec1544f0 legacy=0x7f81ec0c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.763+0000 7f81ebfff640 1 -- 172.21.15.97:0/2152241442 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0a5280 con 0x7f81ec0c0450 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 Processor -- start 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 -- start start 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 0x7fa8c40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa8c406df10 0x7fa8c415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c41548c0 con 0x7fa8c40bf2a0 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c4154640 con 0x7fa8c4151e70 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8cad3e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c40c38f0 con 0x7fa8c406df10 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8c8ada640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 0x7fa8c40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8c8ada640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 0x7fa8c40c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49814/0 (socket says 172.21.15.97:49814) 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8c8ada640 1 -- 172.21.15.97:0/3284977983 learned_addr learned my addr 172.21.15.97:0/3284977983 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.767+0000 7fa8c92db640 1 --2- 172.21.15.97:0/3284977983 >> v2:172.21.15.143:3300/0 conn(0x7fa8c406df10 0x7fa8c415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fa8c92db640 1 -- 172.21.15.97:0/3284977983 >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 msgr2=0x7fa8c40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fa8c92db640 1 --2- 172.21.15.97:0/3284977983 >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 0x7fa8c40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fa8c92db640 1 -- 172.21.15.97:0/3284977983 >> v1:172.21.15.143:6789/0 conn(0x7fa8c40bf2a0 legacy=0x7fa8c4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fa8c92db640 1 -- 172.21.15.97:0/3284977983 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4071c70 con 0x7fa8c406df10 2023-12-04T05:36:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81ebfff640 1 --2- 172.21.15.97:0/2152241442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec0c0450 0x7f81ec14d830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009e50 tx=0x7f81e401c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410333846e4ab970 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55ed9d640 1 --2- 172.21.15.97:0/1971980940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd5601591d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55801c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8279ffcb252b230f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55d59a640 1 -- 172.21.15.97:0/1971980940 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580a57f0 con 0x7fd5600c4c50 2023-12-04T05:36:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55d59a640 1 -- 172.21.15.97:0/1971980940 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5580a5950 con 0x7fd5600c4c50 2023-12-04T05:36:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55d59a640 1 -- 172.21.15.97:0/1971980940 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580a5ce0 con 0x7fd5600c4c50 2023-12-04T05:36:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81eaffd640 1 -- 172.21.15.97:0/2152241442 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40a5870 con 0x7f81ec0c0450 2023-12-04T05:36:46.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81eaffd640 1 -- 172.21.15.97:0/2152241442 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40a59d0 con 0x7f81ec0c0450 2023-12-04T05:36:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81eaffd640 1 -- 172.21.15.97:0/2152241442 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40a5d60 con 0x7f81ec0c0450 2023-12-04T05:36:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec0c0450 msgr2=0x7f81ec14d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 --2- 172.21.15.97:0/2152241442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec0c0450 0x7f81ec14d830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009e50 tx=0x7f81e401c990 comp rx=0 tx=0).stop 2023-12-04T05:36:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 shutdown_connections 2023-12-04T05:36:46.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 --2- 172.21.15.97:0/2152241442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec0c0450 0x7f81ec14d830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 >> 172.21.15.97:0/2152241442 conn(0x7f81ec06a9f0 msgr2=0x7f81ec06ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 -- 172.21.15.97:0/1971980940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 msgr2=0x7fd5601591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 --2- 172.21.15.97:0/1971980940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd5601591d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55801c770 comp rx=0 tx=0).stop 2023-12-04T05:36:46.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 -- 172.21.15.97:0/1971980940 shutdown_connections 2023-12-04T05:36:46.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 --2- 172.21.15.97:0/1971980940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd5601591d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 -- 172.21.15.97:0/1971980940 >> 172.21.15.97:0/1971980940 conn(0x7fd56006a9f0 msgr2=0x7fd56006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 -- 172.21.15.97:0/1971980940 shutdown_connections 2023-12-04T05:36:46.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7fd55f59e640 1 -- 172.21.15.97:0/1971980940 wait complete. 2023-12-04T05:36:46.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f5e4edf8640 1 Processor -- start 2023-12-04T05:36:46.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 shutdown_connections 2023-12-04T05:36:46.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f81f1674640 1 -- 172.21.15.97:0/2152241442 wait complete. 2023-12-04T05:36:46.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 Processor -- start 2023-12-04T05:36:46.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.771+0000 7f5e4edf8640 1 -- start start 2023-12-04T05:36:46.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 -- start start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 Processor -- start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 -- start start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7fd55f59e640 1 Processor -- start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7fd55f59e640 1 -- start start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f81f1674640 1 Processor -- start 2023-12-04T05:36:46.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f81f1674640 1 -- start start 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7fd55f59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd56015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7fa8c92db640 1 --2- 172.21.15.97:0/3284977983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c415efc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8c406fa90 tx=0x7fa8bc01c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83277c1b9dee4486 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a1006c440 0x7f8a101524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100aa240 con 0x7f8a1006d210 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100aa500 con 0x7f8a100c1e70 2023-12-04T05:36:46.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a1509a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1006c0c0 con 0x7f8a1006c440 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a1006c440 0x7f8a101524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a1006c440 0x7f8a101524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49836/0 (socket says 172.21.15.97:49836) 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 -- 172.21.15.97:0/2317332104 learned_addr learned my addr 172.21.15.97:0/2317332104 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efca80c1e70 0x7efca81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efca806d210 0x7efca806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca80aa240 con 0x7efca806c440 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca806c0c0 con 0x7efca80c1e70 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcae372640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80aa500 con 0x7efca806d210 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcac90f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efca806d210 0x7efca806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcac90f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efca806d210 0x7efca806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48012/0 (socket says 172.21.15.97:48012) 2023-12-04T05:36:46.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7efcac90f640 1 -- 172.21.15.97:0/2371494400 learned_addr learned my addr 172.21.15.97:0/2371494400 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e4edf8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e48156070 0x7f5e480c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e4edf8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e48163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e4edf8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e48071380 con 0x7f5e4806e410 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e4edf8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4806cc20 con 0x7f5e48156070 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e4edf8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4806cf00 con 0x7f5e480c0db0 2023-12-04T05:36:46.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7fd55f59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 0x7fd56014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd560156090 0x7fd56014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8c37fe640 1 -- 172.21.15.97:0/3284977983 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a5870 con 0x7fa8c406df10 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8c37fe640 1 -- 172.21.15.97:0/3284977983 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0a59d0 con 0x7fa8c406df10 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8c37fe640 1 -- 172.21.15.97:0/3284977983 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0a5d60 con 0x7fa8c406df10 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7efcac90f640 1 -- 172.21.15.97:0/2371494400 >> v2:172.21.15.97:3300/0 conn(0x7efca80c1e70 msgr2=0x7efca81524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7efcac90f640 1 --2- 172.21.15.97:0/2371494400 >> v2:172.21.15.97:3300/0 conn(0x7efca80c1e70 0x7efca81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7efcac90f640 1 -- 172.21.15.97:0/2371494400 >> v1:172.21.15.97:6789/0 conn(0x7efca806c440 legacy=0x7efca80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7efca77fe640 1 -- 172.21.15.97:0/2371494400 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514542641 0 0) 0x7efca80aa240 con 0x7efca806c440 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 0x7fd56014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 0x7fd56014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42356/0 (socket says 172.21.15.97:42356) 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56014ca20 con 0x7fd560156090 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600a8990 con 0x7fd5600c4c50 2023-12-04T05:36:46.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600bffd0 con 0x7fd5600c54d0 2023-12-04T05:36:46.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7efcac90f640 1 -- 172.21.15.97:0/2371494400 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80aa7e0 con 0x7efca806d210 2023-12-04T05:36:46.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81ec0c0450 0x7f81ec14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd56015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd56015b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48028/0 (socket says 172.21.15.97:48028) 2023-12-04T05:36:46.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55e59c640 1 -- 172.21.15.97:0/4241519154 learned_addr learned my addr 172.21.15.97:0/4241519154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 0x7f81ec1fadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55ed9d640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd560156090 0x7fd56014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81ec1544f0 0x7f81ec1f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 0x7f81ec1fadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 0x7f81ec1fadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48030/0 (socket says 172.21.15.97:48030) 2023-12-04T05:36:46.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81eb7fe640 1 -- 172.21.15.97:0/2007200708 learned_addr learned my addr 172.21.15.97:0/2007200708 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 -- 172.21.15.97:0/4241519154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 msgr2=0x7fd56015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5600c4c50 0x7fd56015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 -- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd560156090 msgr2=0x7fd56014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd560156090 0x7fd56014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558009a70 con 0x7fd5600c54d0 2023-12-04T05:36:46.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 -- 172.21.15.97:0/3284977983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 msgr2=0x7fa8c415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/3284977983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c415efc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8c406fa90 tx=0x7fa8bc01c7b0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81ec1544f0 0x7f81ec1f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81ebfff640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81ec0c0450 0x7f81ec14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec14edf0 con 0x7f81ec0c0450 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec151520 con 0x7f81ec14dd70 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f1674640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec1fa760 con 0x7f81ec1544f0 2023-12-04T05:36:46.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55dd9b640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 0x7fd56014ce40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd55000c390 tx=0x7fd55000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 -- 172.21.15.97:0/3284977983 shutdown_connections 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/3284977983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c415efc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/3284977983 >> v2:172.21.15.97:3300/0 conn(0x7fa8c4151e70 0x7fa8c40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fa8cad3e640 1 -- 172.21.15.97:0/3284977983 >> 172.21.15.97:0/3284977983 conn(0x7fa8c40c2970 msgr2=0x7fa8c40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550003600 con 0x7fd5600c54d0 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5600c02b0 con 0x7fd5600c54d0 2023-12-04T05:36:46.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56014dc10 con 0x7fd5600c54d0 2023-12-04T05:36:46.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 -- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 msgr2=0x7f81ec1fadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 0x7f81ec1fadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 -- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81ec0c0450 msgr2=0x7f81ec14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81ec0c0450 0x7f81ec14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009b30 con 0x7f81ec1544f0 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e47fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f5e4806e410 0x7f5e48071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38050/0 (socket says 172.21.15.97:38050) 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f5e47fff640 1 -- 172.21.15.97:0/1387018907 learned_addr learned my addr 172.21.15.97:0/1387018907 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683752049 0 0) 0x7f5e48071380 con 0x7f5e4806e410 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003530 con 0x7f5e4806e410 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e48163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145634838 0 0) 0x7f5e30003530 con 0x7f5e4806e410 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 msgr2=0x7f5e48163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e48163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 >> v2:172.21.15.97:3300/0 conn(0x7f5e48156070 msgr2=0x7f5e480c0870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 --2- 172.21.15.97:0/1387018907 >> v2:172.21.15.97:3300/0 conn(0x7f5e48156070 0x7f5e480c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4815cbb0 con 0x7f5e4806e410 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f5e3c001680 con 0x7f5e4806e410 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 >> v1:172.21.15.143:6789/0 conn(0x7f5e4806e410 legacy=0x7f5e48071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e30003980 0x7f5e30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e300047d0 0x7f5e30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4806cc20 con 0x7f5e300047d0 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4806cf00 con 0x7f5e30003980 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3000bac0 con 0x7f5e480c0db0 2023-12-04T05:36:46.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f81f0e73640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81ec1544f0 0x7f81ec1f9bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b3e0 tx=0x7f81e000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5600724a0 con 0x7fd5600c54d0 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a0e59c640 1 -- 172.21.15.97:0/2317332104 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342490061 0 0) 0x7f8a100aa500 con 0x7f8a100c1e70 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a0e59c640 1 -- 172.21.15.97:0/2317332104 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89fc003530 con 0x7f8a100c1e70 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 -- 172.21.15.97:0/2317332104 >> v1:172.21.15.143:6789/0 conn(0x7f8a100c1e70 legacy=0x7f8a100a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 -- 172.21.15.97:0/2317332104 >> v1:172.21.15.97:6789/0 conn(0x7f8a1006d210 legacy=0x7f8a1006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.775+0000 7f8a07fff640 1 -- 172.21.15.97:0/2317332104 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100aa7e0 con 0x7f8a1006c440 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 -- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e30003980 msgr2=0x7f5e30003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e30003980 0x7f5e30003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 -- 172.21.15.97:0/1387018907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e300047d0 msgr2=0x7f5e30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e300047d0 0x7f5e30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.779+0000 7f5e4d395640 1 -- 172.21.15.97:0/1387018907 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4815cbb0 con 0x7f5e480c0db0 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81eb7fe640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81ec14dd70 0x7f81ec1fadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:46.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550003760 con 0x7fd5600c54d0 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550003b10 con 0x7fd5600c54d0 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fa8cad3e640 1 -- 172.21.15.97:0/3284977983 shutdown_connections 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0011830 con 0x7f81ec1544f0 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00119b0 con 0x7f81ec1544f0 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0011d60 con 0x7f81ec1544f0 2023-12-04T05:36:46.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f8a07fff640 1 --2- 172.21.15.97:0/2317332104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006c440 0x7f8a101524e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009870 tx=0x7f89f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979e51da57a8dfba server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81f1674640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec14f090 con 0x7f81ec1544f0 2023-12-04T05:36:46.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81f1674640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec14f650 con 0x7f81ec1544f0 2023-12-04T05:36:46.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f8a0e59c640 1 -- 172.21.15.97:0/2317332104 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80aa430 con 0x7f8a1006c440 2023-12-04T05:36:46.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7efcac90f640 1 --2- 172.21.15.97:0/2371494400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca806d620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca8150020 tx=0x7efca001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b715dfdd1df37c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7efca77fe640 1 -- 172.21.15.97:0/2371494400 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00ac640 con 0x7efca806d210 2023-12-04T05:36:46.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7efca77fe640 1 -- 172.21.15.97:0/2371494400 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00ac7a0 con 0x7efca806d210 2023-12-04T05:36:46.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fec146d6640 1 Processor -- start 2023-12-04T05:36:46.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f8a0e59c640 1 -- 172.21.15.97:0/2317332104 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f80aa590 con 0x7f8a1006c440 2023-12-04T05:36:46.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7efca77fe640 1 -- 172.21.15.97:0/2371494400 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00acb30 con 0x7efca806d210 2023-12-04T05:36:46.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fa8cad3e640 1 -- 172.21.15.97:0/3284977983 wait complete. 2023-12-04T05:36:46.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f8a0e59c640 1 -- 172.21.15.97:0/2317332104 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80aa920 con 0x7f8a1006c440 2023-12-04T05:36:46.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fa8cad3e640 1 Processor -- start 2023-12-04T05:36:46.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81c4000fd0 con 0x7f81ec1544f0 2023-12-04T05:36:46.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fa8cad3e640 1 -- start start 2023-12-04T05:36:46.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fec146d6640 1 -- start start 2023-12-04T05:36:46.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fb860596640 1 Processor -- start 2023-12-04T05:36:46.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 -- 172.21.15.97:0/2371494400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 msgr2=0x7efca806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 --2- 172.21.15.97:0/2371494400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca806d620 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca8150020 tx=0x7efca001c4d0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e30005190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e480c11b0 tx=0x7f5e4001cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbac5db513ca16ba server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd550003c70 con 0x7fd5600c54d0 2023-12-04T05:36:46.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 -- 172.21.15.97:0/2317332104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006c440 msgr2=0x7f8a101524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec146d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec146d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec0c06e2e0 0x7fec0c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec146d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c0c30a0 con 0x7fec0c156680 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec146d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0c64e0 con 0x7fec0c06e2e0 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec146d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c89c0 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a5c10 con 0x7f5e480c0db0 2023-12-04T05:36:46.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e477fe640 1 -- 172.21.15.97:0/1387018907 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000f040 con 0x7f5e480c0db0 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd54effd640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5400668d0 0x7fd540068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd550084160 con 0x7fd5600c54d0 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd55e59c640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5400668d0 0x7fd540068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd54effd640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7fd54006ea70 0x7fd540070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd540071540 con 0x7fd54006ea70 2023-12-04T05:36:46.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5500844d0 con 0x7fd5600c54d0 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.783+0000 7fb860596640 1 -- start start 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 -- 172.21.15.97:0/2371494400 shutdown_connections 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 --2- 172.21.15.97:0/2371494400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca806d620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 --2- 172.21.15.97:0/2371494400 >> v2:172.21.15.97:3300/0 conn(0x7efca80c1e70 0x7efca81524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7efcae372640 1 -- 172.21.15.97:0/2371494400 >> 172.21.15.97:0/2371494400 conn(0x7efca80c5e70 msgr2=0x7efca80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42368/0 (socket says 172.21.15.97:42368) 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 -- 172.21.15.97:0/3799286114 learned_addr learned my addr 172.21.15.97:0/3799286114 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec12c73640 1 --2- 172.21.15.97:0/3799286114 >> v2:172.21.15.97:3300/0 conn(0x7fec0c06e2e0 0x7fec0c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f81e0038490 con 0x7f81ec1544f0 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 --2- 172.21.15.97:0/2317332104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006c440 0x7f8a101524e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009870 tx=0x7f89f801c4f0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 -- 172.21.15.97:0/2317332104 shutdown_connections 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 --2- 172.21.15.97:0/2317332104 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006c440 0x7f8a101524e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 -- 172.21.15.97:0/2317332104 >> 172.21.15.97:0/2317332104 conn(0x7f8a100c5e70 msgr2=0x7f8a100c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c40a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 -- 172.21.15.97:0/2317332104 shutdown_connections 2023-12-04T05:36:46.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f8a1509a640 1 -- 172.21.15.97:0/2317332104 wait complete. 2023-12-04T05:36:46.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8c40bf2a0 0x7fa8c41f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd55ed9d640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7fd54006ea70 0x7fd540070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 msgr2=0x7f5e30005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4edf8640 1 --2- 172.21.15.97:0/1387018907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e480c0db0 0x7f5e30005190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e480c11b0 tx=0x7f5e4001cc00 comp rx=0 tx=0).stop 2023-12-04T05:36:46.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4d395640 1 -- 172.21.15.97:0/1387018907 reap_dead start 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c40a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c40a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48040/0 (socket says 172.21.15.97:48040) 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 -- 172.21.15.97:0/4207066771 learned_addr learned my addr 172.21.15.97:0/4207066771 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 -- 172.21.15.97:0/3799286114 >> v2:172.21.15.97:3300/0 conn(0x7fec0c06e2e0 msgr2=0x7fec0c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 --2- 172.21.15.97:0/3799286114 >> v2:172.21.15.97:3300/0 conn(0x7fec0c06e2e0 0x7fec0c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 -- 172.21.15.97:0/3799286114 >> v1:172.21.15.97:6789/0 conn(0x7fec0c156680 legacy=0x7fec0c0c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8c41491f0 0x7fa8c4146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fec11c71640 1 -- 172.21.15.97:0/3799286114 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0c5cd0 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd55e59c640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5400668d0 0x7fd540068d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd554000f70 tx=0x7fd554007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1387018907 shutdown_connections 2023-12-04T05:36:46.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1387018907 >> 172.21.15.97:0/1387018907 conn(0x7f5e480c5e70 msgr2=0x7f5e480c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7f81e8ff9640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81d80669a0 0x7f81d8068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fd55ed9d640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7fd54006ea70 0x7fd540070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40a89a0 con 0x7fa8c40bf2a0 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c41f1440 con 0x7fa8c406df10 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c40a9f70 con 0x7fa8c41491f0 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c92db640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8c41491f0 0x7fa8c4146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c3fff640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8c40bf2a0 0x7fa8c41f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 -- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8c41491f0 msgr2=0x7fa8c4146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa8c41491f0 0x7fa8c4146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 -- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8c40bf2a0 msgr2=0x7fa8c41f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8c40bf2a0 0x7fa8c41f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.787+0000 7fa8c8ada640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009a70 con 0x7fa8c406df10 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8c3fff640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8c40bf2a0 0x7fa8c41f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8c8ada640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c40a8460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009f40 tx=0x7fa8b800c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb860596640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb858071150 0x7fb85814de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb860596640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85806dde0 con 0x7fb8580c3490 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb860596640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580700b0 con 0x7fb858154810 2023-12-04T05:36:46.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb860596640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb858154cc0 con 0x7fb858071150 2023-12-04T05:36:46.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f81ebfff640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81d80669a0 0x7f81d8068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7efcae372640 1 -- 172.21.15.97:0/2371494400 shutdown_connections 2023-12-04T05:36:46.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85e332640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb8580c3490 0x7fb8580c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41728/0 (socket says 172.21.15.97:41728) 2023-12-04T05:36:46.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85e332640 1 -- 172.21.15.97:0/523340476 learned_addr learned my addr 172.21.15.97:0/523340476 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:46.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8016250 con 0x7fa8c406df10 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1387018907 shutdown_connections 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114385117 0 0) 0x7fb854001120 con 0x7fb8580c3490 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb844003530 con 0x7fb8580c3490 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748995984 0 0) 0x7fb844003530 con 0x7fb8580c3490 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 >> v2:172.21.15.97:3300/0 conn(0x7fb858071150 msgr2=0x7fb85814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85db31640 1 --2- 172.21.15.97:0/523340476 >> v2:172.21.15.97:3300/0 conn(0x7fb858071150 0x7fb85814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80163b0 con 0x7fa8c406df10 2023-12-04T05:36:46.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8016720 con 0x7fa8c406df10 2023-12-04T05:36:46.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 --2- 172.21.15.97:0/523340476 >> v2:172.21.15.97:3300/0 conn(0x7fb858071150 0x7fb85814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 >> v1:172.21.15.143:6789/0 conn(0x7fb858154810 legacy=0x7fb85815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c40a9640 con 0x7fa8c406df10 2023-12-04T05:36:46.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81e00844e0 con 0x7f81ec1544f0 2023-12-04T05:36:46.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c40a9c00 con 0x7fa8c406df10 2023-12-04T05:36:46.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1387018907 wait complete. 2023-12-04T05:36:46.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8c4155460 con 0x7fa8c406df10 2023-12-04T05:36:46.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f8a1509a640 1 Processor -- start 2023-12-04T05:36:46.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== osd.1 v2:172.21.15.97:6808/344946236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd540071540 con 0x7fd54006ea70 2023-12-04T05:36:46.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f8a1509a640 1 -- start start 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858070390 con 0x7fb8580c3490 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fb854001810 con 0x7fb8580c3490 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 >> v1:172.21.15.97:6789/0 conn(0x7fb8580c3490 legacy=0x7fb8580c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844003980 0x7fb844003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8440047d0 0x7fb844004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 0x7fb844009980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb858154cc0 con 0x7fb8440047d0 2023-12-04T05:36:46.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84400a240 con 0x7fb844005390 2023-12-04T05:36:46.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84400a400 con 0x7fb844003980 2023-12-04T05:36:46.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85db31640 1 --2- 172.21.15.97:0/523340476 >> v2:172.21.15.97:3300/0 conn(0x7fb858071150 0x7fb85814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f81e8ff9640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f81d806ebc0 0x7f81d8070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7fb85e332640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844003980 0x7fb844003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f81ebfff640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81d80669a0 0x7f81d8068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81e40ae000 tx=0x7f81e40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7efcae372640 1 -- 172.21.15.97:0/2371494400 wait complete. 2023-12-04T05:36:46.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7efcae372640 1 Processor -- start 2023-12-04T05:36:46.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f8a1509a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 0x7f8a1014ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85db31640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8440047d0 0x7fb844004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a1509a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006d210 0x7f8a10148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 -- start start 2023-12-04T05:36:46.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 0x7f8a1014ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 0x7f8a1014ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48066/0 (socket says 172.21.15.97:48066) 2023-12-04T05:36:46.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 -- 172.21.15.97:0/3311811310 learned_addr learned my addr 172.21.15.97:0/3311811310 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a1509a640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a100c1e70 0x7f8a101485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a1509a640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1013be70 con 0x7f8a1006d210 2023-12-04T05:36:46.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a1509a640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10146cd0 con 0x7f8a1006c440 2023-12-04T05:36:46.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a1509a640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101f53d0 con 0x7f8a100c1e70 2023-12-04T05:36:46.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 0x7fb844009980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.791+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81d8071690 con 0x7f81d806ebc0 2023-12-04T05:36:46.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0f59e640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a100c1e70 0x7f8a101485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec11c71640 1 --2- 172.21.15.97:0/3799286114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7febfc00f9b0 tx=0x7febfc0207f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e523f251a173491 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 -- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a100c1e70 msgr2=0x7f8a101485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a100c1e70 0x7f8a101485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 -- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006d210 msgr2=0x7f8a10148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 -- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844003980 msgr2=0x7fb844003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 0x7efca81ecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec11470640 1 -- 172.21.15.97:0/3799286114 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0a9590 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca81ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844003980 0x7fb844003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81e0084890 con 0x7f81ec1544f0 2023-12-04T05:36:46.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f81eb7fe640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f81d806ebc0 0x7f81d8070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a07fff640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006d210 0x7f8a10148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 0x7efca8151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec11470640 1 -- 172.21.15.97:0/3799286114 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc0a96f0 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f81eb7fe640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f81d806ebc0 0x7f81d8070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efc9f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca81ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efc9f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca81ebfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48072/0 (socket says 172.21.15.97:48072) 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efca7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 0x7efca81ecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efca7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 0x7efca81ecbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42414/0 (socket says 172.21.15.97:42414) 2023-12-04T05:36:46.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec11470640 1 -- 172.21.15.97:0/3799286114 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0a9a80 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcac90f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 0x7efca8151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcac90f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 0x7efca8151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49918/0 (socket says 172.21.15.97:49918) 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efc9f7fe640 1 -- 172.21.15.97:0/637929644 learned_addr learned my addr 172.21.15.97:0/637929644 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81fa640 con 0x7efca80c1e70 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81fa920 con 0x7efca806d210 2023-12-04T05:36:46.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8150760 con 0x7efca806c440 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 -- 172.21.15.97:0/523340476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8440047d0 msgr2=0x7fb844004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8440047d0 0x7fb844004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85eb33640 1 -- 172.21.15.97:0/523340476 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858070390 con 0x7fb844005390 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 -- 172.21.15.97:0/3799286114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 msgr2=0x7fec0c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 --2- 172.21.15.97:0/3799286114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7febfc00f9b0 tx=0x7febfc0207f0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f5e4edf8640 1 Processor -- start 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 -- 172.21.15.97:0/3799286114 shutdown_connections 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 --2- 172.21.15.97:0/3799286114 >> v2:172.21.15.97:3300/0 conn(0x7fec0c06e2e0 0x7fec0c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 --2- 172.21.15.97:0/3799286114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c0c3ad0 0x7fec0c06dda0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fec146d6640 1 -- 172.21.15.97:0/3799286114 >> 172.21.15.97:0/3799286114 conn(0x7fec0c072760 msgr2=0x7fec0c06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fb85db31640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8440047d0 0x7fb844004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:46.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f5e4edf8640 1 -- start start 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== osd.0 v2:172.21.15.97:6800/420219681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f81d8071690 con 0x7f81d806ebc0 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 -- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 msgr2=0x7efca81ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efca806d210 0x7efca81ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 -- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 msgr2=0x7efca8151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 0x7efca8151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca00094d0 con 0x7efca806c440 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8b8029430 con 0x7fa8c406df10 2023-12-04T05:36:46.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c17fa640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa8a8066900 0x7fa8a8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8b8084ec0 con 0x7fa8c406df10 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c17fa640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fa8a806eaa0 0x7fa8a8070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006d210 0x7f8a10148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80094d0 con 0x7f8a1006c440 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a07fff640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a1006d210 0x7f8a10148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.795+0000 7f8a0ed9d640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 0x7f8a1014ce00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c500 tx=0x7f8a0000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000052d0 con 0x7f8a1006c440 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00005450 con 0x7f8a1006c440 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00012870 con 0x7f8a1006c440 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a1509a640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a10146f70 con 0x7f8a1006c440 2023-12-04T05:36:46.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a1509a640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10147530 con 0x7f8a1006c440 2023-12-04T05:36:46.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efcac90f640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efca80c1e70 0x7efca8151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:46.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fec146d6640 1 -- 172.21.15.97:0/3799286114 shutdown_connections 2023-12-04T05:36:46.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fec146d6640 1 -- 172.21.15.97:0/3799286114 wait complete. 2023-12-04T05:36:46.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca7fff640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 0x7efca81ecbe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efc9000bd70 tx=0x7efc9000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89e8000fd0 con 0x7f8a1006c440 2023-12-04T05:36:46.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c3fff640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa8a8066900 0x7fa8a8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c92db640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fa8a806eaa0 0x7fa8a8070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90014440 con 0x7efca806c440 2023-12-04T05:36:46.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc900145c0 con 0x7efca806c440 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90014970 con 0x7efca806c440 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fec146d6640 1 Processor -- start 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 0x7f5e48152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e48156730 0x7f5e4814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e481f6790 0x7f5e4814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48159900 con 0x7f5e480aa890 2023-12-04T05:36:46.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e481522f0 con 0x7f5e48156730 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4edf8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48159620 con 0x7f5e481f6790 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4cb94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 0x7f5e48152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4cb94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 0x7f5e48152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49920/0 (socket says 172.21.15.97:49920) 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4cb94640 1 -- 172.21.15.97:0/1150757712 learned_addr learned my addr 172.21.15.97:0/1150757712 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fb85eb33640 1 -- 172.21.15.97:0/523340476 reap_dead start 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8150a40 con 0x7efca806c440 2023-12-04T05:36:46.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fec146d6640 1 -- start start 2023-12-04T05:36:46.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fb85eb33640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 0x7fb844009980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb850001e70 tx=0x7fb85001c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e31e3fd821827e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7fa8c92db640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fa8a806eaa0 0x7fa8a8070ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca81ec500 con 0x7efca806c440 2023-12-04T05:36:46.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4cb94640 1 -- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e481f6790 msgr2=0x7f5e4814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e47fff640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e48156730 0x7f5e4814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.799+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e481f6790 0x7f5e4814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8a8071570 con 0x7fa8a806eaa0 2023-12-04T05:36:46.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8b8085310 con 0x7fa8c406df10 2023-12-04T05:36:46.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85806c780 con 0x7fb844005390 2023-12-04T05:36:46.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850003ba0 con 0x7fb844005390 2023-12-04T05:36:46.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a000129d0 con 0x7f8a1006c440 2023-12-04T05:36:46.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fa8c3fff640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa8a8066900 0x7fa8a8068dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4153b40 tx=0x7fa8b0007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb85d330640 1 -- 172.21.15.97:0/523340476 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500050d0 con 0x7fb844005390 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec0c06e2e0 0x7fec0c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec0c0c3ad0 0x7fec0c14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c156680 0x7fec0c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c14eab0 con 0x7fec0c0c3ad0 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec11c71640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec0c0c3ad0 0x7fec0c14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12472640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec0c06e2e0 0x7fec0c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12472640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec0c06e2e0 0x7fec0c14cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48090/0 (socket says 172.21.15.97:48090) 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12472640 1 -- 172.21.15.97:0/2106729858 learned_addr learned my addr 172.21.15.97:0/2106729858 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c156680 0x7fec0c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efca81505e0 con 0x7efca806c440 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c14e2a0 con 0x7fec0c06e2e0 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c14e4f0 con 0x7fec0c156680 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== osd.2 v2:172.21.15.97:6824/2063616268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa8a8071570 con 0x7fa8a806eaa0 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4cb94640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e481f6790 0x7f5e4814b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4cb94640 1 -- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e48156730 msgr2=0x7f5e4814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4cb94640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e48156730 0x7f5e4814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 -- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 msgr2=0x7fb844009980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4cb94640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48151ca0 con 0x7f5e480aa890 2023-12-04T05:36:46.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e47fff640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e48156730 0x7f5e4814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e481f6790 0x7f5e4814b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:46.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e4cb94640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 0x7f5e48152970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b460 tx=0x7f5e3800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 -- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec0c06e2e0 msgr2=0x7fec0c14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec0c06e2e0 0x7fec0c14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 -- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec0c0c3ad0 msgr2=0x7fec0c14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec0c0c3ad0 0x7fec0c14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc00f610 con 0x7fec0c156680 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec12c73640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c156680 0x7fec0c14aef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06e6e0 tx=0x7fec0400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 0x7fb844009980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb850001e70 tx=0x7fb85001c760 comp rx=0 tx=0).stop 2023-12-04T05:36:46.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f8a077fe640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89f00669a0 0x7f89f0068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a00083fe0 con 0x7f8a1006c440 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a077fe640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f89f006ebc0 0x7f89f0070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89f0071690 con 0x7f89f006ebc0 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a00086600 con 0x7f8a1006c440 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc9001d3b0 con 0x7efca806c440 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38011890 con 0x7f5e480aa890 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380119f0 con 0x7f5e480aa890 2023-12-04T05:36:46.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38011da0 con 0x7f5e480aa890 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04018070 con 0x7fec0c156680 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400edd0 con 0x7fec0c156680 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04007ea0 con 0x7fec0c156680 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c14e7d0 con 0x7fec0c156680 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0a88e0 con 0x7fec0c156680 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 -- 172.21.15.97:0/523340476 shutdown_connections 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 --2- 172.21.15.97:0/523340476 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb844005390 0x7fb844009980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 -- 172.21.15.97:0/523340476 >> 172.21.15.97:0/523340476 conn(0x7fb8580c2970 msgr2=0x7fb8580c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 -- 172.21.15.97:0/523340476 shutdown_connections 2023-12-04T05:36:46.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.803+0000 7fb860596640 1 -- 172.21.15.97:0/523340476 wait complete. 2023-12-04T05:36:46.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efca57fa640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc88066920 0x7efc88068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc90084560 con 0x7efca806c440 2023-12-04T05:36:46.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a07fff640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89f00669a0 0x7f89f0068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e48151f80 con 0x7f5e480aa890 2023-12-04T05:36:46.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efca57fa640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7efc8806eb40 0x7efc88070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc88071610 con 0x7efc8806eb40 2023-12-04T05:36:46.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc90086b40 con 0x7efca806c440 2023-12-04T05:36:46.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a0f59e640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f89f006ebc0 0x7f89f0070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e48159220 con 0x7f5e480aa890 2023-12-04T05:36:46.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efc9f7fe640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc88066920 0x7efc88068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7efcac90f640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7efc8806eb40 0x7efc88070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f8a0f59e640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f89f006ebc0 0x7f89f0070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e4815ce90 con 0x7f5e480aa890 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7efc9f7fe640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc88066920 0x7efc88068de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efca8067780 tx=0x7efc98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.807+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fec04014420 con 0x7fec0c156680 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febf4000fd0 con 0x7fec0c156680 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec02ffd640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febf0066920 0x7febf0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec040843e0 con 0x7fec0c156680 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec02ffd640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7febf006eac0 0x7febf0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febf0071590 con 0x7febf006eac0 2023-12-04T05:36:46.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb860596640 1 Processor -- start 2023-12-04T05:36:46.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7f8a07fff640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89f00669a0 0x7f89f0068e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89f80ae000 tx=0x7f89f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec040551d0 con 0x7fec0c156680 2023-12-04T05:36:46.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7efcac90f640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7efc8806eb40 0x7efc88070f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec12472640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febf0066920 0x7febf0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== osd.3 v2:172.21.15.97:6809/2471126729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f89f0071690 con 0x7f89f006ebc0 2023-12-04T05:36:46.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== osd.4 v2:172.21.15.143:6816/3115878334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efc88071610 con 0x7efc8806eb40 2023-12-04T05:36:46.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec12472640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febf0066920 0x7febf0068de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec08001960 tx=0x7fec08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fec11c71640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7febf006eac0 0x7febf0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb860596640 1 -- start start 2023-12-04T05:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb860596640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 0x7fb85813c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb860596640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb858153a20 0x7fb85813cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5e3801a400 con 0x7f5e480aa890 2023-12-04T05:36:46.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb85e332640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 0x7fb85813c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb85e332640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 0x7fb85813c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42448/0 (socket says 172.21.15.97:42448) 2023-12-04T05:36:46.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb85e332640 1 -- 172.21.15.97:0/922620901 learned_addr learned my addr 172.21.15.97:0/922620901 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:46.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fec11c71640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7febf006eac0 0x7febf0070ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.811+0000 7fb860596640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8580ab080 0x7fb8580a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580a9f90 con 0x7fb8580ab080 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580a8a50 con 0x7fb858153a20 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8581e96c0 con 0x7fb844005390 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85db31640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb858153a20 0x7fb85813cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e457fa640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e34066920 0x7f5e34068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e38084790 con 0x7f5e480aa890 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== osd.6 v2:172.21.15.143:6808/1463072026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7febf0071590 con 0x7febf006eac0 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85e332640 1 -- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb858153a20 msgr2=0x7fb85813cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85e332640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb858153a20 0x7fb85813cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85e332640 1 -- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8580ab080 msgr2=0x7fb8580a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85e332640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8580ab080 0x7fb8580a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7fb85e332640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580a86e0 con 0x7fb844005390 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e457fa640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f5e3406eb40 0x7f5e34070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e34071610 con 0x7f5e3406eb40 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e38086d70 con 0x7f5e480aa890 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e47fff640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e34066920 0x7f5e34068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e47fff640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e34066920 0x7f5e34068de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e48158fa0 tx=0x7f5e3c0015d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.815+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f5e3406eb40 0x7f5e34070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 --> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd56006de80 con 0x7fd54006ea70 2023-12-04T05:36:46.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb85e332640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 0x7fb85813c740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb854007310 tx=0x7fb8540077d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400f940 con 0x7fb844005390 2023-12-04T05:36:46.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd54effd640 1 -- 172.21.15.97:0/4241519154 <== osd.1 v2:172.21.15.97:6808/344946236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd540071540 con 0x7fd54006ea70 2023-12-04T05:36:46.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7f5e4d395640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f5e3406eb40 0x7f5e34070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400fae0 con 0x7fb844005390 2023-12-04T05:36:46.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400fe90 con 0x7fb844005390 2023-12-04T05:36:46.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8581e93b0 con 0x7fb844005390 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7fd54006ea70 msgr2=0x7fd540070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7fd54006ea70 0x7fd540070e90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5400668d0 msgr2=0x7fd540068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5400668d0 0x7fd540068d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd554000f70 tx=0x7fd554007d50 comp rx=0 tx=0).stop 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 msgr2=0x7fd56014ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 --2- 172.21.15.97:0/4241519154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5600c54d0 0x7fd56014ce40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd55000c390 tx=0x7fd55000c850 comp rx=0 tx=0).stop 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55ed9d640 1 -- 172.21.15.97:0/4241519154 reap_dead start 2023-12-04T05:36:46.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== osd.5 v2:172.21.15.143:6800/4041478737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5e34071610 con 0x7f5e3406eb40 2023-12-04T05:36:46.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8580a9870 con 0x7fb844005390 2023-12-04T05:36:46.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 shutdown_connections 2023-12-04T05:36:46.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 >> 172.21.15.97:0/4241519154 conn(0x7fd56006a9f0 msgr2=0x7fd560157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 shutdown_connections 2023-12-04T05:36:46.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fd55f59e640 1 -- 172.21.15.97:0/4241519154 wait complete. 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.819+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8580a8560 con 0x7fb844005390 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb85401d460 con 0x7fb844005390 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb83c0669d0 0x7fb83c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb854084400 con 0x7fb844005390 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fb83c06ebf0 0x7fb83c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb83c0716c0 con 0x7fb83c06ebf0 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb854086a20 con 0x7fb844005390 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.823+0000 7fb85db31640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb83c0669d0 0x7fb83c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.827+0000 7fb85eb33640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fb83c06ebf0 0x7fb83c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:46.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.827+0000 7fb85db31640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb83c0669d0 0x7fb83c068e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8581e67a0 tx=0x7fb848008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.827+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 --> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f81c4002cc0 con 0x7f81d806ebc0 2023-12-04T05:36:46.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.827+0000 7fb85eb33640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fb83c06ebf0 0x7fb83c071010 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:46.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.827+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== osd.7 v2:172.21.15.143:6824/2750869558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb83c0716c0 con 0x7fb83c06ebf0 2023-12-04T05:36:46.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81e8ff9640 1 -- 172.21.15.97:0/2007200708 <== osd.0 v2:172.21.15.97:6800/420219681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f81c4002cc0 con 0x7f81d806ebc0 2023-12-04T05:36:46.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f81d806ebc0 msgr2=0x7f81d8070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f81d806ebc0 0x7f81d8070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81d80669a0 msgr2=0x7f81d8068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81d80669a0 0x7f81d8068e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81e40ae000 tx=0x7f81e40a7070 comp rx=0 tx=0).stop 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81ec1544f0 msgr2=0x7f81ec1f9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.831+0000 7f81d27fc640 1 --2- 172.21.15.97:0/2007200708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81ec1544f0 0x7f81ec1f9bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81e000b3e0 tx=0x7f81e000b8a0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7f81f0e73640 1 -- 172.21.15.97:0/2007200708 reap_dead start 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 shutdown_connections 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 >> 172.21.15.97:0/2007200708 conn(0x7f81ec06a9f0 msgr2=0x7f81ec15d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 shutdown_connections 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7f81d27fc640 1 -- 172.21.15.97:0/2007200708 wait complete. 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 --> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa8c40aa0b0 con 0x7fa8a806eaa0 2023-12-04T05:36:46.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.835+0000 7fa8c17fa640 1 -- 172.21.15.97:0/4207066771 <== osd.2 v2:172.21.15.97:6824/2063616268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa8bc0a57d0 con 0x7fa8a806eaa0 2023-12-04T05:36:46.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 --> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89e8002cc0 con 0x7f89f006ebc0 2023-12-04T05:36:46.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fa8a806eaa0 msgr2=0x7fa8a8070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fa8a806eaa0 0x7fa8a8070ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa8a8066900 msgr2=0x7fa8a8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa8a8066900 0x7fa8a8068dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4153b40 tx=0x7fa8b0007ad0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 msgr2=0x7fa8c40a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 --2- 172.21.15.97:0/4207066771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa8c406df10 0x7fa8c40a8460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009f40 tx=0x7fa8b800c580 comp rx=0 tx=0).stop 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8c92db640 1 -- 172.21.15.97:0/4207066771 reap_dead start 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 shutdown_connections 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 >> 172.21.15.97:0/4207066771 conn(0x7fa8c40c2970 msgr2=0x7fa8c4147480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 --> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febf4002c90 con 0x7febf006eac0 2023-12-04T05:36:46.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 shutdown_connections 2023-12-04T05:36:46.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fa8cad3e640 1 -- 172.21.15.97:0/4207066771 wait complete. 2023-12-04T05:36:46.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7f8a077fe640 1 -- 172.21.15.97:0/3311811310 <== osd.3 v2:172.21.15.97:6809/2471126729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f89e8002cc0 con 0x7f89f006ebc0 2023-12-04T05:36:46.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7fec02ffd640 1 -- 172.21.15.97:0/2106729858 <== osd.6 v2:172.21.15.143:6808/1463072026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febf4002c90 con 0x7febf006eac0 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f89f006ebc0 msgr2=0x7f89f0070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.839+0000 7f8a057fa640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f89f006ebc0 0x7f89f0070fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89f00669a0 msgr2=0x7f89f0068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89f00669a0 0x7f89f0068e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89f80ae000 tx=0x7f89f8008040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 msgr2=0x7f8a1014ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 --2- 172.21.15.97:0/3311811310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a1006c440 0x7f8a1014ce00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c500 tx=0x7f8a0000c9c0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a0f59e640 1 -- 172.21.15.97:0/3311811310 reap_dead start 2023-12-04T05:36:46.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 shutdown_connections 2023-12-04T05:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 >> 172.21.15.97:0/3311811310 conn(0x7f8a100c5e70 msgr2=0x7f8a10151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7febf006eac0 msgr2=0x7febf0070ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7febf006eac0 0x7febf0070ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7efcae372640 1 -- 172.21.15.97:0/637929644 --> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efca80720c0 con 0x7efc8806eb40 2023-12-04T05:36:46.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 shutdown_connections 2023-12-04T05:36:46.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7f8a057fa640 1 -- 172.21.15.97:0/3311811310 wait complete. 2023-12-04T05:36:46.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febf0066920 msgr2=0x7febf0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febf0066920 0x7febf0068de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec08001960 tx=0x7fec08009040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7efca57fa640 1 -- 172.21.15.97:0/637929644 <== osd.4 v2:172.21.15.143:6816/3115878334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc88071610 con 0x7efc8806eb40 2023-12-04T05:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c156680 msgr2=0x7fec0c14aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec146d6640 1 --2- 172.21.15.97:0/2106729858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec0c156680 0x7fec0c14aef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06e6e0 tx=0x7fec0400e4b0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.843+0000 7fec12c73640 1 -- 172.21.15.97:0/2106729858 reap_dead start 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7efc8806eb40 msgr2=0x7efc88070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7efc8806eb40 0x7efc88070f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc88066920 msgr2=0x7efc88068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc88066920 0x7efc88068de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efca8067780 tx=0x7efc98009040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 msgr2=0x7efca81ecbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 --2- 172.21.15.97:0/637929644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efca806c440 0x7efca81ecbe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efc9000bd70 tx=0x7efc9000be60 comp rx=0 tx=0).stop 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efcac90f640 1 -- 172.21.15.97:0/637929644 reap_dead start 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 shutdown_connections 2023-12-04T05:36:46.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 >> 172.21.15.97:0/637929644 conn(0x7efca80c5e70 msgr2=0x7efca80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 shutdown_connections 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 >> 172.21.15.97:0/2106729858 conn(0x7fec0c072760 msgr2=0x7fec0c0ac950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 shutdown_connections 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7fec146d6640 1 -- 172.21.15.97:0/2106729858 wait complete. 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 shutdown_connections 2023-12-04T05:36:46.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.847+0000 7efc9e7fc640 1 -- 172.21.15.97:0/637929644 wait complete. 2023-12-04T05:36:46.878 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:46.878 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-04T05:36:46.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 --> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e48151b00 con 0x7f5e3406eb40 2023-12-04T05:36:46.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e457fa640 1 -- 172.21.15.97:0/1150757712 <== osd.5 v2:172.21.15.143:6800/4041478737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e48151b00 con 0x7f5e3406eb40 2023-12-04T05:36:46.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f5e3406eb40 msgr2=0x7f5e34070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f5e3406eb40 0x7f5e34070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e34066920 msgr2=0x7f5e34068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e34066920 0x7f5e34068de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e48158fa0 tx=0x7f5e3c0015d0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 msgr2=0x7f5e48152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 --2- 172.21.15.97:0/1150757712 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e480aa890 0x7f5e48152970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800b460 tx=0x7f5e3800b920 comp rx=0 tx=0).stop 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4d395640 1 -- 172.21.15.97:0/1150757712 reap_dead start 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 shutdown_connections 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.851+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 >> 172.21.15.97:0/1150757712 conn(0x7f5e480c5e70 msgr2=0x7f5e48154800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.855+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 shutdown_connections 2023-12-04T05:36:46.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.855+0000 7f5e4edf8640 1 -- 172.21.15.97:0/1150757712 wait complete. 2023-12-04T05:36:46.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.859+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 --> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb858147950 con 0x7fb83c06ebf0 2023-12-04T05:36:46.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.859+0000 7fb84effd640 1 -- 172.21.15.97:0/922620901 <== osd.7 v2:172.21.15.143:6824/2750869558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb858147950 con 0x7fb83c06ebf0 2023-12-04T05:36:46.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.867+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fb83c06ebf0 msgr2=0x7fb83c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.867+0000 7fb860596640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fb83c06ebf0 0x7fb83c071010 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.882 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:46.882 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb83c0669d0 msgr2=0x7fb83c068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb83c0669d0 0x7fb83c068e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8581e67a0 tx=0x7fb848008040 comp rx=0 tx=0).stop 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 msgr2=0x7fb85813c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 --2- 172.21.15.97:0/922620901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb844005390 0x7fb85813c740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb854007310 tx=0x7fb8540077d0 comp rx=0 tx=0).stop 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb85eb33640 1 -- 172.21.15.97:0/922620901 reap_dead start 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 shutdown_connections 2023-12-04T05:36:46.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 >> 172.21.15.97:0/922620901 conn(0x7fb8580c2970 msgr2=0x7fb8581496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:46.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 shutdown_connections 2023-12-04T05:36:46.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:46.871+0000 7fb860596640 1 -- 172.21.15.97:0/922620901 wait complete. 2023-12-04T05:36:46.884 INFO:teuthology.orchestra.run.smithi097.stdout:55834574856 2023-12-04T05:36:46.885 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-04T05:36:46.892 INFO:teuthology.orchestra.run.smithi097.stdout:55834574856 2023-12-04T05:36:46.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-04T05:36:46.893 INFO:teuthology.orchestra.run.smithi097.stdout:55834574853 2023-12-04T05:36:46.894 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:46.894 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-04T05:36:46.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-04T05:36:46.895 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:46.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-04T05:36:46.899 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:46.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-04T05:36:47.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.111+0000 7f148e69c640 1 Processor -- start 2023-12-04T05:36:47.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148e69c640 1 -- start start 2023-12-04T05:36:47.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148e69c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f14880c1210 0x7f1488150570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148e69c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148814e230 con 0x7f148806ba90 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148e69c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880c4600 con 0x7f148814de50 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148e69c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148806dc30 con 0x7f14880c1210 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148cc39640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f148806ba90 0x7f14880a4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41738/0 (socket says 172.21.15.97:41738) 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f147f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f14880c1210 0x7f1488150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.115+0000 7f148cc39640 1 -- 172.21.15.97:0/722376839 learned_addr learned my addr 172.21.15.97:0/722376839 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:47.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.119+0000 7f147f7fe640 1 -- 172.21.15.97:0/722376839 >> v1:172.21.15.143:6789/0 conn(0x7f148814de50 legacy=0x7f14880c4a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-04T05:36:47.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.119+0000 7f147f7fe640 1 -- 172.21.15.97:0/722376839 >> v1:172.21.15.97:6789/0 conn(0x7f148806ba90 legacy=0x7f14880a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.119+0000 7f147f7fe640 1 -- 172.21.15.97:0/722376839 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880c51a0 con 0x7f14880c1210 2023-12-04T05:36:47.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f147f7fe640 1 --2- 172.21.15.97:0/722376839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14880c1210 0x7f1488150570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f147800b050 tx=0x7f147801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7222c936cb070c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f14877fe640 1 -- 172.21.15.97:0/722376839 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780a5c40 con 0x7f14880c1210 2023-12-04T05:36:47.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f14877fe640 1 -- 172.21.15.97:0/722376839 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14780a5da0 con 0x7f14880c1210 2023-12-04T05:36:47.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f14877fe640 1 -- 172.21.15.97:0/722376839 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780a5c40 con 0x7f14880c1210 2023-12-04T05:36:47.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 -- 172.21.15.97:0/722376839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14880c1210 msgr2=0x7f1488150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 --2- 172.21.15.97:0/722376839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14880c1210 0x7f1488150570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f147800b050 tx=0x7f147801cb70 comp rx=0 tx=0).stop 2023-12-04T05:36:47.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 -- 172.21.15.97:0/722376839 shutdown_connections 2023-12-04T05:36:47.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 --2- 172.21.15.97:0/722376839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14880c1210 0x7f1488150570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 -- 172.21.15.97:0/722376839 >> 172.21.15.97:0/722376839 conn(0x7f14880a7800 msgr2=0x7f14880a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 -- 172.21.15.97:0/722376839 shutdown_connections 2023-12-04T05:36:47.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.123+0000 7f148e69c640 1 -- 172.21.15.97:0/722376839 wait complete. 2023-12-04T05:36:47.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7f148e69c640 1 Processor -- start 2023-12-04T05:36:47.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7f148e69c640 1 -- start start 2023-12-04T05:36:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7fa467267640 1 Processor -- start 2023-12-04T05:36:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7fa467267640 1 -- start start 2023-12-04T05:36:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7fa467267640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa460156090 0x7fa4600c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.127+0000 7fa467267640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4600c54d0 0x7fa4601591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa467267640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46015c060 con 0x7fa4600c2a20 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa467267640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa460156470 con 0x7fa4600c54d0 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa467267640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46015c300 con 0x7fa460156090 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4600c54d0 0x7fa4601591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4600c54d0 0x7fa4601591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48104/0 (socket says 172.21.15.97:48104) 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 -- 172.21.15.97:0/619067317 learned_addr learned my addr 172.21.15.97:0/619067317 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49946/0 (socket says 172.21.15.97:49946) 2023-12-04T05:36:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466265640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa460156090 0x7fa4600c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 -- 172.21.15.97:0/914450124 learned_addr learned my addr 172.21.15.97:0/914450124 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14880c1210 0x7f148814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148814de50 0x7f14880ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880abab0 con 0x7f148806ba90 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880a9cf0 con 0x7f148814de50 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14880a9fd0 con 0x7f14880c1210 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 -- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa460156090 msgr2=0x7fa4600c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa460156090 0x7fa4600c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 -- 172.21.15.97:0/619067317 >> v1:172.21.15.97:6789/0 conn(0x7fa4600c2a20 legacy=0x7fa460158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7fa466a66640 1 -- 172.21.15.97:0/619067317 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46015c5e0 con 0x7fa4600c54d0 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 -- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14880c1210 msgr2=0x7f148814bdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14880c1210 0x7f148814bdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.131+0000 7f1487fff640 1 -- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148814de50 msgr2=0x7f14880ab1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f1487fff640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148814de50 0x7f14880ab1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f1487fff640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478009a70 con 0x7f148806ba90 2023-12-04T05:36:47.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f1487fff640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f147000b4a0 tx=0x7f147000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470010610 con 0x7f148806ba90 2023-12-04T05:36:47.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470010790 con 0x7f148806ba90 2023-12-04T05:36:47.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470010b40 con 0x7f148806ba90 2023-12-04T05:36:47.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14880aa2b0 con 0x7f148806ba90 2023-12-04T05:36:47.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14880ab730 con 0x7f148806ba90 2023-12-04T05:36:47.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.135+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14880a9b50 con 0x7f148806ba90 2023-12-04T05:36:47.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa466a66640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c54d0 0x7fa4601591d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa458009e50 tx=0x7fa45801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a8621dd4e37bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa465263640 1 -- 172.21.15.97:0/619067317 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580a58a0 con 0x7fa4600c54d0 2023-12-04T05:36:47.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa465263640 1 -- 172.21.15.97:0/619067317 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4580a5a00 con 0x7fa4600c54d0 2023-12-04T05:36:47.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa465263640 1 -- 172.21.15.97:0/619067317 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4580a5d90 con 0x7fa4600c54d0 2023-12-04T05:36:47.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f3c14c9c640 1 Processor -- start 2023-12-04T05:36:47.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1470010ca0 con 0x7f148806ba90 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 -- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c54d0 msgr2=0x7fa4601591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c54d0 0x7fa4601591d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa458009e50 tx=0x7fa45801ca00 comp rx=0 tx=0).stop 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 -- 172.21.15.97:0/619067317 shutdown_connections 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c54d0 0x7fa4601591d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 --2- 172.21.15.97:0/619067317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa460156090 0x7fa4600c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 -- 172.21.15.97:0/619067317 >> 172.21.15.97:0/619067317 conn(0x7fa46006a9f0 msgr2=0x7fa46006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f3c14c9c640 1 -- start start 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f14857fa640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 0x7f1468068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1470083ff0 con 0x7f148806ba90 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f147f7fe640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 0x7f1468068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 -- 172.21.15.97:0/619067317 shutdown_connections 2023-12-04T05:36:47.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7fa467267640 1 -- 172.21.15.97:0/619067317 wait complete. 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f3c14c9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3c1014de40 0x7f3c101544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.139+0000 7f3c14c9c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100c1da0 con 0x7f3c1014da60 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c14c9c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100c2080 con 0x7f3c10150500 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c14c9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c10153af0 con 0x7f3c1014de40 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f147f7fe640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 0x7f1468068de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14780af000 tx=0x7f14780a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3c10150500 0x7f3c100a4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38078/0 (socket says 172.21.15.97:38078) 2023-12-04T05:36:47.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0ffff640 1 -- 172.21.15.97:0/2899682264 learned_addr learned my addr 172.21.15.97:0/2899682264 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:47.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0effd640 1 --2- 172.21.15.97:0/2899682264 >> v2:172.21.15.143:3300/0 conn(0x7f3c1014de40 0x7f3c101544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7fa467267640 1 Processor -- start 2023-12-04T05:36:47.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7fa467267640 1 -- start start 2023-12-04T05:36:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7fa467267640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 0x7fa4600bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0effd640 1 -- 172.21.15.97:0/2899682264 >> v1:172.21.15.143:6789/0 conn(0x7f3c10150500 legacy=0x7f3c100a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0effd640 1 -- 172.21.15.97:0/2899682264 >> v1:172.21.15.97:6789/0 conn(0x7f3c1014da60 legacy=0x7f3c1006dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7f3c0effd640 1 -- 172.21.15.97:0/2899682264 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10153cd0 con 0x7f3c1014de40 2023-12-04T05:36:47.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.143+0000 7fa467267640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa460156090 0x7fa4600a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42462/0 (socket says 172.21.15.97:42462) 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa466265640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 0x7fa4600bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4601faee0 con 0x7fa460156090 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600bb960 con 0x7fa4600c2a20 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600baa70 con 0x7fa4600c54d0 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa466265640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 0x7fa4600bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48124/0 (socket says 172.21.15.97:48124) 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa466265640 1 -- 172.21.15.97:0/548432557 learned_addr learned my addr 172.21.15.97:0/548432557 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 -- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 msgr2=0x7fa4600bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 0x7fa4600bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 -- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa460156090 msgr2=0x7fa4600a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa460156090 0x7fa4600a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 -- 172.21.15.97:0/548432557 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458009b30 con 0x7fa4600c54d0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa465a64640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa450000f70 tx=0x7fa45000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500052d0 con 0x7fa4600c54d0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450005430 con 0x7fa4600c54d0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450003840 con 0x7fa4600c54d0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4600bad50 con 0x7fa4600c54d0 2023-12-04T05:36:47.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7f865f446640 1 Processor -- start 2023-12-04T05:36:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600bb310 con 0x7fa4600c54d0 2023-12-04T05:36:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7f865f446640 1 -- start start 2023-12-04T05:36:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fe7c6ac9640 1 Processor -- start 2023-12-04T05:36:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fe7c6ac9640 1 -- start start 2023-12-04T05:36:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46006c580 con 0x7fa4600c54d0 2023-12-04T05:36:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fea8759e640 1 Processor -- start 2023-12-04T05:36:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7f3c0effd640 1 --2- 172.21.15.97:0/2899682264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014de40 0x7f3c101544d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c04010b20 tx=0x7f3c04021210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dcbdc574eb0d4c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7fea8759e640 1 -- start start 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.147+0000 7f865f446640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8658151df0 0x7f86580c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865f446640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 0x7f8658154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865f446640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8658157d10 con 0x7f86580bd690 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865f446640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865806c8a0 con 0x7f8658151df0 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865f446640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8658157ff0 con 0x7f86580c8050 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865c9e1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f86580bd690 0x7f8658154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41774/0 (socket says 172.21.15.97:41774) 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865c9e1640 1 -- 172.21.15.97:0/3537303181 learned_addr learned my addr 172.21.15.97:0/3537303181 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d9e3640 1 --2- 172.21.15.97:0/3537303181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 0x7f8658154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c6ac9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7c0151f10 0x7fe7c00c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d1e2640 1 --2- 172.21.15.97:0/3537303181 >> v2:172.21.15.97:3300/0 conn(0x7f8658151df0 0x7f86580c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa4500039a0 con 0x7fa4600c54d0 2023-12-04T05:36:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c6ac9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c6ac9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00ca780 con 0x7fe7c00cac10 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c6ac9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c0158cc0 con 0x7fe7c0151f10 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c6ac9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00c5700 con 0x7fe7c00c7f00 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 0x7fea880c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f3c0e7fc640 1 -- 172.21.15.97:0/2899682264 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a9790 con 0x7f3c1014de40 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f3c0e7fc640 1 -- 172.21.15.97:0/2899682264 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040ad070 con 0x7f3c1014de40 2023-12-04T05:36:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f3c0e7fc640 1 -- 172.21.15.97:0/2899682264 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a9b10 con 0x7f3c1014de40 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8759e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea880c24e0 0x7fea880c2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7c4865640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7c0151f10 0x7fe7c00c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42478/0 (socket says 172.21.15.97:42478) 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 -- 172.21.15.97:0/3872741619 learned_addr learned my addr 172.21.15.97:0/3872741619 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 -- 172.21.15.97:0/3872741619 >> v2:172.21.15.143:3300/0 conn(0x7fe7c0151f10 msgr2=0x7fe7c00c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3872741619 >> v2:172.21.15.143:3300/0 conn(0x7fe7c0151f10 0x7fe7c00c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 -- 172.21.15.97:0/3872741619 >> v1:172.21.15.97:6789/0 conn(0x7fe7c00cac10 legacy=0x7fe7c00c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fe7bffff640 1 -- 172.21.15.97:0/3872741619 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0158720 con 0x7fe7c00c7f00 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fa456ffd640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 0x7fa444068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8659c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fea880c0450 0x7fea8814da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38084/0 (socket says 172.21.15.97:38084) 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8759e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8806d960 con 0x7fea880c0450 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8759e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8806c830 con 0x7fea880c24e0 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88151580 con 0x7fea881544f0 2023-12-04T05:36:47.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea8659c640 1 -- 172.21.15.97:0/3999097793 learned_addr learned my addr 172.21.15.97:0/3999097793 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f3c14c9c640 1 -- 172.21.15.97:0/2899682264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014de40 msgr2=0x7f3c101544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/2899682264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014de40 0x7f3c101544d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c04010b20 tx=0x7f3c04021210 comp rx=0 tx=0).stop 2023-12-04T05:36:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3999097793 >> v2:172.21.15.97:3300/0 conn(0x7fea880c24e0 0x7fea880c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fa466265640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 0x7fa444068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14880a9b50 con 0x7f148806ba90 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa450083900 con 0x7fa4600c54d0 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea8559a640 1 -- 172.21.15.97:0/3999097793 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830337808 0 0) 0x7fea8806d960 con 0x7fea880c0450 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea8559a640 1 -- 172.21.15.97:0/3999097793 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea70003450 con 0x7fea880c0450 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d9e3640 1 -- 172.21.15.97:0/3537303181 >> v2:172.21.15.97:3300/0 conn(0x7f8658151df0 msgr2=0x7f86580c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d9e3640 1 --2- 172.21.15.97:0/3537303181 >> v2:172.21.15.97:3300/0 conn(0x7f8658151df0 0x7f86580c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d9e3640 1 -- 172.21.15.97:0/3537303181 >> v1:172.21.15.97:6789/0 conn(0x7f86580bd690 legacy=0x7f8658154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.151+0000 7f865d9e3640 1 -- 172.21.15.97:0/3537303181 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86581582d0 con 0x7f86580c8050 2023-12-04T05:36:47.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 -- 172.21.15.97:0/2899682264 shutdown_connections 2023-12-04T05:36:47.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/2899682264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014de40 0x7f3c101544d0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c04010b20 tx=0x7f3c04021210 comp rx=0 tx=0).stop 2023-12-04T05:36:47.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 -- 172.21.15.97:0/2899682264 >> 172.21.15.97:0/2899682264 conn(0x7f3c100c5a50 msgr2=0x7f3c100c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea85d9b640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 0x7fea880c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea86d9d640 1 -- 172.21.15.97:0/3999097793 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 msgr2=0x7fea880c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 -- 172.21.15.97:0/2899682264 shutdown_connections 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 0x7fea880c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea86d9d640 1 -- 172.21.15.97:0/3999097793 >> v1:172.21.15.143:6789/0 conn(0x7fea880c0450 legacy=0x7fea8814da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea86d9d640 1 -- 172.21.15.97:0/3999097793 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8806d630 con 0x7fea880c24e0 2023-12-04T05:36:47.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fa466265640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 0x7fa444068dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009b80 tx=0x7fa45c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fea85d9b640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 0x7fea880c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:47.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 -- 172.21.15.97:0/2899682264 wait complete. 2023-12-04T05:36:47.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f865d9e3640 1 --2- 172.21.15.97:0/3537303181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 0x7f8658154d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865001d290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f6d627f4f067bb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3872741619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009870 tx=0x7fe7b001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751f2aec4dfb2e3f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f3c14c9c640 1 Processor -- start 2023-12-04T05:36:47.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f864ffff640 1 -- 172.21.15.97:0/3537303181 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500a5910 con 0x7f86580c8050 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f864ffff640 1 -- 172.21.15.97:0/3537303181 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86500a5a70 con 0x7f86580c8050 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.155+0000 7f864ffff640 1 -- 172.21.15.97:0/3537303181 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500a5e00 con 0x7f86580c8050 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7bf7fe640 1 -- 172.21.15.97:0/3872741619 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b00ab600 con 0x7fe7c00c7f00 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea880c24e0 0x7fea880c2970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da028a44519b628 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7bf7fe640 1 -- 172.21.15.97:0/3872741619 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b00a7050 con 0x7fe7c00c7f00 2023-12-04T05:36:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7bf7fe640 1 -- 172.21.15.97:0/3872741619 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b00ab980 con 0x7fe7c00c7f00 2023-12-04T05:36:47.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa450050be0 con 0x7fa4600c54d0 2023-12-04T05:36:47.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8559a640 1 -- 172.21.15.97:0/3999097793 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780ab620 con 0x7fea880c24e0 2023-12-04T05:36:47.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8559a640 1 -- 172.21.15.97:0/3999097793 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780ab780 con 0x7fea880c24e0 2023-12-04T05:36:47.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8559a640 1 -- 172.21.15.97:0/3999097793 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780abb10 con 0x7fea880c24e0 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3872741619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 msgr2=0x7fe7c0154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 --2- 172.21.15.97:0/3872741619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009870 tx=0x7fe7b001c3b0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3872741619 shutdown_connections 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 --2- 172.21.15.97:0/3872741619 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c0154720 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 --2- 172.21.15.97:0/3872741619 >> v2:172.21.15.143:3300/0 conn(0x7fe7c0151f10 0x7fe7c00c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3872741619 >> 172.21.15.97:0/3872741619 conn(0x7fe7c0073950 msgr2=0x7fe7c0073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3872741619 shutdown_connections 2023-12-04T05:36:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3872741619 wait complete. 2023-12-04T05:36:47.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 -- start start 2023-12-04T05:36:47.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 -- 172.21.15.97:0/3537303181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 msgr2=0x7f8658154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 --2- 172.21.15.97:0/3537303181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 0x7f8658154d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865001d290 comp rx=0 tx=0).stop 2023-12-04T05:36:47.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 -- 172.21.15.97:0/3999097793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea880c24e0 msgr2=0x7fea880c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea880c24e0 0x7fea880c2970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801c480 comp rx=0 tx=0).stop 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014da60 0x7f3c101f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c100a8430 0x7f3c100a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101f5420 con 0x7f3c10150500 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101f2320 con 0x7f3c1014da60 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c14c9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101f25c0 con 0x7f3c100a8430 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 -- 172.21.15.97:0/3999097793 shutdown_connections 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea880c24e0 0x7fea880c2970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 --2- 172.21.15.97:0/3999097793 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea881544f0 0x7fea880c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 -- 172.21.15.97:0/3999097793 >> 172.21.15.97:0/3999097793 conn(0x7fea8806a9f0 msgr2=0x7fea8806ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 -- 172.21.15.97:0/3999097793 shutdown_connections 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 -- 172.21.15.97:0/3537303181 shutdown_connections 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 --2- 172.21.15.97:0/3537303181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580c8050 0x7f8658154d90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 --2- 172.21.15.97:0/3537303181 >> v2:172.21.15.97:3300/0 conn(0x7f8658151df0 0x7f86580c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f865f446640 1 -- 172.21.15.97:0/3537303181 >> 172.21.15.97:0/3537303181 conn(0x7f8658073950 msgr2=0x7f8658073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c0effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c0ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c100a8430 0x7f3c100a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c0effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:49972/0 (socket says 172.21.15.97:49972) 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c0effd640 1 -- 172.21.15.97:0/3810642933 learned_addr learned my addr 172.21.15.97:0/3810642933 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014da60 0x7f3c101f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f865f446640 1 -- 172.21.15.97:0/3537303181 shutdown_connections 2023-12-04T05:36:47.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 Processor -- start 2023-12-04T05:36:47.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 Processor -- start 2023-12-04T05:36:47.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 -- start start 2023-12-04T05:36:47.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f865f446640 1 -- 172.21.15.97:0/3537303181 wait complete. 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 -- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c100a8430 msgr2=0x7f3c100a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c100a8430 0x7f3c100a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 -- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014da60 msgr2=0x7f3c101f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014da60 0x7f3c101f58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 -- 172.21.15.97:0/3810642933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04010800 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c0effd640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c04010b20 tx=0x7f3c0401d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04004030 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04004190 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04004030 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c100a55e0 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c101f50b0 con 0x7f3c10150500 2023-12-04T05:36:47.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.159+0000 7fea8759e640 1 -- 172.21.15.97:0/3999097793 wait complete. 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 -- start start 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 0x7fe7c014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7c0151f10 0x7fe7c01f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01f1c80 con 0x7fe7c0151f10 2023-12-04T05:36:47.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fea8759e640 1 Processor -- start 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0153df0 con 0x7fe7c00cac10 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7fe7c6ac9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01f5800 con 0x7fe7c00c7f00 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f209c06c440 0x7f209c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f209c06d210 0x7f209c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f209c0aa240 con 0x7f209c0c1e70 2023-12-04T05:36:47.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c06c0c0 con 0x7f209c06c440 2023-12-04T05:36:47.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f20a0f57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0aa500 con 0x7f209c06d210 2023-12-04T05:36:47.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f209a59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f209c0c1e70 0x7f209c0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41792/0 (socket says 172.21.15.97:41792) 2023-12-04T05:36:47.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f209a59c640 1 -- 172.21.15.97:0/1574418958 learned_addr learned my addr 172.21.15.97:0/1574418958 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:47.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.163+0000 7f865f446640 1 Processor -- start 2023-12-04T05:36:47.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 -- start start 2023-12-04T05:36:47.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541125725 0 0) 0x7f209c0aa240 con 0x7f209c0c1e70 2023-12-04T05:36:47.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2084003530 con 0x7f209c0c1e70 2023-12-04T05:36:47.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42504/0 (socket says 172.21.15.97:42504) 2023-12-04T05:36:47.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 -- 172.21.15.97:0/3080979014 learned_addr learned my addr 172.21.15.97:0/3080979014 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334726186 0 0) 0x7f2084003530 con 0x7f209c0c1e70 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 >> v2:172.21.15.143:3300/0 conn(0x7f209c06d210 msgr2=0x7f209c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 --2- 172.21.15.97:0/1574418958 >> v2:172.21.15.143:3300/0 conn(0x7f209c06d210 0x7f209c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 >> v2:172.21.15.97:3300/0 conn(0x7f209c06c440 msgr2=0x7f209c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 --2- 172.21.15.97:0/1574418958 >> v2:172.21.15.97:3300/0 conn(0x7f209c06c440 0x7f209c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0aa7e0 con 0x7f209c0c1e70 2023-12-04T05:36:47.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f208c001680 con 0x7f209c0c1e70 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 >> v1:172.21.15.97:6789/0 conn(0x7f209c0c1e70 legacy=0x7f209c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2084003980 0x7f2084003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 0x7f2084004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20840052b0 0x7f208400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c06c0c0 con 0x7f20840052b0 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0aa500 con 0x7f2084003980 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208400c230 con 0x7f20840047d0 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c5066640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7c0151f10 0x7fe7c01f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209ad9d640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20840052b0 0x7f208400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c04004300 con 0x7f3c10150500 2023-12-04T05:36:47.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 0x7fe7c014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209a59c640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2084003980 0x7f2084003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 -- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 msgr2=0x7fe7c014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 0x7fe7c014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 -- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7c0151f10 msgr2=0x7fe7c01f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7c0151f10 0x7fe7c01f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 -- 172.21.15.97:0/3080979014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00094d0 con 0x7fe7c00c7f00 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 0x7f2084004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 0x7fe7c014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:47.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 -- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2084003980 msgr2=0x7f2084003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2084003980 0x7f2084003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c4865640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800efc0 tx=0x7fe7b800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f3bf7fff640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 0x7f3bfc068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8009b80 con 0x7fe7c00c7f00 2023-12-04T05:36:47.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800f040 con 0x7fe7c00c7f00 2023-12-04T05:36:47.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80146a0 con 0x7fe7c00c7f00 2023-12-04T05:36:47.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c0411e6d0 con 0x7f3c10150500 2023-12-04T05:36:47.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0005260 con 0x7f3c10150500 2023-12-04T05:36:47.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580bd690 0x7f8658153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3080979014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c01f1370 con 0x7fe7c00c7f00 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3080979014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c01f1630 con 0x7fe7c00c7f00 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 -- 172.21.15.97:0/1574418958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20840052b0 msgr2=0x7f208400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20840052b0 0x7f208400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f2099d9b640 1 -- 172.21.15.97:0/1574418958 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0aa7e0 con 0x7f20840047d0 2023-12-04T05:36:47.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f209ad9d640 1 -- 172.21.15.97:0/1574418958 reap_dead start 2023-12-04T05:36:47.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 0x7f3bfc068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 0x7f865814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86580c3260 con 0x7f86580c8050 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865814dba0 con 0x7f8658151df0 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.167+0000 7f865f446640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86580c3dd0 con 0x7f86580bd690 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48198/0 (socket says 172.21.15.97:48198) 2023-12-04T05:36:47.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 -- 172.21.15.97:0/1532781643 learned_addr learned my addr 172.21.15.97:0/1532781643 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f3c0f7fe640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 0x7f3bfc068df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c10070c80 tx=0x7f3c00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865c9e1640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 0x7f865814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 -- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580bd690 msgr2=0x7f8658153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d1e2640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580bd690 0x7f8658153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580bd690 0x7f8658153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 -- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 msgr2=0x7f865814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 0x7f865814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 -- 172.21.15.97:0/1532781643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8650009a70 con 0x7f8658151df0 2023-12-04T05:36:47.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865c9e1640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 0x7f865814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8759e640 1 -- start start 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 0x7fea880a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865d9e3640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f86500195d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3080979014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0068440 con 0x7fe7c00c7f00 2023-12-04T05:36:47.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 0x7fea880a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500b9860 con 0x7f8658151df0 2023-12-04T05:36:47.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86500b99c0 con 0x7f8658151df0 2023-12-04T05:36:47.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500b9d30 con 0x7f8658151df0 2023-12-04T05:36:47.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fddfef1d640 1 Processor -- start 2023-12-04T05:36:47.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea85d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86580c1c10 con 0x7f8658151df0 2023-12-04T05:36:47.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea85d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48206/0 (socket says 172.21.15.97:48206) 2023-12-04T05:36:47.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea8659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 0x7fea880a5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42536/0 (socket says 172.21.15.97:42536) 2023-12-04T05:36:47.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f2099d9b640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 0x7f2084004c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2090009890 tx=0x7f209001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caab042898934d95 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86580c2a60 con 0x7f8658151df0 2023-12-04T05:36:47.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7b8014800 con 0x7fe7c00c7f00 2023-12-04T05:36:47.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fddfef1d640 1 -- start start 2023-12-04T05:36:47.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.171+0000 7fea86d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50028/0 (socket says 172.21.15.97:50028) 2023-12-04T05:36:47.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea85d9b640 1 -- 172.21.15.97:0/3129470691 learned_addr learned my addr 172.21.15.97:0/3129470691 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880a66c0 con 0x7fea881544f0 2023-12-04T05:36:47.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fe7bd7fa640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 0x7fe7ac068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea880a9b80 con 0x7fea880c24e0 2023-12-04T05:36:47.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea880a9e40 con 0x7fea880c0450 2023-12-04T05:36:47.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7b8085230 con 0x7fe7c00c7f00 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfef1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfef1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fddf80c2860 0x7fddf806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfef1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80c50a0 con 0x7fddf80c6620 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfef1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80c5380 con 0x7fddf80c2860 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfef1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c5660 con 0x7fddf8159720 2023-12-04T05:36:47.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8658068440 con 0x7f8658151df0 2023-12-04T05:36:47.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 0x7fe7ac068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42550/0 (socket says 172.21.15.97:42550) 2023-12-04T05:36:47.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 -- 172.21.15.97:0/2088521859 learned_addr learned my addr 172.21.15.97:0/2088521859 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 -- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 msgr2=0x7fea880a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 0x7fea880a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 -- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 msgr2=0x7fea8814cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009420 con 0x7fea881544f0 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea85d9b640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:47.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f86500ad440 con 0x7f8658151df0 2023-12-04T05:36:47.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fea86d9d640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea780ac000 tx=0x7fea7801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fe7bffff640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 0x7fe7ac068e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00ad000 tx=0x7fe7b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f864dffb640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 0x7f863c068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f865011f5e0 con 0x7f8658151df0 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f865d1e2640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 0x7f863c068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 -- 172.21.15.97:0/2088521859 >> v2:172.21.15.97:3300/0 conn(0x7fddf80c2860 msgr2=0x7fddf806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 --2- 172.21.15.97:0/2088521859 >> v2:172.21.15.97:3300/0 conn(0x7fddf80c2860 0x7fddf806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 -- 172.21.15.97:0/2088521859 >> v1:172.21.15.97:6789/0 conn(0x7fddf80c6620 legacy=0x7fddf80c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:47.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7fddfccb9640 1 -- 172.21.15.97:0/2088521859 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf806c8d0 con 0x7fddf8159720 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.175+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900ab600 con 0x7f20840047d0 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900a7050 con 0x7f20840047d0 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f865d1e2640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 0x7f863c068e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8654009a30 tx=0x7f8654008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f209959a640 1 -- 172.21.15.97:0/1574418958 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900ab9c0 con 0x7f20840047d0 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 -- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 msgr2=0x7f2084004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 0x7f2084004c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2090009890 tx=0x7f209001c360 comp rx=0 tx=0).stop 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 -- 172.21.15.97:0/1574418958 shutdown_connections 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 --2- 172.21.15.97:0/1574418958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20840047d0 0x7f2084004c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 -- 172.21.15.97:0/1574418958 >> 172.21.15.97:0/1574418958 conn(0x7f209c0c5e70 msgr2=0x7f209c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 -- 172.21.15.97:0/1574418958 shutdown_connections 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c040eb870 con 0x7f3c10150500 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7f20a0f57640 1 -- 172.21.15.97:0/1574418958 wait complete. 2023-12-04T05:36:47.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780abe40 con 0x7fea881544f0 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780bf410 con 0x7fea881544f0 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780bf7c0 con 0x7fea881544f0 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8806c1b0 con 0x7fea881544f0 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea880a60b0 con 0x7fea881544f0 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7b80524e0 con 0x7fe7c00c7f00 2023-12-04T05:36:47.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.179+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea880a62d0 con 0x7fea881544f0 2023-12-04T05:36:47.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 Processor -- start 2023-12-04T05:36:47.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 -- start start 2023-12-04T05:36:47.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86500ec890 con 0x7f8658151df0 2023-12-04T05:36:47.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddfccb9640 1 --2- 172.21.15.97:0/2088521859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3f9af942b3f964 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddf77fe640 1 -- 172.21.15.97:0/2088521859 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0ab5f0 con 0x7fddf8159720 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddf77fe640 1 -- 172.21.15.97:0/2088521859 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0ab750 con 0x7fddf8159720 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddf77fe640 1 -- 172.21.15.97:0/2088521859 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0abae0 con 0x7fddf8159720 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20840047d0 0x7f209c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f209c14c2a0 0x7f209c1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c14fae0 con 0x7f209c14c2a0 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c14cd40 con 0x7f20840047d0 2023-12-04T05:36:47.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f20a0f57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c14c840 con 0x7f209c14d500 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea780bf920 con 0x7fea881544f0 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddfef1d640 1 -- 172.21.15.97:0/2088521859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 msgr2=0x7fddf80c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fddfef1d640 1 --2- 172.21.15.97:0/2088521859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec01c520 comp rx=0 tx=0).stop 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42560/0 (socket says 172.21.15.97:42560) 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 -- 172.21.15.97:0/2843836918 learned_addr learned my addr 172.21.15.97:0/2843836918 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 -- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20840047d0 msgr2=0x7f209c14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20840047d0 0x7f209c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 -- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f209c14c2a0 msgr2=0x7f209c1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f209c14c2a0 0x7f209c1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7f209ad9d640 1 -- 172.21.15.97:0/2843836918 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c14f800 con 0x7f209c14d500 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.183+0000 7fea76ffd640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 0x7fea68068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea7811e9b0 con 0x7fea881544f0 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7f209ad9d640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f209c0722e0 tx=0x7f209400ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fea8659c640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 0x7fea68068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fddfef1d640 1 -- 172.21.15.97:0/2088521859 shutdown_connections 2023-12-04T05:36:47.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fddfef1d640 1 --2- 172.21.15.97:0/2088521859 >> v2:172.21.15.97:3300/0 conn(0x7fddf80c2860 0x7fddf806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fddfef1d640 1 --2- 172.21.15.97:0/2088521859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf8159720 0x7fddf80c2db0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fddfef1d640 1 -- 172.21.15.97:0/2088521859 >> 172.21.15.97:0/2088521859 conn(0x7fddf806a5f0 msgr2=0x7fddf806aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7fea8659c640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 0x7fea68068de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea80005c10 tx=0x7fea80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400cce0 con 0x7f209c14d500 2023-12-04T05:36:47.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209400ce40 con 0x7f209c14d500 2023-12-04T05:36:47.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400cce0 con 0x7f209c14d500 2023-12-04T05:36:47.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.187+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c14cfe0 con 0x7f209c14d500 2023-12-04T05:36:47.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.191+0000 7fddfef1d640 1 -- 172.21.15.97:0/2088521859 shutdown_connections 2023-12-04T05:36:47.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.191+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c144710 con 0x7f209c14d500 2023-12-04T05:36:47.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.191+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c14cba0 con 0x7f209c14d500 2023-12-04T05:36:47.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.191+0000 7fddfef1d640 1 -- 172.21.15.97:0/2088521859 wait complete. 2023-12-04T05:36:47.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.191+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2094016420 con 0x7f209c14d500 2023-12-04T05:36:47.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7f208affd640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 0x7f207c068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fddfef1d640 1 Processor -- start 2023-12-04T05:36:47.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2094008030 con 0x7f209c14d500 2023-12-04T05:36:47.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fddfef1d640 1 -- start start 2023-12-04T05:36:47.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7f209a59c640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 0x7f207c068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea780ebe50 con 0x7fea881544f0 2023-12-04T05:36:47.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7f209a59c640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 0x7f207c068df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f209c0c55c0 tx=0x7f208c000f60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fddfef1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddf80c2860 0x7fddf80a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fddfef1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.195+0000 7fddfef1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 0x7fddf80a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfccb9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddf80c2860 0x7fddf80a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42574/0 (socket says 172.21.15.97:42574) 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 -- 172.21.15.97:0/1342202059 learned_addr learned my addr 172.21.15.97:0/1342202059 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81f4a40 con 0x7fddf8159720 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c23e0 con 0x7fddf80c2860 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81491d0 con 0x7fddf80c6620 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfd4ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 0x7fddf80a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 -- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddf80c2860 msgr2=0x7fddf80a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddf80c2860 0x7fddf80a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 -- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 msgr2=0x7fddf80a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 0x7fddf80a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0094d0 con 0x7fddf80c6620 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddfd4ba640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 0x7fddf80a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:47.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2094052200 con 0x7f209c14d500 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.199+0000 7fddf7fff640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdde400c490 tx=0x7fdde4001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.203+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4003600 con 0x7fddf80c6620 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.203+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4003780 con 0x7fddf80c6620 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.203+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4003b70 con 0x7fddf80c6620 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.207+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80ab450 con 0x7fddf80c6620 2023-12-04T05:36:47.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.207+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80aba10 con 0x7fddf80c6620 2023-12-04T05:36:47.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.207+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdde4003cd0 con 0x7fddf80c6620 2023-12-04T05:36:47.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.211+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8068440 con 0x7fddf80c6620 2023-12-04T05:36:47.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.211+0000 7fddf57fa640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 0x7fdddc068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:47.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.211+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdde4083950 con 0x7fddf80c6620 2023-12-04T05:36:47.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.211+0000 7fddfccb9640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 0x7fdddc068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:47.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.215+0000 7fddfccb9640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 0x7fdddc068e60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddec0af000 tx=0x7fddec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:47.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.215+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdde4050cb0 con 0x7fddf80c6620 2023-12-04T05:36:47.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.483+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa460156790 con 0x7fa4600c54d0 2023-12-04T05:36:47.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.483+0000 7fa456ffd640 1 -- 172.21.15.97:0/548432557 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa450017020 con 0x7fa4600c54d0 2023-12-04T05:36:47.486 INFO:teuthology.orchestra.run.smithi097.stdout:55834574854 2023-12-04T05:36:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 msgr2=0x7fa444068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 0x7fa444068dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009b80 tx=0x7fa45c009190 comp rx=0 tx=0).stop 2023-12-04T05:36:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 msgr2=0x7fa4601fa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa450000f70 tx=0x7fa45000c890 comp rx=0 tx=0).stop 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 shutdown_connections 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa444066900 0x7fa444068dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa460156090 0x7fa4600a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4600c54d0 0x7fa4601fa9a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 --2- 172.21.15.97:0/548432557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4600c2a20 0x7fa4600bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 >> 172.21.15.97:0/548432557 conn(0x7fa46006a9f0 msgr2=0x7fa4600c1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 shutdown_connections 2023-12-04T05:36:47.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7fa467267640 1 -- 172.21.15.97:0/548432557 wait complete. 2023-12-04T05:36:47.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.487+0000 7f148e69c640 1 -- 172.21.15.97:0/914450124 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f14880a9b50 con 0x7f148806ba90 2023-12-04T05:36:47.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.491+0000 7f14857fa640 1 -- 172.21.15.97:0/914450124 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14880a9b50 con 0x7f148806ba90 2023-12-04T05:36:47.501 INFO:teuthology.orchestra.run.smithi097.stdout:55834574854 2023-12-04T05:36:47.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.495+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 msgr2=0x7f1468068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.495+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 0x7f1468068de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14780af000 tx=0x7f14780a7070 comp rx=0 tx=0).stop 2023-12-04T05:36:47.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.495+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 msgr2=0x7f14880aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.495+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f147000b4a0 tx=0x7f147000b960 comp rx=0 tx=0).stop 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 shutdown_connections 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1468066920 0x7f1468068de0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f148814de50 0x7f14880ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14880c1210 0x7f148814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 --2- 172.21.15.97:0/914450124 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f148806ba90 0x7f14880aa7d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 >> 172.21.15.97:0/914450124 conn(0x7f14880a7800 msgr2=0x7f14880a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 shutdown_connections 2023-12-04T05:36:47.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.499+0000 7f147e7fc640 1 -- 172.21.15.97:0/914450124 wait complete. 2023-12-04T05:36:47.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.503+0000 7fe7c6ac9640 1 -- 172.21.15.97:0/3080979014 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe7c006c9c0 con 0x7fe7c00c7f00 2023-12-04T05:36:47.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.503+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f86580c8950 con 0x7f8658151df0 2023-12-04T05:36:47.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.503+0000 7fe7bd7fa640 1 -- 172.21.15.97:0/3080979014 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7b8055b00 con 0x7fe7c00c7f00 2023-12-04T05:36:47.512 INFO:teuthology.orchestra.run.smithi097.stdout:55834574854 2023-12-04T05:36:47.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7f864dffb640 1 -- 172.21.15.97:0/1532781643 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86500efeb0 con 0x7f8658151df0 2023-12-04T05:36:47.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 msgr2=0x7fe7ac068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 0x7fe7ac068e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00ad000 tx=0x7fe7b0008040 comp rx=0 tx=0).stop 2023-12-04T05:36:47.513 INFO:teuthology.orchestra.run.smithi097.stdout:55834574852 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 msgr2=0x7fe7c01f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800efc0 tx=0x7fe7b800c490 comp rx=0 tx=0).stop 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 shutdown_connections 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7ac0669a0 0x7fe7ac068e60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7c0151f10 0x7fe7c01f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7c00cac10 0x7fe7c014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 --2- 172.21.15.97:0/3080979014 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7c00c7f00 0x7fe7c01f52c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 >> 172.21.15.97:0/3080979014 conn(0x7fe7c0073950 msgr2=0x7fe7c0073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.507+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 shutdown_connections 2023-12-04T05:36:47.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7fe7a6ffd640 1 -- 172.21.15.97:0/3080979014 wait complete. 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 msgr2=0x7f863c068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 0x7f863c068e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8654009a30 tx=0x7f8654008040 comp rx=0 tx=0).stop 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 msgr2=0x7f865814d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f86500195d0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 shutdown_connections 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f863c0669d0 0x7f863c068e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8658151df0 0x7f865814d660 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86580c8050 0x7f865814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 --2- 172.21.15.97:0/1532781643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86580bd690 0x7f8658153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 >> 172.21.15.97:0/1532781643 conn(0x7f8658073950 msgr2=0x7f86580c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 shutdown_connections 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f865f446640 1 -- 172.21.15.97:0/1532781643 wait complete. 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.511+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3bf0005510 con 0x7f3c10150500 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.515+0000 7f3bf7fff640 1 -- 172.21.15.97:0/3810642933 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c040af030 con 0x7f3c10150500 2023-12-04T05:36:47.517 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:47.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 msgr2=0x7f3bfc068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 0x7f3bfc068df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c10070c80 tx=0x7f3c00009040 comp rx=0 tx=0).stop 2023-12-04T05:36:47.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 msgr2=0x7f3c10070400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c04010b20 tx=0x7f3c0401d550 comp rx=0 tx=0).stop 2023-12-04T05:36:47.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 shutdown_connections 2023-12-04T05:36:47.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3bfc066930 0x7f3bfc068df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c100a8430 0x7f3c100a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c10150500 0x7f3c10070400 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 --2- 172.21.15.97:0/3810642933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c1014da60 0x7f3c101f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 >> 172.21.15.97:0/3810642933 conn(0x7f3c100c5a50 msgr2=0x7f3c100c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 shutdown_connections 2023-12-04T05:36:47.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.519+0000 7f3c14c9c640 1 -- 172.21.15.97:0/3810642933 wait complete. 2023-12-04T05:36:47.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.523+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f209c14cba0 con 0x7f209c14d500 2023-12-04T05:36:47.527 INFO:teuthology.orchestra.run.smithi097.stdout:55834574854 2023-12-04T05:36:47.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.523+0000 7f208affd640 1 -- 172.21.15.97:0/2843836918 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f209c14cba0 con 0x7f209c14d500 2023-12-04T05:36:47.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-12-04T05:36:47.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.523+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea8804e890 con 0x7fea881544f0 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 msgr2=0x7f207c068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 0x7f207c068df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f209c0c55c0 tx=0x7f208c000f60 comp rx=0 tx=0).stop 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 msgr2=0x7f209c14d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f209c0722e0 tx=0x7f209400ed80 comp rx=0 tx=0).stop 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 shutdown_connections 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f207c066930 0x7f207c068df0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f209c14d500 0x7f209c14d980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f209c14c2a0 0x7f209c1441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 --2- 172.21.15.97:0/2843836918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20840047d0 0x7f209c14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 >> 172.21.15.97:0/2843836918 conn(0x7f209c0c5e70 msgr2=0x7f209c151230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 shutdown_connections 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7f20a0f57640 1 -- 172.21.15.97:0/2843836918 wait complete. 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.527+0000 7fea76ffd640 1 -- 172.21.15.97:0/3129470691 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea780ef470 con 0x7fea881544f0 2023-12-04T05:36:47.531 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 msgr2=0x7fea68068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 0x7fea68068de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fea80005c10 tx=0x7fea80009040 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 msgr2=0x7fea8814d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea780ac000 tx=0x7fea7801ace0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 shutdown_connections 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea68066920 0x7fea68068de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea881544f0 0x7fea8814d120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea880c24e0 0x7fea8814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 --2- 172.21.15.97:0/3129470691 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea880c0450 0x7fea880a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 >> 172.21.15.97:0/3129470691 conn(0x7fea8806a9f0 msgr2=0x7fea881efe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 shutdown_connections 2023-12-04T05:36:47.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.531+0000 7fea8759e640 1 -- 172.21.15.97:0/3129470691 wait complete. 2023-12-04T05:36:47.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-12-04T05:36:47.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.535+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fddf80c5e20 con 0x7fddf80c6620 2023-12-04T05:36:47.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddf57fa640 1 -- 172.21.15.97:0/1342202059 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdde4017070 con 0x7fddf80c6620 2023-12-04T05:36:47.540 INFO:teuthology.orchestra.run.smithi097.stdout:55834574854 2023-12-04T05:36:47.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 msgr2=0x7fdddc068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 0x7fdddc068e60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddec0af000 tx=0x7fddec0a7000 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 msgr2=0x7fddf8153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdde400c490 tx=0x7fdde4001e80 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 shutdown_connections 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdddc0669a0 0x7fdddc068e60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddf8159720 0x7fddf80a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddf80c6620 0x7fddf8153cf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 --2- 172.21.15.97:0/1342202059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddf80c2860 0x7fddf80a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:47.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 >> 172.21.15.97:0/1342202059 conn(0x7fddf806a5f0 msgr2=0x7fddf8162da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:47.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 shutdown_connections 2023-12-04T05:36:47.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:47.539+0000 7fddfef1d640 1 -- 172.21.15.97:0/1342202059 wait complete. 2023-12-04T05:36:47.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-04T05:36:47.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-12-04T05:36:47.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-12-04T05:36:47.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-04T05:36:47.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-12-04T05:36:47.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-12-04T05:36:48.529 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-04T05:36:48.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-04T05:36:48.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-04T05:36:48.554 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-04T05:36:48.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-04T05:36:48.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-04T05:36:48.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-04T05:36:48.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-04T05:36:48.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.747+0000 7fddd385f640 1 Processor -- start 2023-12-04T05:36:48.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.747+0000 7fddd385f640 1 -- start start 2023-12-04T05:36:48.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.747+0000 7fddd385f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fddcc14de50 0x7fddcc150570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.747+0000 7fddd385f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddcc06ba90 0x7fddcc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd385f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc14e230 con 0x7fddcc0c1210 2023-12-04T05:36:48.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd385f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc06dc30 con 0x7fddcc14de50 2023-12-04T05:36:48.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd385f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0c4600 con 0x7fddcc06ba90 2023-12-04T05:36:48.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddcc06ba90 0x7fddcc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fddcc06ba90 0x7fddcc0a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48232/0 (socket says 172.21.15.97:48232) 2023-12-04T05:36:48.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2562068206 learned_addr learned my addr 172.21.15.97:0/2562068206 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd15fb640 1 --2- 172.21.15.97:0/2562068206 >> v2:172.21.15.97:3300/0 conn(0x7fddcc14de50 0x7fddcc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2562068206 >> v2:172.21.15.97:3300/0 conn(0x7fddcc14de50 msgr2=0x7fddcc150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddc3fff640 1 -- 172.21.15.97:0/2562068206 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846365696 0 0) 0x7fddcc14e230 con 0x7fddcc0c1210 2023-12-04T05:36:48.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 --2- 172.21.15.97:0/2562068206 >> v2:172.21.15.97:3300/0 conn(0x7fddcc14de50 0x7fddcc150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2562068206 >> v1:172.21.15.143:6789/0 conn(0x7fddcc0c1210 legacy=0x7fddcc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.751+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2562068206 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0c51a0 con 0x7fddcc06ba90 2023-12-04T05:36:48.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.755+0000 7fddd1dfc640 1 --2- 172.21.15.97:0/2562068206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a4d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0c0f50 tx=0x7fddbc01e610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb60b9b6a93c1c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddc3fff640 1 -- 172.21.15.97:0/2562068206 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc007ad0 con 0x7fddcc06ba90 2023-12-04T05:36:48.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddc3fff640 1 -- 172.21.15.97:0/2562068206 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc007c30 con 0x7fddcc06ba90 2023-12-04T05:36:48.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddc3fff640 1 -- 172.21.15.97:0/2562068206 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0090d0 con 0x7fddcc06ba90 2023-12-04T05:36:48.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 -- 172.21.15.97:0/2562068206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc06ba90 msgr2=0x7fddcc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 --2- 172.21.15.97:0/2562068206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a4d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0c0f50 tx=0x7fddbc01e610 comp rx=0 tx=0).stop 2023-12-04T05:36:48.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 -- 172.21.15.97:0/2562068206 shutdown_connections 2023-12-04T05:36:48.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 --2- 172.21.15.97:0/2562068206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a4d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 --2- 172.21.15.97:0/2562068206 >> v2:172.21.15.97:3300/0 conn(0x7fddcc14de50 0x7fddcc150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.759+0000 7fddd385f640 1 -- 172.21.15.97:0/2562068206 >> 172.21.15.97:0/2562068206 conn(0x7fddcc0a7800 msgr2=0x7fddcc0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.763+0000 7fddd385f640 1 -- 172.21.15.97:0/2562068206 shutdown_connections 2023-12-04T05:36:48.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.763+0000 7fddd385f640 1 -- 172.21.15.97:0/2562068206 wait complete. 2023-12-04T05:36:48.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.763+0000 7fddd385f640 1 Processor -- start 2023-12-04T05:36:48.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.763+0000 7fddd385f640 1 -- start start 2023-12-04T05:36:48.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc0c1210 0x7fddcc0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0aaa80 con 0x7fddcc06ba90 2023-12-04T05:36:48.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0aa170 con 0x7fddcc0c1210 2023-12-04T05:36:48.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd385f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0bfa90 con 0x7fddcc14de50 2023-12-04T05:36:48.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42586/0 (socket says 172.21.15.97:42586) 2023-12-04T05:36:48.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd0dfa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc0c1210 0x7fddcc0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2080100389 learned_addr learned my addr 172.21.15.97:0/2080100389 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd15fb640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc0c1210 msgr2=0x7fddcc0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc0c1210 0x7fddcc0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 msgr2=0x7fddcc0a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 -- 172.21.15.97:0/2080100389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc00d040 con 0x7fddcc14de50 2023-12-04T05:36:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd15fb640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:48.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.767+0000 7fddd1dfc640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01b220 tx=0x7fddbc01b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0093e0 con 0x7fddcc14de50 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc009540 con 0x7fddcc14de50 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0a84f0 con 0x7fddcc14de50 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0aa3c0 con 0x7fddcc14de50 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0a96c0 con 0x7fddcc14de50 2023-12-04T05:36:48.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.771+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc0aabc0 con 0x7fddcc14de50 2023-12-04T05:36:48.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.779+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fddbc0a8650 con 0x7fddcc14de50 2023-12-04T05:36:48.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.779+0000 7fddc1ffb640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 0x7fddb0068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.779+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddbc0ac070 con 0x7fddcc14de50 2023-12-04T05:36:48.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.779+0000 7fddd15fb640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 0x7fddb0068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.783+0000 7fddd15fb640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 0x7fddb0068e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007fc0 tx=0x7fddc40075b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.783+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fddbc0ec5b0 con 0x7fddcc14de50 2023-12-04T05:36:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.807+0000 7efe0359e640 1 Processor -- start 2023-12-04T05:36:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 -- start start 2023-12-04T05:36:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efe04151870 0x7efe04158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe040a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040bf250 con 0x7efe040c6710 2023-12-04T05:36:48.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040bfdf0 con 0x7efe04151870 2023-12-04T05:36:48.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040bef20 con 0x7efe04151c50 2023-12-04T05:36:48.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe0259c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efe04151870 0x7efe04158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe01d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efe040c6710 0x7efe040bf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38108/0 (socket says 172.21.15.97:38108) 2023-12-04T05:36:48.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe01d9b640 1 -- 172.21.15.97:0/1065077686 learned_addr learned my addr 172.21.15.97:0/1065077686 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:48.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe02d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe040a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe02d9d640 1 -- 172.21.15.97:0/1065077686 >> v2:172.21.15.143:3300/0 conn(0x7efe04151870 msgr2=0x7efe04158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe02d9d640 1 --2- 172.21.15.97:0/1065077686 >> v2:172.21.15.143:3300/0 conn(0x7efe04151870 0x7efe04158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe02d9d640 1 -- 172.21.15.97:0/1065077686 >> v1:172.21.15.143:6789/0 conn(0x7efe040c6710 legacy=0x7efe040bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.811+0000 7efe02d9d640 1 -- 172.21.15.97:0/1065077686 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040c3c20 con 0x7efe04151c50 2023-12-04T05:36:48.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe02d9d640 1 --2- 172.21.15.97:0/1065077686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe040a4cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009d90 tx=0x7efdf401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9cc42b53b31fb55 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe0159a640 1 -- 172.21.15.97:0/1065077686 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40a5930 con 0x7efe04151c50 2023-12-04T05:36:48.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe0159a640 1 -- 172.21.15.97:0/1065077686 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf40a5a90 con 0x7efe04151c50 2023-12-04T05:36:48.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe0159a640 1 -- 172.21.15.97:0/1065077686 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40a5e20 con 0x7efe04151c50 2023-12-04T05:36:48.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe0359e640 1 -- 172.21.15.97:0/1065077686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 msgr2=0x7efe040a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7efe0359e640 1 --2- 172.21.15.97:0/1065077686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe040a4cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009d90 tx=0x7efdf401c890 comp rx=0 tx=0).stop 2023-12-04T05:36:48.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7f05019f5640 1 Processor -- start 2023-12-04T05:36:48.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.819+0000 7f05019f5640 1 -- start start 2023-12-04T05:36:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 -- 172.21.15.97:0/1065077686 shutdown_connections 2023-12-04T05:36:48.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 --2- 172.21.15.97:0/1065077686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe040a4cc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 --2- 172.21.15.97:0/1065077686 >> v2:172.21.15.143:3300/0 conn(0x7efe04151870 0x7efe04158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 -- 172.21.15.97:0/1065077686 >> 172.21.15.97:0/1065077686 conn(0x7efe040c5a50 msgr2=0x7efe040c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f05019f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 0x7f04fc14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f05019f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f04fc0700b0 0x7f04fc06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f04faffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 0x7f04fc14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f04faffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 0x7f04fc14dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42610/0 (socket says 172.21.15.97:42610) 2023-12-04T05:36:48.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f04faffd640 1 -- 172.21.15.97:0/1931167875 learned_addr learned my addr 172.21.15.97:0/1931167875 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f04f27fc640 1 --2- 172.21.15.97:0/1931167875 >> v2:172.21.15.143:3300/0 conn(0x7f04fc0700b0 0x7f04fc06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc154610 con 0x7f04fc06cce0 2023-12-04T05:36:48.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc154b40 con 0x7f04fc0700b0 2023-12-04T05:36:48.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc06df30 con 0x7f04fc06d3d0 2023-12-04T05:36:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 -- 172.21.15.97:0/1065077686 shutdown_connections 2023-12-04T05:36:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7efe0359e640 1 -- 172.21.15.97:0/1065077686 wait complete. 2023-12-04T05:36:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.823+0000 7f04fa7fc640 1 -- 172.21.15.97:0/1931167875 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489160568 0 0) 0x7f04fc154610 con 0x7f04fc06cce0 2023-12-04T05:36:48.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7f04fa7fc640 1 -- 172.21.15.97:0/1931167875 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e8003530 con 0x7f04fc06cce0 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 Processor -- start 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 -- start start 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7f04f27fc640 1 -- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 msgr2=0x7f04fc14dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7f04f27fc640 1 --2- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 0x7f04fc14dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7f04f27fc640 1 -- 172.21.15.97:0/1931167875 >> v1:172.21.15.97:6789/0 conn(0x7f04fc06cce0 legacy=0x7f04fc0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7f04f27fc640 1 -- 172.21.15.97:0/1931167875 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc154860 con 0x7f04fc0700b0 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe040c6710 0x7efe040a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe041fa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040bc5a0 con 0x7efe040c6710 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040bdfa0 con 0x7efe04151870 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040be430 con 0x7efe04151c50 2023-12-04T05:36:48.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48244/0 (socket says 172.21.15.97:48244) 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe02d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe041fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 -- 172.21.15.97:0/3348224434 learned_addr learned my addr 172.21.15.97:0/3348224434 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0259c640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe040c6710 0x7efe040a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 -- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 msgr2=0x7efe041fa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe041fa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 -- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe040c6710 msgr2=0x7efe040a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe040c6710 0x7efe040a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 -- 172.21.15.97:0/3348224434 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe01d9b640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdfc001ec0 tx=0x7efdfc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc005cf0 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc005e50 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0072d0 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.827+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe040bd6b0 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040bd950 con 0x7efe04151870 2023-12-04T05:36:48.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7fa93f29c640 1 Processor -- start 2023-12-04T05:36:48.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 Processor -- start 2023-12-04T05:36:48.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 -- start start 2023-12-04T05:36:48.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040be150 con 0x7efe04151870 2023-12-04T05:36:48.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7fa93f29c640 1 -- start start 2023-12-04T05:36:48.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f04f27fc640 1 --2- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc0700b0 0x7f04fc06c7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097c0 tx=0x7f04e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26da67ff7e5a7982 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efdfc007430 con 0x7efe04151870 2023-12-04T05:36:48.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2a0006e360 0x7f2a000aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 0x7f2a000c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f04fa7fc640 1 -- 172.21.15.97:0/1931167875 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40ab400 con 0x7f04fc0700b0 2023-12-04T05:36:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f04fa7fc640 1 -- 172.21.15.97:0/1931167875 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40a7050 con 0x7f04fc0700b0 2023-12-04T05:36:48.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f04fa7fc640 1 -- 172.21.15.97:0/1931167875 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40ab780 con 0x7f04fc0700b0 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a00157a70 con 0x7f2a00157690 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a000c6910 con 0x7f2a000c22b0 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a07f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a000c52e0 con 0x7f2a0006e360 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.831+0000 7f2a05cc6640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f2a00157690 0x7f2a000a9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38110/0 (socket says 172.21.15.97:38110) 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a05cc6640 1 -- 172.21.15.97:0/3289617850 learned_addr learned my addr 172.21.15.97:0/3289617850 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a054c5640 1 --2- 172.21.15.97:0/3289617850 >> v2:172.21.15.143:3300/0 conn(0x7f2a0006e360 0x7f2a000aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a064c7640 1 --2- 172.21.15.97:0/3289617850 >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 0x7f2a000c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a054c5640 1 -- 172.21.15.97:0/3289617850 >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 msgr2=0x7f2a000c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa938154810 0x7fa938072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa93814dbc0 0x7fa93806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a054c5640 1 --2- 172.21.15.97:0/3289617850 >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 0x7f2a000c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a054c5640 1 -- 172.21.15.97:0/3289617850 >> v1:172.21.15.143:6789/0 conn(0x7f2a00157690 legacy=0x7f2a000a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a054c5640 1 -- 172.21.15.97:0/3289617850 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a000c55c0 con 0x7f2a0006e360 2023-12-04T05:36:48.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f2a064c7640 1 --2- 172.21.15.97:0/3289617850 >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 0x7f2a000c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93806dde0 con 0x7fa93814dbc0 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa938072560 con 0x7fa938154810 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93f29c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa938154c30 con 0x7fa9380c3490 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42626/0 (socket says 172.21.15.97:42626) 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 -- 172.21.15.97:0/3816707563 learned_addr learned my addr 172.21.15.97:0/3816707563 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7efdfaffd640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 0x7efde4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdfc0838c0 con 0x7efe04151870 2023-12-04T05:36:48.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d839640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.97:3300/0 conn(0x7fa93814dbc0 0x7fa93806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7efe0259c640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 0x7efde4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93c837640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.143:3300/0 conn(0x7fa938154810 0x7fa938072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 -- 172.21.15.97:0/3816707563 >> v2:172.21.15.143:3300/0 conn(0x7fa938154810 msgr2=0x7fa938072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.143:3300/0 conn(0x7fa938154810 0x7fa938072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 -- 172.21.15.97:0/3816707563 >> v2:172.21.15.97:3300/0 conn(0x7fa93814dbc0 msgr2=0x7fa93806bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.97:3300/0 conn(0x7fa93814dbc0 0x7fa93806bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7fa93d038640 1 -- 172.21.15.97:0/3816707563 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938070390 con 0x7fa9380c3490 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7efe0259c640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 0x7efde4068dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efdec009af0 tx=0x7efdec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f0c2e72a640 1 Processor -- start 2023-12-04T05:36:48.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc0700b0 msgr2=0x7f04fc06c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 --2- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc0700b0 0x7f04fc06c7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f04e40097c0 tx=0x7f04e401c410 comp rx=0 tx=0).stop 2023-12-04T05:36:48.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 shutdown_connections 2023-12-04T05:36:48.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f0c2e72a640 1 -- start start 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 --2- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc0700b0 0x7f04fc06c7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 --2- 172.21.15.97:0/1931167875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc06d3d0 0x7f04fc14dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.835+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 >> 172.21.15.97:0/1931167875 conn(0x7f04fc0c5e70 msgr2=0x7f04fc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 shutdown_connections 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a054c5640 1 --2- 172.21.15.97:0/3289617850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0006e360 0x7f2a000aa590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a000c87b0 tx=0x7f29ec024ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77c3ee63e1a1d800 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe040be150 con 0x7efe04151870 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2e72a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0c280c1360 0x7f0c280700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2e72a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c28154af0 0x7f0c2814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2e72a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c28150bc0 con 0x7f0c2806c000 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2e72a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c28154fd0 con 0x7f0c280c1360 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2e72a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28151a70 con 0x7f0c28154af0 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a04cc4640 1 -- 172.21.15.97:0/3289617850 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0adaa0 con 0x7f2a0006e360 2023-12-04T05:36:48.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a04cc4640 1 -- 172.21.15.97:0/3289617850 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0adc00 con 0x7f2a0006e360 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c277fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0c2806c000 0x7f0c28151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38116/0 (socket says 172.21.15.97:38116) 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c277fe640 1 -- 172.21.15.97:0/3329577576 learned_addr learned my addr 172.21.15.97:0/3329577576 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a04cc4640 1 -- 172.21.15.97:0/3289617850 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0b5440 con 0x7f2a0006e360 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c2ccc7640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c28154af0 0x7f0c2814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511171057 0 0) 0x7f0c28150bc0 con 0x7f0c2806c000 2023-12-04T05:36:48.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c10003530 con 0x7f0c2806c000 2023-12-04T05:36:48.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c27fff640 1 --2- 172.21.15.97:0/3329577576 >> v2:172.21.15.97:3300/0 conn(0x7f0c280c1360 0x7f0c280700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f05019f5640 1 -- 172.21.15.97:0/1931167875 wait complete. 2023-12-04T05:36:48.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3620828381 0 0) 0x7f0c10003530 con 0x7f0c2806c000 2023-12-04T05:36:48.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f05019f5640 1 Processor -- start 2023-12-04T05:36:48.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 -- 172.21.15.97:0/3289617850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0006e360 msgr2=0x7f2a000aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/3289617850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0006e360 0x7f2a000aa590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a000c87b0 tx=0x7f29ec024ac0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 -- 172.21.15.97:0/3289617850 shutdown_connections 2023-12-04T05:36:48.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/3289617850 >> v2:172.21.15.97:3300/0 conn(0x7f2a000c22b0 0x7f2a000c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/3289617850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0006e360 0x7f2a000aa590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f2a07f2a640 1 -- 172.21.15.97:0/3289617850 >> 172.21.15.97:0/3289617850 conn(0x7f2a00072760 msgr2=0x7f2a0006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f05019f5640 1 -- start start 2023-12-04T05:36:48.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7fa93d038640 1 --2- 172.21.15.97:0/3816707563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa938072860 tx=0x7fa93401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d6273aa7fbf409 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c28154af0 msgr2=0x7f0c2814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c28154af0 0x7f0c2814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 >> v2:172.21.15.97:3300/0 conn(0x7f0c280c1360 msgr2=0x7f0c280700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 --2- 172.21.15.97:0/3329577576 >> v2:172.21.15.97:3300/0 conn(0x7f0c280c1360 0x7f0c280700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28072160 con 0x7f0c2806c000 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f0c18001680 con 0x7f0c2806c000 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 >> v1:172.21.15.143:6789/0 conn(0x7f0c2806c000 legacy=0x7f0c28151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c10003b50 0x7f0c10005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c10006600 0x7f0c10008a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10009250 0x7f0c100096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28154fd0 con 0x7f0c10006600 2023-12-04T05:36:48.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28151a70 con 0x7f0c10009250 2023-12-04T05:36:48.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1000a030 con 0x7f0c10003b50 2023-12-04T05:36:48.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.839+0000 7fa92ffff640 1 -- 172.21.15.97:0/3816707563 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340aa3f0 con 0x7fa9380c3490 2023-12-04T05:36:48.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa92ffff640 1 -- 172.21.15.97:0/3816707563 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340aa550 con 0x7fa9380c3490 2023-12-04T05:36:48.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa92ffff640 1 -- 172.21.15.97:0/3816707563 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340aa8e0 con 0x7fa9380c3490 2023-12-04T05:36:48.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f2a07f2a640 1 -- 172.21.15.97:0/3289617850 shutdown_connections 2023-12-04T05:36:48.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c10006600 0x7f0c10008a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c2ccc7640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10009250 0x7f0c100096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f2a07f2a640 1 -- 172.21.15.97:0/3289617850 wait complete. 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c27fff640 1 --2- 172.21.15.97:0/3329577576 >> v2:172.21.15.97:3300/0 conn(0x7f0c280c1360 0x7f0c280700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc06cce0 0x7f04fc140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc06d3d0 0x7f04fc137550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc13eb50 con 0x7f04fc06cce0 2023-12-04T05:36:48.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc13f080 con 0x7f04fc06d3d0 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc137fd0 con 0x7f04fc0700b0 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42634/0 (socket says 172.21.15.97:42634) 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 -- 172.21.15.97:0/1913111605 learned_addr learned my addr 172.21.15.97:0/1913111605 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04f27fc640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc06d3d0 0x7f04fc137550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 -- 172.21.15.97:0/3816707563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 msgr2=0x7fa938071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 --2- 172.21.15.97:0/3816707563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa938072860 tx=0x7fa93401c4d0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 -- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc06d3d0 msgr2=0x7f04fc137550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc06d3d0 0x7f04fc137550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 -- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc06cce0 msgr2=0x7f04fc140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc06cce0 0x7f04fc140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 -- 172.21.15.97:0/1913111605 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e4009420 con 0x7f04fc0700b0 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 -- 172.21.15.97:0/3816707563 shutdown_connections 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.97:3300/0 conn(0x7fa93814dbc0 0x7fa93806bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 --2- 172.21.15.97:0/3816707563 >> v2:172.21.15.143:3300/0 conn(0x7fa938154810 0x7fa938072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 --2- 172.21.15.97:0/3816707563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9380c3490 0x7fa938071150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 -- 172.21.15.97:0/3816707563 >> 172.21.15.97:0/3816707563 conn(0x7fa9380c2970 msgr2=0x7fa9380c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c27fff640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c10003b50 0x7f0c10005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04fb7fe640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c790 tx=0x7f04f400cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 -- 172.21.15.97:0/3816707563 shutdown_connections 2023-12-04T05:36:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7fa93f29c640 1 -- 172.21.15.97:0/3816707563 wait complete. 2023-12-04T05:36:48.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400cea0 con 0x7f04fc0700b0 2023-12-04T05:36:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4003b80 con 0x7f04fc0700b0 2023-12-04T05:36:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400a850 con 0x7f04fc0700b0 2023-12-04T05:36:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc1ed840 con 0x7f04fc0700b0 2023-12-04T05:36:48.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f2a07f2a640 1 Processor -- start 2023-12-04T05:36:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 -- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c10003b50 msgr2=0x7f0c10005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c10003b50 0x7f0c10005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 -- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10009250 msgr2=0x7f0c100096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10009250 0x7f0c100096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f0c277fe640 1 -- 172.21.15.97:0/3329577576 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28072160 con 0x7f0c10006600 2023-12-04T05:36:48.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.843+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc142b60 con 0x7f04fc0700b0 2023-12-04T05:36:48.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc142d50 con 0x7f04fc0700b0 2023-12-04T05:36:48.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7fa93f29c640 1 Processor -- start 2023-12-04T05:36:48.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7fa93f29c640 1 -- start start 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 -- start start 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a00157690 0x7f2a000ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a000c4400 0x7f2a000c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001e9590 con 0x7f2a00157690 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a001e9830 con 0x7f2a000c4400 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a07f2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000acd20 con 0x7f2a000c22b0 2023-12-04T05:36:48.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f04f400a9b0 con 0x7f04fc0700b0 2023-12-04T05:36:48.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42642/0 (socket says 172.21.15.97:42642) 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 -- 172.21.15.97:0/203476477 learned_addr learned my addr 172.21.15.97:0/203476477 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 -- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a000c4400 msgr2=0x7f2a000c28a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a000c4400 0x7f2a000c28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 -- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a00157690 msgr2=0x7f2a000ac4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a00157690 0x7f2a000ac4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 -- 172.21.15.97:0/203476477 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec013a10 con 0x7f2a000c22b0 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f2a05cc6640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29f400cbc0 tx=0x7f29f400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f04f8ff9640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 0x7f04dc068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04f40842b0 con 0x7f04fc0700b0 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7fa93f29c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 0x7fa938145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7fa93f29c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.847+0000 7fa93f29c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa938154810 0x7fa938143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 Processor -- start 2023-12-04T05:36:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f04faffd640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 0x7f04dc068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93c837640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93c837640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42656/0 (socket says 172.21.15.97:42656) 2023-12-04T05:36:48.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93c837640 1 -- 172.21.15.97:0/1284236267 learned_addr learned my addr 172.21.15.97:0/1284236267 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c277fe640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c10006600 0x7f0c10008a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c290 tx=0x7f0c1801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4923c28770e2e34a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93814adb0 con 0x7fa938154810 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93814aad0 con 0x7fa9380c3490 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380a9810 con 0x7fa93814dbc0 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 0x7fa938145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18005ae0 con 0x7f0c10006600 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f04faffd640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 0x7f04dc068e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0094a0 tx=0x7f04ec0093f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d839640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa938154810 0x7fa938143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 -- start start 2023-12-04T05:36:48.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c18005c40 con 0x7f0c10006600 2023-12-04T05:36:48.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c26ffd640 1 -- 172.21.15.97:0/3329577576 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180a57f0 con 0x7f0c10006600 2023-12-04T05:36:48.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 -- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 msgr2=0x7fa938146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 -- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa938154810 msgr2=0x7fa938143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa938154810 0x7fa938143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094d0 con 0x7fa9380c3490 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93c837640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f421c04dac0 0x7f421c04e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93d038640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 0x7fa938145c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9340ab000 tx=0x7fa93401ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f400ac40 con 0x7f2a000c22b0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f400ada0 con 0x7f2a000c22b0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4012600 con 0x7f2a000c22b0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0e1e90 con 0x7f421c04dfd0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c0e2130 con 0x7f421c0dbed0 2023-12-04T05:36:48.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422359e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0e2ad0 con 0x7f421c04dac0 2023-12-04T05:36:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340aa3f0 con 0x7fa9380c3490 2023-12-04T05:36:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340b3820 con 0x7fa9380c3490 2023-12-04T05:36:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340b3bd0 con 0x7fa9380c3490 2023-12-04T05:36:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f421c0dbed0 0x7f421c007190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:38132/0 (socket says 172.21.15.97:38132) 2023-12-04T05:36:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f422259c640 1 -- 172.21.15.97:0/3359419452 learned_addr learned my addr 172.21.15.97:0/3359419452 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:48.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9380a9af0 con 0x7fa9380c3490 2023-12-04T05:36:48.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9380aa9c0 con 0x7fa9380c3490 2023-12-04T05:36:48.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04f4051560 con 0x7f04fc0700b0 2023-12-04T05:36:48.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a000ad000 con 0x7f2a000c22b0 2023-12-04T05:36:48.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a000c2de0 con 0x7f2a000c22b0 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a00068440 con 0x7f2a000c22b0 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7fb8b3e5a640 1 Processor -- start 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b3e5a640 1 -- start start 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f4221d9b640 1 --2- 172.21.15.97:0/3359419452 >> v2:172.21.15.97:3300/0 conn(0x7f421c04dac0 0x7f421c04e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944952719 0 0) 0x7f421c0e2130 con 0x7f421c0dbed0 2023-12-04T05:36:48.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f420c003530 con 0x7f421c0dbed0 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c2e72a640 1 -- 172.21.15.97:0/3329577576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c10006600 msgr2=0x7f0c10008a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.851+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/3329577576 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c10006600 0x7f0c10008a90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c290 tx=0x7f0c1801cca0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f0c2ccc7640 1 -- 172.21.15.97:0/3329577576 reap_dead start 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f0c2e72a640 1 -- 172.21.15.97:0/3329577576 shutdown_connections 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f0c2e72a640 1 -- 172.21.15.97:0/3329577576 >> 172.21.15.97:0/3329577576 conn(0x7f0c280c5e70 msgr2=0x7f0c280c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.1 v1:172.21.15.143:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229977538 0 0) 0x7f420c003530 con 0x7f421c0dbed0 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 >> v2:172.21.15.97:3300/0 conn(0x7f421c04dac0 msgr2=0x7f421c04e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 --2- 172.21.15.97:0/3359419452 >> v2:172.21.15.97:3300/0 conn(0x7f421c04dac0 0x7f421c04e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 >> v1:172.21.15.97:6789/0 conn(0x7f421c04dfd0 legacy=0x7f421c04ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 --> v1:172.21.15.143:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0e2410 con 0x7f421c0dbed0 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.1 v1:172.21.15.143:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f422404edb0 con 0x7f421c0dbed0 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f0c2e72a640 1 -- 172.21.15.97:0/3329577576 shutdown_connections 2023-12-04T05:36:48.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f0c2e72a640 1 -- 172.21.15.97:0/3329577576 wait complete. 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b3e5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b3e5a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb8ac0c7f00 0x7fb8ac154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b1bf6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b1bf6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42670/0 (socket says 172.21.15.97:42670) 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b1bf6640 1 -- 172.21.15.97:0/3769807503 learned_addr learned my addr 172.21.15.97:0/3769807503 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 0x7fb8ac154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 >> v1:172.21.15.143:6789/0 conn(0x7f421c0dbed0 legacy=0x7f421c007190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f420c003980 0x7f420c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f420c0047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f420c004fa0 0x7f420c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0e2ad0 con 0x7f420c004fa0 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00bf00 con 0x7f420c003980 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c00c0c0 con 0x7f420c004320 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f4221d9b640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f420c0047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f4222d9d640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f420c004fa0 0x7f420c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f4221d9b640 1 -- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f420c003980 msgr2=0x7f420c003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-04T05:36:48.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f4221d9b640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f420c003980 0x7f420c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f4221d9b640 1 -- 172.21.15.97:0/3359419452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f420c004fa0 msgr2=0x7f420c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f4221d9b640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f420c004fa0 0x7f420c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f4221d9b640 1 -- 172.21.15.97:0/3359419452 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0e2410 con 0x7f420c004320 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac158cc0 con 0x7fb8ac0cac10 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0c5700 con 0x7fb8ac0c7f00 2023-12-04T05:36:48.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0ca780 con 0x7fb8ac151f10 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b13f5640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.143:3300/0 conn(0x7fb8ac0c7f00 0x7fb8ac154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b1bf6640 1 -- 172.21.15.97:0/3769807503 >> v2:172.21.15.143:3300/0 conn(0x7fb8ac0c7f00 msgr2=0x7fb8ac154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b1bf6640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.143:3300/0 conn(0x7fb8ac0c7f00 0x7fb8ac154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b1bf6640 1 -- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 msgr2=0x7fb8ac154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f29f4007070 con 0x7f2a000c22b0 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa9340b3d30 con 0x7fa9380c3490 2023-12-04T05:36:48.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f29fe7fc640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 0x7f29e4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.855+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93804e890 con 0x7fa9380c3490 2023-12-04T05:36:48.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fa92dffb640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 0x7fa91c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f2a054c5640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 0x7f29e4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fa93c837640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 0x7fa91c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9340a7070 con 0x7fa9380c3490 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f0c2e72a640 1 Processor -- start 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29f4084690 con 0x7f2a000c22b0 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f2a054c5640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 0x7f29e4068de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0b7000 tx=0x7f29ec0af070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29f4084b80 con 0x7f2a000c22b0 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fa93c837640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 0x7fa91c068d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa93806d720 tx=0x7fa93000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7fb8b23f7640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 0x7fb8ac154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f4222d9d640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f420c004fa0 0x7f420c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f4222d9d640 1 -- 172.21.15.97:0/3359419452 reap_dead start 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.859+0000 7f0c2e72a640 1 -- start start 2023-12-04T05:36:48.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 0x7f0c281ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 0x7f0c28147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7fb8b1bf6640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 0x7fb8ac154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c28070a40 0x7f0c28070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7fb8b1bf6640 1 -- 172.21.15.97:0/3769807503 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac158720 con 0x7fb8ac151f10 2023-12-04T05:36:48.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7fb8b23f7640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 0x7fb8ac154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:48.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9340ebc50 con 0x7fa9380c3490 2023-12-04T05:36:48.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f4221d9b640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f420c0047f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4214009ab0 tx=0x7f421401ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eb027d3a34d70d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280aa630 con 0x7f0c28070a40 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280a8a20 con 0x7f0c10006600 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c2e72a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28152e10 con 0x7f0c281474a0 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c277fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 0x7f0c28147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c277fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 0x7f0c28147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42688/0 (socket says 172.21.15.97:42688) 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c277fe640 1 -- 172.21.15.97:0/1188000420 learned_addr learned my addr 172.21.15.97:0/1188000420 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 0x7f0c281ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 -- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 msgr2=0x7f0c28147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 0x7f0c28147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 -- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c28070a40 msgr2=0x7f0c28070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c28070a40 0x7f0c28070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f0c27fff640 1 -- 172.21.15.97:0/1188000420 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c281ecd40 con 0x7f0c10006600 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5620 con 0x7f420c004320 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140a5780 con 0x7f420c004320 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.863+0000 7f422159a640 1 -- 172.21.15.97:0/3359419452 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42140a5b70 con 0x7f420c004320 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c27fff640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 0x7f0c281ec800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000f1c0 tx=0x7f0c2000f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20003ba0 con 0x7f0c10006600 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20010040 con 0x7f0c10006600 2023-12-04T05:36:48.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000feb0 con 0x7f0c10006600 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b1bf6640 1 --2- 172.21.15.97:0/3769807503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac06cfb0 tx=0x7fb8a401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ff1756fab19eb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28153b30 con 0x7f0c10006600 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28152850 con 0x7f0c10006600 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 -- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 msgr2=0x7f420c0047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f420c0047f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4214009ab0 tx=0x7f421401ca70 comp rx=0 tx=0).stop 2023-12-04T05:36:48.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 -- 172.21.15.97:0/3359419452 shutdown_connections 2023-12-04T05:36:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 --2- 172.21.15.97:0/3359419452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f420c0047f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 -- 172.21.15.97:0/3359419452 >> 172.21.15.97:0/3359419452 conn(0x7f421c04c640 msgr2=0x7f421c04ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 -- 172.21.15.97:0/3359419452 shutdown_connections 2023-12-04T05:36:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f422359e640 1 -- 172.21.15.97:0/3359419452 wait complete. 2023-12-04T05:36:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c08005260 con 0x7f0c10006600 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b0bf4640 1 -- 172.21.15.97:0/3769807503 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40ab600 con 0x7fb8ac151f10 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b0bf4640 1 -- 172.21.15.97:0/3769807503 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a40a7050 con 0x7fb8ac151f10 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b0bf4640 1 -- 172.21.15.97:0/3769807503 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40ab980 con 0x7fb8ac151f10 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 msgr2=0x7fb8ac0c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.867+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/3769807503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac06cfb0 tx=0x7fb8a401c3b0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 shutdown_connections 2023-12-04T05:36:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.97:3300/0 conn(0x7fb8ac0cac10 0x7fb8ac154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/3769807503 >> v2:172.21.15.143:3300/0 conn(0x7fb8ac0c7f00 0x7fb8ac154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/3769807503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac151f10 0x7fb8ac0c4980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 >> 172.21.15.97:0/3769807503 conn(0x7fb8ac073950 msgr2=0x7fb8ac073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 shutdown_connections 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/3769807503 wait complete. 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422359e640 1 Processor -- start 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422359e640 1 -- start start 2023-12-04T05:36:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c20004030 con 0x7f0c10006600 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 0x7f421c0350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421c1796f0 0x7f421c179b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422259c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f422259c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42698/0 (socket says 172.21.15.97:42698) 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f4221d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 0x7f421c0350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f4221d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 0x7f421c0350e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48324/0 (socket says 172.21.15.97:48324) 2023-12-04T05:36:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 Processor -- start 2023-12-04T05:36:48.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7fb8b3e5a640 1 -- start start 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 -- 172.21.15.97:0/2946088545 learned_addr learned my addr 172.21.15.97:0/2946088545 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0331e0 con 0x7f421c1796f0 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c17d410 con 0x7f421c00ee80 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c17a0b0 con 0x7f420c004320 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ac0c7f00 0x7fb8ac15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.871+0000 7f0c24ff9640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 0x7f0c14068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c20085b60 con 0x7f0c10006600 2023-12-04T05:36:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c20052e10 con 0x7f0c10006600 2023-12-04T05:36:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8ac151f10 0x7fb8ac0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 -- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 msgr2=0x7f421c0350e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 0x7f421c0350e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 -- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421c1796f0 msgr2=0x7f421c179b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421c1796f0 0x7f421c179b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:42714/0 (socket says 172.21.15.97:42714) 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 -- 172.21.15.97:0/1777866354 learned_addr learned my addr 172.21.15.97:0/1777866354 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac154db0 con 0x7fb8ac151f10 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac152c70 con 0x7fb8ac0c7f00 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac152f50 con 0x7fb8ac0cac10 2023-12-04T05:36:48.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c032860 con 0x7f420c004320 2023-12-04T05:36:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422259c640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4224069110 tx=0x7f422406b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b23f7640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8ac151f10 0x7fb8ac0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240725f0 con 0x7f420c004320 2023-12-04T05:36:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42240727b0 con 0x7f420c004320 2023-12-04T05:36:48.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224072b60 con 0x7f420c004320 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c00f3b0 con 0x7f420c004320 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c032e00 con 0x7f420c004320 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f0c277fe640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 0x7f0c14068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 -- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ac0c7f00 msgr2=0x7fb8ac15e870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ac0c7f00 0x7fb8ac15e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 -- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8ac151f10 msgr2=0x7fb8ac0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8ac151f10 0x7fb8ac0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:48.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.875+0000 7fb8b13f5640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40094d0 con 0x7fb8ac0cac10 2023-12-04T05:36:48.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8b13f5640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800eed0 tx=0x7fb8a800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f0c277fe640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 0x7f0c14068e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c18000c10 tx=0x7f0c180a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4224092400 con 0x7f420c004320 2023-12-04T05:36:48.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c0057c0 con 0x7f420c004320 2023-12-04T05:36:48.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8010040 con 0x7fb8ac0cac10 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8009e80 con 0x7fb8ac0cac10 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8014620 con 0x7fb8ac0cac10 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac153230 con 0x7fb8ac0cac10 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0c2660 con 0x7fb8ac0cac10 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f4212ffd640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 0x7f4204068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42240fe310 con 0x7f420c004320 2023-12-04T05:36:48.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.879+0000 7f4221d9b640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 0x7f4204068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.883+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac068440 con 0x7fb8ac0cac10 2023-12-04T05:36:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.883+0000 7f4221d9b640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 0x7f4204068d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42140af000 tx=0x7f4214008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.883+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42240cb540 con 0x7f420c004320 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.887+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb8a8014780 con 0x7fb8ac0cac10 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.887+0000 7fb8a27fc640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.891+0000 7fb8b1bf6640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.891+0000 7fb8b1bf6640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 0x7fb890068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ad000 tx=0x7fb8a40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.891+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8a8085190 con 0x7fb8ac0cac10 2023-12-04T05:36:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:48.891+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8a8085700 con 0x7fb8ac0cac10 2023-12-04T05:36:49.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.115+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddcc04e890 con 0x7fddcc14de50 2023-12-04T05:36:49.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.119+0000 7fddc1ffb640 1 -- 172.21.15.97:0/2080100389 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddbc0ec5b0 con 0x7fddcc14de50 2023-12-04T05:36:49.120 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:49.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.119+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 msgr2=0x7fddb0068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 0x7fddb0068e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007fc0 tx=0x7fddc40075b0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 msgr2=0x7fddcc14ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01b220 tx=0x7fddbc01b3b0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 shutdown_connections 2023-12-04T05:36:49.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fddb00669a0 0x7fddb0068e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fddcc14de50 0x7fddcc14ab50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fddcc0c1210 0x7fddcc0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 --2- 172.21.15.97:0/2080100389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fddcc06ba90 0x7fddcc0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 >> 172.21.15.97:0/2080100389 conn(0x7fddcc0a7800 msgr2=0x7fddcc14ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 shutdown_connections 2023-12-04T05:36:49.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.123+0000 7fddd385f640 1 -- 172.21.15.97:0/2080100389 wait complete. 2023-12-04T05:36:49.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-12-04T05:36:49.157 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.167+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe0404e890 con 0x7efe04151870 2023-12-04T05:36:49.175 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:49.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.171+0000 7efdfaffd640 1 -- 172.21.15.97:0/3348224434 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdfc017020 con 0x7efe04151870 2023-12-04T05:36:49.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.171+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 msgr2=0x7efde4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.171+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 0x7efde4068dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efdec009af0 tx=0x7efdec008040 comp rx=0 tx=0).stop 2023-12-04T05:36:49.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.171+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 msgr2=0x7efe041f9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.171+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdfc001ec0 tx=0x7efdfc00c890 comp rx=0 tx=0).stop 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 shutdown_connections 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efde4066900 0x7efde4068dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe04151c50 0x7efe041fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe04151870 0x7efe041f9c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 --2- 172.21.15.97:0/3348224434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe040c6710 0x7efe040a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 >> 172.21.15.97:0/3348224434 conn(0x7efe040c5a50 msgr2=0x7efe04071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 shutdown_connections 2023-12-04T05:36:49.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7efe0359e640 1 -- 172.21.15.97:0/3348224434 wait complete. 2023-12-04T05:36:49.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.175+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2a000ace60 con 0x7f2a000c22b0 2023-12-04T05:36:49.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f29fe7fc640 1 -- 172.21.15.97:0/203476477 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a000ace60 con 0x7f2a000c22b0 2023-12-04T05:36:49.180 INFO:teuthology.orchestra.run.smithi097.stdout:55834574853 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 msgr2=0x7f29e4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 0x7f29e4068de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0b7000 tx=0x7f29ec0af070 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 msgr2=0x7f2a000c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29f400cbc0 tx=0x7f29f400a060 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 shutdown_connections 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29e4066920 0x7f29e4068de0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a000c4400 0x7f2a000c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a00157690 0x7f2a000ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 --2- 172.21.15.97:0/203476477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a000c22b0 0x7f2a000c3dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 >> 172.21.15.97:0/203476477 conn(0x7f2a00072760 msgr2=0x7f2a0006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 shutdown_connections 2023-12-04T05:36:49.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.179+0000 7f2a07f2a640 1 -- 172.21.15.97:0/203476477 wait complete. 2023-12-04T05:36:49.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.183+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f04fc068440 con 0x7f04fc0700b0 2023-12-04T05:36:49.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.183+0000 7f04f8ff9640 1 -- 172.21.15.97:0/1913111605 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04f4054b80 con 0x7f04fc0700b0 2023-12-04T05:36:49.187 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:49.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 msgr2=0x7f04dc068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 0x7f04dc068e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0094a0 tx=0x7f04ec0093f0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 msgr2=0x7f04fc137a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c790 tx=0x7f04f400cc50 comp rx=0 tx=0).stop 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 shutdown_connections 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04dc0669d0 0x7f04dc068e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04fc0700b0 0x7f04fc137a90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04fc06d3d0 0x7f04fc137550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 --2- 172.21.15.97:0/1913111605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04fc06cce0 0x7f04fc140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 >> 172.21.15.97:0/1913111605 conn(0x7f04fc0c5e70 msgr2=0x7f04fc0c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 shutdown_connections 2023-12-04T05:36:49.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.187+0000 7f05019f5640 1 -- 172.21.15.97:0/1913111605 wait complete. 2023-12-04T05:36:49.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.191+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9380a9670 con 0x7fa9380c3490 2023-12-04T05:36:49.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.191+0000 7fa92dffb640 1 -- 172.21.15.97:0/1284236267 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9380a9670 con 0x7fa9380c3490 2023-12-04T05:36:49.197 INFO:teuthology.orchestra.run.smithi097.stdout:55834574856 2023-12-04T05:36:49.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 msgr2=0x7fa91c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 0x7fa91c068d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa93806d720 tx=0x7fa93000b040 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 msgr2=0x7fa938145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 0x7fa938145c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9340ab000 tx=0x7fa93401ad10 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 shutdown_connections 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa91c0668d0 0x7fa91c068d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa938154810 0x7fa938143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa93814dbc0 0x7fa938146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 --2- 172.21.15.97:0/1284236267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9380c3490 0x7fa938145c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.195+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 >> 172.21.15.97:0/1284236267 conn(0x7fa9380c2970 msgr2=0x7fa93814f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.199+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 shutdown_connections 2023-12-04T05:36:49.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.199+0000 7fa93f29c640 1 -- 172.21.15.97:0/1284236267 wait complete. 2023-12-04T05:36:49.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.207+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f421c00fb80 con 0x7f420c004320 2023-12-04T05:36:49.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.207+0000 7f4212ffd640 1 -- 172.21.15.97:0/2946088545 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42240ceb60 con 0x7f420c004320 2023-12-04T05:36:49.210 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:49.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0c080057e0 con 0x7f0c10006600 2023-12-04T05:36:49.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8ac154f20 con 0x7fb8ac0cac10 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 msgr2=0x7f4204068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 0x7f4204068d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f42140af000 tx=0x7f4214008040 comp rx=0 tx=0).stop 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 msgr2=0x7f421c17ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4224069110 tx=0x7f422406b9d0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c24ff9640 1 -- 172.21.15.97:0/1188000420 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c20056430 con 0x7f0c10006600 2023-12-04T05:36:49.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8a27fc640 1 -- 172.21.15.97:0/1777866354 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8a8052540 con 0x7fb8ac0cac10 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 shutdown_connections 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42040668d0 0x7f4204068d90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f421c1796f0 0x7f421c179b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f421c00ee80 0x7f421c0350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 --2- 172.21.15.97:0/2946088545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f420c004320 0x7f421c17ced0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 >> 172.21.15.97:0/2946088545 conn(0x7f421c04c640 msgr2=0x7f421c030e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.217 INFO:teuthology.orchestra.run.smithi097.stdout:55834574855 2023-12-04T05:36:49.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 shutdown_connections 2023-12-04T05:36:49.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f422359e640 1 -- 172.21.15.97:0/2946088545 wait complete. 2023-12-04T05:36:49.219 INFO:teuthology.orchestra.run.smithi097.stdout:55834574856 2023-12-04T05:36:49.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-12-04T05:36:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 msgr2=0x7f0c14068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 0x7f0c14068e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c18000c10 tx=0x7f0c180a7070 comp rx=0 tx=0).stop 2023-12-04T05:36:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 msgr2=0x7f0c281ec800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 0x7f0c281ec800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000f1c0 tx=0x7f0c2000f680 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 msgr2=0x7fb890068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 0x7fb890068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40ad000 tx=0x7fb8a40a6000 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 msgr2=0x7fb8ac155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800eed0 tx=0x7fb8a800b480 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 shutdown_connections 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8900668d0 0x7fb890068d90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8ac151f10 0x7fb8ac0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8ac0cac10 0x7fb8ac155240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 --2- 172.21.15.97:0/1777866354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8ac0c7f00 0x7fb8ac15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.211+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 >> 172.21.15.97:0/1777866354 conn(0x7fb8ac073950 msgr2=0x7fb8ac1576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 shutdown_connections 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c140669d0 0x7f0c14068e90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c28070a40 0x7f0c28070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c281474a0 0x7f0c28147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 --2- 172.21.15.97:0/1188000420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c10006600 0x7f0c281ec800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 >> 172.21.15.97:0/1188000420 conn(0x7f0c280c5e70 msgr2=0x7f0c2806c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 shutdown_connections 2023-12-04T05:36:49.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7fb8b3e5a640 1 -- 172.21.15.97:0/1777866354 wait complete. 2023-12-04T05:36:49.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 shutdown_connections 2023-12-04T05:36:49.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.215+0000 7f0c2e72a640 1 -- 172.21.15.97:0/1188000420 wait complete. 2023-12-04T05:36:49.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-12-04T05:36:49.224 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-04T05:36:49.225 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-12-04T05:36:49.235 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-12-04T05:36:49.243 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-12-04T05:36:49.244 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-12-04T05:36:49.248 DEBUG:teuthology.parallel:result is None 2023-12-04T05:36:49.248 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-04T05:36:49.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:36:49.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.419+0000 7f900c996640 1 Processor -- start 2023-12-04T05:36:49.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.419+0000 7f900c996640 1 -- start start 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900c996640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f900806be00 0x7f900806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900c996640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 0x7f90080c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900c996640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9008152300 con 0x7f900814e970 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900c996640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9008071580 con 0x7f900806be00 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900c996640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900814ed50 con 0x7f900806ca50 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f900806be00 0x7f900806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f900814e970 0x7f9008071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41826/0 (socket says 172.21.15.97:41826) 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f900806be00 0x7f900806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50214/0 (socket says 172.21.15.97:50214) 2023-12-04T05:36:49.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f900659c640 1 -- 172.21.15.97:0/4021520369 learned_addr learned my addr 172.21.15.97:0/4021520369 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:49.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f9006d9d640 1 --2- 172.21.15.97:0/4021520369 >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 0x7f90080c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 -- 172.21.15.97:0/4021520369 >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 msgr2=0x7f90080c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:49.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 --2- 172.21.15.97:0/4021520369 >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 0x7f90080c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 -- 172.21.15.97:0/4021520369 >> v1:172.21.15.97:6789/0 conn(0x7f900814e970 legacy=0x7f9008071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f8ffffff640 1 -- 172.21.15.97:0/4021520369 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008151d60 con 0x7f900806be00 2023-12-04T05:36:49.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f9006d9d640 1 --2- 172.21.15.97:0/4021520369 >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 0x7f90080c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:49.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.423+0000 7f9005d9b640 1 -- 172.21.15.97:0/4021520369 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491629220 0 0) 0x7f8ff8001120 con 0x7f900814e970 2023-12-04T05:36:49.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f8ffffff640 1 --2- 172.21.15.97:0/4021520369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900806be00 0x7f900806e150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f900806fef0 tx=0x7f8ff001eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404ab904d2481158 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f9005d9b640 1 -- 172.21.15.97:0/4021520369 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00a7970 con 0x7f900806be00 2023-12-04T05:36:49.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f9005d9b640 1 -- 172.21.15.97:0/4021520369 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff00a7ad0 con 0x7f900806be00 2023-12-04T05:36:49.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f9005d9b640 1 -- 172.21.15.97:0/4021520369 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00a7e60 con 0x7f900806be00 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- 172.21.15.97:0/4021520369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900806be00 msgr2=0x7f900806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 --2- 172.21.15.97:0/4021520369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900806be00 0x7f900806e150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f900806fef0 tx=0x7f8ff001eaa0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- 172.21.15.97:0/4021520369 shutdown_connections 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 --2- 172.21.15.97:0/4021520369 >> v2:172.21.15.143:3300/0 conn(0x7f900806ca50 0x7f90080c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 --2- 172.21.15.97:0/4021520369 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900806be00 0x7f900806e150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- 172.21.15.97:0/4021520369 >> 172.21.15.97:0/4021520369 conn(0x7f90080c2970 msgr2=0x7f90080c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- 172.21.15.97:0/4021520369 shutdown_connections 2023-12-04T05:36:49.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- 172.21.15.97:0/4021520369 wait complete. 2023-12-04T05:36:49.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 Processor -- start 2023-12-04T05:36:49.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.427+0000 7f900c996640 1 -- start start 2023-12-04T05:36:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f900806be00 0x7f90080c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 0x7f90081416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90080c0460 con 0x7f900814e970 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90081ed200 con 0x7f900806ca50 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90081ed4c0 con 0x7f900806be00 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50228/0 (socket says 172.21.15.97:50228) 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 -- 172.21.15.97:0/705357668 learned_addr learned my addr 172.21.15.97:0/705357668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900659c640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f900806be00 0x7f90080c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffffff640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 0x7f90081416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 -- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f900806be00 msgr2=0x7f90080c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f900806be00 0x7f90080c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 -- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 msgr2=0x7f90081416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 0x7f90081416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 -- 172.21.15.97:0/705357668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff000b6c0 con 0x7f900814e970 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffffff640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 0x7f90081416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f9006d9d640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f900000cef0 tx=0x7f900000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000d840 con 0x7f900814e970 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000d9c0 con 0x7f900814e970 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000dd70 con 0x7f900814e970 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90081ed7a0 con 0x7f900814e970 2023-12-04T05:36:49.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90081edd60 con 0x7f900814e970 2023-12-04T05:36:49.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9008068440 con 0x7f900814e970 2023-12-04T05:36:49.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.431+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f900001e3b0 con 0x7f900814e970 2023-12-04T05:36:49.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.435+0000 7f8ffeffd640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 0x7f8fe8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.435+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9000084e20 con 0x7f900814e970 2023-12-04T05:36:49.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.435+0000 7f900659c640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 0x7f8fe8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.435+0000 7f900659c640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 0x7f8fe8068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000f70 tx=0x7f8ff8007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.439+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90000521b0 con 0x7f900814e970 2023-12-04T05:36:49.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.583+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9008072310 con 0x7f8fe80668d0 2023-12-04T05:36:49.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.591+0000 7f8ffeffd640 1 -- 172.21.15.97:0/705357668 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264635 (secure 0 0 0) 0x7f9008072310 con 0x7f8fe80668d0 2023-12-04T05:36:49.596 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:49.598 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 msgr2=0x7f8fe8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 0x7f8fe8068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000f70 tx=0x7f8ff8007c10 comp rx=0 tx=0).stop 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 msgr2=0x7f9008141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f900000cef0 tx=0x7f900000a710 comp rx=0 tx=0).stop 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 shutdown_connections 2023-12-04T05:36:49.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8fe80668d0 0x7f8fe8068d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f900814e970 0x7f9008141c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f900806ca50 0x7f90081416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 --2- 172.21.15.97:0/705357668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f900806be00 0x7f90080c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 >> 172.21.15.97:0/705357668 conn(0x7f90080c2970 msgr2=0x7f9008071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 shutdown_connections 2023-12-04T05:36:49.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.595+0000 7f900c996640 1 -- 172.21.15.97:0/705357668 wait complete. 2023-12-04T05:36:49.617 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-04T05:36:48.192979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001770"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864282+0000","last_change":"2023-12-04T05:36:40.924610+0000","last_active":"2023-12-04T05:36:43.864282+0000","last_peered":"2023-12-04T05:36:43.864282+0000","last_clean":"2023-12-04T05:36:43.864282+0000","last_became_active":"2023-12-04T05:36:40.924042+0000","last_became_peered":"2023-12-04T05:36:40.924042+0000","last_unstale":"2023-12-04T05:36:43.864282+0000","last_undegraded":"2023-12-04T05:36:43.864282+0000","last_fullsized":"2023-12-04T05:36:43.864282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:21:40.711244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894819+0000","last_change":"2023-12-04T05:36:40.915527+0000","last_active":"2023-12-04T05:36:41.894819+0000","last_peered":"2023-12-04T05:36:41.894819+0000","last_clean":"2023-12-04T05:36:41.894819+0000","last_became_active":"2023-12-04T05:36:40.915173+0000","last_became_peered":"2023-12-04T05:36:40.915173+0000","last_unstale":"2023-12-04T05:36:41.894819+0000","last_undegraded":"2023-12-04T05:36:41.894819+0000","last_fullsized":"2023-12-04T05:36:41.894819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465973+0000","last_change":"2023-12-04T05:36:40.913206+0000","last_active":"2023-12-04T05:36:43.465973+0000","last_peered":"2023-12-04T05:36:43.465973+0000","last_clean":"2023-12-04T05:36:43.465973+0000","last_became_active":"2023-12-04T05:36:40.912745+0000","last_became_peered":"2023-12-04T05:36:40.912745+0000","last_unstale":"2023-12-04T05:36:43.465973+0000","last_undegraded":"2023-12-04T05:36:43.465973+0000","last_fullsized":"2023-12-04T05:36:43.465973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863463+0000","last_change":"2023-12-04T05:36:40.922261+0000","last_active":"2023-12-04T05:36:43.863463+0000","last_peered":"2023-12-04T05:36:43.863463+0000","last_clean":"2023-12-04T05:36:43.863463+0000","last_became_active":"2023-12-04T05:36:40.920113+0000","last_became_peered":"2023-12-04T05:36:40.920113+0000","last_unstale":"2023-12-04T05:36:43.863463+0000","last_undegraded":"2023-12-04T05:36:43.863463+0000","last_fullsized":"2023-12-04T05:36:43.863463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863941+0000","last_change":"2023-12-04T05:36:40.919483+0000","last_active":"2023-12-04T05:36:43.863941+0000","last_peered":"2023-12-04T05:36:43.863941+0000","last_clean":"2023-12-04T05:36:43.863941+0000","last_became_active":"2023-12-04T05:36:40.919062+0000","last_became_peered":"2023-12-04T05:36:40.919062+0000","last_unstale":"2023-12-04T05:36:43.863941+0000","last_undegraded":"2023-12-04T05:36:43.863941+0000","last_fullsized":"2023-12-04T05:36:43.863941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:40.225630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863441+0000","last_change":"2023-12-04T05:36:40.918746+0000","last_active":"2023-12-04T05:36:43.863441+0000","last_peered":"2023-12-04T05:36:43.863441+0000","last_clean":"2023-12-04T05:36:43.863441+0000","last_became_active":"2023-12-04T05:36:40.918449+0000","last_became_peered":"2023-12-04T05:36:40.918449+0000","last_unstale":"2023-12-04T05:36:43.863441+0000","last_undegraded":"2023-12-04T05:36:43.863441+0000","last_fullsized":"2023-12-04T05:36:43.863441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863479+0000","last_change":"2023-12-04T05:36:40.917608+0000","last_active":"2023-12-04T05:36:43.863479+0000","last_peered":"2023-12-04T05:36:43.863479+0000","last_clean":"2023-12-04T05:36:43.863479+0000","last_became_active":"2023-12-04T05:36:40.917298+0000","last_became_peered":"2023-12-04T05:36:40.917298+0000","last_unstale":"2023-12-04T05:36:43.863479+0000","last_undegraded":"2023-12-04T05:36:43.863479+0000","last_fullsized":"2023-12-04T05:36:43.863479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727219+0000","last_change":"2023-12-04T05:36:40.925544+0000","last_active":"2023-12-04T05:36:43.727219+0000","last_peered":"2023-12-04T05:36:43.727219+0000","last_clean":"2023-12-04T05:36:43.727219+0000","last_became_active":"2023-12-04T05:36:40.925230+0000","last_became_peered":"2023-12-04T05:36:40.925230+0000","last_unstale":"2023-12-04T05:36:43.727219+0000","last_undegraded":"2023-12-04T05:36:43.727219+0000","last_fullsized":"2023-12-04T05:36:43.727219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864315+0000","last_change":"2023-12-04T05:36:40.924730+0000","last_active":"2023-12-04T05:36:43.864315+0000","last_peered":"2023-12-04T05:36:43.864315+0000","last_clean":"2023-12-04T05:36:43.864315+0000","last_became_active":"2023-12-04T05:36:40.924315+0000","last_became_peered":"2023-12-04T05:36:40.924315+0000","last_unstale":"2023-12-04T05:36:43.864315+0000","last_undegraded":"2023-12-04T05:36:43.864315+0000","last_fullsized":"2023-12-04T05:36:43.864315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:23:56.993089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897856+0000","last_change":"2023-12-04T05:36:40.919533+0000","last_active":"2023-12-04T05:36:41.897856+0000","last_peered":"2023-12-04T05:36:41.897856+0000","last_clean":"2023-12-04T05:36:41.897856+0000","last_became_active":"2023-12-04T05:36:40.919231+0000","last_became_peered":"2023-12-04T05:36:40.919231+0000","last_unstale":"2023-12-04T05:36:41.897856+0000","last_undegraded":"2023-12-04T05:36:41.897856+0000","last_fullsized":"2023-12-04T05:36:41.897856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897623+0000","last_change":"2023-12-04T05:36:40.926975+0000","last_active":"2023-12-04T05:36:41.897623+0000","last_peered":"2023-12-04T05:36:41.897623+0000","last_clean":"2023-12-04T05:36:41.897623+0000","last_became_active":"2023-12-04T05:36:40.926698+0000","last_became_peered":"2023-12-04T05:36:40.926698+0000","last_unstale":"2023-12-04T05:36:41.897623+0000","last_undegraded":"2023-12-04T05:36:41.897623+0000","last_fullsized":"2023-12-04T05:36:41.897623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899008+0000","last_change":"2023-12-04T05:36:40.898383+0000","last_active":"2023-12-04T05:36:41.899008+0000","last_peered":"2023-12-04T05:36:41.899008+0000","last_clean":"2023-12-04T05:36:41.899008+0000","last_became_active":"2023-12-04T05:36:40.898076+0000","last_became_peered":"2023-12-04T05:36:40.898076+0000","last_unstale":"2023-12-04T05:36:41.899008+0000","last_undegraded":"2023-12-04T05:36:41.899008+0000","last_fullsized":"2023-12-04T05:36:41.899008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727464+0000","last_change":"2023-12-04T05:36:40.917782+0000","last_active":"2023-12-04T05:36:43.727464+0000","last_peered":"2023-12-04T05:36:43.727464+0000","last_clean":"2023-12-04T05:36:43.727464+0000","last_became_active":"2023-12-04T05:36:40.917501+0000","last_became_peered":"2023-12-04T05:36:40.917501+0000","last_unstale":"2023-12-04T05:36:43.727464+0000","last_undegraded":"2023-12-04T05:36:43.727464+0000","last_fullsized":"2023-12-04T05:36:43.727464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465753+0000","last_change":"2023-12-04T05:36:40.914405+0000","last_active":"2023-12-04T05:36:43.465753+0000","last_peered":"2023-12-04T05:36:43.465753+0000","last_clean":"2023-12-04T05:36:43.465753+0000","last_became_active":"2023-12-04T05:36:40.913309+0000","last_became_peered":"2023-12-04T05:36:40.913309+0000","last_unstale":"2023-12-04T05:36:43.465753+0000","last_undegraded":"2023-12-04T05:36:43.465753+0000","last_fullsized":"2023-12-04T05:36:43.465753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894524+0000","last_change":"2023-12-04T05:36:40.913295+0000","last_active":"2023-12-04T05:36:41.894524+0000","last_peered":"2023-12-04T05:36:41.894524+0000","last_clean":"2023-12-04T05:36:41.894524+0000","last_became_active":"2023-12-04T05:36:40.913033+0000","last_became_peered":"2023-12-04T05:36:40.913033+0000","last_unstale":"2023-12-04T05:36:41.894524+0000","last_undegraded":"2023-12-04T05:36:41.894524+0000","last_fullsized":"2023-12-04T05:36:41.894524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863028+0000","last_change":"2023-12-04T05:36:40.919008+0000","last_active":"2023-12-04T05:36:43.863028+0000","last_peered":"2023-12-04T05:36:43.863028+0000","last_clean":"2023-12-04T05:36:43.863028+0000","last_became_active":"2023-12-04T05:36:40.918703+0000","last_became_peered":"2023-12-04T05:36:40.918703+0000","last_unstale":"2023-12-04T05:36:43.863028+0000","last_undegraded":"2023-12-04T05:36:43.863028+0000","last_fullsized":"2023-12-04T05:36:43.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864364+0000","last_change":"2023-12-04T05:36:40.924655+0000","last_active":"2023-12-04T05:36:43.864364+0000","last_peered":"2023-12-04T05:36:43.864364+0000","last_clean":"2023-12-04T05:36:43.864364+0000","last_became_active":"2023-12-04T05:36:40.924415+0000","last_became_peered":"2023-12-04T05:36:40.924415+0000","last_unstale":"2023-12-04T05:36:43.864364+0000","last_undegraded":"2023-12-04T05:36:43.864364+0000","last_fullsized":"2023-12-04T05:36:43.864364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:23:56.993089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.753453+0000","last_change":"2023-12-04T05:36:40.911088+0000","last_active":"2023-12-04T05:36:43.753453+0000","last_peered":"2023-12-04T05:36:43.753453+0000","last_clean":"2023-12-04T05:36:43.753453+0000","last_became_active":"2023-12-04T05:36:40.910145+0000","last_became_peered":"2023-12-04T05:36:40.910145+0000","last_unstale":"2023-12-04T05:36:43.753453+0000","last_undegraded":"2023-12-04T05:36:43.753453+0000","last_fullsized":"2023-12-04T05:36:43.753453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864078+0000","last_change":"2023-12-04T05:36:40.918175+0000","last_active":"2023-12-04T05:36:43.864078+0000","last_peered":"2023-12-04T05:36:43.864078+0000","last_clean":"2023-12-04T05:36:43.864078+0000","last_became_active":"2023-12-04T05:36:40.917878+0000","last_became_peered":"2023-12-04T05:36:40.917878+0000","last_unstale":"2023-12-04T05:36:43.864078+0000","last_undegraded":"2023-12-04T05:36:43.864078+0000","last_fullsized":"2023-12-04T05:36:43.864078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:00.972226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897513+0000","last_change":"2023-12-04T05:36:40.898605+0000","last_active":"2023-12-04T05:36:41.897513+0000","last_peered":"2023-12-04T05:36:41.897513+0000","last_clean":"2023-12-04T05:36:41.897513+0000","last_became_active":"2023-12-04T05:36:40.898258+0000","last_became_peered":"2023-12-04T05:36:40.898258+0000","last_unstale":"2023-12-04T05:36:41.897513+0000","last_undegraded":"2023-12-04T05:36:41.897513+0000","last_fullsized":"2023-12-04T05:36:41.897513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465886+0000","last_change":"2023-12-04T05:36:40.916797+0000","last_active":"2023-12-04T05:36:43.465886+0000","last_peered":"2023-12-04T05:36:43.465886+0000","last_clean":"2023-12-04T05:36:43.465886+0000","last_became_active":"2023-12-04T05:36:40.916495+0000","last_became_peered":"2023-12-04T05:36:40.916495+0000","last_unstale":"2023-12-04T05:36:43.465886+0000","last_undegraded":"2023-12-04T05:36:43.465886+0000","last_fullsized":"2023-12-04T05:36:43.465886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863484+0000","last_change":"2023-12-04T05:36:40.922172+0000","last_active":"2023-12-04T05:36:43.863484+0000","last_peered":"2023-12-04T05:36:43.863484+0000","last_clean":"2023-12-04T05:36:43.863484+0000","last_became_active":"2023-12-04T05:36:40.921340+0000","last_became_peered":"2023-12-04T05:36:40.921340+0000","last_unstale":"2023-12-04T05:36:43.863484+0000","last_undegraded":"2023-12-04T05:36:43.863484+0000","last_fullsized":"2023-12-04T05:36:43.863484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727281+0000","last_change":"2023-12-04T05:36:40.924182+0000","last_active":"2023-12-04T05:36:43.727281+0000","last_peered":"2023-12-04T05:36:43.727281+0000","last_clean":"2023-12-04T05:36:43.727281+0000","last_became_active":"2023-12-04T05:36:40.923964+0000","last_became_peered":"2023-12-04T05:36:40.923964+0000","last_unstale":"2023-12-04T05:36:43.727281+0000","last_undegraded":"2023-12-04T05:36:43.727281+0000","last_fullsized":"2023-12-04T05:36:43.727281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863190+0000","last_change":"2023-12-04T05:36:40.925487+0000","last_active":"2023-12-04T05:36:43.863190+0000","last_peered":"2023-12-04T05:36:43.863190+0000","last_clean":"2023-12-04T05:36:43.863190+0000","last_became_active":"2023-12-04T05:36:40.925100+0000","last_became_peered":"2023-12-04T05:36:40.925100+0000","last_unstale":"2023-12-04T05:36:43.863190+0000","last_undegraded":"2023-12-04T05:36:43.863190+0000","last_fullsized":"2023-12-04T05:36:43.863190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727678+0000","last_change":"2023-12-04T05:36:40.917356+0000","last_active":"2023-12-04T05:36:43.727678+0000","last_peered":"2023-12-04T05:36:43.727678+0000","last_clean":"2023-12-04T05:36:43.727678+0000","last_became_active":"2023-12-04T05:36:40.917079+0000","last_became_peered":"2023-12-04T05:36:40.917079+0000","last_unstale":"2023-12-04T05:36:43.727678+0000","last_undegraded":"2023-12-04T05:36:43.727678+0000","last_fullsized":"2023-12-04T05:36:43.727678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897895+0000","last_change":"2023-12-04T05:36:40.923445+0000","last_active":"2023-12-04T05:36:41.897895+0000","last_peered":"2023-12-04T05:36:41.897895+0000","last_clean":"2023-12-04T05:36:41.897895+0000","last_became_active":"2023-12-04T05:36:40.923197+0000","last_became_peered":"2023-12-04T05:36:40.923197+0000","last_unstale":"2023-12-04T05:36:41.897895+0000","last_undegraded":"2023-12-04T05:36:41.897895+0000","last_fullsized":"2023-12-04T05:36:41.897895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894822+0000","last_change":"2023-12-04T05:36:40.925226+0000","last_active":"2023-12-04T05:36:41.894822+0000","last_peered":"2023-12-04T05:36:41.894822+0000","last_clean":"2023-12-04T05:36:41.894822+0000","last_became_active":"2023-12-04T05:36:40.924880+0000","last_became_peered":"2023-12-04T05:36:40.924880+0000","last_unstale":"2023-12-04T05:36:41.894822+0000","last_undegraded":"2023-12-04T05:36:41.894822+0000","last_fullsized":"2023-12-04T05:36:41.894822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727712+0000","last_change":"2023-12-04T05:36:40.917579+0000","last_active":"2023-12-04T05:36:43.727712+0000","last_peered":"2023-12-04T05:36:43.727712+0000","last_clean":"2023-12-04T05:36:43.727712+0000","last_became_active":"2023-12-04T05:36:40.917049+0000","last_became_peered":"2023-12-04T05:36:40.917049+0000","last_unstale":"2023-12-04T05:36:43.727712+0000","last_undegraded":"2023-12-04T05:36:43.727712+0000","last_fullsized":"2023-12-04T05:36:43.727712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465920+0000","last_change":"2023-12-04T05:36:40.919114+0000","last_active":"2023-12-04T05:36:43.465920+0000","last_peered":"2023-12-04T05:36:43.465920+0000","last_clean":"2023-12-04T05:36:43.465920+0000","last_became_active":"2023-12-04T05:36:40.918821+0000","last_became_peered":"2023-12-04T05:36:40.918821+0000","last_unstale":"2023-12-04T05:36:43.465920+0000","last_undegraded":"2023-12-04T05:36:43.465920+0000","last_fullsized":"2023-12-04T05:36:43.465920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863607+0000","last_change":"2023-12-04T05:36:40.920720+0000","last_active":"2023-12-04T05:36:43.863607+0000","last_peered":"2023-12-04T05:36:43.863607+0000","last_clean":"2023-12-04T05:36:43.863607+0000","last_became_active":"2023-12-04T05:36:40.920392+0000","last_became_peered":"2023-12-04T05:36:40.920392+0000","last_unstale":"2023-12-04T05:36:43.863607+0000","last_undegraded":"2023-12-04T05:36:43.863607+0000","last_fullsized":"2023-12-04T05:36:43.863607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.753265+0000","last_change":"2023-12-04T05:36:40.920292+0000","last_active":"2023-12-04T05:36:43.753265+0000","last_peered":"2023-12-04T05:36:43.753265+0000","last_clean":"2023-12-04T05:36:43.753265+0000","last_became_active":"2023-12-04T05:36:40.919985+0000","last_became_peered":"2023-12-04T05:36:40.919985+0000","last_unstale":"2023-12-04T05:36:43.753265+0000","last_undegraded":"2023-12-04T05:36:43.753265+0000","last_fullsized":"2023-12-04T05:36:43.753265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897439+0000","last_change":"2023-12-04T05:36:40.902425+0000","last_active":"2023-12-04T05:36:41.897439+0000","last_peered":"2023-12-04T05:36:41.897439+0000","last_clean":"2023-12-04T05:36:41.897439+0000","last_became_active":"2023-12-04T05:36:40.902138+0000","last_became_peered":"2023-12-04T05:36:40.902138+0000","last_unstale":"2023-12-04T05:36:41.897439+0000","last_undegraded":"2023-12-04T05:36:41.897439+0000","last_fullsized":"2023-12-04T05:36:41.897439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.898859+0000","last_change":"2023-12-04T05:36:40.918990+0000","last_active":"2023-12-04T05:36:41.898859+0000","last_peered":"2023-12-04T05:36:41.898859+0000","last_clean":"2023-12-04T05:36:41.898859+0000","last_became_active":"2023-12-04T05:36:40.916920+0000","last_became_peered":"2023-12-04T05:36:40.916920+0000","last_unstale":"2023-12-04T05:36:41.898859+0000","last_undegraded":"2023-12-04T05:36:41.898859+0000","last_fullsized":"2023-12-04T05:36:41.898859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219057+0000","last_change":"2023-12-04T05:36:39.916724+0000","last_active":"2023-12-04T05:36:43.219057+0000","last_peered":"2023-12-04T05:36:43.219057+0000","last_clean":"2023-12-04T05:36:43.219057+0000","last_became_active":"2023-12-04T05:36:39.916408+0000","last_became_peered":"2023-12-04T05:36:39.916408+0000","last_unstale":"2023-12-04T05:36:43.219057+0000","last_undegraded":"2023-12-04T05:36:43.219057+0000","last_fullsized":"2023-12-04T05:36:43.219057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466049+0000","last_change":"2023-12-04T05:36:40.908915+0000","last_active":"2023-12-04T05:36:43.466049+0000","last_peered":"2023-12-04T05:36:43.466049+0000","last_clean":"2023-12-04T05:36:43.466049+0000","last_became_active":"2023-12-04T05:36:40.908571+0000","last_became_peered":"2023-12-04T05:36:40.908571+0000","last_unstale":"2023-12-04T05:36:43.466049+0000","last_undegraded":"2023-12-04T05:36:43.466049+0000","last_fullsized":"2023-12-04T05:36:43.466049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897458+0000","last_change":"2023-12-04T05:36:39.912675+0000","last_active":"2023-12-04T05:36:41.897458+0000","last_peered":"2023-12-04T05:36:41.897458+0000","last_clean":"2023-12-04T05:36:41.897458+0000","last_became_active":"2023-12-04T05:36:39.912299+0000","last_became_peered":"2023-12-04T05:36:39.912299+0000","last_unstale":"2023-12-04T05:36:41.897458+0000","last_undegraded":"2023-12-04T05:36:41.897458+0000","last_fullsized":"2023-12-04T05:36:41.897458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219010+0000","last_change":"2023-12-04T05:36:39.906738+0000","last_active":"2023-12-04T05:36:43.219010+0000","last_peered":"2023-12-04T05:36:43.219010+0000","last_clean":"2023-12-04T05:36:43.219010+0000","last_became_active":"2023-12-04T05:36:39.906463+0000","last_became_peered":"2023-12-04T05:36:39.906463+0000","last_unstale":"2023-12-04T05:36:43.219010+0000","last_undegraded":"2023-12-04T05:36:43.219010+0000","last_fullsized":"2023-12-04T05:36:43.219010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727303+0000","last_change":"2023-12-04T05:36:40.919035+0000","last_active":"2023-12-04T05:36:43.727303+0000","last_peered":"2023-12-04T05:36:43.727303+0000","last_clean":"2023-12-04T05:36:43.727303+0000","last_became_active":"2023-12-04T05:36:40.914346+0000","last_became_peered":"2023-12-04T05:36:40.914346+0000","last_unstale":"2023-12-04T05:36:43.727303+0000","last_undegraded":"2023-12-04T05:36:43.727303+0000","last_fullsized":"2023-12-04T05:36:43.727303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214888+0000","last_change":"2023-12-04T05:36:39.920898+0000","last_active":"2023-12-04T05:36:43.214888+0000","last_peered":"2023-12-04T05:36:43.214888+0000","last_clean":"2023-12-04T05:36:43.214888+0000","last_became_active":"2023-12-04T05:36:39.920625+0000","last_became_peered":"2023-12-04T05:36:39.920625+0000","last_unstale":"2023-12-04T05:36:43.214888+0000","last_undegraded":"2023-12-04T05:36:43.214888+0000","last_fullsized":"2023-12-04T05:36:43.214888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894571+0000","last_change":"2023-12-04T05:36:40.925470+0000","last_active":"2023-12-04T05:36:41.894571+0000","last_peered":"2023-12-04T05:36:41.894571+0000","last_clean":"2023-12-04T05:36:41.894571+0000","last_became_active":"2023-12-04T05:36:40.925129+0000","last_became_peered":"2023-12-04T05:36:40.925129+0000","last_unstale":"2023-12-04T05:36:41.894571+0000","last_undegraded":"2023-12-04T05:36:41.894571+0000","last_fullsized":"2023-12-04T05:36:41.894571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897835+0000","last_change":"2023-12-04T05:36:39.912643+0000","last_active":"2023-12-04T05:36:41.897835+0000","last_peered":"2023-12-04T05:36:41.897835+0000","last_clean":"2023-12-04T05:36:41.897835+0000","last_became_active":"2023-12-04T05:36:39.909337+0000","last_became_peered":"2023-12-04T05:36:39.909337+0000","last_unstale":"2023-12-04T05:36:41.897835+0000","last_undegraded":"2023-12-04T05:36:41.897835+0000","last_fullsized":"2023-12-04T05:36:41.897835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864128+0000","last_change":"2023-12-04T05:36:40.921153+0000","last_active":"2023-12-04T05:36:43.864128+0000","last_peered":"2023-12-04T05:36:43.864128+0000","last_clean":"2023-12-04T05:36:43.864128+0000","last_became_active":"2023-12-04T05:36:40.920456+0000","last_became_peered":"2023-12-04T05:36:40.920456+0000","last_unstale":"2023-12-04T05:36:43.864128+0000","last_undegraded":"2023-12-04T05:36:43.864128+0000","last_fullsized":"2023-12-04T05:36:43.864128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:21:40.711244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215094+0000","last_change":"2023-12-04T05:36:39.918009+0000","last_active":"2023-12-04T05:36:43.215094+0000","last_peered":"2023-12-04T05:36:43.215094+0000","last_clean":"2023-12-04T05:36:43.215094+0000","last_became_active":"2023-12-04T05:36:39.917694+0000","last_became_peered":"2023-12-04T05:36:39.917694+0000","last_unstale":"2023-12-04T05:36:43.215094+0000","last_undegraded":"2023-12-04T05:36:43.215094+0000","last_fullsized":"2023-12-04T05:36:43.215094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:22.492160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466140+0000","last_change":"2023-12-04T05:36:40.919239+0000","last_active":"2023-12-04T05:36:43.466140+0000","last_peered":"2023-12-04T05:36:43.466140+0000","last_clean":"2023-12-04T05:36:43.466140+0000","last_became_active":"2023-12-04T05:36:40.918774+0000","last_became_peered":"2023-12-04T05:36:40.918774+0000","last_unstale":"2023-12-04T05:36:43.466140+0000","last_undegraded":"2023-12-04T05:36:43.466140+0000","last_fullsized":"2023-12-04T05:36:43.466140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894788+0000","last_change":"2023-12-04T05:36:39.921145+0000","last_active":"2023-12-04T05:36:41.894788+0000","last_peered":"2023-12-04T05:36:41.894788+0000","last_clean":"2023-12-04T05:36:41.894788+0000","last_became_active":"2023-12-04T05:36:39.920191+0000","last_became_peered":"2023-12-04T05:36:39.920191+0000","last_unstale":"2023-12-04T05:36:41.894788+0000","last_undegraded":"2023-12-04T05:36:41.894788+0000","last_fullsized":"2023-12-04T05:36:41.894788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899199+0000","last_change":"2023-12-04T05:36:40.917431+0000","last_active":"2023-12-04T05:36:41.899199+0000","last_peered":"2023-12-04T05:36:41.899199+0000","last_clean":"2023-12-04T05:36:41.899199+0000","last_became_active":"2023-12-04T05:36:40.917118+0000","last_became_peered":"2023-12-04T05:36:40.917118+0000","last_unstale":"2023-12-04T05:36:41.899199+0000","last_undegraded":"2023-12-04T05:36:41.899199+0000","last_fullsized":"2023-12-04T05:36:41.899199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897552+0000","last_change":"2023-12-04T05:36:39.916187+0000","last_active":"2023-12-04T05:36:41.897552+0000","last_peered":"2023-12-04T05:36:41.897552+0000","last_clean":"2023-12-04T05:36:41.897552+0000","last_became_active":"2023-12-04T05:36:39.915832+0000","last_became_peered":"2023-12-04T05:36:39.915832+0000","last_unstale":"2023-12-04T05:36:41.897552+0000","last_undegraded":"2023-12-04T05:36:41.897552+0000","last_fullsized":"2023-12-04T05:36:41.897552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863701+0000","last_change":"2023-12-04T05:36:40.929289+0000","last_active":"2023-12-04T05:36:43.863701+0000","last_peered":"2023-12-04T05:36:43.863701+0000","last_clean":"2023-12-04T05:36:43.863701+0000","last_became_active":"2023-12-04T05:36:40.929006+0000","last_became_peered":"2023-12-04T05:36:40.929006+0000","last_unstale":"2023-12-04T05:36:43.863701+0000","last_undegraded":"2023-12-04T05:36:43.863701+0000","last_fullsized":"2023-12-04T05:36:43.863701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.216558+0000","last_change":"2023-12-04T05:36:39.909850+0000","last_active":"2023-12-04T05:36:43.216558+0000","last_peered":"2023-12-04T05:36:43.216558+0000","last_clean":"2023-12-04T05:36:43.216558+0000","last_became_active":"2023-12-04T05:36:39.909515+0000","last_became_peered":"2023-12-04T05:36:39.909515+0000","last_unstale":"2023-12-04T05:36:43.216558+0000","last_undegraded":"2023-12-04T05:36:43.216558+0000","last_fullsized":"2023-12-04T05:36:43.216558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465841+0000","last_change":"2023-12-04T05:36:40.917716+0000","last_active":"2023-12-04T05:36:43.465841+0000","last_peered":"2023-12-04T05:36:43.465841+0000","last_clean":"2023-12-04T05:36:43.465841+0000","last_became_active":"2023-12-04T05:36:40.917449+0000","last_became_peered":"2023-12-04T05:36:40.917449+0000","last_unstale":"2023-12-04T05:36:43.465841+0000","last_undegraded":"2023-12-04T05:36:43.465841+0000","last_fullsized":"2023-12-04T05:36:43.465841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214978+0000","last_change":"2023-12-04T05:36:39.919474+0000","last_active":"2023-12-04T05:36:43.214978+0000","last_peered":"2023-12-04T05:36:43.214978+0000","last_clean":"2023-12-04T05:36:43.214978+0000","last_became_active":"2023-12-04T05:36:39.919051+0000","last_became_peered":"2023-12-04T05:36:39.919051+0000","last_unstale":"2023-12-04T05:36:43.214978+0000","last_undegraded":"2023-12-04T05:36:43.214978+0000","last_fullsized":"2023-12-04T05:36:43.214978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:12.727217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863680+0000","last_change":"2023-12-04T05:36:40.919992+0000","last_active":"2023-12-04T05:36:43.863680+0000","last_peered":"2023-12-04T05:36:43.863680+0000","last_clean":"2023-12-04T05:36:43.863680+0000","last_became_active":"2023-12-04T05:36:40.919720+0000","last_became_peered":"2023-12-04T05:36:40.919720+0000","last_unstale":"2023-12-04T05:36:43.863680+0000","last_undegraded":"2023-12-04T05:36:43.863680+0000","last_fullsized":"2023-12-04T05:36:43.863680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897599+0000","last_change":"2023-12-04T05:36:39.908368+0000","last_active":"2023-12-04T05:36:41.897599+0000","last_peered":"2023-12-04T05:36:41.897599+0000","last_clean":"2023-12-04T05:36:41.897599+0000","last_became_active":"2023-12-04T05:36:39.907946+0000","last_became_peered":"2023-12-04T05:36:39.907946+0000","last_unstale":"2023-12-04T05:36:41.897599+0000","last_undegraded":"2023-12-04T05:36:41.897599+0000","last_fullsized":"2023-12-04T05:36:41.897599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897271+0000","last_change":"2023-12-04T05:36:40.907233+0000","last_active":"2023-12-04T05:36:41.897271+0000","last_peered":"2023-12-04T05:36:41.897271+0000","last_clean":"2023-12-04T05:36:41.897271+0000","last_became_active":"2023-12-04T05:36:40.906854+0000","last_became_peered":"2023-12-04T05:36:40.906854+0000","last_unstale":"2023-12-04T05:36:41.897271+0000","last_undegraded":"2023-12-04T05:36:41.897271+0000","last_fullsized":"2023-12-04T05:36:41.897271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218589+0000","last_change":"2023-12-04T05:36:39.901154+0000","last_active":"2023-12-04T05:36:43.218589+0000","last_peered":"2023-12-04T05:36:43.218589+0000","last_clean":"2023-12-04T05:36:43.218589+0000","last_became_active":"2023-12-04T05:36:39.900871+0000","last_became_peered":"2023-12-04T05:36:39.900871+0000","last_unstale":"2023-12-04T05:36:43.218589+0000","last_undegraded":"2023-12-04T05:36:43.218589+0000","last_fullsized":"2023-12-04T05:36:43.218589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863389+0000","last_change":"2023-12-04T05:36:40.918025+0000","last_active":"2023-12-04T05:36:43.863389+0000","last_peered":"2023-12-04T05:36:43.863389+0000","last_clean":"2023-12-04T05:36:43.863389+0000","last_became_active":"2023-12-04T05:36:40.917722+0000","last_became_peered":"2023-12-04T05:36:40.917722+0000","last_unstale":"2023-12-04T05:36:43.863389+0000","last_undegraded":"2023-12-04T05:36:43.863389+0000","last_fullsized":"2023-12-04T05:36:43.863389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899228+0000","last_change":"2023-12-04T05:36:39.913527+0000","last_active":"2023-12-04T05:36:41.899228+0000","last_peered":"2023-12-04T05:36:41.899228+0000","last_clean":"2023-12-04T05:36:41.899228+0000","last_became_active":"2023-12-04T05:36:39.911602+0000","last_became_peered":"2023-12-04T05:36:39.911602+0000","last_unstale":"2023-12-04T05:36:41.899228+0000","last_undegraded":"2023-12-04T05:36:41.899228+0000","last_fullsized":"2023-12-04T05:36:41.899228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:10.437590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863707+0000","last_change":"2023-12-04T05:36:40.926649+0000","last_active":"2023-12-04T05:36:43.863707+0000","last_peered":"2023-12-04T05:36:43.863707+0000","last_clean":"2023-12-04T05:36:43.863707+0000","last_became_active":"2023-12-04T05:36:40.926316+0000","last_became_peered":"2023-12-04T05:36:40.926316+0000","last_unstale":"2023-12-04T05:36:43.863707+0000","last_undegraded":"2023-12-04T05:36:43.863707+0000","last_fullsized":"2023-12-04T05:36:43.863707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218644+0000","last_change":"2023-12-04T05:36:39.915096+0000","last_active":"2023-12-04T05:36:43.218644+0000","last_peered":"2023-12-04T05:36:43.218644+0000","last_clean":"2023-12-04T05:36:43.218644+0000","last_became_active":"2023-12-04T05:36:39.914743+0000","last_became_peered":"2023-12-04T05:36:39.914743+0000","last_unstale":"2023-12-04T05:36:43.218644+0000","last_undegraded":"2023-12-04T05:36:43.218644+0000","last_fullsized":"2023-12-04T05:36:43.218644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:21.177051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864406+0000","last_change":"2023-12-04T05:36:40.925949+0000","last_active":"2023-12-04T05:36:43.864406+0000","last_peered":"2023-12-04T05:36:43.864406+0000","last_clean":"2023-12-04T05:36:43.864406+0000","last_became_active":"2023-12-04T05:36:40.925684+0000","last_became_peered":"2023-12-04T05:36:40.925684+0000","last_unstale":"2023-12-04T05:36:43.864406+0000","last_undegraded":"2023-12-04T05:36:43.864406+0000","last_fullsized":"2023-12-04T05:36:43.864406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:50:32.538182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894872+0000","last_change":"2023-12-04T05:36:39.906214+0000","last_active":"2023-12-04T05:36:41.894872+0000","last_peered":"2023-12-04T05:36:41.894872+0000","last_clean":"2023-12-04T05:36:41.894872+0000","last_became_active":"2023-12-04T05:36:39.905868+0000","last_became_peered":"2023-12-04T05:36:39.905868+0000","last_unstale":"2023-12-04T05:36:41.894872+0000","last_undegraded":"2023-12-04T05:36:41.894872+0000","last_fullsized":"2023-12-04T05:36:41.894872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863781+0000","last_change":"2023-12-04T05:36:40.921297+0000","last_active":"2023-12-04T05:36:43.863781+0000","last_peered":"2023-12-04T05:36:43.863781+0000","last_clean":"2023-12-04T05:36:43.863781+0000","last_became_active":"2023-12-04T05:36:40.919804+0000","last_became_peered":"2023-12-04T05:36:40.919804+0000","last_unstale":"2023-12-04T05:36:43.863781+0000","last_undegraded":"2023-12-04T05:36:43.863781+0000","last_fullsized":"2023-12-04T05:36:43.863781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:40.225630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218625+0000","last_change":"2023-12-04T05:36:39.920708+0000","last_active":"2023-12-04T05:36:43.218625+0000","last_peered":"2023-12-04T05:36:43.218625+0000","last_clean":"2023-12-04T05:36:43.218625+0000","last_became_active":"2023-12-04T05:36:39.920411+0000","last_became_peered":"2023-12-04T05:36:39.920411+0000","last_unstale":"2023-12-04T05:36:43.218625+0000","last_undegraded":"2023-12-04T05:36:43.218625+0000","last_fullsized":"2023-12-04T05:36:43.218625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863847+0000","last_change":"2023-12-04T05:36:40.929211+0000","last_active":"2023-12-04T05:36:43.863847+0000","last_peered":"2023-12-04T05:36:43.863847+0000","last_clean":"2023-12-04T05:36:43.863847+0000","last_became_active":"2023-12-04T05:36:40.928878+0000","last_became_peered":"2023-12-04T05:36:40.928878+0000","last_unstale":"2023-12-04T05:36:43.863847+0000","last_undegraded":"2023-12-04T05:36:43.863847+0000","last_fullsized":"2023-12-04T05:36:43.863847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:24.731252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907933+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:36:40.907933+0000","last_peered":"2023-12-04T05:36:40.907933+0000","last_clean":"2023-12-04T05:36:40.907933+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:36:40.907933+0000","last_undegraded":"2023-12-04T05:36:40.907933+0000","last_fullsized":"2023-12-04T05:36:40.907933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214997+0000","last_change":"2023-12-04T05:36:39.909994+0000","last_active":"2023-12-04T05:36:43.214997+0000","last_peered":"2023-12-04T05:36:43.214997+0000","last_clean":"2023-12-04T05:36:43.214997+0000","last_became_active":"2023-12-04T05:36:39.909676+0000","last_became_peered":"2023-12-04T05:36:39.909676+0000","last_unstale":"2023-12-04T05:36:43.214997+0000","last_undegraded":"2023-12-04T05:36:43.214997+0000","last_fullsized":"2023-12-04T05:36:43.214997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:26.127153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727445+0000","last_change":"2023-12-04T05:36:40.922315+0000","last_active":"2023-12-04T05:36:43.727445+0000","last_peered":"2023-12-04T05:36:43.727445+0000","last_clean":"2023-12-04T05:36:43.727445+0000","last_became_active":"2023-12-04T05:36:40.922017+0000","last_became_peered":"2023-12-04T05:36:40.922017+0000","last_unstale":"2023-12-04T05:36:43.727445+0000","last_undegraded":"2023-12-04T05:36:43.727445+0000","last_fullsized":"2023-12-04T05:36:43.727445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214961+0000","last_change":"2023-12-04T05:36:39.917047+0000","last_active":"2023-12-04T05:36:43.214961+0000","last_peered":"2023-12-04T05:36:43.214961+0000","last_clean":"2023-12-04T05:36:43.214961+0000","last_became_active":"2023-12-04T05:36:39.915737+0000","last_became_peered":"2023-12-04T05:36:39.915737+0000","last_unstale":"2023-12-04T05:36:43.214961+0000","last_undegraded":"2023-12-04T05:36:43.214961+0000","last_fullsized":"2023-12-04T05:36:43.214961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465733+0000","last_change":"2023-12-04T05:36:40.909850+0000","last_active":"2023-12-04T05:36:43.465733+0000","last_peered":"2023-12-04T05:36:43.465733+0000","last_clean":"2023-12-04T05:36:43.465733+0000","last_became_active":"2023-12-04T05:36:40.908954+0000","last_became_peered":"2023-12-04T05:36:40.908954+0000","last_unstale":"2023-12-04T05:36:43.465733+0000","last_undegraded":"2023-12-04T05:36:43.465733+0000","last_fullsized":"2023-12-04T05:36:43.465733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218615+0000","last_change":"2023-12-04T05:36:39.900716+0000","last_active":"2023-12-04T05:36:43.218615+0000","last_peered":"2023-12-04T05:36:43.218615+0000","last_clean":"2023-12-04T05:36:43.218615+0000","last_became_active":"2023-12-04T05:36:39.898450+0000","last_became_peered":"2023-12-04T05:36:39.898450+0000","last_unstale":"2023-12-04T05:36:43.218615+0000","last_undegraded":"2023-12-04T05:36:43.218615+0000","last_fullsized":"2023-12-04T05:36:43.218615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894542+0000","last_change":"2023-12-04T05:36:40.912304+0000","last_active":"2023-12-04T05:36:41.894542+0000","last_peered":"2023-12-04T05:36:41.894542+0000","last_clean":"2023-12-04T05:36:41.894542+0000","last_became_active":"2023-12-04T05:36:40.912044+0000","last_became_peered":"2023-12-04T05:36:40.912044+0000","last_unstale":"2023-12-04T05:36:41.894542+0000","last_undegraded":"2023-12-04T05:36:41.894542+0000","last_fullsized":"2023-12-04T05:36:41.894542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214988+0000","last_change":"2023-12-04T05:36:39.911421+0000","last_active":"2023-12-04T05:36:43.214988+0000","last_peered":"2023-12-04T05:36:43.214988+0000","last_clean":"2023-12-04T05:36:43.214988+0000","last_became_active":"2023-12-04T05:36:39.910797+0000","last_became_peered":"2023-12-04T05:36:39.910797+0000","last_unstale":"2023-12-04T05:36:43.214988+0000","last_undegraded":"2023-12-04T05:36:43.214988+0000","last_fullsized":"2023-12-04T05:36:43.214988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899038+0000","last_change":"2023-12-04T05:36:40.902536+0000","last_active":"2023-12-04T05:36:41.899038+0000","last_peered":"2023-12-04T05:36:41.899038+0000","last_clean":"2023-12-04T05:36:41.899038+0000","last_became_active":"2023-12-04T05:36:40.902158+0000","last_became_peered":"2023-12-04T05:36:40.902158+0000","last_unstale":"2023-12-04T05:36:41.899038+0000","last_undegraded":"2023-12-04T05:36:41.899038+0000","last_fullsized":"2023-12-04T05:36:41.899038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894718+0000","last_change":"2023-12-04T05:36:39.911969+0000","last_active":"2023-12-04T05:36:41.894718+0000","last_peered":"2023-12-04T05:36:41.894718+0000","last_clean":"2023-12-04T05:36:41.894718+0000","last_became_active":"2023-12-04T05:36:39.911783+0000","last_became_peered":"2023-12-04T05:36:39.911783+0000","last_unstale":"2023-12-04T05:36:41.894718+0000","last_undegraded":"2023-12-04T05:36:41.894718+0000","last_fullsized":"2023-12-04T05:36:41.894718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863822+0000","last_change":"2023-12-04T05:36:40.925817+0000","last_active":"2023-12-04T05:36:43.863822+0000","last_peered":"2023-12-04T05:36:43.863822+0000","last_clean":"2023-12-04T05:36:43.863822+0000","last_became_active":"2023-12-04T05:36:40.925448+0000","last_became_peered":"2023-12-04T05:36:40.925448+0000","last_unstale":"2023-12-04T05:36:43.863822+0000","last_undegraded":"2023-12-04T05:36:43.863822+0000","last_fullsized":"2023-12-04T05:36:43.863822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:00.972226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215196+0000","last_change":"2023-12-04T05:36:39.921497+0000","last_active":"2023-12-04T05:36:43.215196+0000","last_peered":"2023-12-04T05:36:43.215196+0000","last_clean":"2023-12-04T05:36:43.215196+0000","last_became_active":"2023-12-04T05:36:39.921175+0000","last_became_peered":"2023-12-04T05:36:39.921175+0000","last_unstale":"2023-12-04T05:36:43.215196+0000","last_undegraded":"2023-12-04T05:36:43.215196+0000","last_fullsized":"2023-12-04T05:36:43.215196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894588+0000","last_change":"2023-12-04T05:36:40.913041+0000","last_active":"2023-12-04T05:36:41.894588+0000","last_peered":"2023-12-04T05:36:41.894588+0000","last_clean":"2023-12-04T05:36:41.894588+0000","last_became_active":"2023-12-04T05:36:40.912719+0000","last_became_peered":"2023-12-04T05:36:40.912719+0000","last_unstale":"2023-12-04T05:36:41.894588+0000","last_undegraded":"2023-12-04T05:36:41.894588+0000","last_fullsized":"2023-12-04T05:36:41.894588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218464+0000","last_change":"2023-12-04T05:36:39.908161+0000","last_active":"2023-12-04T05:36:43.218464+0000","last_peered":"2023-12-04T05:36:43.218464+0000","last_clean":"2023-12-04T05:36:43.218464+0000","last_became_active":"2023-12-04T05:36:39.907857+0000","last_became_peered":"2023-12-04T05:36:39.907857+0000","last_unstale":"2023-12-04T05:36:43.218464+0000","last_undegraded":"2023-12-04T05:36:43.218464+0000","last_fullsized":"2023-12-04T05:36:43.218464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727640+0000","last_change":"2023-12-04T05:36:40.929459+0000","last_active":"2023-12-04T05:36:43.727640+0000","last_peered":"2023-12-04T05:36:43.727640+0000","last_clean":"2023-12-04T05:36:43.727640+0000","last_became_active":"2023-12-04T05:36:40.929278+0000","last_became_peered":"2023-12-04T05:36:40.929278+0000","last_unstale":"2023-12-04T05:36:43.727640+0000","last_undegraded":"2023-12-04T05:36:43.727640+0000","last_fullsized":"2023-12-04T05:36:43.727640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897952+0000","last_change":"2023-12-04T05:36:39.916327+0000","last_active":"2023-12-04T05:36:41.897952+0000","last_peered":"2023-12-04T05:36:41.897952+0000","last_clean":"2023-12-04T05:36:41.897952+0000","last_became_active":"2023-12-04T05:36:39.916042+0000","last_became_peered":"2023-12-04T05:36:39.916042+0000","last_unstale":"2023-12-04T05:36:41.897952+0000","last_undegraded":"2023-12-04T05:36:41.897952+0000","last_fullsized":"2023-12-04T05:36:41.897952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466163+0000","last_change":"2023-12-04T05:36:40.924060+0000","last_active":"2023-12-04T05:36:43.466163+0000","last_peered":"2023-12-04T05:36:43.466163+0000","last_clean":"2023-12-04T05:36:43.466163+0000","last_became_active":"2023-12-04T05:36:40.923821+0000","last_became_peered":"2023-12-04T05:36:40.923821+0000","last_unstale":"2023-12-04T05:36:43.466163+0000","last_undegraded":"2023-12-04T05:36:43.466163+0000","last_fullsized":"2023-12-04T05:36:43.466163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214936+0000","last_change":"2023-12-04T05:36:39.921359+0000","last_active":"2023-12-04T05:36:43.214936+0000","last_peered":"2023-12-04T05:36:43.214936+0000","last_clean":"2023-12-04T05:36:43.214936+0000","last_became_active":"2023-12-04T05:36:39.921108+0000","last_became_peered":"2023-12-04T05:36:39.921108+0000","last_unstale":"2023-12-04T05:36:43.214936+0000","last_undegraded":"2023-12-04T05:36:43.214936+0000","last_fullsized":"2023-12-04T05:36:43.214936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899095+0000","last_change":"2023-12-04T05:36:40.909278+0000","last_active":"2023-12-04T05:36:41.899095+0000","last_peered":"2023-12-04T05:36:41.899095+0000","last_clean":"2023-12-04T05:36:41.899095+0000","last_became_active":"2023-12-04T05:36:40.908988+0000","last_became_peered":"2023-12-04T05:36:40.908988+0000","last_unstale":"2023-12-04T05:36:41.899095+0000","last_undegraded":"2023-12-04T05:36:41.899095+0000","last_fullsized":"2023-12-04T05:36:41.899095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894616+0000","last_change":"2023-12-04T05:36:39.913809+0000","last_active":"2023-12-04T05:36:41.894616+0000","last_peered":"2023-12-04T05:36:41.894616+0000","last_clean":"2023-12-04T05:36:41.894616+0000","last_became_active":"2023-12-04T05:36:39.913417+0000","last_became_peered":"2023-12-04T05:36:39.913417+0000","last_unstale":"2023-12-04T05:36:41.894616+0000","last_undegraded":"2023-12-04T05:36:41.894616+0000","last_fullsized":"2023-12-04T05:36:41.894616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727378+0000","last_change":"2023-12-04T05:36:40.925195+0000","last_active":"2023-12-04T05:36:43.727378+0000","last_peered":"2023-12-04T05:36:43.727378+0000","last_clean":"2023-12-04T05:36:43.727378+0000","last_became_active":"2023-12-04T05:36:40.924744+0000","last_became_peered":"2023-12-04T05:36:40.924744+0000","last_unstale":"2023-12-04T05:36:43.727378+0000","last_undegraded":"2023-12-04T05:36:43.727378+0000","last_fullsized":"2023-12-04T05:36:43.727378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894682+0000","last_change":"2023-12-04T05:36:39.904596+0000","last_active":"2023-12-04T05:36:41.894682+0000","last_peered":"2023-12-04T05:36:41.894682+0000","last_clean":"2023-12-04T05:36:41.894682+0000","last_became_active":"2023-12-04T05:36:39.904323+0000","last_became_peered":"2023-12-04T05:36:39.904323+0000","last_unstale":"2023-12-04T05:36:41.894682+0000","last_undegraded":"2023-12-04T05:36:41.894682+0000","last_fullsized":"2023-12-04T05:36:41.894682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727594+0000","last_change":"2023-12-04T05:36:40.917184+0000","last_active":"2023-12-04T05:36:43.727594+0000","last_peered":"2023-12-04T05:36:43.727594+0000","last_clean":"2023-12-04T05:36:43.727594+0000","last_became_active":"2023-12-04T05:36:40.916879+0000","last_became_peered":"2023-12-04T05:36:40.916879+0000","last_unstale":"2023-12-04T05:36:43.727594+0000","last_undegraded":"2023-12-04T05:36:43.727594+0000","last_fullsized":"2023-12-04T05:36:43.727594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215089+0000","last_change":"2023-12-04T05:36:39.918909+0000","last_active":"2023-12-04T05:36:43.215089+0000","last_peered":"2023-12-04T05:36:43.215089+0000","last_clean":"2023-12-04T05:36:43.215089+0000","last_became_active":"2023-12-04T05:36:39.918583+0000","last_became_peered":"2023-12-04T05:36:39.918583+0000","last_unstale":"2023-12-04T05:36:43.215089+0000","last_undegraded":"2023-12-04T05:36:43.215089+0000","last_fullsized":"2023-12-04T05:36:43.215089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897340+0000","last_change":"2023-12-04T05:36:40.899019+0000","last_active":"2023-12-04T05:36:41.897340+0000","last_peered":"2023-12-04T05:36:41.897340+0000","last_clean":"2023-12-04T05:36:41.897340+0000","last_became_active":"2023-12-04T05:36:40.898523+0000","last_became_peered":"2023-12-04T05:36:40.898523+0000","last_unstale":"2023-12-04T05:36:41.897340+0000","last_undegraded":"2023-12-04T05:36:41.897340+0000","last_fullsized":"2023-12-04T05:36:41.897340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863645+0000","last_change":"2023-12-04T05:36:40.918106+0000","last_active":"2023-12-04T05:36:43.863645+0000","last_peered":"2023-12-04T05:36:43.863645+0000","last_clean":"2023-12-04T05:36:43.863645+0000","last_became_active":"2023-12-04T05:36:40.917745+0000","last_became_peered":"2023-12-04T05:36:40.917745+0000","last_unstale":"2023-12-04T05:36:43.863645+0000","last_undegraded":"2023-12-04T05:36:43.863645+0000","last_fullsized":"2023-12-04T05:36:43.863645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:24.731252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215112+0000","last_change":"2023-12-04T05:36:39.924371+0000","last_active":"2023-12-04T05:36:43.215112+0000","last_peered":"2023-12-04T05:36:43.215112+0000","last_clean":"2023-12-04T05:36:43.215112+0000","last_became_active":"2023-12-04T05:36:39.924054+0000","last_became_peered":"2023-12-04T05:36:39.924054+0000","last_unstale":"2023-12-04T05:36:43.215112+0000","last_undegraded":"2023-12-04T05:36:43.215112+0000","last_fullsized":"2023-12-04T05:36:43.215112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863632+0000","last_change":"2023-12-04T05:36:40.917939+0000","last_active":"2023-12-04T05:36:43.863632+0000","last_peered":"2023-12-04T05:36:43.863632+0000","last_clean":"2023-12-04T05:36:43.863632+0000","last_became_active":"2023-12-04T05:36:40.917669+0000","last_became_peered":"2023-12-04T05:36:40.917669+0000","last_unstale":"2023-12-04T05:36:43.863632+0000","last_undegraded":"2023-12-04T05:36:43.863632+0000","last_fullsized":"2023-12-04T05:36:43.863632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215173+0000","last_change":"2023-12-04T05:36:39.920721+0000","last_active":"2023-12-04T05:36:43.215173+0000","last_peered":"2023-12-04T05:36:43.215173+0000","last_clean":"2023-12-04T05:36:43.215173+0000","last_became_active":"2023-12-04T05:36:39.920453+0000","last_became_peered":"2023-12-04T05:36:39.920453+0000","last_unstale":"2023-12-04T05:36:43.215173+0000","last_undegraded":"2023-12-04T05:36:43.215173+0000","last_fullsized":"2023-12-04T05:36:43.215173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466119+0000","last_change":"2023-12-04T05:36:40.919075+0000","last_active":"2023-12-04T05:36:43.466119+0000","last_peered":"2023-12-04T05:36:43.466119+0000","last_clean":"2023-12-04T05:36:43.466119+0000","last_became_active":"2023-12-04T05:36:40.918364+0000","last_became_peered":"2023-12-04T05:36:40.918364+0000","last_unstale":"2023-12-04T05:36:43.466119+0000","last_undegraded":"2023-12-04T05:36:43.466119+0000","last_fullsized":"2023-12-04T05:36:43.466119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219084+0000","last_change":"2023-12-04T05:36:39.920745+0000","last_active":"2023-12-04T05:36:43.219084+0000","last_peered":"2023-12-04T05:36:43.219084+0000","last_clean":"2023-12-04T05:36:43.219084+0000","last_became_active":"2023-12-04T05:36:39.920421+0000","last_became_peered":"2023-12-04T05:36:39.920421+0000","last_unstale":"2023-12-04T05:36:43.219084+0000","last_undegraded":"2023-12-04T05:36:43.219084+0000","last_fullsized":"2023-12-04T05:36:43.219084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727692+0000","last_change":"2023-12-04T05:36:40.920955+0000","last_active":"2023-12-04T05:36:43.727692+0000","last_peered":"2023-12-04T05:36:43.727692+0000","last_clean":"2023-12-04T05:36:43.727692+0000","last_became_active":"2023-12-04T05:36:40.920651+0000","last_became_peered":"2023-12-04T05:36:40.920651+0000","last_unstale":"2023-12-04T05:36:43.727692+0000","last_undegraded":"2023-12-04T05:36:43.727692+0000","last_fullsized":"2023-12-04T05:36:43.727692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.216615+0000","last_change":"2023-12-04T05:36:39.913939+0000","last_active":"2023-12-04T05:36:43.216615+0000","last_peered":"2023-12-04T05:36:43.216615+0000","last_clean":"2023-12-04T05:36:43.216615+0000","last_became_active":"2023-12-04T05:36:39.913586+0000","last_became_peered":"2023-12-04T05:36:39.913586+0000","last_unstale":"2023-12-04T05:36:43.216615+0000","last_undegraded":"2023-12-04T05:36:43.216615+0000","last_fullsized":"2023-12-04T05:36:43.216615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:36:49.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:36:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 Processor -- start 2023-12-04T05:36:49.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 -- start start 2023-12-04T05:36:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 0x7f3aac154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac1547d0 con 0x7f3aac158630 2023-12-04T05:36:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac158b80 con 0x7f3aac151bf0 2023-12-04T05:36:49.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3ab0d57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0c4aa0 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aaad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3aac158630 0x7f3aac15efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41830/0 (socket says 172.21.15.97:41830) 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aaad9d640 1 -- 172.21.15.97:0/3586294194 learned_addr learned my addr 172.21.15.97:0/3586294194 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa9d9b640 1 --2- 172.21.15.97:0/3586294194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 0x7f3aac154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161426727 0 0) 0x7f3aac1547d0 con 0x7f3aac158630 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a94003530 con 0x7f3aac158630 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641979304 0 0) 0x7f3aac158b80 con 0x7f3aac151bf0 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aac1547d0 con 0x7f3aac151bf0 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa9d9b640 1 -- 172.21.15.97:0/3586294194 >> v1:172.21.15.143:6789/0 conn(0x7f3aac151bf0 legacy=0x7f3aac0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa9d9b640 1 -- 172.21.15.97:0/3586294194 >> v1:172.21.15.97:6789/0 conn(0x7f3aac158630 legacy=0x7f3aac15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856996361 0 0) 0x7f3a94003530 con 0x7f3aac158630 2023-12-04T05:36:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.795+0000 7f3aa9d9b640 1 -- 172.21.15.97:0/3586294194 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0c4d40 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3aa9d9b640 1 --2- 172.21.15.97:0/3586294194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 0x7f3aac154c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00097f0 tx=0x7f3aa001bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69f1ba03525b20 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4001a00 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa00a5460 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3aa959a640 1 -- 172.21.15.97:0/3586294194 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00a57f0 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 -- 172.21.15.97:0/3586294194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 msgr2=0x7f3aac154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/3586294194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 0x7f3aac154c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00097f0 tx=0x7f3aa001bfa0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 -- 172.21.15.97:0/3586294194 shutdown_connections 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/3586294194 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac0c7ef0 0x7f3aac154c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 -- 172.21.15.97:0/3586294194 >> 172.21.15.97:0/3586294194 conn(0x7f3aac073550 msgr2=0x7f3aac073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 -- 172.21.15.97:0/3586294194 shutdown_connections 2023-12-04T05:36:49.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.799+0000 7f3ab0d57640 1 -- 172.21.15.97:0/3586294194 wait complete. 2023-12-04T05:36:49.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 Processor -- start 2023-12-04T05:36:49.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- start start 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac151bf0 0x7f3aac1ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aac158630 0x7f3aac148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac156430 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac1f1f50 con 0x7f3aac158630 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac156680 con 0x7f3aac151bf0 2023-12-04T05:36:49.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50242/0 (socket says 172.21.15.97:50242) 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 -- 172.21.15.97:0/1833654348 learned_addr learned my addr 172.21.15.97:0/1833654348 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 -- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac151bf0 msgr2=0x7f3aac1ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac151bf0 0x7f3aac1ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 -- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aac158630 msgr2=0x7f3aac148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aac158630 0x7f3aac148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 -- 172.21.15.97:0/1833654348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009420 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3aaa59c640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00c490 tx=0x7f3a9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0052d0 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c005430 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac156960 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c012870 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.803+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac0afc10 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac068440 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a9c0129d0 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3a9affd640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 0x7f3a8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:49.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a9c083fe0 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3aa9d9b640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 0x7f3a8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:49.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.807+0000 7f3aa9d9b640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 0x7f3a8c068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00ad000 tx=0x7f3aa0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:49.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.811+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a9c054d00 con 0x7f3aac0c7ef0 2023-12-04T05:36:49.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.959+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3aac0c0d20 con 0x7f3a8c0668d0 2023-12-04T05:36:49.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.967+0000 7f3a9affd640 1 -- 172.21.15.97:0/1833654348 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264635 (secure 0 0 0) 0x7f3aac0c0d20 con 0x7f3a8c0668d0 2023-12-04T05:36:49.972 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:49.973 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:36:49.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 msgr2=0x7f3a8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 0x7f3a8c068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00ad000 tx=0x7f3aa0004740 comp rx=0 tx=0).stop 2023-12-04T05:36:49.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 msgr2=0x7f3aac1ef2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:49.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00c490 tx=0x7f3a9c00c950 comp rx=0 tx=0).stop 2023-12-04T05:36:49.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 shutdown_connections 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3a8c0668d0 0x7f3a8c068d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3aac158630 0x7f3aac148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3aac151bf0 0x7f3aac1ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 --2- 172.21.15.97:0/1833654348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3aac0c7ef0 0x7f3aac1ef2a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 >> 172.21.15.97:0/1833654348 conn(0x7f3aac073550 msgr2=0x7f3aac14b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:49.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 shutdown_connections 2023-12-04T05:36:49.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:49.971+0000 7f3ab0d57640 1 -- 172.21.15.97:0/1833654348 wait complete. 2023-12-04T05:36:49.992 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-04T05:36:48.192979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219000,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755720,"statfs":{"total":773094113280,"available":772869857280,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001770"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864282+0000","last_change":"2023-12-04T05:36:40.924610+0000","last_active":"2023-12-04T05:36:43.864282+0000","last_peered":"2023-12-04T05:36:43.864282+0000","last_clean":"2023-12-04T05:36:43.864282+0000","last_became_active":"2023-12-04T05:36:40.924042+0000","last_became_peered":"2023-12-04T05:36:40.924042+0000","last_unstale":"2023-12-04T05:36:43.864282+0000","last_undegraded":"2023-12-04T05:36:43.864282+0000","last_fullsized":"2023-12-04T05:36:43.864282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:21:40.711244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894819+0000","last_change":"2023-12-04T05:36:40.915527+0000","last_active":"2023-12-04T05:36:41.894819+0000","last_peered":"2023-12-04T05:36:41.894819+0000","last_clean":"2023-12-04T05:36:41.894819+0000","last_became_active":"2023-12-04T05:36:40.915173+0000","last_became_peered":"2023-12-04T05:36:40.915173+0000","last_unstale":"2023-12-04T05:36:41.894819+0000","last_undegraded":"2023-12-04T05:36:41.894819+0000","last_fullsized":"2023-12-04T05:36:41.894819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465973+0000","last_change":"2023-12-04T05:36:40.913206+0000","last_active":"2023-12-04T05:36:43.465973+0000","last_peered":"2023-12-04T05:36:43.465973+0000","last_clean":"2023-12-04T05:36:43.465973+0000","last_became_active":"2023-12-04T05:36:40.912745+0000","last_became_peered":"2023-12-04T05:36:40.912745+0000","last_unstale":"2023-12-04T05:36:43.465973+0000","last_undegraded":"2023-12-04T05:36:43.465973+0000","last_fullsized":"2023-12-04T05:36:43.465973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863463+0000","last_change":"2023-12-04T05:36:40.922261+0000","last_active":"2023-12-04T05:36:43.863463+0000","last_peered":"2023-12-04T05:36:43.863463+0000","last_clean":"2023-12-04T05:36:43.863463+0000","last_became_active":"2023-12-04T05:36:40.920113+0000","last_became_peered":"2023-12-04T05:36:40.920113+0000","last_unstale":"2023-12-04T05:36:43.863463+0000","last_undegraded":"2023-12-04T05:36:43.863463+0000","last_fullsized":"2023-12-04T05:36:43.863463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863941+0000","last_change":"2023-12-04T05:36:40.919483+0000","last_active":"2023-12-04T05:36:43.863941+0000","last_peered":"2023-12-04T05:36:43.863941+0000","last_clean":"2023-12-04T05:36:43.863941+0000","last_became_active":"2023-12-04T05:36:40.919062+0000","last_became_peered":"2023-12-04T05:36:40.919062+0000","last_unstale":"2023-12-04T05:36:43.863941+0000","last_undegraded":"2023-12-04T05:36:43.863941+0000","last_fullsized":"2023-12-04T05:36:43.863941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:40.225630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863441+0000","last_change":"2023-12-04T05:36:40.918746+0000","last_active":"2023-12-04T05:36:43.863441+0000","last_peered":"2023-12-04T05:36:43.863441+0000","last_clean":"2023-12-04T05:36:43.863441+0000","last_became_active":"2023-12-04T05:36:40.918449+0000","last_became_peered":"2023-12-04T05:36:40.918449+0000","last_unstale":"2023-12-04T05:36:43.863441+0000","last_undegraded":"2023-12-04T05:36:43.863441+0000","last_fullsized":"2023-12-04T05:36:43.863441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863479+0000","last_change":"2023-12-04T05:36:40.917608+0000","last_active":"2023-12-04T05:36:43.863479+0000","last_peered":"2023-12-04T05:36:43.863479+0000","last_clean":"2023-12-04T05:36:43.863479+0000","last_became_active":"2023-12-04T05:36:40.917298+0000","last_became_peered":"2023-12-04T05:36:40.917298+0000","last_unstale":"2023-12-04T05:36:43.863479+0000","last_undegraded":"2023-12-04T05:36:43.863479+0000","last_fullsized":"2023-12-04T05:36:43.863479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727219+0000","last_change":"2023-12-04T05:36:40.925544+0000","last_active":"2023-12-04T05:36:43.727219+0000","last_peered":"2023-12-04T05:36:43.727219+0000","last_clean":"2023-12-04T05:36:43.727219+0000","last_became_active":"2023-12-04T05:36:40.925230+0000","last_became_peered":"2023-12-04T05:36:40.925230+0000","last_unstale":"2023-12-04T05:36:43.727219+0000","last_undegraded":"2023-12-04T05:36:43.727219+0000","last_fullsized":"2023-12-04T05:36:43.727219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864315+0000","last_change":"2023-12-04T05:36:40.924730+0000","last_active":"2023-12-04T05:36:43.864315+0000","last_peered":"2023-12-04T05:36:43.864315+0000","last_clean":"2023-12-04T05:36:43.864315+0000","last_became_active":"2023-12-04T05:36:40.924315+0000","last_became_peered":"2023-12-04T05:36:40.924315+0000","last_unstale":"2023-12-04T05:36:43.864315+0000","last_undegraded":"2023-12-04T05:36:43.864315+0000","last_fullsized":"2023-12-04T05:36:43.864315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:23:56.993089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897856+0000","last_change":"2023-12-04T05:36:40.919533+0000","last_active":"2023-12-04T05:36:41.897856+0000","last_peered":"2023-12-04T05:36:41.897856+0000","last_clean":"2023-12-04T05:36:41.897856+0000","last_became_active":"2023-12-04T05:36:40.919231+0000","last_became_peered":"2023-12-04T05:36:40.919231+0000","last_unstale":"2023-12-04T05:36:41.897856+0000","last_undegraded":"2023-12-04T05:36:41.897856+0000","last_fullsized":"2023-12-04T05:36:41.897856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897623+0000","last_change":"2023-12-04T05:36:40.926975+0000","last_active":"2023-12-04T05:36:41.897623+0000","last_peered":"2023-12-04T05:36:41.897623+0000","last_clean":"2023-12-04T05:36:41.897623+0000","last_became_active":"2023-12-04T05:36:40.926698+0000","last_became_peered":"2023-12-04T05:36:40.926698+0000","last_unstale":"2023-12-04T05:36:41.897623+0000","last_undegraded":"2023-12-04T05:36:41.897623+0000","last_fullsized":"2023-12-04T05:36:41.897623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899008+0000","last_change":"2023-12-04T05:36:40.898383+0000","last_active":"2023-12-04T05:36:41.899008+0000","last_peered":"2023-12-04T05:36:41.899008+0000","last_clean":"2023-12-04T05:36:41.899008+0000","last_became_active":"2023-12-04T05:36:40.898076+0000","last_became_peered":"2023-12-04T05:36:40.898076+0000","last_unstale":"2023-12-04T05:36:41.899008+0000","last_undegraded":"2023-12-04T05:36:41.899008+0000","last_fullsized":"2023-12-04T05:36:41.899008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:03.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727464+0000","last_change":"2023-12-04T05:36:40.917782+0000","last_active":"2023-12-04T05:36:43.727464+0000","last_peered":"2023-12-04T05:36:43.727464+0000","last_clean":"2023-12-04T05:36:43.727464+0000","last_became_active":"2023-12-04T05:36:40.917501+0000","last_became_peered":"2023-12-04T05:36:40.917501+0000","last_unstale":"2023-12-04T05:36:43.727464+0000","last_undegraded":"2023-12-04T05:36:43.727464+0000","last_fullsized":"2023-12-04T05:36:43.727464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465753+0000","last_change":"2023-12-04T05:36:40.914405+0000","last_active":"2023-12-04T05:36:43.465753+0000","last_peered":"2023-12-04T05:36:43.465753+0000","last_clean":"2023-12-04T05:36:43.465753+0000","last_became_active":"2023-12-04T05:36:40.913309+0000","last_became_peered":"2023-12-04T05:36:40.913309+0000","last_unstale":"2023-12-04T05:36:43.465753+0000","last_undegraded":"2023-12-04T05:36:43.465753+0000","last_fullsized":"2023-12-04T05:36:43.465753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:59.175301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894524+0000","last_change":"2023-12-04T05:36:40.913295+0000","last_active":"2023-12-04T05:36:41.894524+0000","last_peered":"2023-12-04T05:36:41.894524+0000","last_clean":"2023-12-04T05:36:41.894524+0000","last_became_active":"2023-12-04T05:36:40.913033+0000","last_became_peered":"2023-12-04T05:36:40.913033+0000","last_unstale":"2023-12-04T05:36:41.894524+0000","last_undegraded":"2023-12-04T05:36:41.894524+0000","last_fullsized":"2023-12-04T05:36:41.894524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863028+0000","last_change":"2023-12-04T05:36:40.919008+0000","last_active":"2023-12-04T05:36:43.863028+0000","last_peered":"2023-12-04T05:36:43.863028+0000","last_clean":"2023-12-04T05:36:43.863028+0000","last_became_active":"2023-12-04T05:36:40.918703+0000","last_became_peered":"2023-12-04T05:36:40.918703+0000","last_unstale":"2023-12-04T05:36:43.863028+0000","last_undegraded":"2023-12-04T05:36:43.863028+0000","last_fullsized":"2023-12-04T05:36:43.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864364+0000","last_change":"2023-12-04T05:36:40.924655+0000","last_active":"2023-12-04T05:36:43.864364+0000","last_peered":"2023-12-04T05:36:43.864364+0000","last_clean":"2023-12-04T05:36:43.864364+0000","last_became_active":"2023-12-04T05:36:40.924415+0000","last_became_peered":"2023-12-04T05:36:40.924415+0000","last_unstale":"2023-12-04T05:36:43.864364+0000","last_undegraded":"2023-12-04T05:36:43.864364+0000","last_fullsized":"2023-12-04T05:36:43.864364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:23:56.993089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.753453+0000","last_change":"2023-12-04T05:36:40.911088+0000","last_active":"2023-12-04T05:36:43.753453+0000","last_peered":"2023-12-04T05:36:43.753453+0000","last_clean":"2023-12-04T05:36:43.753453+0000","last_became_active":"2023-12-04T05:36:40.910145+0000","last_became_peered":"2023-12-04T05:36:40.910145+0000","last_unstale":"2023-12-04T05:36:43.753453+0000","last_undegraded":"2023-12-04T05:36:43.753453+0000","last_fullsized":"2023-12-04T05:36:43.753453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:15.664848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864078+0000","last_change":"2023-12-04T05:36:40.918175+0000","last_active":"2023-12-04T05:36:43.864078+0000","last_peered":"2023-12-04T05:36:43.864078+0000","last_clean":"2023-12-04T05:36:43.864078+0000","last_became_active":"2023-12-04T05:36:40.917878+0000","last_became_peered":"2023-12-04T05:36:40.917878+0000","last_unstale":"2023-12-04T05:36:43.864078+0000","last_undegraded":"2023-12-04T05:36:43.864078+0000","last_fullsized":"2023-12-04T05:36:43.864078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:00.972226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897513+0000","last_change":"2023-12-04T05:36:40.898605+0000","last_active":"2023-12-04T05:36:41.897513+0000","last_peered":"2023-12-04T05:36:41.897513+0000","last_clean":"2023-12-04T05:36:41.897513+0000","last_became_active":"2023-12-04T05:36:40.898258+0000","last_became_peered":"2023-12-04T05:36:40.898258+0000","last_unstale":"2023-12-04T05:36:41.897513+0000","last_undegraded":"2023-12-04T05:36:41.897513+0000","last_fullsized":"2023-12-04T05:36:41.897513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465886+0000","last_change":"2023-12-04T05:36:40.916797+0000","last_active":"2023-12-04T05:36:43.465886+0000","last_peered":"2023-12-04T05:36:43.465886+0000","last_clean":"2023-12-04T05:36:43.465886+0000","last_became_active":"2023-12-04T05:36:40.916495+0000","last_became_peered":"2023-12-04T05:36:40.916495+0000","last_unstale":"2023-12-04T05:36:43.465886+0000","last_undegraded":"2023-12-04T05:36:43.465886+0000","last_fullsized":"2023-12-04T05:36:43.465886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863484+0000","last_change":"2023-12-04T05:36:40.922172+0000","last_active":"2023-12-04T05:36:43.863484+0000","last_peered":"2023-12-04T05:36:43.863484+0000","last_clean":"2023-12-04T05:36:43.863484+0000","last_became_active":"2023-12-04T05:36:40.921340+0000","last_became_peered":"2023-12-04T05:36:40.921340+0000","last_unstale":"2023-12-04T05:36:43.863484+0000","last_undegraded":"2023-12-04T05:36:43.863484+0000","last_fullsized":"2023-12-04T05:36:43.863484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727281+0000","last_change":"2023-12-04T05:36:40.924182+0000","last_active":"2023-12-04T05:36:43.727281+0000","last_peered":"2023-12-04T05:36:43.727281+0000","last_clean":"2023-12-04T05:36:43.727281+0000","last_became_active":"2023-12-04T05:36:40.923964+0000","last_became_peered":"2023-12-04T05:36:40.923964+0000","last_unstale":"2023-12-04T05:36:43.727281+0000","last_undegraded":"2023-12-04T05:36:43.727281+0000","last_fullsized":"2023-12-04T05:36:43.727281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863190+0000","last_change":"2023-12-04T05:36:40.925487+0000","last_active":"2023-12-04T05:36:43.863190+0000","last_peered":"2023-12-04T05:36:43.863190+0000","last_clean":"2023-12-04T05:36:43.863190+0000","last_became_active":"2023-12-04T05:36:40.925100+0000","last_became_peered":"2023-12-04T05:36:40.925100+0000","last_unstale":"2023-12-04T05:36:43.863190+0000","last_undegraded":"2023-12-04T05:36:43.863190+0000","last_fullsized":"2023-12-04T05:36:43.863190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727678+0000","last_change":"2023-12-04T05:36:40.917356+0000","last_active":"2023-12-04T05:36:43.727678+0000","last_peered":"2023-12-04T05:36:43.727678+0000","last_clean":"2023-12-04T05:36:43.727678+0000","last_became_active":"2023-12-04T05:36:40.917079+0000","last_became_peered":"2023-12-04T05:36:40.917079+0000","last_unstale":"2023-12-04T05:36:43.727678+0000","last_undegraded":"2023-12-04T05:36:43.727678+0000","last_fullsized":"2023-12-04T05:36:43.727678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897895+0000","last_change":"2023-12-04T05:36:40.923445+0000","last_active":"2023-12-04T05:36:41.897895+0000","last_peered":"2023-12-04T05:36:41.897895+0000","last_clean":"2023-12-04T05:36:41.897895+0000","last_became_active":"2023-12-04T05:36:40.923197+0000","last_became_peered":"2023-12-04T05:36:40.923197+0000","last_unstale":"2023-12-04T05:36:41.897895+0000","last_undegraded":"2023-12-04T05:36:41.897895+0000","last_fullsized":"2023-12-04T05:36:41.897895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894822+0000","last_change":"2023-12-04T05:36:40.925226+0000","last_active":"2023-12-04T05:36:41.894822+0000","last_peered":"2023-12-04T05:36:41.894822+0000","last_clean":"2023-12-04T05:36:41.894822+0000","last_became_active":"2023-12-04T05:36:40.924880+0000","last_became_peered":"2023-12-04T05:36:40.924880+0000","last_unstale":"2023-12-04T05:36:41.894822+0000","last_undegraded":"2023-12-04T05:36:41.894822+0000","last_fullsized":"2023-12-04T05:36:41.894822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727712+0000","last_change":"2023-12-04T05:36:40.917579+0000","last_active":"2023-12-04T05:36:43.727712+0000","last_peered":"2023-12-04T05:36:43.727712+0000","last_clean":"2023-12-04T05:36:43.727712+0000","last_became_active":"2023-12-04T05:36:40.917049+0000","last_became_peered":"2023-12-04T05:36:40.917049+0000","last_unstale":"2023-12-04T05:36:43.727712+0000","last_undegraded":"2023-12-04T05:36:43.727712+0000","last_fullsized":"2023-12-04T05:36:43.727712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465920+0000","last_change":"2023-12-04T05:36:40.919114+0000","last_active":"2023-12-04T05:36:43.465920+0000","last_peered":"2023-12-04T05:36:43.465920+0000","last_clean":"2023-12-04T05:36:43.465920+0000","last_became_active":"2023-12-04T05:36:40.918821+0000","last_became_peered":"2023-12-04T05:36:40.918821+0000","last_unstale":"2023-12-04T05:36:43.465920+0000","last_undegraded":"2023-12-04T05:36:43.465920+0000","last_fullsized":"2023-12-04T05:36:43.465920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863607+0000","last_change":"2023-12-04T05:36:40.920720+0000","last_active":"2023-12-04T05:36:43.863607+0000","last_peered":"2023-12-04T05:36:43.863607+0000","last_clean":"2023-12-04T05:36:43.863607+0000","last_became_active":"2023-12-04T05:36:40.920392+0000","last_became_peered":"2023-12-04T05:36:40.920392+0000","last_unstale":"2023-12-04T05:36:43.863607+0000","last_undegraded":"2023-12-04T05:36:43.863607+0000","last_fullsized":"2023-12-04T05:36:43.863607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.753265+0000","last_change":"2023-12-04T05:36:40.920292+0000","last_active":"2023-12-04T05:36:43.753265+0000","last_peered":"2023-12-04T05:36:43.753265+0000","last_clean":"2023-12-04T05:36:43.753265+0000","last_became_active":"2023-12-04T05:36:40.919985+0000","last_became_peered":"2023-12-04T05:36:40.919985+0000","last_unstale":"2023-12-04T05:36:43.753265+0000","last_undegraded":"2023-12-04T05:36:43.753265+0000","last_fullsized":"2023-12-04T05:36:43.753265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897439+0000","last_change":"2023-12-04T05:36:40.902425+0000","last_active":"2023-12-04T05:36:41.897439+0000","last_peered":"2023-12-04T05:36:41.897439+0000","last_clean":"2023-12-04T05:36:41.897439+0000","last_became_active":"2023-12-04T05:36:40.902138+0000","last_became_peered":"2023-12-04T05:36:40.902138+0000","last_unstale":"2023-12-04T05:36:41.897439+0000","last_undegraded":"2023-12-04T05:36:41.897439+0000","last_fullsized":"2023-12-04T05:36:41.897439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.898859+0000","last_change":"2023-12-04T05:36:40.918990+0000","last_active":"2023-12-04T05:36:41.898859+0000","last_peered":"2023-12-04T05:36:41.898859+0000","last_clean":"2023-12-04T05:36:41.898859+0000","last_became_active":"2023-12-04T05:36:40.916920+0000","last_became_peered":"2023-12-04T05:36:40.916920+0000","last_unstale":"2023-12-04T05:36:41.898859+0000","last_undegraded":"2023-12-04T05:36:41.898859+0000","last_fullsized":"2023-12-04T05:36:41.898859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:08.543357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219057+0000","last_change":"2023-12-04T05:36:39.916724+0000","last_active":"2023-12-04T05:36:43.219057+0000","last_peered":"2023-12-04T05:36:43.219057+0000","last_clean":"2023-12-04T05:36:43.219057+0000","last_became_active":"2023-12-04T05:36:39.916408+0000","last_became_peered":"2023-12-04T05:36:39.916408+0000","last_unstale":"2023-12-04T05:36:43.219057+0000","last_undegraded":"2023-12-04T05:36:43.219057+0000","last_fullsized":"2023-12-04T05:36:43.219057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466049+0000","last_change":"2023-12-04T05:36:40.908915+0000","last_active":"2023-12-04T05:36:43.466049+0000","last_peered":"2023-12-04T05:36:43.466049+0000","last_clean":"2023-12-04T05:36:43.466049+0000","last_became_active":"2023-12-04T05:36:40.908571+0000","last_became_peered":"2023-12-04T05:36:40.908571+0000","last_unstale":"2023-12-04T05:36:43.466049+0000","last_undegraded":"2023-12-04T05:36:43.466049+0000","last_fullsized":"2023-12-04T05:36:43.466049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897458+0000","last_change":"2023-12-04T05:36:39.912675+0000","last_active":"2023-12-04T05:36:41.897458+0000","last_peered":"2023-12-04T05:36:41.897458+0000","last_clean":"2023-12-04T05:36:41.897458+0000","last_became_active":"2023-12-04T05:36:39.912299+0000","last_became_peered":"2023-12-04T05:36:39.912299+0000","last_unstale":"2023-12-04T05:36:41.897458+0000","last_undegraded":"2023-12-04T05:36:41.897458+0000","last_fullsized":"2023-12-04T05:36:41.897458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219010+0000","last_change":"2023-12-04T05:36:39.906738+0000","last_active":"2023-12-04T05:36:43.219010+0000","last_peered":"2023-12-04T05:36:43.219010+0000","last_clean":"2023-12-04T05:36:43.219010+0000","last_became_active":"2023-12-04T05:36:39.906463+0000","last_became_peered":"2023-12-04T05:36:39.906463+0000","last_unstale":"2023-12-04T05:36:43.219010+0000","last_undegraded":"2023-12-04T05:36:43.219010+0000","last_fullsized":"2023-12-04T05:36:43.219010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727303+0000","last_change":"2023-12-04T05:36:40.919035+0000","last_active":"2023-12-04T05:36:43.727303+0000","last_peered":"2023-12-04T05:36:43.727303+0000","last_clean":"2023-12-04T05:36:43.727303+0000","last_became_active":"2023-12-04T05:36:40.914346+0000","last_became_peered":"2023-12-04T05:36:40.914346+0000","last_unstale":"2023-12-04T05:36:43.727303+0000","last_undegraded":"2023-12-04T05:36:43.727303+0000","last_fullsized":"2023-12-04T05:36:43.727303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214888+0000","last_change":"2023-12-04T05:36:39.920898+0000","last_active":"2023-12-04T05:36:43.214888+0000","last_peered":"2023-12-04T05:36:43.214888+0000","last_clean":"2023-12-04T05:36:43.214888+0000","last_became_active":"2023-12-04T05:36:39.920625+0000","last_became_peered":"2023-12-04T05:36:39.920625+0000","last_unstale":"2023-12-04T05:36:43.214888+0000","last_undegraded":"2023-12-04T05:36:43.214888+0000","last_fullsized":"2023-12-04T05:36:43.214888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894571+0000","last_change":"2023-12-04T05:36:40.925470+0000","last_active":"2023-12-04T05:36:41.894571+0000","last_peered":"2023-12-04T05:36:41.894571+0000","last_clean":"2023-12-04T05:36:41.894571+0000","last_became_active":"2023-12-04T05:36:40.925129+0000","last_became_peered":"2023-12-04T05:36:40.925129+0000","last_unstale":"2023-12-04T05:36:41.894571+0000","last_undegraded":"2023-12-04T05:36:41.894571+0000","last_fullsized":"2023-12-04T05:36:41.894571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:27.133845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897835+0000","last_change":"2023-12-04T05:36:39.912643+0000","last_active":"2023-12-04T05:36:41.897835+0000","last_peered":"2023-12-04T05:36:41.897835+0000","last_clean":"2023-12-04T05:36:41.897835+0000","last_became_active":"2023-12-04T05:36:39.909337+0000","last_became_peered":"2023-12-04T05:36:39.909337+0000","last_unstale":"2023-12-04T05:36:41.897835+0000","last_undegraded":"2023-12-04T05:36:41.897835+0000","last_fullsized":"2023-12-04T05:36:41.897835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864128+0000","last_change":"2023-12-04T05:36:40.921153+0000","last_active":"2023-12-04T05:36:43.864128+0000","last_peered":"2023-12-04T05:36:43.864128+0000","last_clean":"2023-12-04T05:36:43.864128+0000","last_became_active":"2023-12-04T05:36:40.920456+0000","last_became_peered":"2023-12-04T05:36:40.920456+0000","last_unstale":"2023-12-04T05:36:43.864128+0000","last_undegraded":"2023-12-04T05:36:43.864128+0000","last_fullsized":"2023-12-04T05:36:43.864128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:21:40.711244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215094+0000","last_change":"2023-12-04T05:36:39.918009+0000","last_active":"2023-12-04T05:36:43.215094+0000","last_peered":"2023-12-04T05:36:43.215094+0000","last_clean":"2023-12-04T05:36:43.215094+0000","last_became_active":"2023-12-04T05:36:39.917694+0000","last_became_peered":"2023-12-04T05:36:39.917694+0000","last_unstale":"2023-12-04T05:36:43.215094+0000","last_undegraded":"2023-12-04T05:36:43.215094+0000","last_fullsized":"2023-12-04T05:36:43.215094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:22.492160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466140+0000","last_change":"2023-12-04T05:36:40.919239+0000","last_active":"2023-12-04T05:36:43.466140+0000","last_peered":"2023-12-04T05:36:43.466140+0000","last_clean":"2023-12-04T05:36:43.466140+0000","last_became_active":"2023-12-04T05:36:40.918774+0000","last_became_peered":"2023-12-04T05:36:40.918774+0000","last_unstale":"2023-12-04T05:36:43.466140+0000","last_undegraded":"2023-12-04T05:36:43.466140+0000","last_fullsized":"2023-12-04T05:36:43.466140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:55.741372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894788+0000","last_change":"2023-12-04T05:36:39.921145+0000","last_active":"2023-12-04T05:36:41.894788+0000","last_peered":"2023-12-04T05:36:41.894788+0000","last_clean":"2023-12-04T05:36:41.894788+0000","last_became_active":"2023-12-04T05:36:39.920191+0000","last_became_peered":"2023-12-04T05:36:39.920191+0000","last_unstale":"2023-12-04T05:36:41.894788+0000","last_undegraded":"2023-12-04T05:36:41.894788+0000","last_fullsized":"2023-12-04T05:36:41.894788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899199+0000","last_change":"2023-12-04T05:36:40.917431+0000","last_active":"2023-12-04T05:36:41.899199+0000","last_peered":"2023-12-04T05:36:41.899199+0000","last_clean":"2023-12-04T05:36:41.899199+0000","last_became_active":"2023-12-04T05:36:40.917118+0000","last_became_peered":"2023-12-04T05:36:40.917118+0000","last_unstale":"2023-12-04T05:36:41.899199+0000","last_undegraded":"2023-12-04T05:36:41.899199+0000","last_fullsized":"2023-12-04T05:36:41.899199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:17:05.976398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897552+0000","last_change":"2023-12-04T05:36:39.916187+0000","last_active":"2023-12-04T05:36:41.897552+0000","last_peered":"2023-12-04T05:36:41.897552+0000","last_clean":"2023-12-04T05:36:41.897552+0000","last_became_active":"2023-12-04T05:36:39.915832+0000","last_became_peered":"2023-12-04T05:36:39.915832+0000","last_unstale":"2023-12-04T05:36:41.897552+0000","last_undegraded":"2023-12-04T05:36:41.897552+0000","last_fullsized":"2023-12-04T05:36:41.897552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:20.435369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863701+0000","last_change":"2023-12-04T05:36:40.929289+0000","last_active":"2023-12-04T05:36:43.863701+0000","last_peered":"2023-12-04T05:36:43.863701+0000","last_clean":"2023-12-04T05:36:43.863701+0000","last_became_active":"2023-12-04T05:36:40.929006+0000","last_became_peered":"2023-12-04T05:36:40.929006+0000","last_unstale":"2023-12-04T05:36:43.863701+0000","last_undegraded":"2023-12-04T05:36:43.863701+0000","last_fullsized":"2023-12-04T05:36:43.863701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.216558+0000","last_change":"2023-12-04T05:36:39.909850+0000","last_active":"2023-12-04T05:36:43.216558+0000","last_peered":"2023-12-04T05:36:43.216558+0000","last_clean":"2023-12-04T05:36:43.216558+0000","last_became_active":"2023-12-04T05:36:39.909515+0000","last_became_peered":"2023-12-04T05:36:39.909515+0000","last_unstale":"2023-12-04T05:36:43.216558+0000","last_undegraded":"2023-12-04T05:36:43.216558+0000","last_fullsized":"2023-12-04T05:36:43.216558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465841+0000","last_change":"2023-12-04T05:36:40.917716+0000","last_active":"2023-12-04T05:36:43.465841+0000","last_peered":"2023-12-04T05:36:43.465841+0000","last_clean":"2023-12-04T05:36:43.465841+0000","last_became_active":"2023-12-04T05:36:40.917449+0000","last_became_peered":"2023-12-04T05:36:40.917449+0000","last_unstale":"2023-12-04T05:36:43.465841+0000","last_undegraded":"2023-12-04T05:36:43.465841+0000","last_fullsized":"2023-12-04T05:36:43.465841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214978+0000","last_change":"2023-12-04T05:36:39.919474+0000","last_active":"2023-12-04T05:36:43.214978+0000","last_peered":"2023-12-04T05:36:43.214978+0000","last_clean":"2023-12-04T05:36:43.214978+0000","last_became_active":"2023-12-04T05:36:39.919051+0000","last_became_peered":"2023-12-04T05:36:39.919051+0000","last_unstale":"2023-12-04T05:36:43.214978+0000","last_undegraded":"2023-12-04T05:36:43.214978+0000","last_fullsized":"2023-12-04T05:36:43.214978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:12.727217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863680+0000","last_change":"2023-12-04T05:36:40.919992+0000","last_active":"2023-12-04T05:36:43.863680+0000","last_peered":"2023-12-04T05:36:43.863680+0000","last_clean":"2023-12-04T05:36:43.863680+0000","last_became_active":"2023-12-04T05:36:40.919720+0000","last_became_peered":"2023-12-04T05:36:40.919720+0000","last_unstale":"2023-12-04T05:36:43.863680+0000","last_undegraded":"2023-12-04T05:36:43.863680+0000","last_fullsized":"2023-12-04T05:36:43.863680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:27.563724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897599+0000","last_change":"2023-12-04T05:36:39.908368+0000","last_active":"2023-12-04T05:36:41.897599+0000","last_peered":"2023-12-04T05:36:41.897599+0000","last_clean":"2023-12-04T05:36:41.897599+0000","last_became_active":"2023-12-04T05:36:39.907946+0000","last_became_peered":"2023-12-04T05:36:39.907946+0000","last_unstale":"2023-12-04T05:36:41.897599+0000","last_undegraded":"2023-12-04T05:36:41.897599+0000","last_fullsized":"2023-12-04T05:36:41.897599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897271+0000","last_change":"2023-12-04T05:36:40.907233+0000","last_active":"2023-12-04T05:36:41.897271+0000","last_peered":"2023-12-04T05:36:41.897271+0000","last_clean":"2023-12-04T05:36:41.897271+0000","last_became_active":"2023-12-04T05:36:40.906854+0000","last_became_peered":"2023-12-04T05:36:40.906854+0000","last_unstale":"2023-12-04T05:36:41.897271+0000","last_undegraded":"2023-12-04T05:36:41.897271+0000","last_fullsized":"2023-12-04T05:36:41.897271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:55.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218589+0000","last_change":"2023-12-04T05:36:39.901154+0000","last_active":"2023-12-04T05:36:43.218589+0000","last_peered":"2023-12-04T05:36:43.218589+0000","last_clean":"2023-12-04T05:36:43.218589+0000","last_became_active":"2023-12-04T05:36:39.900871+0000","last_became_peered":"2023-12-04T05:36:39.900871+0000","last_unstale":"2023-12-04T05:36:43.218589+0000","last_undegraded":"2023-12-04T05:36:43.218589+0000","last_fullsized":"2023-12-04T05:36:43.218589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863389+0000","last_change":"2023-12-04T05:36:40.918025+0000","last_active":"2023-12-04T05:36:43.863389+0000","last_peered":"2023-12-04T05:36:43.863389+0000","last_clean":"2023-12-04T05:36:43.863389+0000","last_became_active":"2023-12-04T05:36:40.917722+0000","last_became_peered":"2023-12-04T05:36:40.917722+0000","last_unstale":"2023-12-04T05:36:43.863389+0000","last_undegraded":"2023-12-04T05:36:43.863389+0000","last_fullsized":"2023-12-04T05:36:43.863389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899228+0000","last_change":"2023-12-04T05:36:39.913527+0000","last_active":"2023-12-04T05:36:41.899228+0000","last_peered":"2023-12-04T05:36:41.899228+0000","last_clean":"2023-12-04T05:36:41.899228+0000","last_became_active":"2023-12-04T05:36:39.911602+0000","last_became_peered":"2023-12-04T05:36:39.911602+0000","last_unstale":"2023-12-04T05:36:41.899228+0000","last_undegraded":"2023-12-04T05:36:41.899228+0000","last_fullsized":"2023-12-04T05:36:41.899228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:11:10.437590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863707+0000","last_change":"2023-12-04T05:36:40.926649+0000","last_active":"2023-12-04T05:36:43.863707+0000","last_peered":"2023-12-04T05:36:43.863707+0000","last_clean":"2023-12-04T05:36:43.863707+0000","last_became_active":"2023-12-04T05:36:40.926316+0000","last_became_peered":"2023-12-04T05:36:40.926316+0000","last_unstale":"2023-12-04T05:36:43.863707+0000","last_undegraded":"2023-12-04T05:36:43.863707+0000","last_fullsized":"2023-12-04T05:36:43.863707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:12:37.753470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218644+0000","last_change":"2023-12-04T05:36:39.915096+0000","last_active":"2023-12-04T05:36:43.218644+0000","last_peered":"2023-12-04T05:36:43.218644+0000","last_clean":"2023-12-04T05:36:43.218644+0000","last_became_active":"2023-12-04T05:36:39.914743+0000","last_became_peered":"2023-12-04T05:36:39.914743+0000","last_unstale":"2023-12-04T05:36:43.218644+0000","last_undegraded":"2023-12-04T05:36:43.218644+0000","last_fullsized":"2023-12-04T05:36:43.218644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:11:21.177051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.864406+0000","last_change":"2023-12-04T05:36:40.925949+0000","last_active":"2023-12-04T05:36:43.864406+0000","last_peered":"2023-12-04T05:36:43.864406+0000","last_clean":"2023-12-04T05:36:43.864406+0000","last_became_active":"2023-12-04T05:36:40.925684+0000","last_became_peered":"2023-12-04T05:36:40.925684+0000","last_unstale":"2023-12-04T05:36:43.864406+0000","last_undegraded":"2023-12-04T05:36:43.864406+0000","last_fullsized":"2023-12-04T05:36:43.864406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:50:32.538182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894872+0000","last_change":"2023-12-04T05:36:39.906214+0000","last_active":"2023-12-04T05:36:41.894872+0000","last_peered":"2023-12-04T05:36:41.894872+0000","last_clean":"2023-12-04T05:36:41.894872+0000","last_became_active":"2023-12-04T05:36:39.905868+0000","last_became_peered":"2023-12-04T05:36:39.905868+0000","last_unstale":"2023-12-04T05:36:41.894872+0000","last_undegraded":"2023-12-04T05:36:41.894872+0000","last_fullsized":"2023-12-04T05:36:41.894872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863781+0000","last_change":"2023-12-04T05:36:40.921297+0000","last_active":"2023-12-04T05:36:43.863781+0000","last_peered":"2023-12-04T05:36:43.863781+0000","last_clean":"2023-12-04T05:36:43.863781+0000","last_became_active":"2023-12-04T05:36:40.919804+0000","last_became_peered":"2023-12-04T05:36:40.919804+0000","last_unstale":"2023-12-04T05:36:43.863781+0000","last_undegraded":"2023-12-04T05:36:43.863781+0000","last_fullsized":"2023-12-04T05:36:43.863781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:40.225630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218625+0000","last_change":"2023-12-04T05:36:39.920708+0000","last_active":"2023-12-04T05:36:43.218625+0000","last_peered":"2023-12-04T05:36:43.218625+0000","last_clean":"2023-12-04T05:36:43.218625+0000","last_became_active":"2023-12-04T05:36:39.920411+0000","last_became_peered":"2023-12-04T05:36:39.920411+0000","last_unstale":"2023-12-04T05:36:43.218625+0000","last_undegraded":"2023-12-04T05:36:43.218625+0000","last_fullsized":"2023-12-04T05:36:43.218625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863847+0000","last_change":"2023-12-04T05:36:40.929211+0000","last_active":"2023-12-04T05:36:43.863847+0000","last_peered":"2023-12-04T05:36:43.863847+0000","last_clean":"2023-12-04T05:36:43.863847+0000","last_became_active":"2023-12-04T05:36:40.928878+0000","last_became_peered":"2023-12-04T05:36:40.928878+0000","last_unstale":"2023-12-04T05:36:43.863847+0000","last_undegraded":"2023-12-04T05:36:43.863847+0000","last_fullsized":"2023-12-04T05:36:43.863847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:24.731252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:40.907933+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:36:40.907933+0000","last_peered":"2023-12-04T05:36:40.907933+0000","last_clean":"2023-12-04T05:36:40.907933+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:36:40.907933+0000","last_undegraded":"2023-12-04T05:36:40.907933+0000","last_fullsized":"2023-12-04T05:36:40.907933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214997+0000","last_change":"2023-12-04T05:36:39.909994+0000","last_active":"2023-12-04T05:36:43.214997+0000","last_peered":"2023-12-04T05:36:43.214997+0000","last_clean":"2023-12-04T05:36:43.214997+0000","last_became_active":"2023-12-04T05:36:39.909676+0000","last_became_peered":"2023-12-04T05:36:39.909676+0000","last_unstale":"2023-12-04T05:36:43.214997+0000","last_undegraded":"2023-12-04T05:36:43.214997+0000","last_fullsized":"2023-12-04T05:36:43.214997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:26.127153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727445+0000","last_change":"2023-12-04T05:36:40.922315+0000","last_active":"2023-12-04T05:36:43.727445+0000","last_peered":"2023-12-04T05:36:43.727445+0000","last_clean":"2023-12-04T05:36:43.727445+0000","last_became_active":"2023-12-04T05:36:40.922017+0000","last_became_peered":"2023-12-04T05:36:40.922017+0000","last_unstale":"2023-12-04T05:36:43.727445+0000","last_undegraded":"2023-12-04T05:36:43.727445+0000","last_fullsized":"2023-12-04T05:36:43.727445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214961+0000","last_change":"2023-12-04T05:36:39.917047+0000","last_active":"2023-12-04T05:36:43.214961+0000","last_peered":"2023-12-04T05:36:43.214961+0000","last_clean":"2023-12-04T05:36:43.214961+0000","last_became_active":"2023-12-04T05:36:39.915737+0000","last_became_peered":"2023-12-04T05:36:39.915737+0000","last_unstale":"2023-12-04T05:36:43.214961+0000","last_undegraded":"2023-12-04T05:36:43.214961+0000","last_fullsized":"2023-12-04T05:36:43.214961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:22.256754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.465733+0000","last_change":"2023-12-04T05:36:40.909850+0000","last_active":"2023-12-04T05:36:43.465733+0000","last_peered":"2023-12-04T05:36:43.465733+0000","last_clean":"2023-12-04T05:36:43.465733+0000","last_became_active":"2023-12-04T05:36:40.908954+0000","last_became_peered":"2023-12-04T05:36:40.908954+0000","last_unstale":"2023-12-04T05:36:43.465733+0000","last_undegraded":"2023-12-04T05:36:43.465733+0000","last_fullsized":"2023-12-04T05:36:43.465733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:27.299383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218615+0000","last_change":"2023-12-04T05:36:39.900716+0000","last_active":"2023-12-04T05:36:43.218615+0000","last_peered":"2023-12-04T05:36:43.218615+0000","last_clean":"2023-12-04T05:36:43.218615+0000","last_became_active":"2023-12-04T05:36:39.898450+0000","last_became_peered":"2023-12-04T05:36:39.898450+0000","last_unstale":"2023-12-04T05:36:43.218615+0000","last_undegraded":"2023-12-04T05:36:43.218615+0000","last_fullsized":"2023-12-04T05:36:43.218615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894542+0000","last_change":"2023-12-04T05:36:40.912304+0000","last_active":"2023-12-04T05:36:41.894542+0000","last_peered":"2023-12-04T05:36:41.894542+0000","last_clean":"2023-12-04T05:36:41.894542+0000","last_became_active":"2023-12-04T05:36:40.912044+0000","last_became_peered":"2023-12-04T05:36:40.912044+0000","last_unstale":"2023-12-04T05:36:41.894542+0000","last_undegraded":"2023-12-04T05:36:41.894542+0000","last_fullsized":"2023-12-04T05:36:41.894542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:28.875447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214988+0000","last_change":"2023-12-04T05:36:39.911421+0000","last_active":"2023-12-04T05:36:43.214988+0000","last_peered":"2023-12-04T05:36:43.214988+0000","last_clean":"2023-12-04T05:36:43.214988+0000","last_became_active":"2023-12-04T05:36:39.910797+0000","last_became_peered":"2023-12-04T05:36:39.910797+0000","last_unstale":"2023-12-04T05:36:43.214988+0000","last_undegraded":"2023-12-04T05:36:43.214988+0000","last_fullsized":"2023-12-04T05:36:43.214988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899038+0000","last_change":"2023-12-04T05:36:40.902536+0000","last_active":"2023-12-04T05:36:41.899038+0000","last_peered":"2023-12-04T05:36:41.899038+0000","last_clean":"2023-12-04T05:36:41.899038+0000","last_became_active":"2023-12-04T05:36:40.902158+0000","last_became_peered":"2023-12-04T05:36:40.902158+0000","last_unstale":"2023-12-04T05:36:41.899038+0000","last_undegraded":"2023-12-04T05:36:41.899038+0000","last_fullsized":"2023-12-04T05:36:41.899038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:46:23.263446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894718+0000","last_change":"2023-12-04T05:36:39.911969+0000","last_active":"2023-12-04T05:36:41.894718+0000","last_peered":"2023-12-04T05:36:41.894718+0000","last_clean":"2023-12-04T05:36:41.894718+0000","last_became_active":"2023-12-04T05:36:39.911783+0000","last_became_peered":"2023-12-04T05:36:39.911783+0000","last_unstale":"2023-12-04T05:36:41.894718+0000","last_undegraded":"2023-12-04T05:36:41.894718+0000","last_fullsized":"2023-12-04T05:36:41.894718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863822+0000","last_change":"2023-12-04T05:36:40.925817+0000","last_active":"2023-12-04T05:36:43.863822+0000","last_peered":"2023-12-04T05:36:43.863822+0000","last_clean":"2023-12-04T05:36:43.863822+0000","last_became_active":"2023-12-04T05:36:40.925448+0000","last_became_peered":"2023-12-04T05:36:40.925448+0000","last_unstale":"2023-12-04T05:36:43.863822+0000","last_undegraded":"2023-12-04T05:36:43.863822+0000","last_fullsized":"2023-12-04T05:36:43.863822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:16:00.972226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215196+0000","last_change":"2023-12-04T05:36:39.921497+0000","last_active":"2023-12-04T05:36:43.215196+0000","last_peered":"2023-12-04T05:36:43.215196+0000","last_clean":"2023-12-04T05:36:43.215196+0000","last_became_active":"2023-12-04T05:36:39.921175+0000","last_became_peered":"2023-12-04T05:36:39.921175+0000","last_unstale":"2023-12-04T05:36:43.215196+0000","last_undegraded":"2023-12-04T05:36:43.215196+0000","last_fullsized":"2023-12-04T05:36:43.215196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:27:27.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894588+0000","last_change":"2023-12-04T05:36:40.913041+0000","last_active":"2023-12-04T05:36:41.894588+0000","last_peered":"2023-12-04T05:36:41.894588+0000","last_clean":"2023-12-04T05:36:41.894588+0000","last_became_active":"2023-12-04T05:36:40.912719+0000","last_became_peered":"2023-12-04T05:36:40.912719+0000","last_unstale":"2023-12-04T05:36:41.894588+0000","last_undegraded":"2023-12-04T05:36:41.894588+0000","last_fullsized":"2023-12-04T05:36:41.894588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.218464+0000","last_change":"2023-12-04T05:36:39.908161+0000","last_active":"2023-12-04T05:36:43.218464+0000","last_peered":"2023-12-04T05:36:43.218464+0000","last_clean":"2023-12-04T05:36:43.218464+0000","last_became_active":"2023-12-04T05:36:39.907857+0000","last_became_peered":"2023-12-04T05:36:39.907857+0000","last_unstale":"2023-12-04T05:36:43.218464+0000","last_undegraded":"2023-12-04T05:36:43.218464+0000","last_fullsized":"2023-12-04T05:36:43.218464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727640+0000","last_change":"2023-12-04T05:36:40.929459+0000","last_active":"2023-12-04T05:36:43.727640+0000","last_peered":"2023-12-04T05:36:43.727640+0000","last_clean":"2023-12-04T05:36:43.727640+0000","last_became_active":"2023-12-04T05:36:40.929278+0000","last_became_peered":"2023-12-04T05:36:40.929278+0000","last_unstale":"2023-12-04T05:36:43.727640+0000","last_undegraded":"2023-12-04T05:36:43.727640+0000","last_fullsized":"2023-12-04T05:36:43.727640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:57.793652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897952+0000","last_change":"2023-12-04T05:36:39.916327+0000","last_active":"2023-12-04T05:36:41.897952+0000","last_peered":"2023-12-04T05:36:41.897952+0000","last_clean":"2023-12-04T05:36:41.897952+0000","last_became_active":"2023-12-04T05:36:39.916042+0000","last_became_peered":"2023-12-04T05:36:39.916042+0000","last_unstale":"2023-12-04T05:36:41.897952+0000","last_undegraded":"2023-12-04T05:36:41.897952+0000","last_fullsized":"2023-12-04T05:36:41.897952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:29:58.168609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466163+0000","last_change":"2023-12-04T05:36:40.924060+0000","last_active":"2023-12-04T05:36:43.466163+0000","last_peered":"2023-12-04T05:36:43.466163+0000","last_clean":"2023-12-04T05:36:43.466163+0000","last_became_active":"2023-12-04T05:36:40.923821+0000","last_became_peered":"2023-12-04T05:36:40.923821+0000","last_unstale":"2023-12-04T05:36:43.466163+0000","last_undegraded":"2023-12-04T05:36:43.466163+0000","last_fullsized":"2023-12-04T05:36:43.466163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.214936+0000","last_change":"2023-12-04T05:36:39.921359+0000","last_active":"2023-12-04T05:36:43.214936+0000","last_peered":"2023-12-04T05:36:43.214936+0000","last_clean":"2023-12-04T05:36:43.214936+0000","last_became_active":"2023-12-04T05:36:39.921108+0000","last_became_peered":"2023-12-04T05:36:39.921108+0000","last_unstale":"2023-12-04T05:36:43.214936+0000","last_undegraded":"2023-12-04T05:36:43.214936+0000","last_fullsized":"2023-12-04T05:36:43.214936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:07.536665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.899095+0000","last_change":"2023-12-04T05:36:40.909278+0000","last_active":"2023-12-04T05:36:41.899095+0000","last_peered":"2023-12-04T05:36:41.899095+0000","last_clean":"2023-12-04T05:36:41.899095+0000","last_became_active":"2023-12-04T05:36:40.908988+0000","last_became_peered":"2023-12-04T05:36:40.908988+0000","last_unstale":"2023-12-04T05:36:41.899095+0000","last_undegraded":"2023-12-04T05:36:41.899095+0000","last_fullsized":"2023-12-04T05:36:41.899095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:51.762154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894616+0000","last_change":"2023-12-04T05:36:39.913809+0000","last_active":"2023-12-04T05:36:41.894616+0000","last_peered":"2023-12-04T05:36:41.894616+0000","last_clean":"2023-12-04T05:36:41.894616+0000","last_became_active":"2023-12-04T05:36:39.913417+0000","last_became_peered":"2023-12-04T05:36:39.913417+0000","last_unstale":"2023-12-04T05:36:41.894616+0000","last_undegraded":"2023-12-04T05:36:41.894616+0000","last_fullsized":"2023-12-04T05:36:41.894616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727378+0000","last_change":"2023-12-04T05:36:40.925195+0000","last_active":"2023-12-04T05:36:43.727378+0000","last_peered":"2023-12-04T05:36:43.727378+0000","last_clean":"2023-12-04T05:36:43.727378+0000","last_became_active":"2023-12-04T05:36:40.924744+0000","last_became_peered":"2023-12-04T05:36:40.924744+0000","last_unstale":"2023-12-04T05:36:43.727378+0000","last_undegraded":"2023-12-04T05:36:43.727378+0000","last_fullsized":"2023-12-04T05:36:43.727378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:43:23.498852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.894682+0000","last_change":"2023-12-04T05:36:39.904596+0000","last_active":"2023-12-04T05:36:41.894682+0000","last_peered":"2023-12-04T05:36:41.894682+0000","last_clean":"2023-12-04T05:36:41.894682+0000","last_became_active":"2023-12-04T05:36:39.904323+0000","last_became_peered":"2023-12-04T05:36:39.904323+0000","last_unstale":"2023-12-04T05:36:41.894682+0000","last_undegraded":"2023-12-04T05:36:41.894682+0000","last_fullsized":"2023-12-04T05:36:41.894682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727594+0000","last_change":"2023-12-04T05:36:40.917184+0000","last_active":"2023-12-04T05:36:43.727594+0000","last_peered":"2023-12-04T05:36:43.727594+0000","last_clean":"2023-12-04T05:36:43.727594+0000","last_became_active":"2023-12-04T05:36:40.916879+0000","last_became_peered":"2023-12-04T05:36:40.916879+0000","last_unstale":"2023-12-04T05:36:43.727594+0000","last_undegraded":"2023-12-04T05:36:43.727594+0000","last_fullsized":"2023-12-04T05:36:43.727594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:33:58.316819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215089+0000","last_change":"2023-12-04T05:36:39.918909+0000","last_active":"2023-12-04T05:36:43.215089+0000","last_peered":"2023-12-04T05:36:43.215089+0000","last_clean":"2023-12-04T05:36:43.215089+0000","last_became_active":"2023-12-04T05:36:39.918583+0000","last_became_peered":"2023-12-04T05:36:39.918583+0000","last_unstale":"2023-12-04T05:36:43.215089+0000","last_undegraded":"2023-12-04T05:36:43.215089+0000","last_fullsized":"2023-12-04T05:36:43.215089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:29:14.658156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:41.897340+0000","last_change":"2023-12-04T05:36:40.899019+0000","last_active":"2023-12-04T05:36:41.897340+0000","last_peered":"2023-12-04T05:36:41.897340+0000","last_clean":"2023-12-04T05:36:41.897340+0000","last_became_active":"2023-12-04T05:36:40.898523+0000","last_became_peered":"2023-12-04T05:36:40.898523+0000","last_unstale":"2023-12-04T05:36:41.897340+0000","last_undegraded":"2023-12-04T05:36:41.897340+0000","last_fullsized":"2023-12-04T05:36:41.897340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:13.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863645+0000","last_change":"2023-12-04T05:36:40.918106+0000","last_active":"2023-12-04T05:36:43.863645+0000","last_peered":"2023-12-04T05:36:43.863645+0000","last_clean":"2023-12-04T05:36:43.863645+0000","last_became_active":"2023-12-04T05:36:40.917745+0000","last_became_peered":"2023-12-04T05:36:40.917745+0000","last_unstale":"2023-12-04T05:36:43.863645+0000","last_undegraded":"2023-12-04T05:36:43.863645+0000","last_fullsized":"2023-12-04T05:36:43.863645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:24.731252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215112+0000","last_change":"2023-12-04T05:36:39.924371+0000","last_active":"2023-12-04T05:36:43.215112+0000","last_peered":"2023-12-04T05:36:43.215112+0000","last_clean":"2023-12-04T05:36:43.215112+0000","last_became_active":"2023-12-04T05:36:39.924054+0000","last_became_peered":"2023-12-04T05:36:39.924054+0000","last_unstale":"2023-12-04T05:36:43.215112+0000","last_undegraded":"2023-12-04T05:36:43.215112+0000","last_fullsized":"2023-12-04T05:36:43.215112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:02.726002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.863632+0000","last_change":"2023-12-04T05:36:40.917939+0000","last_active":"2023-12-04T05:36:43.863632+0000","last_peered":"2023-12-04T05:36:43.863632+0000","last_clean":"2023-12-04T05:36:43.863632+0000","last_became_active":"2023-12-04T05:36:40.917669+0000","last_became_peered":"2023-12-04T05:36:40.917669+0000","last_unstale":"2023-12-04T05:36:43.863632+0000","last_undegraded":"2023-12-04T05:36:43.863632+0000","last_fullsized":"2023-12-04T05:36:43.863632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.215173+0000","last_change":"2023-12-04T05:36:39.920721+0000","last_active":"2023-12-04T05:36:43.215173+0000","last_peered":"2023-12-04T05:36:43.215173+0000","last_clean":"2023-12-04T05:36:43.215173+0000","last_became_active":"2023-12-04T05:36:39.920453+0000","last_became_peered":"2023-12-04T05:36:39.920453+0000","last_unstale":"2023-12-04T05:36:43.215173+0000","last_undegraded":"2023-12-04T05:36:43.215173+0000","last_fullsized":"2023-12-04T05:36:43.215173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:54.898788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.466119+0000","last_change":"2023-12-04T05:36:40.919075+0000","last_active":"2023-12-04T05:36:43.466119+0000","last_peered":"2023-12-04T05:36:43.466119+0000","last_clean":"2023-12-04T05:36:43.466119+0000","last_became_active":"2023-12-04T05:36:40.918364+0000","last_became_peered":"2023-12-04T05:36:40.918364+0000","last_unstale":"2023-12-04T05:36:43.466119+0000","last_undegraded":"2023-12-04T05:36:43.466119+0000","last_fullsized":"2023-12-04T05:36:43.466119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:06:24.981796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.219084+0000","last_change":"2023-12-04T05:36:39.920745+0000","last_active":"2023-12-04T05:36:43.219084+0000","last_peered":"2023-12-04T05:36:43.219084+0000","last_clean":"2023-12-04T05:36:43.219084+0000","last_became_active":"2023-12-04T05:36:39.920421+0000","last_became_peered":"2023-12-04T05:36:39.920421+0000","last_unstale":"2023-12-04T05:36:43.219084+0000","last_undegraded":"2023-12-04T05:36:43.219084+0000","last_fullsized":"2023-12-04T05:36:43.219084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:43:26.292691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.727692+0000","last_change":"2023-12-04T05:36:40.920955+0000","last_active":"2023-12-04T05:36:43.727692+0000","last_peered":"2023-12-04T05:36:43.727692+0000","last_clean":"2023-12-04T05:36:43.727692+0000","last_became_active":"2023-12-04T05:36:40.920651+0000","last_became_peered":"2023-12-04T05:36:40.920651+0000","last_unstale":"2023-12-04T05:36:43.727692+0000","last_undegraded":"2023-12-04T05:36:43.727692+0000","last_fullsized":"2023-12-04T05:36:43.727692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:39.878306+0000","last_clean_scrub_stamp":"2023-12-04T05:36:39.878306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:40:46.092900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-04T05:36:43.216615+0000","last_change":"2023-12-04T05:36:39.913939+0000","last_active":"2023-12-04T05:36:43.216615+0000","last_peered":"2023-12-04T05:36:43.216615+0000","last_clean":"2023-12-04T05:36:43.216615+0000","last_became_active":"2023-12-04T05:36:39.913586+0000","last_became_peered":"2023-12-04T05:36:39.913586+0000","last_unstale":"2023-12-04T05:36:43.216615+0000","last_undegraded":"2023-12-04T05:36:43.216615+0000","last_fullsized":"2023-12-04T05:36:43.216615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:38.871614+0000","last_clean_scrub_stamp":"2023-12-04T05:36:38.871614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:02.229027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:36:49.996 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-04T05:36:49.996 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-04T05:36:49.996 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-04T05:36:49.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-04T05:36:50.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 Processor -- start 2023-12-04T05:36:50.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 -- start start 2023-12-04T05:36:50.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81c00c7ef0 0x7f81c0154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c01547d0 con 0x7f81c0158630 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c0158b80 con 0x7f81c0151bf0 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81c58ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00c4aa0 con 0x7f81c00c7ef0 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81be7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81c00c7ef0 0x7f81c0154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81bf7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f81c0158630 0x7f81c015efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41840/0 (socket says 172.21.15.97:41840) 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81bf7fe640 1 -- 172.21.15.97:0/3623605511 learned_addr learned my addr 172.21.15.97:0/3623605511 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81bdffb640 1 -- 172.21.15.97:0/3623605511 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779997114 0 0) 0x7f81c01547d0 con 0x7f81c0158630 2023-12-04T05:36:50.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81be7fc640 1 -- 172.21.15.97:0/3623605511 >> v1:172.21.15.143:6789/0 conn(0x7f81c0151bf0 legacy=0x7f81c00abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81be7fc640 1 -- 172.21.15.97:0/3623605511 >> v1:172.21.15.97:6789/0 conn(0x7f81c0158630 legacy=0x7f81c015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.171+0000 7f81be7fc640 1 -- 172.21.15.97:0/3623605511 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00c4d40 con 0x7f81c00c7ef0 2023-12-04T05:36:50.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81be7fc640 1 --2- 172.21.15.97:0/3623605511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c0154c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097c0 tx=0x7f81b401c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb71fca60363f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81bdffb640 1 -- 172.21.15.97:0/3623605511 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40a4770 con 0x7f81c00c7ef0 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81bdffb640 1 -- 172.21.15.97:0/3623605511 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b40a48d0 con 0x7f81c00c7ef0 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81bdffb640 1 -- 172.21.15.97:0/3623605511 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40a4c60 con 0x7f81c00c7ef0 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 -- 172.21.15.97:0/3623605511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 msgr2=0x7f81c0154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3623605511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c0154c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097c0 tx=0x7f81b401c040 comp rx=0 tx=0).stop 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 -- 172.21.15.97:0/3623605511 shutdown_connections 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3623605511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c0154c60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 -- 172.21.15.97:0/3623605511 >> 172.21.15.97:0/3623605511 conn(0x7f81c0073550 msgr2=0x7f81c0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 -- 172.21.15.97:0/3623605511 shutdown_connections 2023-12-04T05:36:50.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.175+0000 7f81c58ea640 1 -- 172.21.15.97:0/3623605511 wait complete. 2023-12-04T05:36:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 Processor -- start 2023-12-04T05:36:50.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- start start 2023-12-04T05:36:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c00aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81c0158630 0x7f81c014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c014e5e0 con 0x7f81c0151bf0 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00c42d0 con 0x7f81c00c7ef0 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c014a690 con 0x7f81c0158630 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50254/0 (socket says 172.21.15.97:50254) 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 -- 172.21.15.97:0/3392141880 learned_addr learned my addr 172.21.15.97:0/3392141880 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81beffd640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c00aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81bf7fe640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81c0158630 0x7f81c014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 -- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81c0158630 msgr2=0x7f81c014bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81c0158630 0x7f81c014bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 -- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 msgr2=0x7f81c00aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c00aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 -- 172.21.15.97:0/3392141880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009420 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81be7fc640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81b4018f70 tx=0x7f81b4019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40ac640 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b40ac7c0 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c014db00 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40acb70 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.179+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c014e0c0 con 0x7f81c0151bf0 2023-12-04T05:36:50.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c0068440 con 0x7f81c0151bf0 2023-12-04T05:36:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f81b40b3040 con 0x7f81c0151bf0 2023-12-04T05:36:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81a7fff640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 0x7f81ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b411db50 con 0x7f81c0151bf0 2023-12-04T05:36:50.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81beffd640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 0x7f81ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.183+0000 7f81beffd640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 0x7f81ac068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81c0154780 tx=0x7f81b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.191+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81b40ead20 con 0x7f81c0151bf0 2023-12-04T05:36:50.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.375+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81c00cab80 con 0x7f81c0151bf0 2023-12-04T05:36:50.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81a7fff640 1 -- 172.21.15.97:0/3392141880 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f81b40b1040 con 0x7f81c0151bf0 2023-12-04T05:36:50.380 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:50.380 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-04T05:36:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 msgr2=0x7f81ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 0x7f81ac068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81c0154780 tx=0x7f81b0009040 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 msgr2=0x7f81c014b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81b4018f70 tx=0x7f81b4019100 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 shutdown_connections 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f81ac0668d0 0x7f81ac068d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81c0158630 0x7f81c014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81c0151bf0 0x7f81c014b660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 --2- 172.21.15.97:0/3392141880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81c00c7ef0 0x7f81c00aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 >> 172.21.15.97:0/3392141880 conn(0x7f81c0073550 msgr2=0x7f81c00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 shutdown_connections 2023-12-04T05:36:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.379+0000 7f81c58ea640 1 -- 172.21.15.97:0/3392141880 wait complete. 2023-12-04T05:36:50.402 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-04T05:36:50.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:50.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 Processor -- start 2023-12-04T05:36:50.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 -- start start 2023-12-04T05:36:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea01547d0 con 0x7f7ea00c7ef0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea0158b80 con 0x7f7ea0151bf0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7ea5e9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00c4aa0 con 0x7f7ea0155370 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7ea00c7ef0 0x7f7ea0154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41844/0 (socket says 172.21.15.97:41844) 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9effd640 1 -- 172.21.15.97:0/3316355915 learned_addr learned my addr 172.21.15.97:0/3316355915 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9ffff640 1 --2- 172.21.15.97:0/3316355915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606578933 0 0) 0x7f7ea01547d0 con 0x7f7ea00c7ef0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e88003530 con 0x7f7ea00c7ef0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304482619 0 0) 0x7f7ea0158b80 con 0x7f7ea0151bf0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea01547d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9ffff640 1 -- 172.21.15.97:0/3316355915 >> v1:172.21.15.143:6789/0 conn(0x7f7ea0151bf0 legacy=0x7f7ea00abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9ffff640 1 -- 172.21.15.97:0/3316355915 >> v1:172.21.15.97:6789/0 conn(0x7f7ea00c7ef0 legacy=0x7f7ea0154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.539+0000 7f7e9ffff640 1 -- 172.21.15.97:0/3316355915 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00c4d40 con 0x7f7ea0155370 2023-12-04T05:36:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7e9ffff640 1 --2- 172.21.15.97:0/3316355915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea015ffc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009dc0 tx=0x7f7e9801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c76105944a9040 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980a4d80 con 0x7f7ea0155370 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e980ac440 con 0x7f7ea0155370 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7e9e7fc640 1 -- 172.21.15.97:0/3316355915 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ac7b0 con 0x7f7ea0155370 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/3316355915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 msgr2=0x7f7ea015ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/3316355915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea015ffc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009dc0 tx=0x7f7e9801c530 comp rx=0 tx=0).stop 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/3316355915 shutdown_connections 2023-12-04T05:36:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/3316355915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea015ffc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/3316355915 >> 172.21.15.97:0/3316355915 conn(0x7f7ea0073550 msgr2=0x7f7ea0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/3316355915 shutdown_connections 2023-12-04T05:36:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.543+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/3316355915 wait complete. 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 Processor -- start 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 -- start start 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00c7ef0 0x7f7ea00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea0146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01eec80 con 0x7f7ea0151bf0 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00ad0c0 con 0x7f7ea00c7ef0 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7ea5e9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01f1400 con 0x7f7ea0155370 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50268/0 (socket says 172.21.15.97:50268) 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 -- 172.21.15.97:0/2910529017 learned_addr learned my addr 172.21.15.97:0/2910529017 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9f7fe640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00c7ef0 0x7f7ea00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9ffff640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea0146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 -- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 msgr2=0x7f7ea0146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea0146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 -- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00c7ef0 msgr2=0x7f7ea00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00c7ef0 0x7f7ea00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 -- 172.21.15.97:0/2910529017 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009a70 con 0x7f7ea0151bf0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e9effd640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005890 tx=0x7f7e9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005cf0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94005e50 con 0x7f7ea0151bf0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.547+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940072d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea01ee6e0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea01ee9a0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea01f11d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7e94007430 con 0x7f7ea0151bf0 2023-12-04T05:36:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7e87fff640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 0x7f7e8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.551+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e940838f0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.555+0000 7f7e9f7fe640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 0x7f7e8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.555+0000 7f7e9f7fe640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 0x7f7e8c068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e900011f0 tx=0x7f7e90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.555+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ea01f11d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ea01f11d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7e87fff640 1 -- 172.21.15.97:0/2910529017 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f7ea01f11d0 con 0x7f7ea0151bf0 2023-12-04T05:36:50.714 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:50.714 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 msgr2=0x7f7e8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 0x7f7e8c068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e900011f0 tx=0x7f7e90009040 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 msgr2=0x7f7ea01f1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005890 tx=0x7f7e9400c8b0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 shutdown_connections 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e8c0668d0 0x7f7e8c068d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ea0155370 0x7f7ea0146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ea0151bf0 0x7f7ea01f1890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 --2- 172.21.15.97:0/2910529017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea00c7ef0 0x7f7ea00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.711+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 >> 172.21.15.97:0/2910529017 conn(0x7f7ea0073550 msgr2=0x7f7ea0147510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.715+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 shutdown_connections 2023-12-04T05:36:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.715+0000 7f7ea5e9a640 1 -- 172.21.15.97:0/2910529017 wait complete. 2023-12-04T05:36:50.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:36:50.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:36:50.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.871+0000 7fb182c17640 1 Processor -- start 2023-12-04T05:36:50.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb182c17640 1 -- start start 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb182c17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb17c0c1e70 0x7fb17c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb182c17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0aa240 con 0x7fb17c06c440 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb182c17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0aa500 con 0x7fb17c06d210 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb182c17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c06c0c0 con 0x7fb17c0c1e70 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb173fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb17c06c440 0x7fb17c0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41846/0 (socket says 172.21.15.97:41846) 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb173fff640 1 -- 172.21.15.97:0/2551205205 learned_addr learned my addr 172.21.15.97:0/2551205205 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1809b3640 1 --2- 172.21.15.97:0/2551205205 >> v2:172.21.15.143:3300/0 conn(0x7fb17c0c1e70 0x7fb17c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346983778 0 0) 0x7fb17c0aa240 con 0x7fb17c06c440 2023-12-04T05:36:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb164003530 con 0x7fb17c06c440 2023-12-04T05:36:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1809b3640 1 -- 172.21.15.97:0/2551205205 >> v1:172.21.15.143:6789/0 conn(0x7fb17c06d210 legacy=0x7fb17c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1809b3640 1 -- 172.21.15.97:0/2551205205 >> v1:172.21.15.97:6789/0 conn(0x7fb17c06c440 legacy=0x7fb17c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443385556 0 0) 0x7fb164003530 con 0x7fb17c06c440 2023-12-04T05:36:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.875+0000 7fb1809b3640 1 -- 172.21.15.97:0/2551205205 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0aa7e0 con 0x7fb17c0c1e70 2023-12-04T05:36:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb1809b3640 1 --2- 172.21.15.97:0/2551205205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0c1e70 0x7fb17c1524e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097c0 tx=0x7fb17801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e9293cdd801848f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c001680 con 0x7fb17c0c1e70 2023-12-04T05:36:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780a7050 con 0x7fb17c0c1e70 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb1737fe640 1 -- 172.21.15.97:0/2551205205 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780ab620 con 0x7fb17c0c1e70 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- 172.21.15.97:0/2551205205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0c1e70 msgr2=0x7fb17c1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 --2- 172.21.15.97:0/2551205205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0c1e70 0x7fb17c1524e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097c0 tx=0x7fb17801c370 comp rx=0 tx=0).stop 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- 172.21.15.97:0/2551205205 shutdown_connections 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 --2- 172.21.15.97:0/2551205205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0c1e70 0x7fb17c1524e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- 172.21.15.97:0/2551205205 >> 172.21.15.97:0/2551205205 conn(0x7fb17c0c5e70 msgr2=0x7fb17c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- 172.21.15.97:0/2551205205 shutdown_connections 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- 172.21.15.97:0/2551205205 wait complete. 2023-12-04T05:36:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 Processor -- start 2023-12-04T05:36:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.879+0000 7fb182c17640 1 -- start start 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c06c440 0x7fb17c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0c1e70 0x7fb17c0bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c142800 con 0x7fb17c06d210 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c14f420 con 0x7fb17c06c440 2023-12-04T05:36:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c14e150 con 0x7fb17c0c1e70 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50270/0 (socket says 172.21.15.97:50270) 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 -- 172.21.15.97:0/3479854540 learned_addr learned my addr 172.21.15.97:0/3479854540 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb1809b3640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c06c440 0x7fb17c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb1811b4640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0c1e70 0x7fb17c0bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 -- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0c1e70 msgr2=0x7fb17c0bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0c1e70 0x7fb17c0bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 -- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c06c440 msgr2=0x7fb17c1422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c06c440 0x7fb17c1422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 -- 172.21.15.97:0/3479854540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178009420 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb173fff640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c780 tx=0x7fb16c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c005ae0 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c005c60 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c141fe0 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c007070 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0bfa40 con 0x7fb17c06d210 2023-12-04T05:36:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.883+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c14d0f0 con 0x7fb17c06d210 2023-12-04T05:36:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.887+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb16c0071d0 con 0x7fb17c06d210 2023-12-04T05:36:50.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.887+0000 7fb1717fa640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 0x7fb168068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:50.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.887+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb16c083aa0 con 0x7fb17c06d210 2023-12-04T05:36:50.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.887+0000 7fb1809b3640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 0x7fb168068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.887+0000 7fb1809b3640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 0x7fb168068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ad000 tx=0x7fb178008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:50.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:50.891+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb16c050e40 con 0x7fb17c06d210 2023-12-04T05:36:51.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.039+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb17c14cf10 con 0x7fb17c06d210 2023-12-04T05:36:51.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.039+0000 7fb1717fa640 1 -- 172.21.15.97:0/3479854540 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb17c14cf10 con 0x7fb17c06d210 2023-12-04T05:36:51.042 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:36:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 msgr2=0x7fb168068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 0x7fb168068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ad000 tx=0x7fb178008040 comp rx=0 tx=0).stop 2023-12-04T05:36:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 msgr2=0x7fb17c0bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c780 tx=0x7fb16c00cc40 comp rx=0 tx=0).stop 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 shutdown_connections 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb168066900 0x7fb168068dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0c1e70 0x7fb17c0bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb17c06d210 0x7fb17c0bf500 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 --2- 172.21.15.97:0/3479854540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c06c440 0x7fb17c1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 >> 172.21.15.97:0/3479854540 conn(0x7fb17c0c5e70 msgr2=0x7fb17c0c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 shutdown_connections 2023-12-04T05:36:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.043+0000 7fb182c17640 1 -- 172.21.15.97:0/3479854540 wait complete. 2023-12-04T05:36:51.063 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:36:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 Processor -- start 2023-12-04T05:36:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 -- start start 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 0x7f93ec155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c6bb0 0x7f93ec1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93ec0c4770 0x7f93ec0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0c5680 con 0x7f93ec0c4770 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0c6ff0 con 0x7f93ec0c67d0 2023-12-04T05:36:51.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1f34640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c4bf0 con 0x7f93ec0c6bb0 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93ec0c4770 0x7f93ec0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f93ec0c4770 0x7f93ec0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50278/0 (socket says 172.21.15.97:50278) 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 -- 172.21.15.97:0/3650503002 learned_addr learned my addr 172.21.15.97:0/3650503002 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f0f32640 1 --2- 172.21.15.97:0/3650503002 >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 0x7f93ec155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93ebfff640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c6bb0 0x7f93ec1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 -- 172.21.15.97:0/3650503002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c6bb0 msgr2=0x7f93ec1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c6bb0 0x7f93ec1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 -- 172.21.15.97:0/3650503002 >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 msgr2=0x7f93ec155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 --2- 172.21.15.97:0/3650503002 >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 0x7f93ec155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f1733640 1 -- 172.21.15.97:0/3650503002 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0c5180 con 0x7f93ec0c4770 2023-12-04T05:36:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.203+0000 7f93f0f32640 1 --2- 172.21.15.97:0/3650503002 >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 0x7f93ec155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1733640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec0c7f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0c4260 tx=0x7f93e401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeec9c37a47c77a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93eb7fe640 1 -- 172.21.15.97:0/3650503002 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40a5740 con 0x7f93ec0c4770 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93eb7fe640 1 -- 172.21.15.97:0/3650503002 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40a58a0 con 0x7f93ec0c4770 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93eb7fe640 1 -- 172.21.15.97:0/3650503002 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40a5c30 con 0x7f93ec0c4770 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 -- 172.21.15.97:0/3650503002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 msgr2=0x7f93ec0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec0c7f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0c4260 tx=0x7f93e401c9d0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 -- 172.21.15.97:0/3650503002 shutdown_connections 2023-12-04T05:36:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c6bb0 0x7f93ec1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3650503002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec0c7f10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3650503002 >> v2:172.21.15.143:3300/0 conn(0x7f93ec0c67d0 0x7f93ec155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 -- 172.21.15.97:0/3650503002 >> 172.21.15.97:0/3650503002 conn(0x7f93ec0ab980 msgr2=0x7f93ec0abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 -- 172.21.15.97:0/3650503002 shutdown_connections 2023-12-04T05:36:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 -- 172.21.15.97:0/3650503002 wait complete. 2023-12-04T05:36:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.207+0000 7f93f1f34640 1 Processor -- start 2023-12-04T05:36:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- start start 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c67d0 0x7f93ec0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0c6bb0 0x7f93ec0c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c3900 con 0x7f93ec0c4770 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c0ec0 con 0x7f93ec0c6bb0 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c13f0 con 0x7f93ec0c67d0 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50282/0 (socket says 172.21.15.97:50282) 2023-12-04T05:36:51.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 -- 172.21.15.97:0/3577849919 learned_addr learned my addr 172.21.15.97:0/3577849919 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1733640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0c6bb0 0x7f93ec0c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93ebfff640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c67d0 0x7f93ec0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 -- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c67d0 msgr2=0x7f93ec0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c67d0 0x7f93ec0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 -- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0c6bb0 msgr2=0x7f93ec0c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0c6bb0 0x7f93ec0c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 -- 172.21.15.97:0/3577849919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009420 con 0x7f93ec0c4770 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f0f32640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93e000e900 tx=0x7f93e000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0009660 con 0x7f93ec0c4770 2023-12-04T05:36:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000ca00 con 0x7f93ec0c4770 2023-12-04T05:36:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000cd90 con 0x7f93ec0c4770 2023-12-04T05:36:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e4009b30 con 0x7f93ec0c4770 2023-12-04T05:36:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0c1110 con 0x7f93ec0c4770 2023-12-04T05:36:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.211+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec151af0 con 0x7f93ec0c4770 2023-12-04T05:36:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.215+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93e0013470 con 0x7f93ec0c4770 2023-12-04T05:36:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.215+0000 7f93e97fa640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 0x7f93d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.215+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93e0084550 con 0x7f93ec0c4770 2023-12-04T05:36:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.215+0000 7f93ebfff640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 0x7f93d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.215+0000 7f93ebfff640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 0x7f93d0068dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93ec14c320 tx=0x7f93d8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.219+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93e0051830 con 0x7f93ec0c4770 2023-12-04T05:36:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.367+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93ec04e890 con 0x7f93ec0c4770 2023-12-04T05:36:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.367+0000 7f93e97fa640 1 -- 172.21.15.97:0/3577849919 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93e0054e50 con 0x7f93ec0c4770 2023-12-04T05:36:51.372 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 msgr2=0x7f93d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 0x7f93d0068dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f93ec14c320 tx=0x7f93d8009190 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 msgr2=0x7f93ec1f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93e000e900 tx=0x7f93e000edc0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 shutdown_connections 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f93d0066900 0x7f93d0068dc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93ec0c6bb0 0x7f93ec0c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f93ec0c67d0 0x7f93ec0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 --2- 172.21.15.97:0/3577849919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93ec0c4770 0x7f93ec1f0b00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 >> 172.21.15.97:0/3577849919 conn(0x7f93ec0ab980 msgr2=0x7f93ec0abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 shutdown_connections 2023-12-04T05:36:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.371+0000 7f93f1f34640 1 -- 172.21.15.97:0/3577849919 wait complete. 2023-12-04T05:36:51.392 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:36:51.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 Processor -- start 2023-12-04T05:36:51.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 -- start start 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6678151f10 0x7f66780c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66780cac10 0x7f667815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66780ca780 con 0x7f66780c7f00 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6678158cc0 con 0x7f6678151f10 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667cb0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66780c5700 con 0x7f66780cac10 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6678151f10 0x7f66780c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6678151f10 0x7f66780c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50286/0 (socket says 172.21.15.97:50286) 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 -- 172.21.15.97:0/4166808223 learned_addr learned my addr 172.21.15.97:0/4166808223 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f6676d9d640 1 --2- 172.21.15.97:0/4166808223 >> v2:172.21.15.143:3300/0 conn(0x7f66780cac10 0x7f667815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 -- 172.21.15.97:0/4166808223 >> v2:172.21.15.143:3300/0 conn(0x7f66780cac10 msgr2=0x7f667815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:51.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 --2- 172.21.15.97:0/4166808223 >> v2:172.21.15.143:3300/0 conn(0x7f66780cac10 0x7f667815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 -- 172.21.15.97:0/4166808223 >> v1:172.21.15.143:6789/0 conn(0x7f66780c7f00 legacy=0x7f6678154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.531+0000 7f667659c640 1 -- 172.21.15.97:0/4166808223 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678158720 con 0x7f6678151f10 2023-12-04T05:36:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667659c640 1 --2- 172.21.15.97:0/4166808223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66780c4980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f667806bcd0 tx=0x7f666801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62afc22e776374a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667559a640 1 -- 172.21.15.97:0/4166808223 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680ac410 con 0x7f6678151f10 2023-12-04T05:36:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667559a640 1 -- 172.21.15.97:0/4166808223 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680ac570 con 0x7f6678151f10 2023-12-04T05:36:51.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667559a640 1 -- 172.21.15.97:0/4166808223 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680ac900 con 0x7f6678151f10 2023-12-04T05:36:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 -- 172.21.15.97:0/4166808223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 msgr2=0x7f66780c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 --2- 172.21.15.97:0/4166808223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66780c4980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f667806bcd0 tx=0x7f666801c3b0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 -- 172.21.15.97:0/4166808223 shutdown_connections 2023-12-04T05:36:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 --2- 172.21.15.97:0/4166808223 >> v2:172.21.15.143:3300/0 conn(0x7f66780cac10 0x7f667815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 --2- 172.21.15.97:0/4166808223 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66780c4980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 -- 172.21.15.97:0/4166808223 >> 172.21.15.97:0/4166808223 conn(0x7f6678073950 msgr2=0x7f6678073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 -- 172.21.15.97:0/4166808223 shutdown_connections 2023-12-04T05:36:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 -- 172.21.15.97:0/4166808223 wait complete. 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.535+0000 7f667cb0f640 1 Processor -- start 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- start start 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66780c7f00 0x7f667814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66780cac10 0x7f6678155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66781f1120 con 0x7f6678151f10 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667814f1b0 con 0x7f66780cac10 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667814c480 con 0x7f66780c7f00 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66780c7f00 0x7f667814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50302/0 (socket says 172.21.15.97:50302) 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 -- 172.21.15.97:0/1809056488 learned_addr learned my addr 172.21.15.97:0/1809056488 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6675d9b640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66780cac10 0x7f6678155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 -- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66780c7f00 msgr2=0x7f667814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66780c7f00 0x7f667814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 -- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66780cac10 msgr2=0x7f6678155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66780cac10 0x7f6678155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 -- 172.21.15.97:0/1809056488 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680094d0 con 0x7f6678151f10 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6676d9d640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6670007e30 tx=0x7f667000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670014620 con 0x7f6678151f10 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000ee90 con 0x7f6678151f10 2023-12-04T05:36:51.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66781f0e40 con 0x7f6678151f10 2023-12-04T05:36:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66700149c0 con 0x7f6678151f10 2023-12-04T05:36:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6678155f40 con 0x7f6678151f10 2023-12-04T05:36:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.539+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6678068440 con 0x7f6678151f10 2023-12-04T05:36:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.543+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6670014b20 con 0x7f6678151f10 2023-12-04T05:36:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.543+0000 7f6666ffd640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 0x7f6658068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.543+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6670084c90 con 0x7f6678151f10 2023-12-04T05:36:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.543+0000 7f667659c640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 0x7f6658068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.543+0000 7f667659c640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 0x7f6658068dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66680ae000 tx=0x7f6668008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.547+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6670051f70 con 0x7f6678151f10 2023-12-04T05:36:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.695+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f667814e920 con 0x7f6678151f10 2023-12-04T05:36:51.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.695+0000 7f6666ffd640 1 -- 172.21.15.97:0/1809056488 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6670055590 con 0x7f6678151f10 2023-12-04T05:36:51.699 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:36:51.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 msgr2=0x7f6658068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 0x7f6658068dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66680ae000 tx=0x7f6668008040 comp rx=0 tx=0).stop 2023-12-04T05:36:51.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 msgr2=0x7f66781f0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6670007e30 tx=0x7f667000e4b0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 shutdown_connections 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6658066900 0x7f6658068dc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6678151f10 0x7f66781f0440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66780cac10 0x7f6678155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 --2- 172.21.15.97:0/1809056488 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66780c7f00 0x7f667814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 >> 172.21.15.97:0/1809056488 conn(0x7f6678073950 msgr2=0x7f66780c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 shutdown_connections 2023-12-04T05:36:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.699+0000 7f667cb0f640 1 -- 172.21.15.97:0/1809056488 wait complete. 2023-12-04T05:36:51.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:51.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 Processor -- start 2023-12-04T05:36:51.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 -- start start 2023-12-04T05:36:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 0x7fb24c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 0x7fb24c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c1550f0 con 0x7fb24c151cb0 2023-12-04T05:36:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0c52b0 con 0x7fb24c0c4740 2023-12-04T05:36:51.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb251fd0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c5590 con 0x7fb24c0c4c50 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb24bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 0x7fb24c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb2517cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 0x7fb24c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb24bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 0x7fb24c0c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:48420/0 (socket says 172.21.15.97:48420) 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb24bfff640 1 -- 172.21.15.97:0/1791771326 learned_addr learned my addr 172.21.15.97:0/1791771326 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb2517cf640 1 -- 172.21.15.97:0/1791771326 >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 msgr2=0x7fb24c0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb2517cf640 1 --2- 172.21.15.97:0/1791771326 >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 0x7fb24c0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb2517cf640 1 -- 172.21.15.97:0/1791771326 >> v1:172.21.15.143:6789/0 conn(0x7fb24c151cb0 legacy=0x7fb24c06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.855+0000 7fb2517cf640 1 -- 172.21.15.97:0/1791771326 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0c5870 con 0x7fb24c0c4c50 2023-12-04T05:36:51.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb2517cf640 1 --2- 172.21.15.97:0/1791771326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 0x7fb24c15ee50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb244009d90 tx=0x7fb24401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8424545d49ae4cf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb24b7fe640 1 -- 172.21.15.97:0/1791771326 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440a5800 con 0x7fb24c0c4c50 2023-12-04T05:36:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb24b7fe640 1 -- 172.21.15.97:0/1791771326 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2440a5960 con 0x7fb24c0c4c50 2023-12-04T05:36:51.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb24b7fe640 1 -- 172.21.15.97:0/1791771326 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440a5cf0 con 0x7fb24c0c4c50 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 -- 172.21.15.97:0/1791771326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 msgr2=0x7fb24c15ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 --2- 172.21.15.97:0/1791771326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 0x7fb24c15ee50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb244009d90 tx=0x7fb24401c830 comp rx=0 tx=0).stop 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 -- 172.21.15.97:0/1791771326 shutdown_connections 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 --2- 172.21.15.97:0/1791771326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c0c4c50 0x7fb24c15ee50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 --2- 172.21.15.97:0/1791771326 >> v2:172.21.15.143:3300/0 conn(0x7fb24c0c4740 0x7fb24c0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 -- 172.21.15.97:0/1791771326 >> 172.21.15.97:0/1791771326 conn(0x7fb24c0ab8b0 msgr2=0x7fb24c0abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 -- 172.21.15.97:0/1791771326 shutdown_connections 2023-12-04T05:36:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.859+0000 7fb251fd0640 1 -- 172.21.15.97:0/1791771326 wait complete. 2023-12-04T05:36:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 Processor -- start 2023-12-04T05:36:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- start start 2023-12-04T05:36:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb24c0c4c50 0x7fb24c0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c151cb0 0x7fb24c0c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c155d20 con 0x7fb24c0c4740 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1f1c40 con 0x7fb24c0c4c50 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c14ec20 con 0x7fb24c151cb0 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50306/0 (socket says 172.21.15.97:50306) 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 -- 172.21.15.97:0/3364934308 learned_addr learned my addr 172.21.15.97:0/3364934308 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb24bfff640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb24c0c4c50 0x7fb24c0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb2517cf640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c151cb0 0x7fb24c0c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 -- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c151cb0 msgr2=0x7fb24c0c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c151cb0 0x7fb24c0c1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 -- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb24c0c4c50 msgr2=0x7fb24c0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb24c0c4c50 0x7fb24c0c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 -- 172.21.15.97:0/3364934308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244009a70 con 0x7fb24c0c4740 2023-12-04T05:36:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb250fce640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c3c0 tx=0x7fb24000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400052d0 con 0x7fb24c0c4740 2023-12-04T05:36:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240005430 con 0x7fb24c0c4740 2023-12-04T05:36:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240003840 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c0c7ed0 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c1f18d0 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.863+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c04e890 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.867+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2400039a0 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.867+0000 7fb2497fa640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 0x7fb230068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.867+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2400838b0 con 0x7fb24c0c4740 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.867+0000 7fb24bfff640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 0x7fb230068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.867+0000 7fb24bfff640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 0x7fb230068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0c2e50 tx=0x7fb238009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:51.871+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb240050ba0 con 0x7fb24c0c4740 2023-12-04T05:36:52.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb24c0c82b0 con 0x7fb24c0c4740 2023-12-04T05:36:52.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb2497fa640 1 -- 172.21.15.97:0/3364934308 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb240017090 con 0x7fb24c0c4740 2023-12-04T05:36:52.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:52.054 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:36:52.054 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:36:52.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 msgr2=0x7fb230068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 0x7fb230068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0c2e50 tx=0x7fb238009240 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 msgr2=0x7fb24c1f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c3c0 tx=0x7fb24000c880 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 shutdown_connections 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2300668d0 0x7fb230068d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb24c151cb0 0x7fb24c0c1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb24c0c4c50 0x7fb24c0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 --2- 172.21.15.97:0/3364934308 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb24c0c4740 0x7fb24c1f20d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 >> 172.21.15.97:0/3364934308 conn(0x7fb24c0ab8b0 msgr2=0x7fb24c1534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 shutdown_connections 2023-12-04T05:36:52.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.051+0000 7fb251fd0640 1 -- 172.21.15.97:0/3364934308 wait complete. 2023-12-04T05:36:52.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:52.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 Processor -- start 2023-12-04T05:36:52.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 -- start start 2023-12-04T05:36:52.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7ab414fbb0 0x7f7ab40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40a9770 con 0x7f7ab40a88e0 2023-12-04T05:36:52.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab4071730 con 0x7f7ab40a8460 2023-12-04T05:36:52.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7abac79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab414ff90 con 0x7f7ab414fbb0 2023-12-04T05:36:52.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7ab9216640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7ab40a88e0 0x7f7ab4152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41858/0 (socket says 172.21.15.97:41858) 2023-12-04T05:36:52.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7ab9216640 1 -- 172.21.15.97:0/1399904823 learned_addr learned my addr 172.21.15.97:0/1399904823 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:52.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.211+0000 7f7ab8a15640 1 --2- 172.21.15.97:0/1399904823 >> v2:172.21.15.143:3300/0 conn(0x7f7ab414fbb0 0x7f7ab40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134878393 0 0) 0x7f7ab40a9770 con 0x7f7ab40a88e0 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c003530 con 0x7f7ab40a88e0 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109380094 0 0) 0x7f7ab4071730 con 0x7f7ab40a8460 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab40a9770 con 0x7f7ab40a8460 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7ab8a15640 1 -- 172.21.15.97:0/1399904823 >> v1:172.21.15.143:6789/0 conn(0x7f7ab40a8460 legacy=0x7f7ab4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7ab8a15640 1 -- 172.21.15.97:0/1399904823 >> v1:172.21.15.97:6789/0 conn(0x7f7ab40a88e0 legacy=0x7f7ab4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7ab8a15640 1 -- 172.21.15.97:0/1399904823 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4071a10 con 0x7f7ab414fbb0 2023-12-04T05:36:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7ab8a15640 1 --2- 172.21.15.97:0/1399904823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab40a8f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097c0 tx=0x7f7ab001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8bba8c5ed9fec82 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00ab600 con 0x7f7ab414fbb0 2023-12-04T05:36:52.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab00a7050 con 0x7f7ab414fbb0 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7aab7fe640 1 -- 172.21.15.97:0/1399904823 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00ab960 con 0x7f7ab414fbb0 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7abac79640 1 -- 172.21.15.97:0/1399904823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 msgr2=0x7f7ab40a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7abac79640 1 --2- 172.21.15.97:0/1399904823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab40a8f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00097c0 tx=0x7f7ab001c360 comp rx=0 tx=0).stop 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7abac79640 1 -- 172.21.15.97:0/1399904823 shutdown_connections 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7abac79640 1 --2- 172.21.15.97:0/1399904823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab40a8f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.215+0000 7f7abac79640 1 -- 172.21.15.97:0/1399904823 >> 172.21.15.97:0/1399904823 conn(0x7f7ab40c2970 msgr2=0x7f7ab40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- 172.21.15.97:0/1399904823 shutdown_connections 2023-12-04T05:36:52.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- 172.21.15.97:0/1399904823 wait complete. 2023-12-04T05:36:52.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 Processor -- start 2023-12-04T05:36:52.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- start start 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ab40a8460 0x7f7ab41f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab41ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4140c80 con 0x7f7ab40a88e0 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4140f60 con 0x7f7ab414fbb0 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7abac79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41f0190 con 0x7f7ab40a8460 2023-12-04T05:36:52.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50310/0 (socket says 172.21.15.97:50310) 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 -- 172.21.15.97:0/266604207 learned_addr learned my addr 172.21.15.97:0/266604207 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7ab8a15640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ab40a8460 0x7f7ab41f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7ab9216640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab41ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 -- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ab40a8460 msgr2=0x7f7ab41f0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ab40a8460 0x7f7ab41f0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 -- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 msgr2=0x7f7ab41ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab41ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 -- 172.21.15.97:0/266604207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0009420 con 0x7f7ab40a88e0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7ab9216640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab41ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.219+0000 7f7aabfff640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c430 tx=0x7f7aa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40052d0 con 0x7f7ab40a88e0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4005450 con 0x7f7ab40a88e0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4003840 con 0x7f7ab40a88e0 2023-12-04T05:36:52.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab41f0470 con 0x7f7ab40a88e0 2023-12-04T05:36:52.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40bfa40 con 0x7f7ab40a88e0 2023-12-04T05:36:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4068440 con 0x7f7ab40a88e0 2023-12-04T05:36:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7aa40039a0 con 0x7f7ab40a88e0 2023-12-04T05:36:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 0x7f7aa0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aa4083940 con 0x7f7ab40a88e0 2023-12-04T05:36:52.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7ab8a15640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 0x7f7aa0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.223+0000 7f7ab8a15640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 0x7f7aa0068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ad000 tx=0x7f7ab00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.227+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7aa4050c20 con 0x7f7ab40a88e0 2023-12-04T05:36:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.379+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ab41f0920 con 0x7f7ab40a88e0 2023-12-04T05:36:52.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7aa97fa640 1 -- 172.21.15.97:0/266604207 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f7aa4017090 con 0x7f7ab40a88e0 2023-12-04T05:36:52.385 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:52.385 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 msgr2=0x7f7aa0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 0x7f7aa0068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ad000 tx=0x7f7ab00a6000 comp rx=0 tx=0).stop 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 msgr2=0x7f7ab40bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c430 tx=0x7f7aa400c8f0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 shutdown_connections 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7aa0066900 0x7f7aa0068dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ab414fbb0 0x7f7ab41ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ab40a88e0 0x7f7ab40bf500 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 --2- 172.21.15.97:0/266604207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ab40a8460 0x7f7ab41f0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 >> 172.21.15.97:0/266604207 conn(0x7f7ab40c2970 msgr2=0x7f7ab414e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 shutdown_connections 2023-12-04T05:36:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.383+0000 7f7abac79640 1 -- 172.21.15.97:0/266604207 wait complete. 2023-12-04T05:36:52.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:36:52.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:36:52.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.543+0000 7f17aee5a640 1 Processor -- start 2023-12-04T05:36:52.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.543+0000 7f17aee5a640 1 -- start start 2023-12-04T05:36:52.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17aee5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17a814eb30 0x7f17a814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17aee5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a8154640 con 0x7f17a8154fe0 2023-12-04T05:36:52.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17aee5a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a814ef10 con 0x7f17a814f790 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17aee5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a80c0bd0 con 0x7f17a814eb30 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17a814eb30 0x7f17a814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17a814eb30 0x7f17a814f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50326/0 (socket says 172.21.15.97:50326) 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 -- 172.21.15.97:0/1506798543 learned_addr learned my addr 172.21.15.97:0/1506798543 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 -- 172.21.15.97:0/1506798543 >> v1:172.21.15.143:6789/0 conn(0x7f17a814f790 legacy=0x7f17a81548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 -- 172.21.15.97:0/1506798543 >> v1:172.21.15.97:6789/0 conn(0x7f17a8154fe0 legacy=0x7f17a815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.547+0000 7f17acbf6640 1 -- 172.21.15.97:0/1506798543 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a81535a0 con 0x7f17a814eb30 2023-12-04T05:36:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17acbf6640 1 --2- 172.21.15.97:0/1506798543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a814f250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22948f4484421e12 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f179f7fe640 1 -- 172.21.15.97:0/1506798543 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40aa670 con 0x7f17a814eb30 2023-12-04T05:36:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f179f7fe640 1 -- 172.21.15.97:0/1506798543 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a40aa7d0 con 0x7f17a814eb30 2023-12-04T05:36:52.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f179f7fe640 1 -- 172.21.15.97:0/1506798543 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40aab60 con 0x7f17a814eb30 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- 172.21.15.97:0/1506798543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 msgr2=0x7f17a814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 --2- 172.21.15.97:0/1506798543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a814f250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a401c510 comp rx=0 tx=0).stop 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- 172.21.15.97:0/1506798543 shutdown_connections 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 --2- 172.21.15.97:0/1506798543 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a814f250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- 172.21.15.97:0/1506798543 >> 172.21.15.97:0/1506798543 conn(0x7f17a80c5e70 msgr2=0x7f17a80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- 172.21.15.97:0/1506798543 shutdown_connections 2023-12-04T05:36:52.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- 172.21.15.97:0/1506798543 wait complete. 2023-12-04T05:36:52.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 Processor -- start 2023-12-04T05:36:52.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- start start 2023-12-04T05:36:52.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 0x7f17a8146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 0x7f17a8147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81417a0 con 0x7f17a814eb30 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a8141fb0 con 0x7f17a8154fe0 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17aee5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81413b0 con 0x7f17a814f790 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17acbf6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17acbf6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50338/0 (socket says 172.21.15.97:50338) 2023-12-04T05:36:52.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.551+0000 7f17acbf6640 1 -- 172.21.15.97:0/4269298679 learned_addr learned my addr 172.21.15.97:0/4269298679 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:52.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17ad3f7640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 0x7f17a8147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179ffff640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 0x7f17a8146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 -- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 msgr2=0x7f17a8146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 0x7f17a8146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 -- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 msgr2=0x7f17a8147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 0x7f17a8147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 -- 172.21.15.97:0/4269298679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40094d0 con 0x7f17a814eb30 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179ffff640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 0x7f17a8146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17ad3f7640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 0x7f17a8147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17acbf6640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17a40ac040 tx=0x7f17a401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b38c0 con 0x7f17a814eb30 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a40b3a40 con 0x7f17a814eb30 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a814fd20 con 0x7f17a814eb30 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b3df0 con 0x7f17a814eb30 2023-12-04T05:36:52.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a8141cd0 con 0x7f17a814eb30 2023-12-04T05:36:52.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a8068440 con 0x7f17a814eb30 2023-12-04T05:36:52.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f17a40b2380 con 0x7f17a814eb30 2023-12-04T05:36:52.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.555+0000 7f179d7fa640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 0x7f1794068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.559+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17a411ed90 con 0x7f17a814eb30 2023-12-04T05:36:52.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.559+0000 7f179ffff640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 0x7f1794068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.559+0000 7f179ffff640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 0x7f1794068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17a80c02e0 tx=0x7f1798009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.559+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17a40ec080 con 0x7f17a814eb30 2023-12-04T05:36:52.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17a8140070 con 0x7f17a814eb30 2023-12-04T05:36:52.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f179d7fa640 1 -- 172.21.15.97:0/4269298679 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17a40c30a0 con 0x7f17a814eb30 2023-12-04T05:36:52.718 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 msgr2=0x7f1794068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 0x7f1794068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f17a80c02e0 tx=0x7f1798009040 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 msgr2=0x7f17a8143c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17a40ac040 tx=0x7f17a401ad50 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 shutdown_connections 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17940668d0 0x7f1794068d90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17a8154fe0 0x7f17a8147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17a814f790 0x7f17a8146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 --2- 172.21.15.97:0/4269298679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17a814eb30 0x7f17a8143c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 >> 172.21.15.97:0/4269298679 conn(0x7f17a80c5e70 msgr2=0x7f17a806da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 shutdown_connections 2023-12-04T05:36:52.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.715+0000 7f17aee5a640 1 -- 172.21.15.97:0/4269298679 wait complete. 2023-12-04T05:36:52.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:36:52.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 Processor -- start 2023-12-04T05:36:52.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 -- start start 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 0x7fa894155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa89406b600 0x7fa89406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa894152b60 con 0x7fa89406ec90 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940a9b30 con 0x7fa89406b600 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.875+0000 7fa898ee3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa894156100 con 0x7fa89414fd00 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa89406b600 0x7fa89406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa89406b600 0x7fa89406ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50348/0 (socket says 172.21.15.97:50348) 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 -- 172.21.15.97:0/3695432670 learned_addr learned my addr 172.21.15.97:0/3695432670 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa89259c640 1 --2- 172.21.15.97:0/3695432670 >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 0x7fa894155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 -- 172.21.15.97:0/3695432670 >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 msgr2=0x7fa894155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:52.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 --2- 172.21.15.97:0/3695432670 >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 0x7fa894155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 -- 172.21.15.97:0/3695432670 >> v1:172.21.15.143:6789/0 conn(0x7fa89406ec90 legacy=0x7fa894152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:52.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 -- 172.21.15.97:0/3695432670 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940abc80 con 0x7fa89406b600 2023-12-04T05:36:52.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa89259c640 1 --2- 172.21.15.97:0/3695432670 >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 0x7fa894155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:52.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa892d9d640 1 --2- 172.21.15.97:0/3695432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa89406ba70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa894072ca0 tx=0x7fa88c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d2935cd04932b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa891d9b640 1 -- 172.21.15.97:0/3695432670 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0ab600 con 0x7fa89406b600 2023-12-04T05:36:52.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa891d9b640 1 -- 172.21.15.97:0/3695432670 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0a7050 con 0x7fa89406b600 2023-12-04T05:36:52.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.879+0000 7fa891d9b640 1 -- 172.21.15.97:0/3695432670 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0ab980 con 0x7fa89406b600 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- 172.21.15.97:0/3695432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 msgr2=0x7fa89406ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3695432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa89406ba70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa894072ca0 tx=0x7fa88c01c430 comp rx=0 tx=0).stop 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- 172.21.15.97:0/3695432670 shutdown_connections 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3695432670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa89406ba70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3695432670 >> v2:172.21.15.143:3300/0 conn(0x7fa89414fd00 0x7fa894155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- 172.21.15.97:0/3695432670 >> 172.21.15.97:0/3695432670 conn(0x7fa8940c31c0 msgr2=0x7fa8940c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- 172.21.15.97:0/3695432670 shutdown_connections 2023-12-04T05:36:52.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- 172.21.15.97:0/3695432670 wait complete. 2023-12-04T05:36:52.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 Processor -- start 2023-12-04T05:36:52.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- start start 2023-12-04T05:36:52.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa89406ec90 0x7fa8941ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa89414fd00 0x7fa8941eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894153e50 con 0x7fa89406b600 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894152100 con 0x7fa89414fd00 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa898ee3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941552b0 con 0x7fa89406ec90 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50360/0 (socket says 172.21.15.97:50360) 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 -- 172.21.15.97:0/3622648993 learned_addr learned my addr 172.21.15.97:0/3622648993 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa889d9b640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa89406ec90 0x7fa8941ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa892d9d640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa89414fd00 0x7fa8941eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 -- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa89406ec90 msgr2=0x7fa8941ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa89406ec90 0x7fa8941ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 -- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa89414fd00 msgr2=0x7fa8941eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.883+0000 7fa89259c640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa89414fd00 0x7fa8941eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa89259c640 1 -- 172.21.15.97:0/3622648993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0094d0 con 0x7fa89406b600 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa89259c640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa884007ef0 tx=0x7fa88400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884003ba0 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400f040 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894155550 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400de80 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894155b10 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8941ed6d0 con 0x7fa89406b600 2023-12-04T05:36:52.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa884004030 con 0x7fa89406b600 2023-12-04T05:36:52.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.887+0000 7fa88b7fe640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 0x7fa874068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:52.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.891+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa884084740 con 0x7fa89406b600 2023-12-04T05:36:52.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.891+0000 7fa889d9b640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 0x7fa874068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:52.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.891+0000 7fa889d9b640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 0x7fa874068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8941493e0 tx=0x7fa87c007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:52.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:52.895+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa884051990 con 0x7fa89406b600 2023-12-04T05:36:53.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.043+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa894068440 con 0x7fa89406b600 2023-12-04T05:36:53.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.043+0000 7fa88b7fe640 1 -- 172.21.15.97:0/3622648993 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa88401a020 con 0x7fa89406b600 2023-12-04T05:36:53.047 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 msgr2=0x7fa874068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 0x7fa874068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8941493e0 tx=0x7fa87c007e40 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 msgr2=0x7fa894071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa884007ef0 tx=0x7fa88400d4a0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 shutdown_connections 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa874066900 0x7fa874068dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa89414fd00 0x7fa8941eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa89406ec90 0x7fa8941ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 --2- 172.21.15.97:0/3622648993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa89406b600 0x7fa894071d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 >> 172.21.15.97:0/3622648993 conn(0x7fa8940c31c0 msgr2=0x7fa8940bfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 shutdown_connections 2023-12-04T05:36:53.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.047+0000 7fa898ee3640 1 -- 172.21.15.97:0/3622648993 wait complete. 2023-12-04T05:36:53.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:36:53.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.207+0000 7f4277caa640 1 Processor -- start 2023-12-04T05:36:53.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 -- start start 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f42700c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4270158800 0x7f427006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4270158c60 con 0x7f42700c1fb0 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4270154880 con 0x7f4270158800 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4277caa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427006e160 con 0x7f4270072800 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f42700c1fb0 0x7f4270155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41886/0 (socket says 172.21.15.97:41886) 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 -- 172.21.15.97:0/3510998323 learned_addr learned my addr 172.21.15.97:0/3510998323 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4276247640 1 --2- 172.21.15.97:0/3510998323 >> v2:172.21.15.143:3300/0 conn(0x7f4270158800 0x7f427006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275245640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f42700c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208932784 0 0) 0x7f4270158c60 con 0x7f42700c1fb0 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f425c003530 con 0x7f42700c1fb0 2023-12-04T05:36:53.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4126700846 0 0) 0x7f425c003530 con 0x7f42700c1fb0 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 msgr2=0x7f42700c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f42700c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 >> v2:172.21.15.143:3300/0 conn(0x7f4270158800 msgr2=0x7f427006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 --2- 172.21.15.97:0/3510998323 >> v2:172.21.15.143:3300/0 conn(0x7f4270158800 0x7f427006b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427006e440 con 0x7f42700c1fb0 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f426c001680 con 0x7f42700c1fb0 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 >> v1:172.21.15.97:6789/0 conn(0x7f42700c1fb0 legacy=0x7f4270155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f425c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f425c0047d0 0x7f425c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f425c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270154880 con 0x7f425c003980 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427006e160 con 0x7f425c0047d0 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c00ba10 con 0x7f4270072800 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f425c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4276247640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f425c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275245640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f425c0047d0 0x7f425c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 -- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 msgr2=0x7f425c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4270072800 0x7f425c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 -- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f425c0047d0 msgr2=0x7f425c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f425c0047d0 0x7f425c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275a46640 1 -- 172.21.15.97:0/3510998323 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c003530 con 0x7f425c003980 2023-12-04T05:36:53.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.211+0000 7f4275245640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f425c0047d0 0x7f425c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4275a46640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f425c003da0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c240 tx=0x7f426c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de9c1c9a3bd7743 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0058e0 con 0x7f425c003980 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c005a40 con 0x7f425c003980 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4274a44640 1 -- 172.21.15.97:0/3510998323 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c005e30 con 0x7f425c003980 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 -- 172.21.15.97:0/3510998323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 msgr2=0x7f425c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 --2- 172.21.15.97:0/3510998323 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f425c003da0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c240 tx=0x7f426c01cc30 comp rx=0 tx=0).stop 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4276247640 1 -- 172.21.15.97:0/3510998323 reap_dead start 2023-12-04T05:36:53.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 -- 172.21.15.97:0/3510998323 shutdown_connections 2023-12-04T05:36:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 -- 172.21.15.97:0/3510998323 >> 172.21.15.97:0/3510998323 conn(0x7f42700c31c0 msgr2=0x7f42700c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 -- 172.21.15.97:0/3510998323 shutdown_connections 2023-12-04T05:36:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.215+0000 7f4277caa640 1 -- 172.21.15.97:0/3510998323 wait complete. 2023-12-04T05:36:53.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 Processor -- start 2023-12-04T05:36:53.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- start start 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42701ee340 0x7f427014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4270149680 0x7f4270149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427014c520 con 0x7f425c003980 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701ee840 con 0x7f4270149680 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700c5f20 con 0x7f42701ee340 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50378/0 (socket says 172.21.15.97:50378) 2023-12-04T05:36:53.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 -- 172.21.15.97:0/2263909584 learned_addr learned my addr 172.21.15.97:0/2263909584 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:53.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4276247640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4270149680 0x7f4270149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275245640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42701ee340 0x7f427014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 -- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42701ee340 msgr2=0x7f427014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42701ee340 0x7f427014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 -- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4270149680 msgr2=0x7f4270149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4270149680 0x7f4270149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 -- 172.21.15.97:0/2263909584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270152820 con 0x7f425c003980 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4275a46640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c240 tx=0x7f425c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c005e90 con 0x7f425c003980 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c0a5820 con 0x7f425c003980 2023-12-04T05:36:53.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4270152b00 con 0x7f425c003980 2023-12-04T05:36:53.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c0a5bb0 con 0x7f425c003980 2023-12-04T05:36:53.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.219+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427014f2d0 con 0x7f425c003980 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4270152d40 con 0x7f425c003980 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f426c0a5d10 con 0x7f425c003980 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f42667fc640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 0x7f4254068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f426c11dae0 con 0x7f425c003980 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f4275245640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 0x7f4254068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.223+0000 7f4275245640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 0x7f4254068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4270152030 tx=0x7f4260008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.227+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f426c0eac80 con 0x7f425c003980 2023-12-04T05:36:53.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4270068440 con 0x7f425c003980 2023-12-04T05:36:53.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f42667fc640 1 -- 172.21.15.97:0/2263909584 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f426c0ee2a0 con 0x7f425c003980 2023-12-04T05:36:53.382 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:36:53.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 msgr2=0x7f4254068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 0x7f4254068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4270152030 tx=0x7f4260008040 comp rx=0 tx=0).stop 2023-12-04T05:36:53.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 msgr2=0x7f42701541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c240 tx=0x7f425c005800 comp rx=0 tx=0).stop 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 shutdown_connections 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4254066900 0x7f4254068dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4270149680 0x7f4270149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42701ee340 0x7f427014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 --2- 172.21.15.97:0/2263909584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f425c003980 0x7f42701541e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 >> 172.21.15.97:0/2263909584 conn(0x7f42700c31c0 msgr2=0x7f4270071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 shutdown_connections 2023-12-04T05:36:53.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.379+0000 7f4277caa640 1 -- 172.21.15.97:0/2263909584 wait complete. 2023-12-04T05:36:53.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:53.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.535+0000 7efe0e4dd640 1 Processor -- start 2023-12-04T05:36:53.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.535+0000 7efe0e4dd640 1 -- start start 2023-12-04T05:36:53.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0e4dd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 0x7efe080abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0e4dd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efe080c7ef0 0x7efe08154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0e4dd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe081547d0 con 0x7efe08158630 2023-12-04T05:36:53.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0e4dd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe08158b80 con 0x7efe080c7ef0 2023-12-04T05:36:53.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0e4dd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c4aa0 con 0x7efe08151bf0 2023-12-04T05:36:53.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0ca7a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efe08158630 0x7efe080c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41900/0 (socket says 172.21.15.97:41900) 2023-12-04T05:36:53.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe0ca7a640 1 -- 172.21.15.97:0/1787482473 learned_addr learned my addr 172.21.15.97:0/1787482473 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:53.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe07fff640 1 --2- 172.21.15.97:0/1787482473 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 0x7efe080abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe077fe640 1 --2- 172.21.15.97:0/1787482473 >> v2:172.21.15.143:3300/0 conn(0x7efe080c7ef0 0x7efe08154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe06ffd640 1 -- 172.21.15.97:0/1787482473 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7669952 0 0) 0x7efe081547d0 con 0x7efe08158630 2023-12-04T05:36:53.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe06ffd640 1 -- 172.21.15.97:0/1787482473 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0003530 con 0x7efe08158630 2023-12-04T05:36:53.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe07fff640 1 -- 172.21.15.97:0/1787482473 >> v2:172.21.15.143:3300/0 conn(0x7efe080c7ef0 msgr2=0x7efe08154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe07fff640 1 --2- 172.21.15.97:0/1787482473 >> v2:172.21.15.143:3300/0 conn(0x7efe080c7ef0 0x7efe08154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe07fff640 1 -- 172.21.15.97:0/1787482473 >> v1:172.21.15.97:6789/0 conn(0x7efe08158630 legacy=0x7efe080c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.539+0000 7efe07fff640 1 -- 172.21.15.97:0/1787482473 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080c4d40 con 0x7efe08151bf0 2023-12-04T05:36:53.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe07fff640 1 --2- 172.21.15.97:0/1787482473 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 0x7efe080abbb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdf80097c0 tx=0x7efdf801c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4804544588613d0f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe06ffd640 1 -- 172.21.15.97:0/1787482473 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80a5670 con 0x7efe08151bf0 2023-12-04T05:36:53.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe06ffd640 1 -- 172.21.15.97:0/1787482473 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80a57d0 con 0x7efe08151bf0 2023-12-04T05:36:53.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe06ffd640 1 -- 172.21.15.97:0/1787482473 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80a5b60 con 0x7efe08151bf0 2023-12-04T05:36:53.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- 172.21.15.97:0/1787482473 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 msgr2=0x7efe080abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/1787482473 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 0x7efe080abbb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdf80097c0 tx=0x7efdf801c040 comp rx=0 tx=0).stop 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- 172.21.15.97:0/1787482473 shutdown_connections 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/1787482473 >> v2:172.21.15.143:3300/0 conn(0x7efe080c7ef0 0x7efe08154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/1787482473 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08151bf0 0x7efe080abbb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- 172.21.15.97:0/1787482473 >> 172.21.15.97:0/1787482473 conn(0x7efe08073550 msgr2=0x7efe08073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- 172.21.15.97:0/1787482473 shutdown_connections 2023-12-04T05:36:53.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- 172.21.15.97:0/1787482473 wait complete. 2023-12-04T05:36:53.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 Processor -- start 2023-12-04T05:36:53.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.543+0000 7efe0e4dd640 1 -- start start 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe08151bf0 0x7efe08142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08158630 0x7efe08143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081ee4a0 con 0x7efe080c7ef0 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080ab7c0 con 0x7efe08151bf0 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080abaa0 con 0x7efe08158630 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50390/0 (socket says 172.21.15.97:50390) 2023-12-04T05:36:53.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 -- 172.21.15.97:0/2863694566 learned_addr learned my addr 172.21.15.97:0/2863694566 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe077fe640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe08151bf0 0x7efe08142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0ca7a640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08158630 0x7efe08143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 -- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08158630 msgr2=0x7efe08143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08158630 0x7efe08143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 -- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe08151bf0 msgr2=0x7efe08142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe08151bf0 0x7efe08142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 -- 172.21.15.97:0/2863694566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8009420 con 0x7efe080c7ef0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe07fff640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efdf801a6f0 tx=0x7efdf8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b0450 con 0x7efe080c7ef0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80b05b0 con 0x7efe080c7ef0 2023-12-04T05:36:53.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080abd80 con 0x7efe080c7ef0 2023-12-04T05:36:53.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80b0960 con 0x7efe080c7ef0 2023-12-04T05:36:53.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08157980 con 0x7efe080c7ef0 2023-12-04T05:36:53.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe080abf10 con 0x7efe080c7ef0 2023-12-04T05:36:53.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.547+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efdf80b0ac0 con 0x7efe080c7ef0 2023-12-04T05:36:53.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.551+0000 7efe04ff9640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 0x7efdf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.551+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf811d830 con 0x7efe080c7ef0 2023-12-04T05:36:53.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.551+0000 7efe077fe640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 0x7efdf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.551+0000 7efe077fe640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 0x7efdf4068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe081e8cd0 tx=0x7efdfc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.555+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efdf80eab30 con 0x7efe080c7ef0 2023-12-04T05:36:53.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe08068440 con 0x7efe080c7ef0 2023-12-04T05:36:53.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe04ff9640 1 -- 172.21.15.97:0/2863694566 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7efdf80ab090 con 0x7efe080c7ef0 2023-12-04T05:36:53.738 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:53.738 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:36:53.738 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 msgr2=0x7efdf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 0x7efdf4068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe081e8cd0 tx=0x7efdfc009190 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 msgr2=0x7efe08156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efdf801a6f0 tx=0x7efdf8019100 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 shutdown_connections 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efdf40668d0 0x7efdf4068d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe08158630 0x7efe08143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe08151bf0 0x7efe08142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 --2- 172.21.15.97:0/2863694566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe080c7ef0 0x7efe08156c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.735+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 >> 172.21.15.97:0/2863694566 conn(0x7efe08073550 msgr2=0x7efe0815f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.739+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 shutdown_connections 2023-12-04T05:36:53.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.739+0000 7efe0e4dd640 1 -- 172.21.15.97:0/2863694566 wait complete. 2023-12-04T05:36:53.759 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:53.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 Processor -- start 2023-12-04T05:36:53.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 -- start start 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f860c155370 0x7f860c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c1547d0 con 0x7f860c151bf0 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c158b80 con 0x7f860c0c7ef0 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f86137b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0c4aa0 con 0x7f860c155370 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f860c151bf0 0x7f860c0abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41908/0 (socket says 172.21.15.97:41908) 2023-12-04T05:36:53.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 -- 172.21.15.97:0/4231675292 learned_addr learned my addr 172.21.15.97:0/4231675292 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611d55640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f860c155370 0x7f860c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169612850 0 0) 0x7f860c1547d0 con 0x7f860c151bf0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003530 con 0x7f860c151bf0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413888875 0 0) 0x7f860c158b80 con 0x7f860c0c7ef0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860c1547d0 con 0x7f860c0c7ef0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671443261 0 0) 0x7f85f8003530 con 0x7f860c151bf0 2023-12-04T05:36:53.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f860c155370 msgr2=0x7f860c15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f860c155370 0x7f860c15ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 >> v1:172.21.15.143:6789/0 conn(0x7f860c0c7ef0 legacy=0x7f860c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0c4d40 con 0x7f860c151bf0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f8608001680 con 0x7f860c151bf0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 >> v1:172.21.15.97:6789/0 conn(0x7f860c151bf0 legacy=0x7f860c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f8003b40 0x7f85f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f80047d0 0x7f85f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85f8005190 0x7f85f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0c4aa0 con 0x7f85f8003b40 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c0c0 con 0x7f85f8005190 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c280 con 0x7f85f80047d0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f8003b40 0x7f85f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611d55640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85f8005190 0x7f85f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8610d53640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f80047d0 0x7f85f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 -- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f80047d0 msgr2=0x7f85f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f80047d0 0x7f85f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 -- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85f8005190 msgr2=0x7f85f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:53.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85f8005190 0x7f85f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.895+0000 7f8611554640 1 -- 172.21.15.97:0/4231675292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8003530 con 0x7f85f8003b40 2023-12-04T05:36:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f8611554640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f8003b40 0x7f85f8003f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f860800c160 tx=0x7f860801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eccc4464fa1832f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080a4d00 con 0x7f85f8003b40 2023-12-04T05:36:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86080a4e80 con 0x7f85f8003b40 2023-12-04T05:36:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f8603fff640 1 -- 172.21.15.97:0/4231675292 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608005b20 con 0x7f85f8003b40 2023-12-04T05:36:53.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 -- 172.21.15.97:0/4231675292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f8003b40 msgr2=0x7f85f8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 --2- 172.21.15.97:0/4231675292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85f8003b40 0x7f85f8003f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f860800c160 tx=0x7f860801c8a0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f8611d55640 1 -- 172.21.15.97:0/4231675292 reap_dead start 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 -- 172.21.15.97:0/4231675292 shutdown_connections 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 -- 172.21.15.97:0/4231675292 >> 172.21.15.97:0/4231675292 conn(0x7f860c073550 msgr2=0x7f860c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 -- 172.21.15.97:0/4231675292 shutdown_connections 2023-12-04T05:36:53.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.899+0000 7f86137b8640 1 -- 172.21.15.97:0/4231675292 wait complete. 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 Processor -- start 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 -- start start 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f8003b40 0x7f860c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f860c1f14b0 0x7f860c1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c148ee0 con 0x7f860c148520 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0c9760 con 0x7f860c1f14b0 2023-12-04T05:36:53.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c152f50 con 0x7f85f8003b40 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:50404/0 (socket says 172.21.15.97:50404) 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 -- 172.21.15.97:0/219776668 learned_addr learned my addr 172.21.15.97:0/219776668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8611554640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f8003b40 0x7f860c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8611d55640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f860c1f14b0 0x7f860c1f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 -- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f8003b40 msgr2=0x7f860c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f8003b40 0x7f860c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 -- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f860c1f14b0 msgr2=0x7f860c1f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f860c1f14b0 0x7f860c1f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 -- 172.21.15.97:0/219776668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c1534d0 con 0x7f860c148520 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8610d53640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00f7d0 tx=0x7f85fc00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc005110 con 0x7f860c148520 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc005290 con 0x7f860c148520 2023-12-04T05:36:53.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c14ae30 con 0x7f860c148520 2023-12-04T05:36:53.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.903+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc0067e0 con 0x7f860c148520 2023-12-04T05:36:53.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0c9950 con 0x7f860c148520 2023-12-04T05:36:53.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c0c9b70 con 0x7f860c148520 2023-12-04T05:36:53.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f85fc006940 con 0x7f860c148520 2023-12-04T05:36:53.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f8601ffb640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 0x7f85f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:53.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85fc083c40 con 0x7f860c148520 2023-12-04T05:36:53.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f8611554640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 0x7f85f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:53.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.907+0000 7f8611554640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 0x7f85f0068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86080a9000 tx=0x7f8608001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:53.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:53.911+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85fc050fc0 con 0x7f860c148520 2023-12-04T05:36:54.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.063+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f860c068440 con 0x7f860c148520 2023-12-04T05:36:54.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.063+0000 7f8601ffb640 1 -- 172.21.15.97:0/219776668 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f85fc01a090 con 0x7f860c148520 2023-12-04T05:36:54.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:54.066 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 msgr2=0x7f85f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 0x7f85f0068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86080a9000 tx=0x7f8608001a00 comp rx=0 tx=0).stop 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 msgr2=0x7f860c1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00f7d0 tx=0x7f85fc00fc90 comp rx=0 tx=0).stop 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 shutdown_connections 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85f00668d0 0x7f85f0068d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f860c1f14b0 0x7f860c1f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f860c148520 0x7f860c1489a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 --2- 172.21.15.97:0/219776668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85f8003b40 0x7f860c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 >> 172.21.15.97:0/219776668 conn(0x7f860c073550 msgr2=0x7f860c0a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:54.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 shutdown_connections 2023-12-04T05:36:54.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.067+0000 7f86137b8640 1 -- 172.21.15.97:0/219776668 wait complete. 2023-12-04T05:36:54.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:36:54.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 Processor -- start 2023-12-04T05:36:54.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 -- start start 2023-12-04T05:36:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fde840c5d40 0x7fde840c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde840a7290 0x7fde840c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84157dc0 con 0x7fde84151e10 2023-12-04T05:36:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840c3cd0 con 0x7fde840a7290 2023-12-04T05:36:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.227+0000 7fde88b9d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde841521f0 con 0x7fde840c5d40 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde840a7290 0x7fde840c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde840a7290 0x7fde840c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60264/0 (socket says 172.21.15.97:60264) 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 -- 172.21.15.97:0/2428355457 learned_addr learned my addr 172.21.15.97:0/2428355457 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde81d9b640 1 --2- 172.21.15.97:0/2428355457 >> v2:172.21.15.143:3300/0 conn(0x7fde840c5d40 0x7fde840c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 -- 172.21.15.97:0/2428355457 >> v2:172.21.15.143:3300/0 conn(0x7fde840c5d40 msgr2=0x7fde840c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 --2- 172.21.15.97:0/2428355457 >> v2:172.21.15.143:3300/0 conn(0x7fde840c5d40 0x7fde840c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 -- 172.21.15.97:0/2428355457 >> v1:172.21.15.143:6789/0 conn(0x7fde84151e10 legacy=0x7fde84158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 -- 172.21.15.97:0/2428355457 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84158c60 con 0x7fde840a7290 2023-12-04T05:36:54.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde82d9d640 1 --2- 172.21.15.97:0/2428355457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde840a7290 0x7fde840c4800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde840c5610 tx=0x7fde7c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6f08529d5c4875 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:54.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde8159a640 1 -- 172.21.15.97:0/2428355457 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0a56a0 con 0x7fde840a7290 2023-12-04T05:36:54.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde8159a640 1 -- 172.21.15.97:0/2428355457 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c0a5800 con 0x7fde840a7290 2023-12-04T05:36:54.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.231+0000 7fde8159a640 1 -- 172.21.15.97:0/2428355457 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0a5b90 con 0x7fde840a7290 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- 172.21.15.97:0/2428355457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde840a7290 msgr2=0x7fde840c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- 172.21.15.97:0/2428355457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde840a7290 0x7fde840c4800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde840c5610 tx=0x7fde7c01c8d0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- 172.21.15.97:0/2428355457 shutdown_connections 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- 172.21.15.97:0/2428355457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde840a7290 0x7fde840c4800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- 172.21.15.97:0/2428355457 >> v2:172.21.15.143:3300/0 conn(0x7fde840c5d40 0x7fde840c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- 172.21.15.97:0/2428355457 >> 172.21.15.97:0/2428355457 conn(0x7fde840c7e40 msgr2=0x7fde840c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- 172.21.15.97:0/2428355457 shutdown_connections 2023-12-04T05:36:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- 172.21.15.97:0/2428355457 wait complete. 2023-12-04T05:36:54.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 Processor -- start 2023-12-04T05:36:54.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- start start 2023-12-04T05:36:54.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde840a7290 0x7fde8406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde840c5d40 0x7fde8414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8414eff0 con 0x7fde84151e10 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde841ed0f0 con 0x7fde840a7290 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde88b9d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde841ed390 con 0x7fde840c5d40 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60278/0 (socket says 172.21.15.97:60278) 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 -- 172.21.15.97:0/4202454191 learned_addr learned my addr 172.21.15.97:0/4202454191 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde8259c640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde840a7290 0x7fde8406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde81d9b640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde840c5d40 0x7fde8414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 -- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde840c5d40 msgr2=0x7fde8414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde840c5d40 0x7fde8414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 -- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde840a7290 msgr2=0x7fde8406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde840a7290 0x7fde8406fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.235+0000 7fde82d9d640 1 -- 172.21.15.97:0/4202454191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c009b30 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde82d9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde7c01a500 tx=0x7fde7c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b8670 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c0b87f0 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0b8ba0 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde841ed670 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde841edc30 con 0x7fde84151e10 2023-12-04T05:36:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84068440 con 0x7fde84151e10 2023-12-04T05:36:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fde7c0b8d00 con 0x7fde84151e10 2023-12-04T05:36:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 0x7fde64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde7c11fa50 con 0x7fde84151e10 2023-12-04T05:36:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde8259c640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 0x7fde64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.239+0000 7fde8259c640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 0x7fde64068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde740098e0 tx=0x7fde74009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:54.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.243+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde7c0ecdc0 con 0x7fde84151e10 2023-12-04T05:36:54.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.423+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde840c5660 con 0x7fde84151e10 2023-12-04T05:36:54.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde72ffd640 1 -- 172.21.15.97:0/4202454191 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fde7c0f03e0 con 0x7fde84151e10 2023-12-04T05:36:54.428 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:54.428 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:36:54.428 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 msgr2=0x7fde64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 0x7fde64068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde740098e0 tx=0x7fde74009060 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 msgr2=0x7fde8406e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde7c01a500 tx=0x7fde7c019670 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 shutdown_connections 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde640668d0 0x7fde64068d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde84151e10 0x7fde8406e040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde840c5d40 0x7fde8414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 --2- 172.21.15.97:0/4202454191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde840a7290 0x7fde8406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 >> 172.21.15.97:0/4202454191 conn(0x7fde840c7e40 msgr2=0x7fde84158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:54.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 shutdown_connections 2023-12-04T05:36:54.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.427+0000 7fde88b9d640 1 -- 172.21.15.97:0/4202454191 wait complete. 2023-12-04T05:36:54.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T05:36:40.271902+0000', 'modified': '2023-12-04T05:36:43.356654+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6834/3822856223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 3822856223}, {'type': 'v1', 'addr': '172.21.15.143:6834', 'nonce': 3822856223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T05:36:54.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T05:36:54.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 Processor -- start 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 -- start start 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe54151f10 0x7fbe540c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540c7f00 0x7fbe54154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe540ca780 con 0x7fbe540cac10 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe54158cc0 con 0x7fbe54151f10 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.987+0000 7fbe5949c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c5700 con 0x7fbe540c7f00 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe54151f10 0x7fbe540c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbe54151f10 0x7fbe540c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60288/0 (socket says 172.21.15.97:60288) 2023-12-04T05:36:54.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 -- 172.21.15.97:0/3149704697 learned_addr learned my addr 172.21.15.97:0/3149704697 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe537fe640 1 --1- 172.21.15.97:0/3149704697 >> v1:172.21.15.97:6789/0 conn(0x7fbe540cac10 0x7fbe540c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47524/0 (socket says 172.21.15.97:47524) 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe527fc640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540c7f00 0x7fbe54154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 -- 172.21.15.97:0/3149704697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540c7f00 msgr2=0x7fbe54154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540c7f00 0x7fbe54154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 -- 172.21.15.97:0/3149704697 >> v1:172.21.15.97:6789/0 conn(0x7fbe540cac10 legacy=0x7fbe540c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 -- 172.21.15.97:0/3149704697 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54158720 con 0x7fbe54151f10 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe54151f10 0x7fbe540c4980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009870 tx=0x7fbe4401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6d2fbb1700314b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe51ffb640 1 -- 172.21.15.97:0/3149704697 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440ab5f0 con 0x7fbe54151f10 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe51ffb640 1 -- 172.21.15.97:0/3149704697 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440ab750 con 0x7fbe54151f10 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.991+0000 7fbe51ffb640 1 -- 172.21.15.97:0/3149704697 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440abae0 con 0x7fbe54151f10 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- 172.21.15.97:0/3149704697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe54151f10 msgr2=0x7fbe540c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:54.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe54151f10 0x7fbe540c4980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009870 tx=0x7fbe4401c3f0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- 172.21.15.97:0/3149704697 shutdown_connections 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540c7f00 0x7fbe54154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- 172.21.15.97:0/3149704697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe54151f10 0x7fbe540c4980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- 172.21.15.97:0/3149704697 >> 172.21.15.97:0/3149704697 conn(0x7fbe54073950 msgr2=0x7fbe54073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- 172.21.15.97:0/3149704697 shutdown_connections 2023-12-04T05:36:54.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- 172.21.15.97:0/3149704697 wait complete. 2023-12-04T05:36:55.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 Processor -- start 2023-12-04T05:36:55.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- start start 2023-12-04T05:36:55.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540cac10 0x7fbe541edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe54151f10 0x7fbe541ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5414db40 con 0x7fbe540c7f00 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5414ccd0 con 0x7fbe54151f10 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe5949c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe541f1950 con 0x7fbe540cac10 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60298/0 (socket says 172.21.15.97:60298) 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 -- 172.21.15.97:0/180895364 learned_addr learned my addr 172.21.15.97:0/180895364 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe527fc640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540cac10 0x7fbe541edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe537fe640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe54151f10 0x7fbe541ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 -- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540cac10 msgr2=0x7fbe541edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540cac10 0x7fbe541edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 -- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe54151f10 msgr2=0x7fbe541ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe54151f10 0x7fbe541ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.995+0000 7fbe52ffd640 1 -- 172.21.15.97:0/180895364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440094d0 con 0x7fbe540c7f00 2023-12-04T05:36:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe440ad040 tx=0x7fbe4401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 -- 172.21.15.97:0/180895364 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440be5f0 con 0x7fbe540c7f00 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 -- 172.21.15.97:0/180895364 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440be770 con 0x7fbe540c7f00 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 -- 172.21.15.97:0/180895364 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440beb20 con 0x7fbe540c7f00 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5414cf90 con 0x7fbe540c7f00 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe540c0790 con 0x7fbe540c7f00 2023-12-04T05:36:55.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 -- 172.21.15.97:0/180895364 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbe440b43f0 con 0x7fbe540c7f00 2023-12-04T05:36:55.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 0x7fbe40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe3b7fe640 1 -- 172.21.15.97:0/180895364 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe440a8050 con 0x7fbe540c7f00 2023-12-04T05:36:55.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe527fc640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 0x7fbe40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:54.999+0000 7fbe5c81b000 1 Processor -- start 2023-12-04T05:36:55.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe527fc640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 0x7fbe40068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe54154800 tx=0x7fbe48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- start start 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad653ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad6586ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad6405110 con 0x55bad653bfc0 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad63959a0 con 0x55bad653c8e0 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bad6392ed0 con 0x55bad653d200 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60300/0 (socket says 172.21.15.97:60300) 2023-12-04T05:36:55.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 -- 172.21.15.97:0/1546797684 learned_addr learned my addr 172.21.15.97:0/1546797684 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe527fc640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad653ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe537fe640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad6586ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 -- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 msgr2=0x55bad6586ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad6586ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 -- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 msgr2=0x55bad653ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad653ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 -- 172.21.15.97:0/1546797684 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad6086890 con 0x55bad653bfc0 2023-12-04T05:36:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe537fe640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad6586ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:55.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe440ec730 tx=0x7fbe440f0230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc25c1a8552fdf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe38ff9640 1 -- 172.21.15.97:0/1546797684 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440f8480 con 0x55bad653bfc0 2023-12-04T05:36:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe38ff9640 1 -- 172.21.15.97:0/1546797684 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440ec940 con 0x55bad653bfc0 2023-12-04T05:36:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe38ff9640 1 -- 172.21.15.97:0/1546797684 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440f81f0 con 0x55bad653bfc0 2023-12-04T05:36:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- 172.21.15.97:0/1546797684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 msgr2=0x55bad653c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe440ec730 tx=0x7fbe440f0230 comp rx=0 tx=0).stop 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- 172.21.15.97:0/1546797684 shutdown_connections 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad6586ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad653ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/1546797684 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad653c3a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- 172.21.15.97:0/1546797684 >> 172.21.15.97:0/1546797684 conn(0x55bad657a830 msgr2=0x55bad657cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- 172.21.15.97:0/1546797684 shutdown_connections 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- 172.21.15.97:0/1546797684 wait complete. 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 -- start start 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.003+0000 7fbe5c81b000 1 Processor -- start 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653bfc0 0x55bad6542df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad6543330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad638e7c0 con 0x55bad653d200 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad6346bf0 con 0x55bad653c8e0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bad634ca90 con 0x55bad653bfc0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 10 client.0 _ll_register_callbacks cb 0x55bad6529e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60316/0 (socket says 172.21.15.97:60316) 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 -- 172.21.15.97:0/2266177994 learned_addr learned my addr 172.21.15.97:0/2266177994 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653bfc0 0x55bad6542df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad6543330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 -- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653bfc0 msgr2=0x55bad6542df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653bfc0 0x55bad6542df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 -- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 msgr2=0x55bad6543330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad6543330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 -- 172.21.15.97:0/2266177994 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe540c0790 con 0x55bad653d200 2023-12-04T05:36:55.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad6543330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007b30 tx=0x7fbe4c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859e996f485e7bb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c013570 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe4c0136d0 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bad6350470 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe4c013890 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 10 client.4617 fetch_fsmap learned FSMap version 8 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55bad634f190 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bad6350470 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe4c0139f0 con 0x55bad653d200 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 10 client.4617 fetch_fsmap finished waiting for FSMap version 8 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 10 client.4617 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 20 client.4617 populate_metadata read hostname 'smithi097' 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad658fe40 0x55bad6592230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 4 client.4617 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 --> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bad6353b50 con 0x55bad658fe40 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad658fe40 0x55bad6592230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad658fe40 0x55bad6592230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315ec02e41bc0ee2 server_cookie=4298dc2778d924d4 in_seq=0 out_seq=0 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.007+0000 7fbe31ffb640 10 client.4617 ms_handle_connect on v2:172.21.15.143:6832/3822856223 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2266177994 <== mds.0 v2:172.21.15.143:6832/3822856223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bad6353b50 con 0x55bad658fe40 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe31ffb640 10 client.4617 handle_command_reply: tid=0 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 client.4617 shutdown 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 msgr2=0x55bad6543870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c007b30 tx=0x7fbe4c0019b0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 shutdown_connections 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad658fe40 0x55bad6592230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653d200 0x55bad6543870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653c8e0 0x55bad6543330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe31ffb640 0 client.4617 ms_handle_reset on v2:172.21.15.143:6832/3822856223 2023-12-04T05:36:55.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2266177994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653bfc0 0x55bad6542df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 >> 172.21.15.97:0/2266177994 conn(0x55bad657a830 msgr2=0x55bad657cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 shutdown_connections 2023-12-04T05:36:55.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2266177994 wait complete. 2023-12-04T05:36:55.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.011+0000 7fbe5c81b000 20 client.4617 trim_cache size 0 max 16384 2023-12-04T05:36:55.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.023+0000 7fbe5c81b000 1 Processor -- start 2023-12-04T05:36:55.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- start start 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653c8e0 0x55bad6590760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 0x55bad6590ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad6047940 con 0x55bad653bfc0 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad6315a00 con 0x55bad653d200 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bad638dfd0 con 0x55bad653c8e0 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60330/0 (socket says 172.21.15.97:60330) 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 -- 172.21.15.97:0/2187054953 learned_addr learned my addr 172.21.15.97:0/2187054953 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653c8e0 0x55bad6590760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 0x55bad6590ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 -- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653c8e0 msgr2=0x55bad6590760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653c8e0 0x55bad6590760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 -- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 msgr2=0x55bad6590ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 0x55bad6590ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 -- 172.21.15.97:0/2187054953 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad6335490 con 0x55bad653bfc0 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 0x55bad6590ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe4401c8d0 tx=0x7fbe440b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9af6f62f2d51e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe397fa640 1 -- 172.21.15.97:0/2187054953 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440ec940 con 0x55bad653bfc0 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe397fa640 1 -- 172.21.15.97:0/2187054953 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440ecaa0 con 0x55bad653bfc0 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe397fa640 1 -- 172.21.15.97:0/2187054953 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440f81f0 con 0x55bad653bfc0 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2187054953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 msgr2=0x55bad6590220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe4401c8d0 tx=0x7fbe440b5000 comp rx=0 tx=0).stop 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2187054953 shutdown_connections 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653d200 0x55bad6590ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653c8e0 0x55bad6590760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2187054953 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653bfc0 0x55bad6590220 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2187054953 >> 172.21.15.97:0/2187054953 conn(0x55bad657a830 msgr2=0x55bad653b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2187054953 shutdown_connections 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2187054953 wait complete. 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 -- start start 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.027+0000 7fbe5c81b000 1 Processor -- start 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 0x55bad6593550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad65a2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad6415570 con 0x55bad653c8e0 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad63298a0 con 0x55bad653bfc0 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bad6546510 con 0x55bad653d200 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 10 client.0 _ll_register_callbacks cb 0x55bad63998e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe52ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 0x55bad6593550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60342/0 (socket says 172.21.15.97:60342) 2023-12-04T05:36:55.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 -- 172.21.15.97:0/2379733381 learned_addr learned my addr 172.21.15.97:0/2379733381 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe537fe640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad65a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 -- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 msgr2=0x55bad65a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad65a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 -- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 msgr2=0x55bad6593550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 0x55bad6593550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 -- 172.21.15.97:0/2379733381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bad6086890 con 0x55bad653c8e0 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 0x55bad6593550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe527fc640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe48016a00 tx=0x7fbe48004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbedd4a286916c6e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48014bc0 con 0x55bad653c8e0 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe48014d20 con 0x55bad653c8e0 2023-12-04T05:36:55.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bad6540f20 con 0x55bad653c8e0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe48025450 con 0x55bad653c8e0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 10 client.4623 fetch_fsmap learned FSMap version 8 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55bad6086cc0 con 0x55bad653c8e0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bad6540f20 con 0x55bad653c8e0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe4802b020 con 0x55bad653c8e0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 20 client.4623 populate_metadata read hostname 'smithi097' 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad65a2760 0x55bad65e9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 4 client.4623 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 --> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bad638d110 con 0x55bad65a2760 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad65a2760 0x55bad65e9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 10 client.4623 ms_handle_connect on v2:172.21.15.143:6832/3822856223 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe52ffd640 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad65a2760 0x55bad65e9950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927b7ecf899bc8d server_cookie=246e0a86d732870b in_seq=0 out_seq=0 2023-12-04T05:36:55.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 1 -- 172.21.15.97:0/2379733381 <== mds.0 v2:172.21.15.143:6832/3822856223 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55bad638d110 con 0x55bad65a2760 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 10 client.4623 handle_command_reply: tid=0 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 client.4623 shutdown 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 msgr2=0x55bad65a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe48016a00 tx=0x7fbe48004740 comp rx=0 tx=0).stop 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 shutdown_connections 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:6832/3822856223,v1:172.21.15.143:6834/3822856223] conn(0x55bad65a2760 0x55bad65e9950 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bad653d200 0x55bad65a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55bad653c8e0 0x55bad65a1ce0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe31ffb640 0 client.4623 ms_handle_reset on v2:172.21.15.143:6832/3822856223 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 --2- 172.21.15.97:0/2379733381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bad653bfc0 0x55bad6593550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 >> 172.21.15.97:0/2379733381 conn(0x55bad657a830 msgr2=0x55bad65d9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 shutdown_connections 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 1 -- 172.21.15.97:0/2379733381 wait complete. 2023-12-04T05:36:55.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.031+0000 7fbe5c81b000 20 client.4623 trim_cache size 0 max 16384 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "76f28696-8109-44bf-b432-6ecc5796b8c9", 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4272, 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 14.066242931, 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 8, 2023-12-04T05:36:55.045 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 20, 2023-12-04T05:36:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 20, 2023-12-04T05:36:55.046 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 21.171268044000001 2023-12-04T05:36:55.046 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:36:55.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 msgr2=0x7fbe40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 0x7fbe40068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe54154800 tx=0x7fbe48008040 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 msgr2=0x7fbe540bfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe440ad040 tx=0x7fbe4401ac30 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 shutdown_connections 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbe400668d0 0x7fbe40068d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe54151f10 0x7fbe541ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbe540cac10 0x7fbe541edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 --2- 172.21.15.97:0/180895364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbe540c7f00 0x7fbe540bfea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 >> 172.21.15.97:0/180895364 conn(0x7fbe54073950 msgr2=0x7fbe5415f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 shutdown_connections 2023-12-04T05:36:55.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.035+0000 7fbe5949c640 1 -- 172.21.15.97:0/180895364 wait complete. 2023-12-04T05:36:55.055 INFO:teuthology.run_tasks:Running task kclient... 2023-12-04T05:36:55.080 INFO:tasks.kclient:Mounting kernel clients... 2023-12-04T05:36:55.080 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-04T05:36:55.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.081 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:36:55.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.093 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-12-04T05:36:55.158 INFO:teuthology.orchestra.run.smithi097.stderr:Cannot find device "ceph-brx" 2023-12-04T05:36:55.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:36:55.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.161 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:36:55.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.173 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-12-04T05:36:55.241 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2023-12-04T05:36:55.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:36:55.243 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-04T05:36:55.243 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T05:36:55.243 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:36:55.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:36:55.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 Processor -- start 2023-12-04T05:36:55.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 -- start start 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe42406df10 0x7fe42414da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42406c760 con 0x7fe424154260 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42406ca40 con 0x7fe424154d50 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe42a49a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240a8670 con 0x7fe42406df10 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe423fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe424154260 0x7fe424154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47538/0 (socket says 172.21.15.97:47538) 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe423fff640 1 -- 172.21.15.97:0/1676557915 learned_addr learned my addr 172.21.15.97:0/1676557915 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:55.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe428a37640 1 --2- 172.21.15.97:0/1676557915 >> v2:172.21.15.97:3300/0 conn(0x7fe42406df10 0x7fe42414da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe422ffd640 1 -- 172.21.15.97:0/1676557915 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201286520 0 0) 0x7fe42406c760 con 0x7fe424154260 2023-12-04T05:36:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe422ffd640 1 -- 172.21.15.97:0/1676557915 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003450 con 0x7fe424154260 2023-12-04T05:36:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe428a37640 1 -- 172.21.15.97:0/1676557915 >> v1:172.21.15.143:6789/0 conn(0x7fe424154d50 legacy=0x7fe42406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe428a37640 1 -- 172.21.15.97:0/1676557915 >> v1:172.21.15.97:6789/0 conn(0x7fe424154260 legacy=0x7fe424154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.379+0000 7fe428a37640 1 -- 172.21.15.97:0/1676557915 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42406cd20 con 0x7fe42406df10 2023-12-04T05:36:55.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe428a37640 1 --2- 172.21.15.97:0/1676557915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe42406df10 0x7fe42414da50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d90 tx=0x7fe41c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13f61efeb738680 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe422ffd640 1 -- 172.21.15.97:0/1676557915 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5900 con 0x7fe42406df10 2023-12-04T05:36:55.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe422ffd640 1 -- 172.21.15.97:0/1676557915 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c0a5a60 con 0x7fe42406df10 2023-12-04T05:36:55.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe422ffd640 1 -- 172.21.15.97:0/1676557915 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0a5dd0 con 0x7fe42406df10 2023-12-04T05:36:55.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 -- 172.21.15.97:0/1676557915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe42406df10 msgr2=0x7fe42414da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 --2- 172.21.15.97:0/1676557915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe42406df10 0x7fe42414da50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d90 tx=0x7fe41c01c950 comp rx=0 tx=0).stop 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 -- 172.21.15.97:0/1676557915 shutdown_connections 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 --2- 172.21.15.97:0/1676557915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe42406df10 0x7fe42414da50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 -- 172.21.15.97:0/1676557915 >> 172.21.15.97:0/1676557915 conn(0x7fe4240c2970 msgr2=0x7fe4240c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 -- 172.21.15.97:0/1676557915 shutdown_connections 2023-12-04T05:36:55.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.383+0000 7fe42a49a640 1 -- 172.21.15.97:0/1676557915 wait complete. 2023-12-04T05:36:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 Processor -- start 2023-12-04T05:36:55.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- start start 2023-12-04T05:36:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe42406df10 0x7fe4241531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe424154d50 0x7fe4241f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c3de0 con 0x7fe424154260 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c4080 con 0x7fe42406df10 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240c4370 con 0x7fe424154d50 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60360/0 (socket says 172.21.15.97:60360) 2023-12-04T05:36:55.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 -- 172.21.15.97:0/2594435769 learned_addr learned my addr 172.21.15.97:0/2594435769 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe423fff640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe42406df10 0x7fe4241531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe428a37640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe424154d50 0x7fe4241f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 -- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe424154d50 msgr2=0x7fe4241f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe424154d50 0x7fe4241f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 -- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe42406df10 msgr2=0x7fe4241531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe42406df10 0x7fe4241531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 -- 172.21.15.97:0/2594435769 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009a70 con 0x7fe424154260 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe4237fe640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c340 tx=0x7fe41800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4180052d0 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418005430 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42414e4a0 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418007260 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4240c4930 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.387+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4240c05e0 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.391+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe4180073c0 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.391+0000 7fe420ff9640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 0x7fe410068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.391+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4180837e0 con 0x7fe424154260 2023-12-04T05:36:55.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.391+0000 7fe423fff640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 0x7fe410068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:55.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.391+0000 7fe423fff640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 0x7fe410068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4140011f0 tx=0x7fe414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:55.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.395+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe418050a10 con 0x7fe424154260 2023-12-04T05:36:55.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.575+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe424068440 con 0x7fe424154260 2023-12-04T05:36:55.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.575+0000 7fe420ff9640 1 -- 172.21.15.97:0/2594435769 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe418054030 con 0x7fe424154260 2023-12-04T05:36:55.580 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:36:55.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 msgr2=0x7fe410068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 0x7fe410068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4140011f0 tx=0x7fe414009040 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 msgr2=0x7fe4241437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c340 tx=0x7fe41800c800 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 shutdown_connections 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4100668d0 0x7fe410068d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe424154d50 0x7fe4241f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe424154260 0x7fe4241437a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 --2- 172.21.15.97:0/2594435769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe42406df10 0x7fe4241531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 >> 172.21.15.97:0/2594435769 conn(0x7fe4240c2970 msgr2=0x7fe42414b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 shutdown_connections 2023-12-04T05:36:55.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:55.579+0000 7fe42a49a640 1 -- 172.21.15.97:0/2594435769 wait complete. 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:36:55.601 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:36:55.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.601 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:55.612 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42134sec preferred_lft 42134sec 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:36:55.613 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:55.614 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-04T05:36:55.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.614 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:36:55.614 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:36:55.614 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add name ceph-brx type bridge 2023-12-04T05:36:55.614 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr flush dev ceph-brx 2023-12-04T05:36:55.614 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set ceph-brx up 2023-12-04T05:36:55.615 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-04T05:36:55.615 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:36:55.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.725 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:36:55.747 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:36:55.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.750 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:36:55.824 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:36:55.824 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:36:55.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:36:55.826 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:36:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.924 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:36:55.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.935 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list-id 2023-12-04T05:36:55.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:55.984 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:36:55.985 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:36:55.985 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:36:55.985 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-04T05:36:55.985 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:36:56.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-04T05:36:56.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-04T05:36:56.068 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:36:56.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.239 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:36:56.239 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:36:56.239 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:36:56.239 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set dev brx.0 master ceph-brx 2023-12-04T05:36:56.239 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:36:56.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:36:56.286 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:36:56.336 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:36:56.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:36:56.337 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:36:56.387 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T05:36:56.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:56.502 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:56.502 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:36:56.604 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:56.604 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:36:56.604 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:36:56.604 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 0@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:36:56.604 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:36:56.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:36:56.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:36:56.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.631 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:56.711 INFO:teuthology.orchestra.run.smithi097.stdout:client4635 2023-12-04T05:36:56.712 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:36:56.712 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:36:56.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.765 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:56.827 INFO:teuthology.orchestra.run.smithi097.stdout:client4635 2023-12-04T05:36:56.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.827 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:56.886 INFO:teuthology.orchestra.run.smithi097.stdout:client4635 2023-12-04T05:36:56.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:56.887 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76f28696-8109-44bf-b432-6ecc5796b8c9.client4635/status') 2023-12-04T05:36:56.958 INFO:teuthology.orchestra.run.smithi097.stdout:instance: client.4635 (3)192.168.0.1:0/3954679728 2023-12-04T05:36:56.959 INFO:teuthology.orchestra.run.smithi097.stdout:blocklisted: false 2023-12-04T05:36:56.959 INFO:teuthology.orchestra.run.smithi097.stderr:0+1 records in 2023-12-04T05:36:56.960 INFO:teuthology.orchestra.run.smithi097.stderr:0+1 records out 2023-12-04T05:36:56.960 INFO:teuthology.orchestra.run.smithi097.stderr:69 bytes copied, 5.2979e-05 s, 1.3 MB/s 2023-12-04T05:36:56.960 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-04T05:36:56.960 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T05:36:56.960 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:36:56.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:36:57.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 Processor -- start 2023-12-04T05:36:57.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 -- start start 2023-12-04T05:36:57.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 0x7fd1d80c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 0x7fd1d8151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d80739b0 con 0x7fd1d8152090 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d80c15a0 con 0x7fd1d806b860 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1dcdaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d8155220 con 0x7fd1d80c1030 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d6d9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd1d8152090 0x7fd1d8157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47550/0 (socket says 172.21.15.97:47550) 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d6d9d640 1 -- 172.21.15.97:0/1639686340 learned_addr learned my addr 172.21.15.97:0/1639686340 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1cdd9b640 1 --2- 172.21.15.97:0/1639686340 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 0x7fd1d8151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d659c640 1 --2- 172.21.15.97:0/1639686340 >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 0x7fd1d80c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d5d9b640 1 -- 172.21.15.97:0/1639686340 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531583213 0 0) 0x7fd1d80739b0 con 0x7fd1d8152090 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d5d9b640 1 -- 172.21.15.97:0/1639686340 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c4003530 con 0x7fd1d8152090 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1cdd9b640 1 -- 172.21.15.97:0/1639686340 >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 msgr2=0x7fd1d80c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1cdd9b640 1 --2- 172.21.15.97:0/1639686340 >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 0x7fd1d80c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1cdd9b640 1 -- 172.21.15.97:0/1639686340 >> v1:172.21.15.97:6789/0 conn(0x7fd1d8152090 legacy=0x7fd1d8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1cdd9b640 1 -- 172.21.15.97:0/1639686340 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8155710 con 0x7fd1d80c1030 2023-12-04T05:36:57.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.143+0000 7fd1d659c640 1 --2- 172.21.15.97:0/1639686340 >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 0x7fd1d80c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:36:57.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1cdd9b640 1 --2- 172.21.15.97:0/1639686340 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 0x7fd1d8151b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009d90 tx=0x7fd1c001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d125a6b2bcc62a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:57.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1d5d9b640 1 -- 172.21.15.97:0/1639686340 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00a5780 con 0x7fd1d80c1030 2023-12-04T05:36:57.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1d5d9b640 1 -- 172.21.15.97:0/1639686340 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c00a58e0 con 0x7fd1d80c1030 2023-12-04T05:36:57.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1d5d9b640 1 -- 172.21.15.97:0/1639686340 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00a5c70 con 0x7fd1d80c1030 2023-12-04T05:36:57.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1639686340 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 msgr2=0x7fd1d8151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1639686340 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 0x7fd1d8151b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009d90 tx=0x7fd1c001c8c0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1639686340 shutdown_connections 2023-12-04T05:36:57.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1639686340 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d80c1030 0x7fd1d8151b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1639686340 >> v2:172.21.15.143:3300/0 conn(0x7fd1d806b860 0x7fd1d80c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1639686340 >> 172.21.15.97:0/1639686340 conn(0x7fd1d80c3130 msgr2=0x7fd1d80c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1639686340 shutdown_connections 2023-12-04T05:36:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.147+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1639686340 wait complete. 2023-12-04T05:36:57.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 Processor -- start 2023-12-04T05:36:57.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- start start 2023-12-04T05:36:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d806b860 0x7fd1d8148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1d80c1030 0x7fd1d814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80a7e80 con 0x7fd1d8152090 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d81f0cb0 con 0x7fd1d80c1030 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d81f0f90 con 0x7fd1d806b860 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60364/0 (socket says 172.21.15.97:60364) 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 -- 172.21.15.97:0/1408792845 learned_addr learned my addr 172.21.15.97:0/1408792845 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d659c640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d806b860 0x7fd1d8148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1cdd9b640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1d80c1030 0x7fd1d814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 -- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d806b860 msgr2=0x7fd1d8148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d806b860 0x7fd1d8148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 -- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1d80c1030 msgr2=0x7fd1d814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1d80c1030 0x7fd1d814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 -- 172.21.15.97:0/1408792845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c8009420 con 0x7fd1d8152090 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1d6d9d640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c3c0 tx=0x7fd1d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0005cf0 con 0x7fd1d8152090 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0005e50 con 0x7fd1d8152090 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0007310 con 0x7fd1d8152090 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0009a70 con 0x7fd1d8152090 2023-12-04T05:36:57.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.151+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d814b960 con 0x7fd1d8152090 2023-12-04T05:36:57.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d8072c70 con 0x7fd1d8152090 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd1d0007470 con 0x7fd1d8152090 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1cf7fe640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 0x7fd1b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1d0083720 con 0x7fd1d8152090 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1d659c640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 0x7fd1b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.155+0000 7fd1d659c640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 0x7fd1b8068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd1d814d800 tx=0x7fd1c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:57.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.159+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1d00508c0 con 0x7fd1d8152090 2023-12-04T05:36:57.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1d8151610 con 0x7fd1d8152090 2023-12-04T05:36:57.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1cf7fe640 1 -- 172.21.15.97:0/1408792845 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd1d0053ee0 con 0x7fd1d8152090 2023-12-04T05:36:57.345 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 msgr2=0x7fd1b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 0x7fd1b8068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd1d814d800 tx=0x7fd1c8008040 comp rx=0 tx=0).stop 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 msgr2=0x7fd1d81ecc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c3c0 tx=0x7fd1d000c880 comp rx=0 tx=0).stop 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 shutdown_connections 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1b80668d0 0x7fd1b8068d90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd1d8152090 0x7fd1d81ecc70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1d80c1030 0x7fd1d814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 --2- 172.21.15.97:0/1408792845 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd1d806b860 0x7fd1d8148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:57.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 >> 172.21.15.97:0/1408792845 conn(0x7fd1d80c3130 msgr2=0x7fd1d81500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:57.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 shutdown_connections 2023-12-04T05:36:57.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:57.343+0000 7fd1dcdaa640 1 -- 172.21.15.97:0/1408792845 wait complete. 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:36:57.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:36:57.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.369 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:36:57.379 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:36:57.380 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42125sec preferred_lft 42125sec 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:36:57.381 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:36:57.383 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-04T05:36:57.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-04T05:36:57.384 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:36:57.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.503 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:36:57.523 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:36:57.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.525 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:36:57.596 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:36:57.597 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:36:57.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:36:57.598 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:36:57.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.690 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:36:57.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.700 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2023-12-04T05:36:57.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.756 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:36:57.756 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:36:57.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:36:57.756 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-04T05:36:57.756 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:36:57.844 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-04T05:36:57.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:57.844 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:36:57.844 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:36:57.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-04T05:36:57.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-04T05:36:57.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-04T05:36:57.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-04T05:36:57.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-04T05:36:57.845 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:36:58.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.007 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:36:58.008 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:36:58.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:36:58.008 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2023-12-04T05:36:58.008 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:36:58.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:36:58.049 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:36:58.104 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:36:58.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:36:58.104 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:36:58.159 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-04T05:36:58.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:58.265 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:58.265 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:36:58.371 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:36:58.371 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:36:58.371 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:36:58.371 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:36:58.371 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:36:58.374 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:36:58.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:36:58.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.398 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:58.463 INFO:teuthology.orchestra.run.smithi143.stdout:client4644 2023-12-04T05:36:58.463 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:36:58.464 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:36:58.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.519 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:58.577 INFO:teuthology.orchestra.run.smithi143.stdout:client4644 2023-12-04T05:36:58.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.578 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:36:58.633 INFO:teuthology.orchestra.run.smithi143.stdout:client4644 2023-12-04T05:36:58.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:36:58.634 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76f28696-8109-44bf-b432-6ecc5796b8c9.client4644/status') 2023-12-04T05:36:58.695 INFO:teuthology.orchestra.run.smithi143.stdout:instance: client.4644 (3)172.21.15.143:0/1258936682 2023-12-04T05:36:58.695 INFO:teuthology.orchestra.run.smithi143.stdout:blocklisted: false 2023-12-04T05:36:58.695 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records in 2023-12-04T05:36:58.695 INFO:teuthology.orchestra.run.smithi143.stderr:0+1 records out 2023-12-04T05:36:58.695 INFO:teuthology.orchestra.run.smithi143.stderr:71 bytes copied, 5.0478e-05 s, 1.4 MB/s 2023-12-04T05:36:58.697 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-04T05:36:58.930 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:36:59.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.075+0000 7f73d6e09640 1 Processor -- start 2023-12-04T05:36:59.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.075+0000 7f73d6e09640 1 -- start start 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d6e09640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73d00a8460 0x7f73d00a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d6e09640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 0x7f73d01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d6e09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d00a9770 con 0x7f73d014fbb0 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d6e09640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d014ff90 con 0x7f73d00a8460 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d6e09640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d0071730 con 0x7f73d0152490 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73d00a8460 0x7f73d00a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73d00a8460 0x7f73d00a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60378/0 (socket says 172.21.15.97:60378) 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 -- 172.21.15.97:0/655686366 learned_addr learned my addr 172.21.15.97:0/655686366 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:59.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d53a6640 1 --2- 172.21.15.97:0/655686366 >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 0x7f73d01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 -- 172.21.15.97:0/655686366 >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 msgr2=0x7f73d01528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 --2- 172.21.15.97:0/655686366 >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 0x7f73d01528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 -- 172.21.15.97:0/655686366 >> v1:172.21.15.143:6789/0 conn(0x7f73d014fbb0 legacy=0x7f73d00a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 -- 172.21.15.97:0/655686366 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0071a10 con 0x7f73d00a8460 2023-12-04T05:36:59.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73d53a6640 1 --2- 172.21.15.97:0/655686366 >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 0x7f73d01528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:59.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.079+0000 7f73cffff640 1 --2- 172.21.15.97:0/655686366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d00a8460 0x7f73d00a88e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73d00c0070 tx=0x7f73bc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d27f5a1007ad54 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cf7fe640 1 -- 172.21.15.97:0/655686366 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0ac410 con 0x7f73d00a8460 2023-12-04T05:36:59.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cf7fe640 1 -- 172.21.15.97:0/655686366 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0ac570 con 0x7f73d00a8460 2023-12-04T05:36:59.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cf7fe640 1 -- 172.21.15.97:0/655686366 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0ac900 con 0x7f73d00a8460 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- 172.21.15.97:0/655686366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d00a8460 msgr2=0x7f73d00a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- 172.21.15.97:0/655686366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d00a8460 0x7f73d00a88e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73d00c0070 tx=0x7f73bc01c3b0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- 172.21.15.97:0/655686366 shutdown_connections 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- 172.21.15.97:0/655686366 >> v2:172.21.15.143:3300/0 conn(0x7f73d0152490 0x7f73d01528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- 172.21.15.97:0/655686366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d00a8460 0x7f73d00a88e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- 172.21.15.97:0/655686366 >> 172.21.15.97:0/655686366 conn(0x7f73d00c2970 msgr2=0x7f73d00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- 172.21.15.97:0/655686366 shutdown_connections 2023-12-04T05:36:59.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- 172.21.15.97:0/655686366 wait complete. 2023-12-04T05:36:59.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 Processor -- start 2023-12-04T05:36:59.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- start start 2023-12-04T05:36:59.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73d00a8460 0x7f73d014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73d0152490 0x7f73d00c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d014f040 con 0x7f73d014fbb0 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01eb690 con 0x7f73d00a8460 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d6e09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01eadc0 con 0x7f73d0152490 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60382/0 (socket says 172.21.15.97:60382) 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73cffff640 1 -- 172.21.15.97:0/2329408070 learned_addr learned my addr 172.21.15.97:0/2329408070 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d4ba5640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73d00a8460 0x7f73d014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.083+0000 7f73d53a6640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73d0152490 0x7f73d00c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 -- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73d0152490 msgr2=0x7f73d00c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73d0152490 0x7f73d00c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 -- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73d00a8460 msgr2=0x7f73d014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73d00a8460 0x7f73d014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 -- 172.21.15.97:0/2329408070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0094d0 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cffff640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f73bc018fc0 tx=0x7f73bc019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0ac410 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0b65f0 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d014ed60 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0b69c0 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d01eb2b0 con 0x7f73d014fbb0 2023-12-04T05:36:59.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d01eb7d0 con 0x7f73d014fbb0 2023-12-04T05:36:59.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f73bc0b6b20 con 0x7f73d014fbb0 2023-12-04T05:36:59.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 0x7f73b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73bc11ec30 con 0x7f73d014fbb0 2023-12-04T05:36:59.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.087+0000 7f73d4ba5640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 0x7f73b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.091+0000 7f73d4ba5640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 0x7f73b4068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73d014a470 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.091+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73d01eb7d0 con 0x7f73d014fbb0 2023-12-04T05:36:59.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.243+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73d01eb7d0 con 0x7f73d014fbb0 2023-12-04T05:36:59.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.243+0000 7f73cd7fa640 1 -- 172.21.15.97:0/2329408070 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f73d01eb7d0 con 0x7f73d014fbb0 2023-12-04T05:36:59.248 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:36:59.248 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 msgr2=0x7f73b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 0x7f73b4068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73d014a470 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 msgr2=0x7f73d0145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f73bc018fc0 tx=0x7f73bc019150 comp rx=0 tx=0).stop 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 shutdown_connections 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73b40668d0 0x7f73b4068d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73d0152490 0x7f73d00c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73d014fbb0 0x7f73d0145270 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 --2- 172.21.15.97:0/2329408070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73d00a8460 0x7f73d014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 >> 172.21.15.97:0/2329408070 conn(0x7f73d00c2970 msgr2=0x7f73d015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 shutdown_connections 2023-12-04T05:36:59.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.247+0000 7f73d6e09640 1 -- 172.21.15.97:0/2329408070 wait complete. 2023-12-04T05:36:59.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:36:59.270 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:36:59.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 Processor -- start 2023-12-04T05:36:59.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 -- start start 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c65b0 0x7ff5dc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5dc0c7f00 0x7ff5dc154e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc1587f0 con 0x7ff5dc151da0 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c5020 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e3cfe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc158600 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5dc0c7f00 0x7ff5dc154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff5dc0c7f00 0x7ff5dc154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60390/0 (socket says 172.21.15.97:60390) 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 -- 172.21.15.97:0/865452998 learned_addr learned my addr 172.21.15.97:0/865452998 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e1299640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c65b0 0x7ff5dc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 -- 172.21.15.97:0/865452998 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c65b0 msgr2=0x7ff5dc1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c65b0 0x7ff5dc1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 -- 172.21.15.97:0/865452998 >> v1:172.21.15.143:6789/0 conn(0x7ff5dc151da0 legacy=0x7ff5dc0abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.407+0000 7ff5e229b640 1 -- 172.21.15.97:0/865452998 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0c4980 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e229b640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c7f00 0x7ff5dc154e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009e50 tx=0x7ff5d401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bfcf23a474ca9d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e0a98640 1 -- 172.21.15.97:0/865452998 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40a57d0 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e0a98640 1 -- 172.21.15.97:0/865452998 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d40a5930 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e0a98640 1 -- 172.21.15.97:0/865452998 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40a5cc0 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/865452998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c7f00 msgr2=0x7ff5dc154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c7f00 0x7ff5dc154e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009e50 tx=0x7ff5d401ca10 comp rx=0 tx=0).stop 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/865452998 shutdown_connections 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c7f00 0x7ff5dc154e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/865452998 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c65b0 0x7ff5dc1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/865452998 >> 172.21.15.97:0/865452998 conn(0x7ff5dc0ca000 msgr2=0x7ff5dc0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/865452998 shutdown_connections 2023-12-04T05:36:59.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.411+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/865452998 wait complete. 2023-12-04T05:36:59.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 Processor -- start 2023-12-04T05:36:59.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- start start 2023-12-04T05:36:59.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c7f00 0x7ff5dc0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 0x7ff5dc14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc1edf60 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc156450 con 0x7ff5dc151da0 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc155b80 con 0x7ff5dc0c7f00 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60402/0 (socket says 172.21.15.97:60402) 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 -- 172.21.15.97:0/970170886 learned_addr learned my addr 172.21.15.97:0/970170886 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:59.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1299640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c7f00 0x7ff5dc0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e229b640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 0x7ff5dc14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 -- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c7f00 msgr2=0x7ff5dc0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c7f00 0x7ff5dc0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 -- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 msgr2=0x7ff5dc14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 0x7ff5dc14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 -- 172.21.15.97:0/970170886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4009b30 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e229b640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 0x7ff5dc14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e1a9a640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c3c0 tx=0x7ff5d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80052d0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8005430 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc156bc0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8003840 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.415+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc1573b0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc068440 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5d80039a0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5d27fc640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 0x7ff5c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d8083970 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5e1299640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 0x7ff5c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.419+0000 7ff5e1299640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 0x7ff5c0068d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc1563e0 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.423+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5d8050bc0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5dc06d1b0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5d27fc640 1 -- 172.21.15.97:0/970170886 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5d80170a0 con 0x7ff5dc0c65b0 2023-12-04T05:36:59.577 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 msgr2=0x7ff5c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 0x7ff5c0068d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc1563e0 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 msgr2=0x7ff5dc1eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c3c0 tx=0x7ff5d800c880 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 shutdown_connections 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff5c00668d0 0x7ff5c0068d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5dc151da0 0x7ff5dc14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff5dc0c7f00 0x7ff5dc0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 --2- 172.21.15.97:0/970170886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff5dc0c65b0 0x7ff5dc1eda20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 >> 172.21.15.97:0/970170886 conn(0x7ff5dc0ca000 msgr2=0x7ff5dc0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 shutdown_connections 2023-12-04T05:36:59.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.575+0000 7ff5e3cfe640 1 -- 172.21.15.97:0/970170886 wait complete. 2023-12-04T05:36:59.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:36:59.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 Processor -- start 2023-12-04T05:36:59.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 -- start start 2023-12-04T05:36:59.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88d01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f88d006d210 0x7f88d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00aa240 con 0x7f88d00c1e70 2023-12-04T05:36:59.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d006c0c0 con 0x7f88d006d210 2023-12-04T05:36:59.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d839d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00aa500 con 0x7f88d006c440 2023-12-04T05:36:59.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f88d00c1e70 0x7f88d00a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47556/0 (socket says 172.21.15.97:47556) 2023-12-04T05:36:59.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 -- 172.21.15.97:0/3247466386 learned_addr learned my addr 172.21.15.97:0/3247466386 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:36:59.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920062031 0 0) 0x7f88d00aa240 con 0x7f88d00c1e70 2023-12-04T05:36:59.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5938640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88d01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d693a640 1 --2- 172.21.15.97:0/3247466386 >> v2:172.21.15.143:3300/0 conn(0x7f88d006d210 0x7f88d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88bc003530 con 0x7f88d00c1e70 2023-12-04T05:36:59.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 676549045 0 0) 0x7f88bc003530 con 0x7f88d00c1e70 2023-12-04T05:36:59.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 msgr2=0x7f88d01524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88d01524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 >> v2:172.21.15.143:3300/0 conn(0x7f88d006d210 msgr2=0x7f88d006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 --2- 172.21.15.97:0/3247466386 >> v2:172.21.15.143:3300/0 conn(0x7f88d006d210 0x7f88d006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00aa7e0 con 0x7f88d00c1e70 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f88cc001680 con 0x7f88d00c1e70 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 >> v1:172.21.15.97:6789/0 conn(0x7f88d00c1e70 legacy=0x7f88d00a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88bc003980 0x7f88bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc0047d0 0x7f88bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d006c0c0 con 0x7f88bc003980 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00aa500 con 0x7f88bc0047d0 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc00b990 con 0x7f88d006c440 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88bc003980 0x7f88bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5938640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc0047d0 0x7f88bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d693a640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 -- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 msgr2=0x7f88bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d006c440 0x7f88bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 -- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc0047d0 msgr2=0x7f88bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:36:59.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc0047d0 0x7f88bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d6139640 1 -- 172.21.15.97:0/3247466386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc003530 con 0x7f88bc003980 2023-12-04T05:36:59.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.739+0000 7f88d5938640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc0047d0 0x7f88bc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d6139640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88bc003980 0x7f88bc003da0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c210 tx=0x7f88cc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ff0d99e9f052b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0058e0 con 0x7f88bc003980 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc005a40 con 0x7f88bc003980 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d5137640 1 -- 172.21.15.97:0/3247466386 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc005dd0 con 0x7f88bc003980 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 -- 172.21.15.97:0/3247466386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88bc003980 msgr2=0x7f88bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 --2- 172.21.15.97:0/3247466386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88bc003980 0x7f88bc003da0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c210 tx=0x7f88cc01cc30 comp rx=0 tx=0).stop 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d693a640 1 -- 172.21.15.97:0/3247466386 reap_dead start 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 -- 172.21.15.97:0/3247466386 shutdown_connections 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 -- 172.21.15.97:0/3247466386 >> 172.21.15.97:0/3247466386 conn(0x7f88d00c5e70 msgr2=0x7f88d00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 -- 172.21.15.97:0/3247466386 shutdown_connections 2023-12-04T05:36:59.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.743+0000 7f88d839d640 1 -- 172.21.15.97:0/3247466386 wait complete. 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 Processor -- start 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- start start 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc003980 0x7f88d0141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d0147b40 0x7f88d0147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0156140 con 0x7f88d01551c0 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01ebd40 con 0x7f88bc003980 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0148500 con 0x7f88d0147b40 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60420/0 (socket says 172.21.15.97:60420) 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 -- 172.21.15.97:0/1763910836 learned_addr learned my addr 172.21.15.97:0/1763910836 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d6139640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc003980 0x7f88d0141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d693a640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d0147b40 0x7f88d0147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 -- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d0147b40 msgr2=0x7f88d0147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d0147b40 0x7f88d0147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 -- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc003980 msgr2=0x7f88d0141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc003980 0x7f88d0141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 -- 172.21.15.97:0/1763910836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d01eb130 con 0x7f88d01551c0 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d5938640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009160 tx=0x7f88c0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004220 con 0x7f88d01551c0 2023-12-04T05:36:59.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0004380 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0015890 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d01eb410 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.747+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d01eb9d0 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0068440 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f88c00159f0 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88c6ffd640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 0x7f88b4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c0084810 con 0x7f88d01551c0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88d6139640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 0x7f88b4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:36:59.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.751+0000 7f88d6139640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 0x7f88b4068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0aa000 tx=0x7f88cc001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:36:59.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.755+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88c0051af0 con 0x7f88d01551c0 2023-12-04T05:36:59.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.903+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88d01ebe80 con 0x7f88d01551c0 2023-12-04T05:36:59.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.903+0000 7f88c6ffd640 1 -- 172.21.15.97:0/1763910836 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88c0022020 con 0x7f88d01551c0 2023-12-04T05:36:59.908 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:36:59.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 msgr2=0x7f88b4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 0x7f88b4068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0aa000 tx=0x7f88cc001a10 comp rx=0 tx=0).stop 2023-12-04T05:36:59.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 msgr2=0x7f88d0155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:36:59.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009160 tx=0x7f88c0011a60 comp rx=0 tx=0).stop 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 shutdown_connections 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88b4066900 0x7f88b4068dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88d0147b40 0x7f88d0147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88d01551c0 0x7f88d0155620 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 --2- 172.21.15.97:0/1763910836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88bc003980 0x7f88d0141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 >> 172.21.15.97:0/1763910836 conn(0x7f88d00c5e70 msgr2=0x7f88d015ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 shutdown_connections 2023-12-04T05:36:59.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:36:59.907+0000 7f88d839d640 1 -- 172.21.15.97:0/1763910836 wait complete. 2023-12-04T05:36:59.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 Processor -- start 2023-12-04T05:37:00.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 -- start start 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b380c53e0 0x7f9b380a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b380c1240 0x7f9b380a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380c20f0 con 0x7f9b38155460 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3806f7b0 con 0x7f9b380c1240 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b3c85f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b380c1e10 con 0x7f9b380c53e0 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b380c1240 0x7f9b380a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b380c1240 0x7f9b380a7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60428/0 (socket says 172.21.15.97:60428) 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 -- 172.21.15.97:0/3014502134 learned_addr learned my addr 172.21.15.97:0/3014502134 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:00.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b2dd9b640 1 --2- 172.21.15.97:0/3014502134 >> v2:172.21.15.143:3300/0 conn(0x7f9b380c53e0 0x7f9b380a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 -- 172.21.15.97:0/3014502134 >> v2:172.21.15.143:3300/0 conn(0x7f9b380c53e0 msgr2=0x7f9b380a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:00.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 --2- 172.21.15.97:0/3014502134 >> v2:172.21.15.143:3300/0 conn(0x7f9b380c53e0 0x7f9b380a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 -- 172.21.15.97:0/3014502134 >> v1:172.21.15.143:6789/0 conn(0x7f9b38155460 legacy=0x7f9b380a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.067+0000 7f9b36d9d640 1 -- 172.21.15.97:0/3014502134 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380c7090 con 0x7f9b380c1240 2023-12-04T05:37:00.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b36d9d640 1 --2- 172.21.15.97:0/3014502134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b380c1240 0x7f9b380a7220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b380c4a30 tx=0x7f9b3001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3043c4432105b92c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b35d9b640 1 -- 172.21.15.97:0/3014502134 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300ac630 con 0x7f9b380c1240 2023-12-04T05:37:00.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b35d9b640 1 -- 172.21.15.97:0/3014502134 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300ac790 con 0x7f9b380c1240 2023-12-04T05:37:00.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b35d9b640 1 -- 172.21.15.97:0/3014502134 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300acb20 con 0x7f9b380c1240 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 -- 172.21.15.97:0/3014502134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b380c1240 msgr2=0x7f9b380a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/3014502134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b380c1240 0x7f9b380a7220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b380c4a30 tx=0x7f9b3001c470 comp rx=0 tx=0).stop 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 -- 172.21.15.97:0/3014502134 shutdown_connections 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/3014502134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b380c1240 0x7f9b380a7220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/3014502134 >> v2:172.21.15.143:3300/0 conn(0x7f9b380c53e0 0x7f9b380a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 -- 172.21.15.97:0/3014502134 >> 172.21.15.97:0/3014502134 conn(0x7f9b3806e2c0 msgr2=0x7f9b3806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 -- 172.21.15.97:0/3014502134 shutdown_connections 2023-12-04T05:37:00.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.071+0000 7f9b3c85f640 1 -- 172.21.15.97:0/3014502134 wait complete. 2023-12-04T05:37:00.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 Processor -- start 2023-12-04T05:37:00.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- start start 2023-12-04T05:37:00.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b380c1240 0x7f9b380aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b380c53e0 0x7f9b380c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38156b40 con 0x7f9b38155460 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380ab160 con 0x7f9b380c53e0 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380ab400 con 0x7f9b380c1240 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60432/0 (socket says 172.21.15.97:60432) 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 -- 172.21.15.97:0/4143457984 learned_addr learned my addr 172.21.15.97:0/4143457984 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b2dd9b640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b380c53e0 0x7f9b380c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3659c640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b380c1240 0x7f9b380aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 -- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b380c1240 msgr2=0x7f9b380aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b380c1240 0x7f9b380aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 -- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b380c53e0 msgr2=0x7f9b380c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b380c53e0 0x7f9b380c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 -- 172.21.15.97:0/4143457984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300094d0 con 0x7f9b38155460 2023-12-04T05:37:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b36d9d640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b300af040 tx=0x7f9b30019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300b7670 con 0x7f9b38155460 2023-12-04T05:37:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300b77d0 con 0x7f9b38155460 2023-12-04T05:37:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300b7b40 con 0x7f9b38155460 2023-12-04T05:37:00.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b380c7a10 con 0x7f9b38155460 2023-12-04T05:37:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.075+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b381f01b0 con 0x7f9b38155460 2023-12-04T05:37:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38068440 con 0x7f9b38155460 2023-12-04T05:37:00.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9b300b3070 con 0x7f9b38155460 2023-12-04T05:37:00.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b2f7fe640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 0x7f9b18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b3011e950 con 0x7f9b38155460 2023-12-04T05:37:00.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b3659c640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 0x7f9b18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.079+0000 7f9b3659c640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 0x7f9b18068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b380c86c0 tx=0x7f9b28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.083+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b300ebca0 con 0x7f9b38155460 2023-12-04T05:37:00.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b380c1020 con 0x7f9b38155460 2023-12-04T05:37:00.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b2f7fe640 1 -- 172.21.15.97:0/4143457984 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b300a8020 con 0x7f9b38155460 2023-12-04T05:37:00.242 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:00.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 msgr2=0x7f9b18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 0x7f9b18068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b380c86c0 tx=0x7f9b28009040 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 msgr2=0x7f9b381ec960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.239+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b300af040 tx=0x7f9b30019210 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 shutdown_connections 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b180668d0 0x7f9b18068d90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b38155460 0x7f9b381ec960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b380c53e0 0x7f9b380c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 --2- 172.21.15.97:0/4143457984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b380c1240 0x7f9b380aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 >> 172.21.15.97:0/4143457984 conn(0x7f9b3806e2c0 msgr2=0x7f9b380a9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 shutdown_connections 2023-12-04T05:37:00.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.243+0000 7f9b3c85f640 1 -- 172.21.15.97:0/4143457984 wait complete. 2023-12-04T05:37:00.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:00.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 Processor -- start 2023-12-04T05:37:00.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 -- start start 2023-12-04T05:37:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0f600a8460 0x7f0f600a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600a9770 con 0x7f0f6014fbb0 2023-12-04T05:37:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f60071730 con 0x7f0f60152490 2023-12-04T05:37:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f6669a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6014ff90 con 0x7f0f600a8460 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0f6014fbb0 0x7f0f600a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47568/0 (socket says 172.21.15.97:47568) 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5ffff640 1 -- 172.21.15.97:0/3742774253 learned_addr learned my addr 172.21.15.97:0/3742774253 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5f7fe640 1 --2- 172.21.15.97:0/3742774253 >> v2:172.21.15.97:3300/0 conn(0x7f0f600a8460 0x7f0f600a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5effd640 1 -- 172.21.15.97:0/3742774253 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153461074 0 0) 0x7f0f600a9770 con 0x7f0f6014fbb0 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5effd640 1 -- 172.21.15.97:0/3742774253 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f48003530 con 0x7f0f6014fbb0 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5f7fe640 1 -- 172.21.15.97:0/3742774253 >> v1:172.21.15.143:6789/0 conn(0x7f0f60152490 legacy=0x7f0f601528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5f7fe640 1 -- 172.21.15.97:0/3742774253 >> v1:172.21.15.97:6789/0 conn(0x7f0f6014fbb0 legacy=0x7f0f600a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.399+0000 7f0f5f7fe640 1 -- 172.21.15.97:0/3742774253 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60071a10 con 0x7f0f600a8460 2023-12-04T05:37:00.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f5f7fe640 1 --2- 172.21.15.97:0/3742774253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f600a8460 0x7f0f600a88e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097c0 tx=0x7f0f5401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66ed056f0a78678 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f5effd640 1 -- 172.21.15.97:0/3742774253 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540ab600 con 0x7f0f600a8460 2023-12-04T05:37:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f5effd640 1 -- 172.21.15.97:0/3742774253 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f540a7050 con 0x7f0f600a8460 2023-12-04T05:37:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f5effd640 1 -- 172.21.15.97:0/3742774253 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540ab980 con 0x7f0f600a8460 2023-12-04T05:37:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 -- 172.21.15.97:0/3742774253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f600a8460 msgr2=0x7f0f600a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 --2- 172.21.15.97:0/3742774253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f600a8460 0x7f0f600a88e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097c0 tx=0x7f0f5401c330 comp rx=0 tx=0).stop 2023-12-04T05:37:00.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 -- 172.21.15.97:0/3742774253 shutdown_connections 2023-12-04T05:37:00.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 --2- 172.21.15.97:0/3742774253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f600a8460 0x7f0f600a88e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 -- 172.21.15.97:0/3742774253 >> 172.21.15.97:0/3742774253 conn(0x7f0f600c2970 msgr2=0x7f0f600c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 -- 172.21.15.97:0/3742774253 shutdown_connections 2023-12-04T05:37:00.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.403+0000 7f0f6669a640 1 -- 172.21.15.97:0/3742774253 wait complete. 2023-12-04T05:37:00.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 Processor -- start 2023-12-04T05:37:00.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- start start 2023-12-04T05:37:00.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 0x7f0f600c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 0x7f0f600c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601f0d10 con 0x7f0f60152490 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6014d3e0 con 0x7f0f600a8460 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6006db70 con 0x7f0f6014fbb0 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60444/0 (socket says 172.21.15.97:60444) 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 -- 172.21.15.97:0/2163074334 learned_addr learned my addr 172.21.15.97:0/2163074334 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5ffff640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 0x7f0f600c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5f7fe640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 0x7f0f600c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 -- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 msgr2=0x7f0f600c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 0x7f0f600c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 -- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 msgr2=0x7f0f600c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 0x7f0f600c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 -- 172.21.15.97:0/2163074334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009420 con 0x7f0f60152490 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5f7fe640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 0x7f0f600c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:00.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5ffff640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 0x7f0f600c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f64c37640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c730 tx=0x7f0f5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58003b80 con 0x7f0f60152490 2023-12-04T05:37:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58003ce0 con 0x7f0f60152490 2023-12-04T05:37:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800aa30 con 0x7f0f60152490 2023-12-04T05:37:00.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6006dda0 con 0x7f0f60152490 2023-12-04T05:37:00.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6006c0a0 con 0x7f0f60152490 2023-12-04T05:37:00.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.407+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f60068440 con 0x7f0f60152490 2023-12-04T05:37:00.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.411+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0f5800ab90 con 0x7f0f60152490 2023-12-04T05:37:00.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.411+0000 7f0f5cff9640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 0x7f0f4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.411+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f580843a0 con 0x7f0f60152490 2023-12-04T05:37:00.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.411+0000 7f0f5ffff640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 0x7f0f4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.411+0000 7f0f5ffff640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 0x7f0f4c068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f500011f0 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.415+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0f580514b0 con 0x7f0f60152490 2023-12-04T05:37:00.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.563+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f6006df30 con 0x7f0f60152490 2023-12-04T05:37:00.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f5cff9640 1 -- 172.21.15.97:0/2163074334 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f0f58054ad0 con 0x7f0f60152490 2023-12-04T05:37:00.569 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:00.569 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 msgr2=0x7f0f4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 0x7f0f4c068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f500011f0 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 msgr2=0x7f0f601efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800c730 tx=0x7f0f5800cbf0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 shutdown_connections 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0f4c0668d0 0x7f0f4c068d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f60152490 0x7f0f601efff0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f6014fbb0 0x7f0f600c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 --2- 172.21.15.97:0/2163074334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f600a8460 0x7f0f600c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 >> 172.21.15.97:0/2163074334 conn(0x7f0f600c2970 msgr2=0x7f0f600abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 shutdown_connections 2023-12-04T05:37:00.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.567+0000 7f0f6669a640 1 -- 172.21.15.97:0/2163074334 wait complete. 2023-12-04T05:37:00.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:00.591 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:00.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.727+0000 7f641de9c640 1 Processor -- start 2023-12-04T05:37:00.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.727+0000 7f641de9c640 1 -- start start 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.727+0000 7f641de9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6418151d60 0x7f6418155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.727+0000 7f641de9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f641806f7f0 0x7f641806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f641de9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f641806a5f0 0x7f641806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f641de9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64180c34d0 con 0x7f6418151d60 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f641de9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418152140 con 0x7f641806f7f0 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f641de9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641806b530 con 0x7f641806a5f0 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6418151d60 0x7f6418155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6418151d60 0x7f6418155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60460/0 (socket says 172.21.15.97:60460) 2023-12-04T05:37:00.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 -- 172.21.15.97:0/3749856729 learned_addr learned my addr 172.21.15.97:0/3749856729 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:00.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 -- 172.21.15.97:0/3749856729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f641806a5f0 msgr2=0x7f641806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:00.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 --2- 172.21.15.97:0/3749856729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f641806a5f0 0x7f641806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 -- 172.21.15.97:0/3749856729 >> v2:172.21.15.143:3300/0 conn(0x7f641806f7f0 msgr2=0x7f641806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:00.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 --2- 172.21.15.97:0/3749856729 >> v2:172.21.15.143:3300/0 conn(0x7f641806f7f0 0x7f641806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 -- 172.21.15.97:0/3749856729 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64181556b0 con 0x7f6418151d60 2023-12-04T05:37:00.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64177fe640 1 --2- 172.21.15.97:0/3749856729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6418151d60 0x7f6418155170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6418074340 tx=0x7f640801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89c5c42c06b6cdd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64167fc640 1 -- 172.21.15.97:0/3749856729 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080ab600 con 0x7f6418151d60 2023-12-04T05:37:00.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64167fc640 1 -- 172.21.15.97:0/3749856729 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080a7050 con 0x7f6418151d60 2023-12-04T05:37:00.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.731+0000 7f64167fc640 1 -- 172.21.15.97:0/3749856729 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080ab980 con 0x7f6418151d60 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- 172.21.15.97:0/3749856729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6418151d60 msgr2=0x7f6418155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- 172.21.15.97:0/3749856729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6418151d60 0x7f6418155170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6418074340 tx=0x7f640801c3e0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- 172.21.15.97:0/3749856729 shutdown_connections 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- 172.21.15.97:0/3749856729 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f641806a5f0 0x7f641806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- 172.21.15.97:0/3749856729 >> v2:172.21.15.143:3300/0 conn(0x7f641806f7f0 0x7f641806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- 172.21.15.97:0/3749856729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6418151d60 0x7f6418155170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- 172.21.15.97:0/3749856729 >> 172.21.15.97:0/3749856729 conn(0x7f64180c3980 msgr2=0x7f64180c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- 172.21.15.97:0/3749856729 shutdown_connections 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- 172.21.15.97:0/3749856729 wait complete. 2023-12-04T05:37:00.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 Processor -- start 2023-12-04T05:37:00.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- start start 2023-12-04T05:37:00.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f641806f7f0 0x7f6418147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6418151d60 0x7f6418147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641814a730 con 0x7f641806a5f0 2023-12-04T05:37:00.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64181484b0 con 0x7f641806f7f0 2023-12-04T05:37:00.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f641de9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64181f5440 con 0x7f6418151d60 2023-12-04T05:37:00.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60464/0 (socket says 172.21.15.97:60464) 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 -- 172.21.15.97:0/1218006698 learned_addr learned my addr 172.21.15.97:0/1218006698 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f6417fff640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6418151d60 0x7f6418147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f6416ffd640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f641806f7f0 0x7f6418147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 -- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6418151d60 msgr2=0x7f6418147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6418151d60 0x7f6418147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 -- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f641806f7f0 msgr2=0x7f6418147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f641806f7f0 0x7f6418147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.735+0000 7f64177fe640 1 -- 172.21.15.97:0/1218006698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080094d0 con 0x7f641806a5f0 2023-12-04T05:37:00.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f64177fe640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64080ae040 tx=0x7f640801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080b6620 con 0x7f641806a5f0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080b67a0 con 0x7f641806a5f0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080b6b50 con 0x7f641806a5f0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6418149e00 con 0x7f641806a5f0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641814a3c0 con 0x7f641806a5f0 2023-12-04T05:37:00.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6418068440 con 0x7f641806a5f0 2023-12-04T05:37:00.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f64080b2040 con 0x7f641806a5f0 2023-12-04T05:37:00.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 0x7f6404068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:00.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f640811e900 con 0x7f641806a5f0 2023-12-04T05:37:00.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.739+0000 7f6416ffd640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 0x7f6404068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:00.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.743+0000 7f6416ffd640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 0x7f6404068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f640c006fd0 tx=0x7f640c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:00.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.743+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64080ebbe0 con 0x7f641806a5f0 2023-12-04T05:37:00.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f641806b260 con 0x7f641806a5f0 2023-12-04T05:37:00.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f63fffff640 1 -- 172.21.15.97:0/1218006698 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64080ef200 con 0x7f641806a5f0 2023-12-04T05:37:00.898 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:00.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 msgr2=0x7f6404068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 0x7f6404068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f640c006fd0 tx=0x7f640c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 msgr2=0x7f64181578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f64080ae040 tx=0x7f640801ac20 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 shutdown_connections 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64040668d0 0x7f6404068d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6418151d60 0x7f6418147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f641806f7f0 0x7f6418147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 --2- 172.21.15.97:0/1218006698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f641806a5f0 0x7f64181578d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 >> 172.21.15.97:0/1218006698 conn(0x7f64180c3980 msgr2=0x7f641814c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 shutdown_connections 2023-12-04T05:37:00.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:00.895+0000 7f641de9c640 1 -- 172.21.15.97:0/1218006698 wait complete. 2023-12-04T05:37:00.918 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:01.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 Processor -- start 2023-12-04T05:37:01.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 -- start start 2023-12-04T05:37:01.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f599c151da0 0x7f599c0abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 0x7f599c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c1587f0 con 0x7f599c0ac120 2023-12-04T05:37:01.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599c0c5020 con 0x7f599c151da0 2023-12-04T05:37:01.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59a158d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c158600 con 0x7f599c0c65b0 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f599affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f599c151da0 0x7f599c0abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f599affd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f599c151da0 0x7f599c0abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60480/0 (socket says 172.21.15.97:60480) 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f599affd640 1 -- 172.21.15.97:0/1473289287 learned_addr learned my addr 172.21.15.97:0/1473289287 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.055+0000 7f59927fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f599c0ac120 0x7f599c1548e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47578/0 (socket says 172.21.15.97:47578) 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599affd640 1 -- 172.21.15.97:0/1473289287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 msgr2=0x7f599c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599b7fe640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 0x7f599c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599affd640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 0x7f599c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599a7fc640 1 -- 172.21.15.97:0/1473289287 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744672260 0 0) 0x7f599c1587f0 con 0x7f599c0ac120 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599affd640 1 -- 172.21.15.97:0/1473289287 >> v1:172.21.15.97:6789/0 conn(0x7f599c0ac120 legacy=0x7f599c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599affd640 1 -- 172.21.15.97:0/1473289287 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0c4980 con 0x7f599c151da0 2023-12-04T05:37:01.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599b7fe640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 0x7f599c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:01.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599affd640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c151da0 0x7f599c0abbe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d422ecd731561a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599a7fc640 1 -- 172.21.15.97:0/1473289287 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0a57d0 con 0x7f599c151da0 2023-12-04T05:37:01.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599a7fc640 1 -- 172.21.15.97:0/1473289287 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c0a5930 con 0x7f599c151da0 2023-12-04T05:37:01.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f599a7fc640 1 -- 172.21.15.97:0/1473289287 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0a5cc0 con 0x7f599c151da0 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f59a158d640 1 -- 172.21.15.97:0/1473289287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c151da0 msgr2=0x7f599c0abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.059+0000 7f59a158d640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c151da0 0x7f599c0abbe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f598c009e50 tx=0x7f598c01ca10 comp rx=0 tx=0).stop 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- 172.21.15.97:0/1473289287 shutdown_connections 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0c65b0 0x7f599c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 --2- 172.21.15.97:0/1473289287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c151da0 0x7f599c0abbe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- 172.21.15.97:0/1473289287 >> 172.21.15.97:0/1473289287 conn(0x7f599c0ca000 msgr2=0x7f599c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- 172.21.15.97:0/1473289287 shutdown_connections 2023-12-04T05:37:01.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- 172.21.15.97:0/1473289287 wait complete. 2023-12-04T05:37:01.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 Processor -- start 2023-12-04T05:37:01.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- start start 2023-12-04T05:37:01.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ac120 0x7f599c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 0x7f599c1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c157830 con 0x7f599c0c65b0 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c155f00 con 0x7f599c151da0 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59a158d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c157a60 con 0x7f599c0ac120 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60496/0 (socket says 172.21.15.97:60496) 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 -- 172.21.15.97:0/3461956602 learned_addr learned my addr 172.21.15.97:0/3461956602 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f599b7fe640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 0x7f599c1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f599affd640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ac120 0x7f599c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 -- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ac120 msgr2=0x7f599c156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ac120 0x7f599c156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 -- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 msgr2=0x7f599c1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 0x7f599c1572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 -- 172.21.15.97:0/3461956602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009b30 con 0x7f599c0c65b0 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f599b7fe640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 0x7f599c1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:01.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.063+0000 7f59927fc640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f598400c480 tx=0x7f598400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840074e0 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984007660 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984004a30 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c1558b0 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c157d40 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c156070 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5984004b90 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 0x7f597c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5984083580 con 0x7f599c0c65b0 2023-12-04T05:37:01.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f599affd640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 0x7f597c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.067+0000 7f599affd640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 0x7f597c068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f598c0ae000 tx=0x7f598c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.071+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59840542f0 con 0x7f599c0c65b0 2023-12-04T05:37:01.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.223+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f599c068440 con 0x7f599c0c65b0 2023-12-04T05:37:01.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f5993fff640 1 -- 172.21.15.97:0/3461956602 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5984053e80 con 0x7f599c0c65b0 2023-12-04T05:37:01.228 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 msgr2=0x7f597c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 0x7f597c068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f598c0ae000 tx=0x7f598c0a7070 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 msgr2=0x7f599c1edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f598400c480 tx=0x7f598400c940 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 shutdown_connections 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f597c0668d0 0x7f597c068d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f599c151da0 0x7f599c1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f599c0c65b0 0x7f599c1edb70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 --2- 172.21.15.97:0/3461956602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f599c0ac120 0x7f599c156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 >> 172.21.15.97:0/3461956602 conn(0x7f599c0ca000 msgr2=0x7f599c0c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 shutdown_connections 2023-12-04T05:37:01.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.227+0000 7f59a158d640 1 -- 172.21.15.97:0/3461956602 wait complete. 2023-12-04T05:37:01.249 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:01.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 Processor -- start 2023-12-04T05:37:01.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 -- start start 2023-12-04T05:37:01.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3c40c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c4157c70 con 0x7fa3c40c4e30 2023-12-04T05:37:01.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c4157f50 con 0x7fa3c40af8b0 2023-12-04T05:37:01.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c991d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c4152170 con 0x7fa3c406cb20 2023-12-04T05:37:01.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa3c40c4e30 0x7fa3c4154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47592/0 (socket says 172.21.15.97:47592) 2023-12-04T05:37:01.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3c37fe640 1 -- 172.21.15.97:0/695853294 learned_addr learned my addr 172.21.15.97:0/695853294 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:01.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.391+0000 7fa3ba7fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3c40c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236148817 0 0) 0x7fa3c4157c70 con 0x7fa3c40c4e30 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b0003530 con 0x7fa3c40c4e30 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088909837 0 0) 0x7fa3c4157f50 con 0x7fa3c40af8b0 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c4157c70 con 0x7fa3c40af8b0 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3158738985 0 0) 0x7fa3b0003530 con 0x7fa3c40c4e30 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 msgr2=0x7fa3c40c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3c40c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 >> v1:172.21.15.143:6789/0 conn(0x7fa3c40af8b0 legacy=0x7fa3c40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4158230 con 0x7fa3c40c4e30 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fa3bc001680 con 0x7fa3c40c4e30 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 >> v1:172.21.15.97:6789/0 conn(0x7fa3c40c4e30 legacy=0x7fa3c4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3b0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b0004d10 0x7fa3b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b000bb20 con 0x7fa3b0003b40 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b000bc60 con 0x7fa3b0004d10 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b000be20 con 0x7fa3c406cb20 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3b0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c37fe640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b0004d10 0x7fa3b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3ba7fc640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 msgr2=0x7fa3b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c406cb20 0x7fa3b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b0004d10 msgr2=0x7fa3b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b0004d10 0x7fa3b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/695853294 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0003530 con 0x7fa3b0003b40 2023-12-04T05:37:01.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.395+0000 7fa3c37fe640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3b0004d10 0x7fa3b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3b0003f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40018d0 tx=0x7fa3b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8871755d7fdd1d07 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40052d0 con 0x7fa3b0003b40 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b40a7050 con 0x7fa3b0003b40 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c27fc640 1 -- 172.21.15.97:0/695853294 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4003600 con 0x7fa3b0003b40 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- 172.21.15.97:0/695853294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 msgr2=0x7fa3b0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 --2- 172.21.15.97:0/695853294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3b0003f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40018d0 tx=0x7fa3b401c560 comp rx=0 tx=0).stop 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c37fe640 1 -- 172.21.15.97:0/695853294 reap_dead start 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- 172.21.15.97:0/695853294 shutdown_connections 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- 172.21.15.97:0/695853294 >> 172.21.15.97:0/695853294 conn(0x7fa3c4073720 msgr2=0x7fa3c4073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- 172.21.15.97:0/695853294 shutdown_connections 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- 172.21.15.97:0/695853294 wait complete. 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 Processor -- start 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- start start 2023-12-04T05:37:01.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3c40c12a0 0x7fa3c40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c40adef0 0x7fa3c41f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40acd70 con 0x7fa3b0003b40 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40ad050 con 0x7fa3c40c12a0 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c991d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c2af0 con 0x7fa3c40adef0 2023-12-04T05:37:01.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60506/0 (socket says 172.21.15.97:60506) 2023-12-04T05:37:01.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/3988504126 learned_addr learned my addr 172.21.15.97:0/3988504126 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.399+0000 7fa3ba7fc640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3c40c12a0 0x7fa3c40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c37fe640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c40adef0 0x7fa3c41f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c40adef0 msgr2=0x7fa3c41f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c40adef0 0x7fa3c41f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3c40c12a0 msgr2=0x7fa3c40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3c40c12a0 0x7fa3c40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 -- 172.21.15.97:0/3988504126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4150fb0 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c2ffd640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ad040 tx=0x7fa3b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40069e0 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4006b40 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c41512f0 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4007030 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40c3a30 con 0x7fa3b0003b40 2023-12-04T05:37:01.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c40ad210 con 0x7fa3b0003b40 2023-12-04T05:37:01.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3b4007190 con 0x7fa3b0003b40 2023-12-04T05:37:01.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 0x7fa3a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.403+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3b411e690 con 0x7fa3b0003b40 2023-12-04T05:37:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.407+0000 7fa3ba7fc640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 0x7fa3a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.407+0000 7fa3ba7fc640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 0x7fa3a4068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40af140 tx=0x7fa3ac00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.407+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3b40eb970 con 0x7fa3b0003b40 2023-12-04T05:37:01.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3c4068440 con 0x7fa3b0003b40 2023-12-04T05:37:01.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c0ff9640 1 -- 172.21.15.97:0/3988504126 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3b40eef90 con 0x7fa3b0003b40 2023-12-04T05:37:01.566 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 msgr2=0x7fa3a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 0x7fa3a4068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40af140 tx=0x7fa3ac00b040 comp rx=0 tx=0).stop 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 msgr2=0x7fa3c40c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ad040 tx=0x7fa3b0005800 comp rx=0 tx=0).stop 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 shutdown_connections 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3a40668d0 0x7fa3a4068d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3c40adef0 0x7fa3c41f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3c40c12a0 0x7fa3c40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 --2- 172.21.15.97:0/3988504126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3b0003b40 0x7fa3c40c25b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.563+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 >> 172.21.15.97:0/3988504126 conn(0x7fa3c4073720 msgr2=0x7fa3c415f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.567+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 shutdown_connections 2023-12-04T05:37:01.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.567+0000 7fa3c991d640 1 -- 172.21.15.97:0/3988504126 wait complete. 2023-12-04T05:37:01.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:01.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 Processor -- start 2023-12-04T05:37:01.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 -- start start 2023-12-04T05:37:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1814e970 0x7fcb1806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcb1806ca50 0x7fcb180c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb18152300 con 0x7fcb1806be00 2023-12-04T05:37:01.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb18071580 con 0x7fcb1806ca50 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1ffb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1814ed50 con 0x7fcb1814e970 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcb1806ca50 0x7fcb180c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcb1806ca50 0x7fcb180c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60520/0 (socket says 172.21.15.97:60520) 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 -- 172.21.15.97:0/588582366 learned_addr learned my addr 172.21.15.97:0/588582366 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1dd54640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1814e970 0x7fcb1806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 -- 172.21.15.97:0/588582366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1814e970 msgr2=0x7fcb1806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1814e970 0x7fcb1806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 -- 172.21.15.97:0/588582366 >> v1:172.21.15.143:6789/0 conn(0x7fcb1806be00 legacy=0x7fcb18071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.723+0000 7fcb1e555640 1 -- 172.21.15.97:0/588582366 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1806cea0 con 0x7fcb1806ca50 2023-12-04T05:37:01.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1e555640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1806ca50 0x7fcb180c1880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b993b6f2bb5406ca server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1cd52640 1 -- 172.21.15.97:0/588582366 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100a57b0 con 0x7fcb1806ca50 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1cd52640 1 -- 172.21.15.97:0/588582366 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100a5910 con 0x7fcb1806ca50 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1cd52640 1 -- 172.21.15.97:0/588582366 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100a5ca0 con 0x7fcb1806ca50 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/588582366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1806ca50 msgr2=0x7fcb180c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1806ca50 0x7fcb180c1880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/588582366 shutdown_connections 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1806ca50 0x7fcb180c1880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/588582366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1814e970 0x7fcb1806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/588582366 >> 172.21.15.97:0/588582366 conn(0x7fcb180c2970 msgr2=0x7fcb180c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/588582366 shutdown_connections 2023-12-04T05:37:01.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.727+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/588582366 wait complete. 2023-12-04T05:37:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 Processor -- start 2023-12-04T05:37:01.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- start start 2023-12-04T05:37:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1806be00 0x7fcb181455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 0x7fcb18145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180ab6d0 con 0x7fcb1814e970 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aaac0 con 0x7fcb1806be00 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aada0 con 0x7fcb1806ca50 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60530/0 (socket says 172.21.15.97:60530) 2023-12-04T05:37:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 -- 172.21.15.97:0/1127507439 learned_addr learned my addr 172.21.15.97:0/1127507439 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1dd54640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1806be00 0x7fcb181455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1d553640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 0x7fcb18145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 -- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 msgr2=0x7fcb18145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 0x7fcb18145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 -- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1806be00 msgr2=0x7fcb181455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1806be00 0x7fcb181455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 -- 172.21.15.97:0/1127507439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009b30 con 0x7fcb1814e970 2023-12-04T05:37:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1d553640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 0x7fcb18145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:01.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1e555640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb100af040 tx=0x7fcb10019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100b8880 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100b89e0 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100b8d90 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180ab080 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18146020 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.731+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180ab880 con 0x7fcb1814e970 2023-12-04T05:37:01.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.735+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb100b6440 con 0x7fcb1814e970 2023-12-04T05:37:01.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.735+0000 7fcb0e7fc640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:01.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.735+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb1011fba0 con 0x7fcb1814e970 2023-12-04T05:37:01.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.735+0000 7fcb1dd54640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:01.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.735+0000 7fcb1dd54640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 0x7fcafc068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400b930 tx=0x7fcb14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:01.741 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.739+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb180ab880 con 0x7fcb1814e970 2023-12-04T05:37:01.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.887+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb180ab880 con 0x7fcb1814e970 2023-12-04T05:37:01.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb0e7fc640 1 -- 172.21.15.97:0/1127507439 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fcb180ab880 con 0x7fcb1814e970 2023-12-04T05:37:01.893 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:01.893 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 msgr2=0x7fcafc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 0x7fcafc068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400b930 tx=0x7fcb14008040 comp rx=0 tx=0).stop 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 msgr2=0x7fcb181ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb100af040 tx=0x7fcb10019690 comp rx=0 tx=0).stop 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 shutdown_connections 2023-12-04T05:37:01.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb1814e970 0x7fcb181ee580 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806ca50 0x7fcb18145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 --2- 172.21.15.97:0/1127507439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb1806be00 0x7fcb181455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 >> 172.21.15.97:0/1127507439 conn(0x7fcb180c2970 msgr2=0x7fcb180704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 shutdown_connections 2023-12-04T05:37:01.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:01.891+0000 7fcb1ffb8640 1 -- 172.21.15.97:0/1127507439 wait complete. 2023-12-04T05:37:01.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:01.915 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:02.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 Processor -- start 2023-12-04T05:37:02.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 -- start start 2023-12-04T05:37:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31580c1360 0x7f31580700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158150bc0 con 0x7f315806c000 2023-12-04T05:37:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158154fd0 con 0x7f3158154af0 2023-12-04T05:37:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315cd55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3158151a70 con 0x7f31580c1360 2023-12-04T05:37:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.055+0000 7f315659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31580c1360 0x7f31580700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f314dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f315806c000 0x7f3158151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47600/0 (socket says 172.21.15.97:47600) 2023-12-04T05:37:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f314dd9b640 1 -- 172.21.15.97:0/1267254162 learned_addr learned my addr 172.21.15.97:0/1267254162 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f315659c640 1 -- 172.21.15.97:0/1267254162 >> v1:172.21.15.143:6789/0 conn(0x7f3158154af0 legacy=0x7f315814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f315659c640 1 -- 172.21.15.97:0/1267254162 >> v1:172.21.15.97:6789/0 conn(0x7f315806c000 legacy=0x7f3158151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f315659c640 1 -- 172.21.15.97:0/1267254162 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158072160 con 0x7f31580c1360 2023-12-04T05:37:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f3155d9b640 1 -- 172.21.15.97:0/1267254162 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70977471 0 0) 0x7f3158150bc0 con 0x7f315806c000 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f315659c640 1 --2- 172.21.15.97:0/1267254162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31580700b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97767119e41f666c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f3155d9b640 1 -- 172.21.15.97:0/1267254162 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480ab600 con 0x7f31580c1360 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f3155d9b640 1 -- 172.21.15.97:0/1267254162 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31480a7050 con 0x7f31580c1360 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.059+0000 7f3155d9b640 1 -- 172.21.15.97:0/1267254162 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480ab980 con 0x7f31580c1360 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- 172.21.15.97:0/1267254162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 msgr2=0x7f31580700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 --2- 172.21.15.97:0/1267254162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31580700b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31480097c0 tx=0x7f314801c3f0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- 172.21.15.97:0/1267254162 shutdown_connections 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 --2- 172.21.15.97:0/1267254162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31580700b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- 172.21.15.97:0/1267254162 >> 172.21.15.97:0/1267254162 conn(0x7f31580c5e70 msgr2=0x7f31580c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- 172.21.15.97:0/1267254162 shutdown_connections 2023-12-04T05:37:02.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- 172.21.15.97:0/1267254162 wait complete. 2023-12-04T05:37:02.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 Processor -- start 2023-12-04T05:37:02.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- start start 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f315806c000 0x7f31580c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3158154af0 0x7f3158148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158148230 con 0x7f31580c1360 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31581436d0 con 0x7f315806c000 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315cd55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31581439b0 con 0x7f3158154af0 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f314dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f314dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60548/0 (socket says 172.21.15.97:60548) 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f314dd9b640 1 -- 172.21.15.97:0/100774974 learned_addr learned my addr 172.21.15.97:0/100774974 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f315659c640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f315806c000 0x7f31580c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.063+0000 7f3156d9d640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3158154af0 0x7f3158148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 -- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3158154af0 msgr2=0x7f3158148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3158154af0 0x7f3158148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 -- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f315806c000 msgr2=0x7f31580c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f315806c000 0x7f31580c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 -- 172.21.15.97:0/100774974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148009420 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314dd9b640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f314000c4a0 tx=0x7f314000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31400074e0 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140007640 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140004a30 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3158143c90 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580c59c0 con 0x7f31580c1360 2023-12-04T05:37:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31581441b0 con 0x7f31580c1360 2023-12-04T05:37:02.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3140004b90 con 0x7f31580c1360 2023-12-04T05:37:02.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 0x7f3138068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31400835d0 con 0x7f31580c1360 2023-12-04T05:37:02.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.067+0000 7f315659c640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 0x7f3138068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.071+0000 7f315659c640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 0x7f3138068dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31480ad000 tx=0x7f31480a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.071+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31581441b0 con 0x7f31580c1360 2023-12-04T05:37:02.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.223+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31581441b0 con 0x7f31580c1360 2023-12-04T05:37:02.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.223+0000 7f314f7fe640 1 -- 172.21.15.97:0/100774974 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31581441b0 con 0x7f31580c1360 2023-12-04T05:37:02.227 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 msgr2=0x7f3138068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 0x7f3138068dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31480ad000 tx=0x7f31480a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 msgr2=0x7f31581417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f314000c4a0 tx=0x7f314000c960 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 shutdown_connections 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3138066900 0x7f3138068dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3158154af0 0x7f3158148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31580c1360 0x7f31581417f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 --2- 172.21.15.97:0/100774974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f315806c000 0x7f31580c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 >> 172.21.15.97:0/100774974 conn(0x7f31580c5e70 msgr2=0x7f315814db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 shutdown_connections 2023-12-04T05:37:02.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.227+0000 7f315cd55640 1 -- 172.21.15.97:0/100774974 wait complete. 2023-12-04T05:37:02.248 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:02.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 Processor -- start 2023-12-04T05:37:02.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 -- start start 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0680c7e40 0x7fe0680c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068157c50 0x7fe0681580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe068155320 con 0x7fe068151ec0 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06806c840 con 0x7fe0680c7e40 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe06d2ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680c5600 con 0x7fe068157c50 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0667fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe0680c7e40 0x7fe0680c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe066ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe068151ec0 0x7fe0680c48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47602/0 (socket says 172.21.15.97:47602) 2023-12-04T05:37:02.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe066ffd640 1 -- 172.21.15.97:0/1581632036 learned_addr learned my addr 172.21.15.97:0/1581632036 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:02.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0677fe640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068157c50 0x7fe0681580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0667fc640 1 -- 172.21.15.97:0/1581632036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068157c50 msgr2=0x7fe0681580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:02.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0667fc640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068157c50 0x7fe0681580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0667fc640 1 -- 172.21.15.97:0/1581632036 >> v1:172.21.15.97:6789/0 conn(0x7fe068151ec0 legacy=0x7fe0680c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.387+0000 7fe0667fc640 1 -- 172.21.15.97:0/1581632036 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0681549f0 con 0x7fe0680c7e40 2023-12-04T05:37:02.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe0667fc640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0680c7e40 0x7fe0680c82a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097c0 tx=0x7fe05c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcb88c843d58a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe065ffb640 1 -- 172.21.15.97:0/1581632036 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0ac620 con 0x7fe0680c7e40 2023-12-04T05:37:02.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe065ffb640 1 -- 172.21.15.97:0/1581632036 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c0ac780 con 0x7fe0680c7e40 2023-12-04T05:37:02.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe065ffb640 1 -- 172.21.15.97:0/1581632036 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0acb10 con 0x7fe0680c7e40 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- 172.21.15.97:0/1581632036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0680c7e40 msgr2=0x7fe0680c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0680c7e40 0x7fe0680c82a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097c0 tx=0x7fe05c01c3c0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- 172.21.15.97:0/1581632036 shutdown_connections 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068157c50 0x7fe0681580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/1581632036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe0680c7e40 0x7fe0680c82a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- 172.21.15.97:0/1581632036 >> 172.21.15.97:0/1581632036 conn(0x7fe068073720 msgr2=0x7fe068073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- 172.21.15.97:0/1581632036 shutdown_connections 2023-12-04T05:37:02.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- 172.21.15.97:0/1581632036 wait complete. 2023-12-04T05:37:02.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 Processor -- start 2023-12-04T05:37:02.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.391+0000 7fe06d2ea640 1 -- start start 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0680c7e40 0x7fe0680c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068151ec0 0x7fe0680aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0681eced0 con 0x7fe068157c50 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0681ed190 con 0x7fe0680c7e40 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0681ed470 con 0x7fe068151ec0 2023-12-04T05:37:02.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60568/0 (socket says 172.21.15.97:60568) 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 -- 172.21.15.97:0/4056490160 learned_addr learned my addr 172.21.15.97:0/4056490160 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0667fc640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068151ec0 0x7fe0680aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe066ffd640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0680c7e40 0x7fe0680c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 -- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068151ec0 msgr2=0x7fe0680aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068151ec0 0x7fe0680aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 -- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0680c7e40 msgr2=0x7fe0680c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0680c7e40 0x7fe0680c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 -- 172.21.15.97:0/4056490160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c009420 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe0677fe640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe060007e60 tx=0x7fe06000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060014420 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0600145a0 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060014950 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0681ed750 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0681edd10 con 0x7fe068157c50 2023-12-04T05:37:02.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.395+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe068068440 con 0x7fe068157c50 2023-12-04T05:37:02.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.399+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe060014ab0 con 0x7fe068157c50 2023-12-04T05:37:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.399+0000 7fe04f7fe640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 0x7fe054068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.399+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe060084d70 con 0x7fe068157c50 2023-12-04T05:37:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.399+0000 7fe066ffd640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 0x7fe054068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.399+0000 7fe066ffd640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 0x7fe054068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe058005890 tx=0x7fe058009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.403+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe060051fa0 con 0x7fe068157c50 2023-12-04T05:37:02.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe06806c980 con 0x7fe068157c50 2023-12-04T05:37:02.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe04f7fe640 1 -- 172.21.15.97:0/4056490160 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0600555c0 con 0x7fe068157c50 2023-12-04T05:37:02.554 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:02.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 msgr2=0x7fe054068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 0x7fe054068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe058005890 tx=0x7fe058009040 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 msgr2=0x7fe0680af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe060007e60 tx=0x7fe06000e4b0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 shutdown_connections 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe0540668d0 0x7fe054068d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe068157c50 0x7fe0680af350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe068151ec0 0x7fe0680aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 --2- 172.21.15.97:0/4056490160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0680c7e40 0x7fe0680c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 >> 172.21.15.97:0/4056490160 conn(0x7fe068073720 msgr2=0x7fe06814ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 shutdown_connections 2023-12-04T05:37:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.551+0000 7fe06d2ea640 1 -- 172.21.15.97:0/4056490160 wait complete. 2023-12-04T05:37:02.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 Processor -- start 2023-12-04T05:37:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 -- start start 2023-12-04T05:37:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb23406f7f0 0x7fb23406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340c34d0 con 0x7fb234151d60 2023-12-04T05:37:02.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb234152140 con 0x7fb23406a5f0 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb23b246640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23406b530 con 0x7fb23406f7f0 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb238fe2640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb234151d60 0x7fb234155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47606/0 (socket says 172.21.15.97:47606) 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.711+0000 7fb238fe2640 1 -- 172.21.15.97:0/152304979 learned_addr learned my addr 172.21.15.97:0/152304979 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb233fff640 1 --2- 172.21.15.97:0/152304979 >> v2:172.21.15.143:3300/0 conn(0x7fb23406f7f0 0x7fb23406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb2337fe640 1 -- 172.21.15.97:0/152304979 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371442082 0 0) 0x7fb2340c34d0 con 0x7fb234151d60 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb2337fe640 1 -- 172.21.15.97:0/152304979 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb224003530 con 0x7fb234151d60 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb233fff640 1 -- 172.21.15.97:0/152304979 >> v1:172.21.15.143:6789/0 conn(0x7fb23406a5f0 legacy=0x7fb23415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb233fff640 1 -- 172.21.15.97:0/152304979 >> v1:172.21.15.97:6789/0 conn(0x7fb234151d60 legacy=0x7fb234155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb233fff640 1 -- 172.21.15.97:0/152304979 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340acd80 con 0x7fb23406f7f0 2023-12-04T05:37:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb233fff640 1 --2- 172.21.15.97:0/152304979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23406dc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097c0 tx=0x7fb22001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfdb71e560f4f8c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb2337fe640 1 -- 172.21.15.97:0/152304979 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200ab600 con 0x7fb23406f7f0 2023-12-04T05:37:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb2337fe640 1 -- 172.21.15.97:0/152304979 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2200a7050 con 0x7fb23406f7f0 2023-12-04T05:37:02.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.715+0000 7fb2337fe640 1 -- 172.21.15.97:0/152304979 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200ab980 con 0x7fb23406f7f0 2023-12-04T05:37:02.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- 172.21.15.97:0/152304979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 msgr2=0x7fb23406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 --2- 172.21.15.97:0/152304979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23406dc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2200097c0 tx=0x7fb22001c360 comp rx=0 tx=0).stop 2023-12-04T05:37:02.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- 172.21.15.97:0/152304979 shutdown_connections 2023-12-04T05:37:02.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 --2- 172.21.15.97:0/152304979 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23406dc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- 172.21.15.97:0/152304979 >> 172.21.15.97:0/152304979 conn(0x7fb2340c3980 msgr2=0x7fb2340c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- 172.21.15.97:0/152304979 shutdown_connections 2023-12-04T05:37:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- 172.21.15.97:0/152304979 wait complete. 2023-12-04T05:37:02.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 Processor -- start 2023-12-04T05:37:02.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- start start 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb23406a5f0 0x7fb2340c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341ed4b0 con 0x7fb234151d60 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341f0f20 con 0x7fb23406f7f0 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb23b246640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341f1200 con 0x7fb23406a5f0 2023-12-04T05:37:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb233fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60578/0 (socket says 172.21.15.97:60578) 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 -- 172.21.15.97:0/2042635249 learned_addr learned my addr 172.21.15.97:0/2042635249 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb238fe2640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb23406a5f0 0x7fb2340c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 -- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb23406a5f0 msgr2=0x7fb2340c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb23406a5f0 0x7fb2340c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 -- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 msgr2=0x7fb23414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.719+0000 7fb2397e3640 1 -- 172.21.15.97:0/2042635249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220009420 con 0x7fb234151d60 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2397e3640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c730 tx=0x7fb22c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c003b80 con 0x7fb234151d60 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c003ce0 con 0x7fb234151d60 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2341f14e0 con 0x7fb234151d60 2023-12-04T05:37:02.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00aa30 con 0x7fb234151d60 2023-12-04T05:37:02.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2340c6b40 con 0x7fb234151d60 2023-12-04T05:37:02.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2341ed6d0 con 0x7fb234151d60 2023-12-04T05:37:02.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb22c00ab90 con 0x7fb234151d60 2023-12-04T05:37:02.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 0x7fb218068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:02.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb22c0840b0 con 0x7fb234151d60 2023-12-04T05:37:02.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb238fe2640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 0x7fb218068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:02.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.723+0000 7fb238fe2640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 0x7fb218068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2280011f0 tx=0x7fb228007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:02.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.727+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2341ed6d0 con 0x7fb234151d60 2023-12-04T05:37:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.875+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2341ed6d0 con 0x7fb234151d60 2023-12-04T05:37:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.875+0000 7fb2317fa640 1 -- 172.21.15.97:0/2042635249 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2341ed6d0 con 0x7fb234151d60 2023-12-04T05:37:02.880 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 msgr2=0x7fb218068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 0x7fb218068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb2280011f0 tx=0x7fb228007d40 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 msgr2=0x7fb23414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c730 tx=0x7fb22c00cbf0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 shutdown_connections 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2180668d0 0x7fb218068d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb234151d60 0x7fb23414ee50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb23406f7f0 0x7fb23414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 --2- 172.21.15.97:0/2042635249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb23406a5f0 0x7fb2340c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 >> 172.21.15.97:0/2042635249 conn(0x7fb2340c3980 msgr2=0x7fb234146840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:02.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 shutdown_connections 2023-12-04T05:37:02.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:02.879+0000 7fb23b246640 1 -- 172.21.15.97:0/2042635249 wait complete. 2023-12-04T05:37:02.901 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.035+0000 7feaae165640 1 Processor -- start 2023-12-04T05:37:03.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.035+0000 7feaae165640 1 -- start start 2023-12-04T05:37:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaae165640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7feaa806e150 0x7feaa806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaae165640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa8152300 con 0x7feaa814e970 2023-12-04T05:37:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaae165640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa8071580 con 0x7feaa806be00 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaae165640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa814ed50 con 0x7feaa806e150 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa77fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7feaa814e970 0x7feaa8071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47608/0 (socket says 172.21.15.97:47608) 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa77fe640 1 -- 172.21.15.97:0/317631846 learned_addr learned my addr 172.21.15.97:0/317631846 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa7fff640 1 --2- 172.21.15.97:0/317631846 >> v2:172.21.15.97:3300/0 conn(0x7feaa806e150 0x7feaa806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa6ffd640 1 -- 172.21.15.97:0/317631846 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489141394 0 0) 0x7fea98001120 con 0x7feaa814e970 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa6ffd640 1 -- 172.21.15.97:0/317631846 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea94005740 con 0x7feaa814e970 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa7fff640 1 -- 172.21.15.97:0/317631846 >> v1:172.21.15.143:6789/0 conn(0x7feaa806be00 legacy=0x7feaa80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa7fff640 1 -- 172.21.15.97:0/317631846 >> v1:172.21.15.97:6789/0 conn(0x7feaa814e970 legacy=0x7feaa8071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.039+0000 7feaa7fff640 1 -- 172.21.15.97:0/317631846 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8151d60 con 0x7feaa806e150 2023-12-04T05:37:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaa7fff640 1 --2- 172.21.15.97:0/317631846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa806ca50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009d90 tx=0x7feaa001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e083decf61260d44 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaa6ffd640 1 -- 172.21.15.97:0/317631846 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00a5690 con 0x7feaa806e150 2023-12-04T05:37:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaa6ffd640 1 -- 172.21.15.97:0/317631846 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa00a57f0 con 0x7feaa806e150 2023-12-04T05:37:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaa6ffd640 1 -- 172.21.15.97:0/317631846 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00a5b80 con 0x7feaa806e150 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- 172.21.15.97:0/317631846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 msgr2=0x7feaa806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 --2- 172.21.15.97:0/317631846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa806ca50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009d90 tx=0x7feaa001c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- 172.21.15.97:0/317631846 shutdown_connections 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 --2- 172.21.15.97:0/317631846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa806ca50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- 172.21.15.97:0/317631846 >> 172.21.15.97:0/317631846 conn(0x7feaa80c2970 msgr2=0x7feaa80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- 172.21.15.97:0/317631846 shutdown_connections 2023-12-04T05:37:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- 172.21.15.97:0/317631846 wait complete. 2023-12-04T05:37:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 Processor -- start 2023-12-04T05:37:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- start start 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa806be00 0x7feaa80bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa814e970 0x7feaa8141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80c3e10 con 0x7feaa806e150 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80c5bf0 con 0x7feaa814e970 2023-12-04T05:37:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7feaae165640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8142410 con 0x7feaa806be00 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.043+0000 7fea9ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60596/0 (socket says 172.21.15.97:60596) 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 -- 172.21.15.97:0/3609895865 learned_addr learned my addr 172.21.15.97:0/3609895865 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa77fe640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa806be00 0x7feaa80bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa7fff640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa814e970 0x7feaa8141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 -- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa806be00 msgr2=0x7feaa80bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa806be00 0x7feaa80bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 -- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa814e970 msgr2=0x7feaa8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa814e970 0x7feaa8141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 -- 172.21.15.97:0/3609895865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009a70 con 0x7feaa806e150 2023-12-04T05:37:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7fea9ffff640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c500 tx=0x7fea9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90005220 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90005380 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90007270 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa80c5020 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa80c55a0 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa81ecf40 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea900073d0 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.047+0000 7feaa4ff9640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 0x7fea88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.051+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea90083c00 con 0x7feaa806e150 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.051+0000 7feaa77fe640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 0x7fea88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.051+0000 7feaa77fe640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 0x7fea88068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea98001280 tx=0x7fea98007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.051+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea90050e60 con 0x7feaa806e150 2023-12-04T05:37:03.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa8068440 con 0x7feaa806e150 2023-12-04T05:37:03.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaa4ff9640 1 -- 172.21.15.97:0/3609895865 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fea90054480 con 0x7feaa806e150 2023-12-04T05:37:03.210 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:03.210 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 msgr2=0x7fea88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 0x7fea88068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea98001280 tx=0x7fea98007bc0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 msgr2=0x7feaa8141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea9000c500 tx=0x7fea9000c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 shutdown_connections 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea880668d0 0x7fea88068d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa814e970 0x7feaa8141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa806e150 0x7feaa8141990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 --2- 172.21.15.97:0/3609895865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feaa806be00 0x7feaa80bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.207+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 >> 172.21.15.97:0/3609895865 conn(0x7feaa80c2970 msgr2=0x7feaa80c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.211+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 shutdown_connections 2023-12-04T05:37:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.211+0000 7feaae165640 1 -- 172.21.15.97:0/3609895865 wait complete. 2023-12-04T05:37:03.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:03.233 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:03.278 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:37:03.282 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:37:03.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.371+0000 7f55823b8640 1 Processor -- start 2023-12-04T05:37:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.371+0000 7f55823b8640 1 -- start start 2023-12-04T05:37:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.371+0000 7f55823b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 0x7f557c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.371+0000 7f55823b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f557c06d210 0x7f557c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.371+0000 7f55823b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557c0aa240 con 0x7f557c0c1e70 2023-12-04T05:37:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f55823b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557c06c0c0 con 0x7f557c06d210 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f55823b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c0aa500 con 0x7f557c06c440 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f557c06d210 0x7f557c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f557c06d210 0x7f557c06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60604/0 (socket says 172.21.15.97:60604) 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 -- 172.21.15.97:0/2538188862 learned_addr learned my addr 172.21.15.97:0/2538188862 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f557b7fe640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 0x7f557c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 -- 172.21.15.97:0/2538188862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 msgr2=0x7f557c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 0x7f557c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 -- 172.21.15.97:0/2538188862 >> v1:172.21.15.143:6789/0 conn(0x7f557c0c1e70 legacy=0x7f557c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 -- 172.21.15.97:0/2538188862 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c0aa7e0 con 0x7f557c06d210 2023-12-04T05:37:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f557b7fe640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 0x7f557c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f5580955640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c06d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f557401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d75c580e837b95 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f557affd640 1 -- 172.21.15.97:0/2538188862 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740a58d0 con 0x7f557c06d210 2023-12-04T05:37:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f557affd640 1 -- 172.21.15.97:0/2538188862 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55740a5a30 con 0x7f557c06d210 2023-12-04T05:37:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.375+0000 7f557affd640 1 -- 172.21.15.97:0/2538188862 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740a5dc0 con 0x7f557c06d210 2023-12-04T05:37:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- 172.21.15.97:0/2538188862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 msgr2=0x7f557c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c06d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5574009e50 tx=0x7f557401c9e0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- 172.21.15.97:0/2538188862 shutdown_connections 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c06d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- 172.21.15.97:0/2538188862 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c06c440 0x7f557c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- 172.21.15.97:0/2538188862 >> 172.21.15.97:0/2538188862 conn(0x7f557c0c5e70 msgr2=0x7f557c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- 172.21.15.97:0/2538188862 shutdown_connections 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- 172.21.15.97:0/2538188862 wait complete. 2023-12-04T05:37:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 Processor -- start 2023-12-04T05:37:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- start start 2023-12-04T05:37:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f557c06c440 0x7f557c144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c0c1e70 0x7f557c1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c1556a0 con 0x7f557c06d210 2023-12-04T05:37:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557c144d10 con 0x7f557c06c440 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f55823b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557c144ff0 con 0x7f557c0c1e70 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60612/0 (socket says 172.21.15.97:60612) 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 -- 172.21.15.97:0/1232907897 learned_addr learned my addr 172.21.15.97:0/1232907897 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557bfff640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f557c06c440 0x7f557c144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f5580955640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c0c1e70 0x7f557c1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 -- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c0c1e70 msgr2=0x7f557c1505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c0c1e70 0x7f557c1505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 -- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f557c06c440 msgr2=0x7f557c144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.379+0000 7f557b7fe640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f557c06c440 0x7f557c144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f557b7fe640 1 -- 172.21.15.97:0/1232907897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574009b30 con 0x7f557c06d210 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f557b7fe640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f557000d800 tx=0x7f557000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700096c0 con 0x7f557c06d210 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570009820 con 0x7f557c06d210 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570009bd0 con 0x7f557c06d210 2023-12-04T05:37:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c155330 con 0x7f557c06d210 2023-12-04T05:37:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557c155030 con 0x7f557c06d210 2023-12-04T05:37:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c155810 con 0x7f557c06d210 2023-12-04T05:37:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5570009d30 con 0x7f557c06d210 2023-12-04T05:37:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 0x7f5568068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5570084a60 con 0x7f557c06d210 2023-12-04T05:37:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.383+0000 7f557bfff640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 0x7f5568068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.387+0000 7f557bfff640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 0x7f5568068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.387+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5570051cb0 con 0x7f557c06d210 2023-12-04T05:37:03.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.539+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f557c068440 con 0x7f557c06d210 2023-12-04T05:37:03.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.539+0000 7f5578ff9640 1 -- 172.21.15.97:0/1232907897 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55700552d0 con 0x7f557c06d210 2023-12-04T05:37:03.543 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 msgr2=0x7f5568068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 0x7f5568068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 msgr2=0x7f557c143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f557000d800 tx=0x7f557000dcc0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 shutdown_connections 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5568066900 0x7f5568068dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f557c0c1e70 0x7f557c1505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f557c06d210 0x7f557c143db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 --2- 172.21.15.97:0/1232907897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f557c06c440 0x7f557c144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 >> 172.21.15.97:0/1232907897 conn(0x7f557c0c5e70 msgr2=0x7f557c1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 shutdown_connections 2023-12-04T05:37:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.543+0000 7f55823b8640 1 -- 172.21.15.97:0/1232907897 wait complete. 2023-12-04T05:37:03.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:03.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 Processor -- start 2023-12-04T05:37:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 -- start start 2023-12-04T05:37:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f671006f7f0 0x7f671006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 0x7f671006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100c34d0 con 0x7f6710151d60 2023-12-04T05:37:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6710152140 con 0x7f671006f7f0 2023-12-04T05:37:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f671630f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671006b530 con 0x7f671006a5f0 2023-12-04T05:37:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f671006f7f0 0x7f671006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f67148ac640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 0x7f671006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f6710151d60 0x7f6710155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:60046/0 (socket says 172.21.15.97:60046) 2023-12-04T05:37:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670ffff640 1 -- 172.21.15.97:0/3702775454 learned_addr learned my addr 172.21.15.97:0/3702775454 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670effd640 1 -- 172.21.15.97:0/3702775454 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253864886 0 0) 0x7f67100c34d0 con 0x7f6710151d60 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670effd640 1 -- 172.21.15.97:0/3702775454 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f8003530 con 0x7f6710151d60 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670f7fe640 1 -- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 msgr2=0x7f671006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670f7fe640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 0x7f671006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670f7fe640 1 -- 172.21.15.97:0/3702775454 >> v1:172.21.15.143:6789/0 conn(0x7f6710151d60 legacy=0x7f6710155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f670f7fe640 1 -- 172.21.15.97:0/3702775454 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100acd80 con 0x7f671006f7f0 2023-12-04T05:37:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.703+0000 7f67148ac640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 0x7f671006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:03.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f670f7fe640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f671006dc40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67040097c0 tx=0x7f670401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6ed3b4fa6086bd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f670effd640 1 -- 172.21.15.97:0/3702775454 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040ab600 con 0x7f671006f7f0 2023-12-04T05:37:03.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f670effd640 1 -- 172.21.15.97:0/3702775454 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040a7050 con 0x7f671006f7f0 2023-12-04T05:37:03.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f670effd640 1 -- 172.21.15.97:0/3702775454 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040ab980 con 0x7f671006f7f0 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 -- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 msgr2=0x7f671006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f671006dc40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f67040097c0 tx=0x7f670401c360 comp rx=0 tx=0).stop 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 -- 172.21.15.97:0/3702775454 shutdown_connections 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f671006a5f0 0x7f671006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 --2- 172.21.15.97:0/3702775454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f671006dc40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 -- 172.21.15.97:0/3702775454 >> 172.21.15.97:0/3702775454 conn(0x7f67100c3980 msgr2=0x7f67100c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 -- 172.21.15.97:0/3702775454 shutdown_connections 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.707+0000 7f671630f640 1 -- 172.21.15.97:0/3702775454 wait complete. 2023-12-04T05:37:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 Processor -- start 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- start start 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f67101ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6710151d60 0x7f67101ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671014c220 con 0x7f671006a5f0 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67101f0f60 con 0x7f671006f7f0 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671014b970 con 0x7f6710151d60 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60620/0 (socket says 172.21.15.97:60620) 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 -- 172.21.15.97:0/4060221262 learned_addr learned my addr 172.21.15.97:0/4060221262 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f67148ac640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6710151d60 0x7f67101ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670f7fe640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f67101ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 -- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6710151d60 msgr2=0x7f67101ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6710151d60 0x7f67101ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 -- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 msgr2=0x7f67101ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f67101ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 -- 172.21.15.97:0/4060221262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009a70 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670ffff640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f670000c420 tx=0x7f670000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700005cf0 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700005e50 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6704009420 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000072d0 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.711+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671014b690 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710068440 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6700007430 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f670cff9640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 0x7f66fc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67000837f0 con 0x7f671006a5f0 2023-12-04T05:37:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f670f7fe640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 0x7f66fc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:03.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.715+0000 7f670f7fe640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 0x7f66fc068dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67040ad000 tx=0x7f67040a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:03.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.719+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6700050b70 con 0x7f671006a5f0 2023-12-04T05:37:03.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f671006b260 con 0x7f671006a5f0 2023-12-04T05:37:03.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f670cff9640 1 -- 172.21.15.97:0/4060221262 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6700017020 con 0x7f671006a5f0 2023-12-04T05:37:03.874 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:03.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 msgr2=0x7f66fc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 0x7f66fc068dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f67040ad000 tx=0x7f67040a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 msgr2=0x7f67100c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f670000c420 tx=0x7f670000c820 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 shutdown_connections 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66fc066900 0x7f66fc068dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6710151d60 0x7f67101ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f671006f7f0 0x7f67101ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 --2- 172.21.15.97:0/4060221262 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f671006a5f0 0x7f67100c5e00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.871+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 >> 172.21.15.97:0/4060221262 conn(0x7f67100c3980 msgr2=0x7f671014fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.875+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 shutdown_connections 2023-12-04T05:37:03.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:03.875+0000 7f671630f640 1 -- 172.21.15.97:0/4060221262 wait complete. 2023-12-04T05:37:03.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:04.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.031+0000 7faa0f7f5640 1 Processor -- start 2023-12-04T05:37:04.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.031+0000 7faa0f7f5640 1 -- start start 2023-12-04T05:37:04.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0f7f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faa081524e0 0x7faa0806d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0f7f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080aa240 con 0x7faa080c1e70 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0f7f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080aa500 con 0x7faa0806c440 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0f7f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0806c0c0 con 0x7faa081524e0 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0d591640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7faa080c1e70 0x7faa080a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:47610/0 (socket says 172.21.15.97:47610) 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0d591640 1 -- 172.21.15.97:0/1449435668 learned_addr learned my addr 172.21.15.97:0/1449435668 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0dd92640 1 --2- 172.21.15.97:0/1449435668 >> v2:172.21.15.143:3300/0 conn(0x7faa081524e0 0x7faa0806d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7fa9fffff640 1 -- 172.21.15.97:0/1449435668 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081209310 0 0) 0x7faa080aa240 con 0x7faa080c1e70 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7fa9fffff640 1 -- 172.21.15.97:0/1449435668 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f4003530 con 0x7faa080c1e70 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0dd92640 1 -- 172.21.15.97:0/1449435668 >> v1:172.21.15.143:6789/0 conn(0x7faa0806c440 legacy=0x7faa0806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0dd92640 1 -- 172.21.15.97:0/1449435668 >> v1:172.21.15.97:6789/0 conn(0x7faa080c1e70 legacy=0x7faa080a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.035+0000 7faa0dd92640 1 -- 172.21.15.97:0/1449435668 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080aa7e0 con 0x7faa081524e0 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0dd92640 1 --2- 172.21.15.97:0/1449435668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa081524e0 0x7faa0806d920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ebfbeb42204f5e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7fa9fffff640 1 -- 172.21.15.97:0/1449435668 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000a5900 con 0x7faa081524e0 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7fa9fffff640 1 -- 172.21.15.97:0/1449435668 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000a5a60 con 0x7faa081524e0 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7fa9fffff640 1 -- 172.21.15.97:0/1449435668 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000a5df0 con 0x7faa081524e0 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- 172.21.15.97:0/1449435668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa081524e0 msgr2=0x7faa0806d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/1449435668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa081524e0 0x7faa0806d920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001c950 comp rx=0 tx=0).stop 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- 172.21.15.97:0/1449435668 shutdown_connections 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/1449435668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa081524e0 0x7faa0806d920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- 172.21.15.97:0/1449435668 >> 172.21.15.97:0/1449435668 conn(0x7faa080c5e70 msgr2=0x7faa080c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- 172.21.15.97:0/1449435668 shutdown_connections 2023-12-04T05:37:04.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- 172.21.15.97:0/1449435668 wait complete. 2023-12-04T05:37:04.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 Processor -- start 2023-12-04T05:37:04.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.039+0000 7faa0f7f5640 1 -- start start 2023-12-04T05:37:04.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa0806c440 0x7faa080700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 0x7faa080bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa081ed070 con 0x7faa081524e0 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0814ab90 con 0x7faa080c1e70 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa08149600 con 0x7faa0806c440 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60636/0 (socket says 172.21.15.97:60636) 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 -- 172.21.15.97:0/2881147173 learned_addr learned my addr 172.21.15.97:0/2881147173 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0d591640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa0806c440 0x7faa080700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0cd90640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 0x7faa080bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 -- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa0806c440 msgr2=0x7faa080700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa0806c440 0x7faa080700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 -- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 msgr2=0x7faa080bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 0x7faa080bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 -- 172.21.15.97:0/2881147173 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009a70 con 0x7faa081524e0 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0cd90640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 0x7faa080bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:04.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0dd92640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa000b0040 tx=0x7faa000196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b9860 con 0x7faa081524e0 2023-12-04T05:37:04.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000a58f0 con 0x7faa081524e0 2023-12-04T05:37:04.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b9c00 con 0x7faa081524e0 2023-12-04T05:37:04.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa081498e0 con 0x7faa081524e0 2023-12-04T05:37:04.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0814c650 con 0x7faa081524e0 2023-12-04T05:37:04.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.043+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa08149d90 con 0x7faa081524e0 2023-12-04T05:37:04.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.047+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faa000ad440 con 0x7faa081524e0 2023-12-04T05:37:04.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.047+0000 7fa9fdffb640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 0x7fa9ec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.047+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa0011f640 con 0x7faa081524e0 2023-12-04T05:37:04.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.047+0000 7faa0d591640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 0x7fa9ec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.047+0000 7faa0d591640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 0x7fa9ec068dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa040011f0 tx=0x7faa04007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.051+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa000eca30 con 0x7faa081524e0 2023-12-04T05:37:04.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.199+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa08068440 con 0x7faa081524e0 2023-12-04T05:37:04.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.199+0000 7fa9fdffb640 1 -- 172.21.15.97:0/2881147173 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa000f0050 con 0x7faa081524e0 2023-12-04T05:37:04.203 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:04.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 msgr2=0x7fa9ec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 0x7fa9ec068dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa040011f0 tx=0x7faa04007d40 comp rx=0 tx=0).stop 2023-12-04T05:37:04.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 msgr2=0x7faa081ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa000b0040 tx=0x7faa000196f0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 shutdown_connections 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9ec066900 0x7fa9ec068dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa081524e0 0x7faa081ed500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa080c1e70 0x7faa080bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 --2- 172.21.15.97:0/2881147173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa0806c440 0x7faa080700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 >> 172.21.15.97:0/2881147173 conn(0x7faa080c5e70 msgr2=0x7faa08151370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 shutdown_connections 2023-12-04T05:37:04.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.203+0000 7faa0f7f5640 1 -- 172.21.15.97:0/2881147173 wait complete. 2023-12-04T05:37:04.241 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-04T05:37:04.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:04.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 Processor -- start 2023-12-04T05:37:04.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 -- start start 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 0x7f40940c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4094071e10 0x7f409406be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 0x7f409415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409406dd10 con 0x7f4094071e10 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409406ff60 con 0x7f40940c1880 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f409c0bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940707c0 con 0x7f409406c340 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f4099656640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4094071e10 0x7f409406be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f4099656640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4094071e10 0x7f409406be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47636/0 (socket says 172.21.15.97:47636) 2023-12-04T05:37:04.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.375+0000 7f4099656640 1 -- 172.21.15.97:0/4188339545 learned_addr learned my addr 172.21.15.97:0/4188339545 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:04.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099e57640 1 --2- 172.21.15.97:0/4188339545 >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 0x7f40940c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f409a658640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 0x7f409415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 -- 172.21.15.97:0/4188339545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 msgr2=0x7f409415bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 0x7f409415bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 -- 172.21.15.97:0/4188339545 >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 msgr2=0x7f40940c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 --2- 172.21.15.97:0/4188339545 >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 0x7f40940c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 -- 172.21.15.97:0/4188339545 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4094159470 con 0x7f4094071e10 2023-12-04T05:37:04.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099e57640 1 --2- 172.21.15.97:0/4188339545 >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 0x7f40940c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:04.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f409a658640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 0x7f409415bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:04.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4099656640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409406be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40940c3920 tx=0x7f408401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a362316a7a0987 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4098e55640 1 -- 172.21.15.97:0/4188339545 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ac410 con 0x7f4094071e10 2023-12-04T05:37:04.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4098e55640 1 -- 172.21.15.97:0/4188339545 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840ac570 con 0x7f4094071e10 2023-12-04T05:37:04.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f4098e55640 1 -- 172.21.15.97:0/4188339545 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ac900 con 0x7f4094071e10 2023-12-04T05:37:04.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f409c0bb640 1 -- 172.21.15.97:0/4188339545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 msgr2=0x7f409406be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.379+0000 7f409c0bb640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409406be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40940c3920 tx=0x7f408401c500 comp rx=0 tx=0).stop 2023-12-04T05:37:04.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- 172.21.15.97:0/4188339545 shutdown_connections 2023-12-04T05:37:04.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f409406c340 0x7f409415bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- 172.21.15.97:0/4188339545 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409406be00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- 172.21.15.97:0/4188339545 >> v2:172.21.15.143:3300/0 conn(0x7f40940c1880 0x7f40940c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- 172.21.15.97:0/4188339545 >> 172.21.15.97:0/4188339545 conn(0x7f40940c2970 msgr2=0x7f40940c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- 172.21.15.97:0/4188339545 shutdown_connections 2023-12-04T05:37:04.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- 172.21.15.97:0/4188339545 wait complete. 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 Processor -- start 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- start start 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f409406c340 0x7f40940ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40940c1880 0x7f40941459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940aa880 con 0x7f4094071e10 2023-12-04T05:37:04.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941589e0 con 0x7f409406c340 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409c0bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940abfb0 con 0x7f40940c1880 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47650/0 (socket says 172.21.15.97:47650) 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 -- 172.21.15.97:0/1594041142 learned_addr learned my addr 172.21.15.97:0/1594041142 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099e57640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f409406c340 0x7f40940ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f409a658640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40940c1880 0x7f40941459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 -- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40940c1880 msgr2=0x7f40941459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40940c1880 0x7f40941459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 -- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f409406c340 msgr2=0x7f40940ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f409406c340 0x7f40940ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 -- 172.21.15.97:0/1594041142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840094d0 con 0x7f4094071e10 2023-12-04T05:37:04.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f4099656640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f408401abb0 tx=0x7f40840192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ac410 con 0x7f4094071e10 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840b65f0 con 0x7f4094071e10 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.383+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840b69c0 con 0x7f4094071e10 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40941f1a60 con 0x7f4094071e10 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40941f2020 con 0x7f4094071e10 2023-12-04T05:37:04.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4094068440 con 0x7f4094071e10 2023-12-04T05:37:04.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f40840b6b20 con 0x7f4094071e10 2023-12-04T05:37:04.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f408a7fc640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 0x7f4078068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f408411ede0 con 0x7f4094071e10 2023-12-04T05:37:04.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.387+0000 7f4099e57640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 0x7f4078068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.391+0000 7f4099e57640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 0x7f4078068d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4090006fd0 tx=0x7f4090008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.391+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40840ec1b0 con 0x7f4094071e10 2023-12-04T05:37:04.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4094071170 con 0x7f4094071e10 2023-12-04T05:37:04.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f408a7fc640 1 -- 172.21.15.97:0/1594041142 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f40840ef7d0 con 0x7f4094071e10 2023-12-04T05:37:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:04.546 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:04.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 msgr2=0x7f4078068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 0x7f4078068d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4090006fd0 tx=0x7f4090008040 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 msgr2=0x7f409415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f408401abb0 tx=0x7f40840192a0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 shutdown_connections 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40780668d0 0x7f4078068d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40940c1880 0x7f40941459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4094071e10 0x7f409415b090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 --2- 172.21.15.97:0/1594041142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f409406c340 0x7f40940ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 >> 172.21.15.97:0/1594041142 conn(0x7f40940c2970 msgr2=0x7f4094148dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 shutdown_connections 2023-12-04T05:37:04.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.543+0000 7f409c0bb640 1 -- 172.21.15.97:0/1594041142 wait complete. 2023-12-04T05:37:04.567 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:04.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:04.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.703+0000 7f6ea7bf8640 1 Processor -- start 2023-12-04T05:37:04.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.703+0000 7f6ea7bf8640 1 -- start start 2023-12-04T05:37:04.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea7bf8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6ea0156070 0x7f6ea00c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea7bf8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6ea0163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea7bf8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea0071380 con 0x7f6ea006e410 2023-12-04T05:37:04.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea7bf8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea006cc20 con 0x7f6ea0156070 2023-12-04T05:37:04.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea7bf8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea006cf00 con 0x7f6ea00c0db0 2023-12-04T05:37:04.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5193640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6ea006e410 0x7f6ea0071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46010/0 (socket says 172.21.15.97:46010) 2023-12-04T05:37:04.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5193640 1 -- 172.21.15.97:0/503639212 learned_addr learned my addr 172.21.15.97:0/503639212 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 --2- 172.21.15.97:0/503639212 >> v2:172.21.15.143:3300/0 conn(0x7f6ea0156070 0x7f6ea00c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea6195640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6ea0163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729730083 0 0) 0x7f6ea0071380 con 0x7f6ea006e410 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c003530 con 0x7f6ea006e410 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1075247516 0 0) 0x7f6e8c003530 con 0x7f6ea006e410 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 msgr2=0x7f6ea0163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6ea0163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 >> v2:172.21.15.143:3300/0 conn(0x7f6ea0156070 msgr2=0x7f6ea00c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 --2- 172.21.15.97:0/503639212 >> v2:172.21.15.143:3300/0 conn(0x7f6ea0156070 0x7f6ea00c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea015cbb0 con 0x7f6ea006e410 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f6e90001680 con 0x7f6ea006e410 2023-12-04T05:37:04.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 >> v1:172.21.15.97:6789/0 conn(0x7f6ea006e410 legacy=0x7f6ea0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e8c003980 0x7f6e8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6e8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea006cc20 con 0x7f6e8c003980 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea006cf00 con 0x7f6e8c0047d0 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c00b990 con 0x7f6ea00c0db0 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e8c003980 0x7f6e8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5193640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea6195640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6e8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 -- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 msgr2=0x7f6e8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ea00c0db0 0x7f6e8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 -- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8c0047d0 msgr2=0x7f6e8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:04.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.707+0000 7f6ea5994640 1 -- 172.21.15.97:0/503639212 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c003530 con 0x7f6e8c003980 2023-12-04T05:37:04.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea5994640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e8c003980 0x7f6e8c003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009ae0 tx=0x7f6e9c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b9cb7f86dadd7e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0a5510 con 0x7f6e8c003980 2023-12-04T05:37:04.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c0a5670 con 0x7f6e8c003980 2023-12-04T05:37:04.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea4992640 1 -- 172.21.15.97:0/503639212 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0a5a20 con 0x7f6e8c003980 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/503639212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e8c003980 msgr2=0x7f6e8c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/503639212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e8c003980 0x7f6e8c003da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009ae0 tx=0x7f6e9c01ca90 comp rx=0 tx=0).stop 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea6195640 1 -- 172.21.15.97:0/503639212 reap_dead start 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/503639212 shutdown_connections 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/503639212 >> 172.21.15.97:0/503639212 conn(0x7f6ea00c5e70 msgr2=0x7f6ea00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/503639212 shutdown_connections 2023-12-04T05:37:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/503639212 wait complete. 2023-12-04T05:37:04.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.711+0000 7f6ea7bf8640 1 Processor -- start 2023-12-04T05:37:04.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- start start 2023-12-04T05:37:04.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 0x7f6ea00aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea01f4d80 0x7f6ea01f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00aa1b0 con 0x7f6ea015e8d0 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f20a0 con 0x7f6ea01f4d80 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f17d0 con 0x7f6e8c003980 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47664/0 (socket says 172.21.15.97:47664) 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 -- 172.21.15.97:0/3167190777 learned_addr learned my addr 172.21.15.97:0/3167190777 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5994640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 0x7f6ea00aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea6195640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea01f4d80 0x7f6ea01f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 -- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 msgr2=0x7f6ea00aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 0x7f6ea00aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 -- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea01f4d80 msgr2=0x7f6ea01f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea01f4d80 0x7f6ea01f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 -- 172.21.15.97:0/3167190777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea015eea0 con 0x7f6ea015e8d0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5994640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 0x7f6ea00aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea5193640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6e90004f70 tx=0x7f6e900074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90007740 con 0x7f6ea015e8d0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000f960 con 0x7f6ea015e8d0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea01f1a50 con 0x7f6ea015e8d0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000fd10 con 0x7f6ea015e8d0 2023-12-04T05:37:04.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea015c4c0 con 0x7f6ea015e8d0 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.715+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea01f2230 con 0x7f6ea015e8d0 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.719+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e9001d460 con 0x7f6ea015e8d0 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.719+0000 7f6e967fc640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 0x7f6e84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.719+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e90084580 con 0x7f6ea015e8d0 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.719+0000 7f6ea5994640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 0x7f6e84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:04.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.719+0000 7f6ea5994640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 0x7f6e84068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0af000 tx=0x7f6e9c0a7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:04.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.723+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e90051830 con 0x7f6ea015e8d0 2023-12-04T05:37:04.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.871+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ea0068440 con 0x7f6ea015e8d0 2023-12-04T05:37:04.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6e967fc640 1 -- 172.21.15.97:0/3167190777 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e90054e50 con 0x7f6ea015e8d0 2023-12-04T05:37:04.876 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:04.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 msgr2=0x7f6e84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 0x7f6e84068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0af000 tx=0x7f6e9c0a7040 comp rx=0 tx=0).stop 2023-12-04T05:37:04.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 msgr2=0x7f6ea00c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:04.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6e90004f70 tx=0x7f6e900074f0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 shutdown_connections 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e840668d0 0x7f6e84068d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ea01f4d80 0x7f6ea01f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6ea015e8d0 0x7f6ea00c19c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 --2- 172.21.15.97:0/3167190777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8c003980 0x7f6ea00aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 >> 172.21.15.97:0/3167190777 conn(0x7f6ea00c5e70 msgr2=0x7f6ea00c3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 shutdown_connections 2023-12-04T05:37:04.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:04.875+0000 7f6ea7bf8640 1 -- 172.21.15.97:0/3167190777 wait complete. 2023-12-04T05:37:04.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:05.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 Processor -- start 2023-12-04T05:37:05.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 -- start start 2023-12-04T05:37:05.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 0x7f514c1643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c071380 con 0x7f514c06e410 2023-12-04T05:37:05.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c06cc20 con 0x7f514c156070 2023-12-04T05:37:05.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f5153dc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c06cf00 con 0x7f514c06c280 2023-12-04T05:37:05.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f515135f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f514c06e410 0x7f514c071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46016/0 (socket says 172.21.15.97:46016) 2023-12-04T05:37:05.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.039+0000 7f515135f640 1 -- 172.21.15.97:0/1789636893 learned_addr learned my addr 172.21.15.97:0/1789636893 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:05.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5152361640 1 --2- 172.21.15.97:0/1789636893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 0x7f514c1643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194813580 0 0) 0x7f514c071380 con 0x7f514c06e410 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5138003530 con 0x7f514c06e410 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283823594 0 0) 0x7f514c06cc20 con 0x7f514c156070 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f514c071380 con 0x7f514c156070 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5152361640 1 -- 172.21.15.97:0/1789636893 >> v1:172.21.15.143:6789/0 conn(0x7f514c156070 legacy=0x7f514c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5152361640 1 -- 172.21.15.97:0/1789636893 >> v1:172.21.15.97:6789/0 conn(0x7f514c06e410 legacy=0x7f514c071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5152361640 1 -- 172.21.15.97:0/1789636893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c15cbb0 con 0x7f514c06c280 2023-12-04T05:37:05.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5152361640 1 --2- 172.21.15.97:0/1789636893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 0x7f514c1643a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5144009dc0 tx=0x7f514401d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=644c58050f1daf92 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51440a5a50 con 0x7f514c06c280 2023-12-04T05:37:05.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51440a5bb0 con 0x7f514c06c280 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.043+0000 7f5150b5e640 1 -- 172.21.15.97:0/1789636893 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51440ad440 con 0x7f514c06c280 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- 172.21.15.97:0/1789636893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 msgr2=0x7f514c1643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 --2- 172.21.15.97:0/1789636893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 0x7f514c1643a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5144009dc0 tx=0x7f514401d3d0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- 172.21.15.97:0/1789636893 shutdown_connections 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 --2- 172.21.15.97:0/1789636893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06c280 0x7f514c1643a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- 172.21.15.97:0/1789636893 >> 172.21.15.97:0/1789636893 conn(0x7f514c0c5e70 msgr2=0x7f514c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:05.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- 172.21.15.97:0/1789636893 shutdown_connections 2023-12-04T05:37:05.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- 172.21.15.97:0/1789636893 wait complete. 2023-12-04T05:37:05.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 Processor -- start 2023-12-04T05:37:05.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- start start 2023-12-04T05:37:05.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 0x7f514c1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 0x7f514c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1f1a50 con 0x7f514c06c280 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0a8a40 con 0x7f514c156070 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5153dc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0a8d20 con 0x7f514c06e410 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47680/0 (socket says 172.21.15.97:47680) 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 -- 172.21.15.97:0/998919326 learned_addr learned my addr 172.21.15.97:0/998919326 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f515135f640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 0x7f514c1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5152361640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 0x7f514c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 -- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 msgr2=0x7f514c1f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 0x7f514c1f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 -- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 msgr2=0x7f514c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 0x7f514c15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5151b60640 1 -- 172.21.15.97:0/998919326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009a70 con 0x7f514c06c280 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f515135f640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 0x7f514c1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.047+0000 7f5152361640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 0x7f514c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f5151b60640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f514800c430 tx=0x7f514800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480052d0 con 0x7f514c06c280 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148005450 con 0x7f514c06c280 2023-12-04T05:37:05.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c1f1d10 con 0x7f514c06c280 2023-12-04T05:37:05.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148003840 con 0x7f514c06c280 2023-12-04T05:37:05.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c15b9e0 con 0x7f514c06c280 2023-12-04T05:37:05.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c1f2230 con 0x7f514c06c280 2023-12-04T05:37:05.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f51480039a0 con 0x7f514c06c280 2023-12-04T05:37:05.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5148083a30 con 0x7f514c06c280 2023-12-04T05:37:05.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.051+0000 7f515135f640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.055+0000 7f515135f640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 0x7f5130068dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f514c1f6080 tx=0x7f513c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.055+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f514c1f2230 con 0x7f514c06c280 2023-12-04T05:37:05.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.207+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f514c1f2230 con 0x7f514c06c280 2023-12-04T05:37:05.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.207+0000 7f51427fc640 1 -- 172.21.15.97:0/998919326 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5148017020 con 0x7f514c06c280 2023-12-04T05:37:05.210 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:05.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.207+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 msgr2=0x7f5130068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.207+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 0x7f5130068dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f514c1f6080 tx=0x7f513c009040 comp rx=0 tx=0).stop 2023-12-04T05:37:05.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 msgr2=0x7f514c0a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f514800c430 tx=0x7f514800c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 shutdown_connections 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5130066900 0x7f5130068dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514c156070 0x7f514c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f514c06e410 0x7f514c1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 --2- 172.21.15.97:0/998919326 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514c06c280 0x7f514c0a8460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 >> 172.21.15.97:0/998919326 conn(0x7f514c0c5e70 msgr2=0x7f514c151da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 shutdown_connections 2023-12-04T05:37:05.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.211+0000 7f5153dc4640 1 -- 172.21.15.97:0/998919326 wait complete. 2023-12-04T05:37:05.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:05.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 Processor -- start 2023-12-04T05:37:05.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 -- start start 2023-12-04T05:37:05.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13e006ec90 0x7f13e0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e0152b60 con 0x7f13e006b600 2023-12-04T05:37:05.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00a9b30 con 0x7f13e006ec90 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.367+0000 7f13e4e32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0156100 con 0x7f13e014fd00 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13e006ec90 0x7f13e0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13e006ec90 0x7f13e0152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47684/0 (socket says 172.21.15.97:47684) 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 -- 172.21.15.97:0/2220979433 learned_addr learned my addr 172.21.15.97:0/2220979433 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13de59c640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 -- 172.21.15.97:0/2220979433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 msgr2=0x7f13e0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e0155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 -- 172.21.15.97:0/2220979433 >> v1:172.21.15.143:6789/0 conn(0x7f13e006b600 legacy=0x7f13e006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 -- 172.21.15.97:0/2220979433 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00abc80 con 0x7f13e006ec90 2023-12-04T05:37:05.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13d7fff640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e0152ff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009870 tx=0x7f13c801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b267345f61a4c64b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13ddd9b640 1 -- 172.21.15.97:0/2220979433 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ab600 con 0x7f13e006ec90 2023-12-04T05:37:05.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13ddd9b640 1 -- 172.21.15.97:0/2220979433 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80a7050 con 0x7f13e006ec90 2023-12-04T05:37:05.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.371+0000 7f13ddd9b640 1 -- 172.21.15.97:0/2220979433 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ab980 con 0x7f13e006ec90 2023-12-04T05:37:05.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- 172.21.15.97:0/2220979433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 msgr2=0x7f13e0152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e0152ff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009870 tx=0x7f13c801c4b0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- 172.21.15.97:0/2220979433 shutdown_connections 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e0152ff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- 172.21.15.97:0/2220979433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e0155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- 172.21.15.97:0/2220979433 >> 172.21.15.97:0/2220979433 conn(0x7f13e00c31c0 msgr2=0x7f13e00c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- 172.21.15.97:0/2220979433 shutdown_connections 2023-12-04T05:37:05.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- 172.21.15.97:0/2220979433 wait complete. 2023-12-04T05:37:05.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 Processor -- start 2023-12-04T05:37:05.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- start start 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13e006b600 0x7f13e01f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e01ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0157c90 con 0x7f13e006ec90 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e015c5e0 con 0x7f13e006b600 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13e4e32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0158a90 con 0x7f13e014fd00 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47690/0 (socket says 172.21.15.97:47690) 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13d7fff640 1 -- 172.21.15.97:0/1161753467 learned_addr learned my addr 172.21.15.97:0/1161753467 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:05.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13de59c640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13e006b600 0x7f13e01f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.375+0000 7f13ded9d640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e01ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 -- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 msgr2=0x7f13e01ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e01ef940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 -- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13e006b600 msgr2=0x7f13e01f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13e006b600 0x7f13e01f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 -- 172.21.15.97:0/1161753467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80094d0 con 0x7f13e006ec90 2023-12-04T05:37:05.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d7fff640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13c80ae040 tx=0x7f13c8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80b4440 con 0x7f13e006ec90 2023-12-04T05:37:05.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80b45c0 con 0x7f13e006ec90 2023-12-04T05:37:05.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e01576d0 con 0x7f13e006ec90 2023-12-04T05:37:05.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80b4970 con 0x7f13e006ec90 2023-12-04T05:37:05.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e01f16a0 con 0x7f13e006ec90 2023-12-04T05:37:05.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e0068440 con 0x7f13e006ec90 2023-12-04T05:37:05.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f13c80b2070 con 0x7f13e006ec90 2023-12-04T05:37:05.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 0x7f13c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.379+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13c811e170 con 0x7f13e006ec90 2023-12-04T05:37:05.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.383+0000 7f13de59c640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 0x7f13c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.383+0000 7f13de59c640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 0x7f13c0068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13d00079c0 tx=0x7f13d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.383+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13c80eb4f0 con 0x7f13e006ec90 2023-12-04T05:37:05.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13e00a5bc0 con 0x7f13e006ec90 2023-12-04T05:37:05.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13d6ffd640 1 -- 172.21.15.97:0/1161753467 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13c80eeb10 con 0x7f13e006ec90 2023-12-04T05:37:05.538 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:05.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 msgr2=0x7f13c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 0x7f13c0068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13d00079c0 tx=0x7f13d0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:05.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 msgr2=0x7f13e01ef400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13c80ae040 tx=0x7f13c8019250 comp rx=0 tx=0).stop 2023-12-04T05:37:05.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 shutdown_connections 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13c00668d0 0x7f13c0068d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13e014fd00 0x7f13e01ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13e006ec90 0x7f13e01ef400 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 --2- 172.21.15.97:0/1161753467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13e006b600 0x7f13e01f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 >> 172.21.15.97:0/1161753467 conn(0x7f13e00c31c0 msgr2=0x7f13e00c5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 shutdown_connections 2023-12-04T05:37:05.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.535+0000 7f13e4e32640 1 -- 172.21.15.97:0/1161753467 wait complete. 2023-12-04T05:37:05.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-04T05:37:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 Processor -- start 2023-12-04T05:37:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 -- start start 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40af630 0x7fe2e40c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe2e40c4d50 0x7fe2e406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e4154680 con 0x7fe2e40c72b0 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40afa10 con 0x7fe2e40c4d50 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e8fb5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4154960 con 0x7fe2e40af630 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe2e40c4d50 0x7fe2e406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe2e40c4d50 0x7fe2e406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47702/0 (socket says 172.21.15.97:47702) 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 -- 172.21.15.97:0/2448436785 learned_addr learned my addr 172.21.15.97:0/2448436785 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e37fe640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40af630 0x7fe2e40c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 -- 172.21.15.97:0/2448436785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40af630 msgr2=0x7fe2e40c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40af630 0x7fe2e40c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 -- 172.21.15.97:0/2448436785 >> v1:172.21.15.143:6789/0 conn(0x7fe2e40c72b0 legacy=0x7fe2e406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.695+0000 7fe2e3fff640 1 -- 172.21.15.97:0/2448436785 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4154c40 con 0x7fe2e40c4d50 2023-12-04T05:37:05.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e3fff640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40c4d50 0x7fe2e406b9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad7113fb022f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e27fc640 1 -- 172.21.15.97:0/2448436785 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a5860 con 0x7fe2e40c4d50 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e27fc640 1 -- 172.21.15.97:0/2448436785 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a59c0 con 0x7fe2e40c4d50 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e27fc640 1 -- 172.21.15.97:0/2448436785 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a5d50 con 0x7fe2e40c4d50 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/2448436785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40c4d50 msgr2=0x7fe2e406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40c4d50 0x7fe2e406b9e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc01c980 comp rx=0 tx=0).stop 2023-12-04T05:37:05.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/2448436785 shutdown_connections 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40c4d50 0x7fe2e406b9e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/2448436785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40af630 0x7fe2e40c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/2448436785 >> 172.21.15.97:0/2448436785 conn(0x7fe2e40aba40 msgr2=0x7fe2e40abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/2448436785 shutdown_connections 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/2448436785 wait complete. 2023-12-04T05:37:05.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.699+0000 7fe2e8fb5640 1 Processor -- start 2023-12-04T05:37:05.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- start start 2023-12-04T05:37:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40c4d50 0x7fe2e41510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 0x7fe2e41515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41558c0 con 0x7fe2e40af630 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41589d0 con 0x7fe2e40c72b0 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4151b20 con 0x7fe2e40c4d50 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47718/0 (socket says 172.21.15.97:47718) 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 -- 172.21.15.97:0/133882122 learned_addr learned my addr 172.21.15.97:0/133882122 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e3fff640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 0x7fe2e41515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e2ffd640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40c4d50 0x7fe2e41510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 -- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40c4d50 msgr2=0x7fe2e41510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40c4d50 0x7fe2e41510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 -- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 msgr2=0x7fe2e41515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 0x7fe2e41515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 -- 172.21.15.97:0/133882122 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc009b30 con 0x7fe2e40af630 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e3fff640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 0x7fe2e41515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e37fe640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400e870 tx=0x7fe2d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4009510 con 0x7fe2e40af630 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400eec0 con 0x7fe2e40af630 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400cb40 con 0x7fe2e40af630 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e4158410 con 0x7fe2e40af630 2023-12-04T05:37:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e415e8a0 con 0x7fe2e40af630 2023-12-04T05:37:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.703+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e404e890 con 0x7fe2e40af630 2023-12-04T05:37:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.707+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2d400cca0 con 0x7fe2e40af630 2023-12-04T05:37:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.707+0000 7fe2cbfff640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 0x7fe2d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.707+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2d4084580 con 0x7fe2e40af630 2023-12-04T05:37:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.707+0000 7fe2e2ffd640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 0x7fe2d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:05.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.707+0000 7fe2e2ffd640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 0x7fe2d0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40c82c0 tx=0x7fe2d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:05.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.711+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2d40517b0 con 0x7fe2e40af630 2023-12-04T05:37:05.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:05.915+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fe2e406c910 con 0x7fe2e40af630 2023-12-04T05:37:06.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.127+0000 7fe2cbfff640 1 -- 172.21.15.97:0/133882122 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v51) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe2d4054dd0 con 0x7fe2e40af630 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 msgr2=0x7fe2d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 0x7fe2d0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40c82c0 tx=0x7fe2d8009040 comp rx=0 tx=0).stop 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 msgr2=0x7fe2e415e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400e870 tx=0x7fe2d400ec70 comp rx=0 tx=0).stop 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 shutdown_connections 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe2d00668d0 0x7fe2d0068d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2e40c72b0 0x7fe2e41515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2e40c4d50 0x7fe2e41510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 --2- 172.21.15.97:0/133882122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2e40af630 0x7fe2e415e360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 >> 172.21.15.97:0/133882122 conn(0x7fe2e40aba40 msgr2=0x7fe2e40abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:06.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 shutdown_connections 2023-12-04T05:37:06.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.131+0000 7fe2e8fb5640 1 -- 172.21.15.97:0/133882122 wait complete. 2023-12-04T05:37:06.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-04T05:37:06.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.291+0000 7fc10ecdd640 1 Processor -- start 2023-12-04T05:37:06.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.291+0000 7fc10ecdd640 1 -- start start 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ecdd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ecdd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc10806c440 0x7fc1080a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ecdd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080aa240 con 0x7fc1080a89a0 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ecdd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10806c0c0 con 0x7fc10806c440 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ecdd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080aa500 con 0x7fc1080c1e70 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc107fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc10806c440 0x7fc1080a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10d27a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc1080a89a0 0x7fc10806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46032/0 (socket says 172.21.15.97:46032) 2023-12-04T05:37:06.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10d27a640 1 -- 172.21.15.97:0/1736595813 learned_addr learned my addr 172.21.15.97:0/1736595813 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc107fff640 1 -- 172.21.15.97:0/1736595813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 msgr2=0x7fc1081524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ca79640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc1077fe640 1 -- 172.21.15.97:0/1736595813 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065221043 0 0) 0x7fc1080aa240 con 0x7fc1080a89a0 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc107fff640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc107fff640 1 -- 172.21.15.97:0/1736595813 >> v1:172.21.15.97:6789/0 conn(0x7fc1080a89a0 legacy=0x7fc10806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc107fff640 1 -- 172.21.15.97:0/1736595813 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080aa7e0 con 0x7fc10806c440 2023-12-04T05:37:06.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.295+0000 7fc10ca79640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:06.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc107fff640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc1080a8460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097c0 tx=0x7fc0f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b9bb0cbe6b226d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc1077fe640 1 -- 172.21.15.97:0/1736595813 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40ab650 con 0x7fc10806c440 2023-12-04T05:37:06.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc1077fe640 1 -- 172.21.15.97:0/1736595813 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f40ab7b0 con 0x7fc10806c440 2023-12-04T05:37:06.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc1077fe640 1 -- 172.21.15.97:0/1736595813 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40abb40 con 0x7fc10806c440 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- 172.21.15.97:0/1736595813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 msgr2=0x7fc1080a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc1080a8460 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097c0 tx=0x7fc0f401c450 comp rx=0 tx=0).stop 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- 172.21.15.97:0/1736595813 shutdown_connections 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc1080a8460 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/1736595813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- 172.21.15.97:0/1736595813 >> 172.21.15.97:0/1736595813 conn(0x7fc1080c5e70 msgr2=0x7fc1080c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:06.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- 172.21.15.97:0/1736595813 shutdown_connections 2023-12-04T05:37:06.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- 172.21.15.97:0/1736595813 wait complete. 2023-12-04T05:37:06.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 Processor -- start 2023-12-04T05:37:06.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- start start 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1080a89a0 0x7fc108155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108155640 con 0x7fc10806c440 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108149d60 con 0x7fc1080a89a0 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.299+0000 7fc10ecdd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108155850 con 0x7fc1080c1e70 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47738/0 (socket says 172.21.15.97:47738) 2023-12-04T05:37:06.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 -- 172.21.15.97:0/2728976575 learned_addr learned my addr 172.21.15.97:0/2728976575 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:06.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc107fff640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1080a89a0 0x7fc108155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10d27a640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 -- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 msgr2=0x7fc1081eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 -- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1080a89a0 msgr2=0x7fc108155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1080a89a0 0x7fc108155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 -- 172.21.15.97:0/2728976575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009420 con 0x7fc10806c440 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ca79640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c7f0 tx=0x7fc0fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc007820 con 0x7fc10806c440 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc007980 con 0x7fc10806c440 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc007d30 con 0x7fc10806c440 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080c23d0 con 0x7fc10806c440 2023-12-04T05:37:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc108149a80 con 0x7fc10806c440 2023-12-04T05:37:06.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108068440 con 0x7fc10806c440 2023-12-04T05:37:06.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.303+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc0fc0113f0 con 0x7fc10806c440 2023-12-04T05:37:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.307+0000 7fc1057fa640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 0x7fc0ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.307+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0fc0846c0 con 0x7fc10806c440 2023-12-04T05:37:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.307+0000 7fc107fff640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 0x7fc0ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.307+0000 7fc107fff640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 0x7fc0ec068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40af000 tx=0x7fc0f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.311+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0fc0519a0 con 0x7fc10806c440 2023-12-04T05:37:06.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.459+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc10806c220 con 0x7fc10806c440 2023-12-04T05:37:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.463+0000 7fc1057fa640 1 -- 172.21.15.97:0/2728976575 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0fc054fc0 con 0x7fc10806c440 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.463+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 msgr2=0x7fc0ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.463+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 0x7fc0ec068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40af000 tx=0x7fc0f40a7000 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.463+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 msgr2=0x7fc108154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.463+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c7f0 tx=0x7fc0fc00ccb0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 shutdown_connections 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc0ec0668d0 0x7fc0ec068d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1080c1e70 0x7fc1081eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1080a89a0 0x7fc108155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 --2- 172.21.15.97:0/2728976575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc10806c440 0x7fc108154bc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 >> 172.21.15.97:0/2728976575 conn(0x7fc1080c5e70 msgr2=0x7fc108152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 shutdown_connections 2023-12-04T05:37:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.467+0000 7fc10ecdd640 1 -- 172.21.15.97:0/2728976575 wait complete. 2023-12-04T05:37:06.487 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:37:06.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:37:06.570 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:37:06.661 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:37:06.662 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:06.662 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:06.675 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:06.675 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:06.733 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:06.733 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:06.789 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:06.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 Processor -- start 2023-12-04T05:37:06.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 -- start start 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc151bf0 0x7f40cc0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc1547d0 con 0x7f40cc155370 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc158b80 con 0x7f40cc0c7ef0 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d32bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0c4aa0 con 0x7f40cc151bf0 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc151bf0 0x7f40cc0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40cc151bf0 0x7f40cc0abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47742/0 (socket says 172.21.15.97:47742) 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 -- 172.21.15.97:0/913298384 learned_addr learned my addr 172.21.15.97:0/913298384 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:06.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1858640 1 --1- 172.21.15.97:0/913298384 >> v1:172.21.15.97:6789/0 conn(0x7f40cc155370 0x7f40cc15efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46040/0 (socket says 172.21.15.97:46040) 2023-12-04T05:37:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 -- 172.21.15.97:0/913298384 >> v1:172.21.15.143:6789/0 conn(0x7f40cc0c7ef0 legacy=0x7f40cc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 -- 172.21.15.97:0/913298384 >> v1:172.21.15.97:6789/0 conn(0x7f40cc155370 legacy=0x7f40cc15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40d1057640 1 -- 172.21.15.97:0/913298384 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0c4d40 con 0x7f40cc151bf0 2023-12-04T05:37:06.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.967+0000 7f40c3fff640 1 -- 172.21.15.97:0/913298384 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322968291 0 0) 0x7f40cc1547d0 con 0x7f40cc155370 2023-12-04T05:37:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d1057640 1 --2- 172.21.15.97:0/913298384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0abbb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009870 tx=0x7f40c801c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65f5186fe486e48 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40c3fff640 1 -- 172.21.15.97:0/913298384 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80a4900 con 0x7f40cc151bf0 2023-12-04T05:37:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40c3fff640 1 -- 172.21.15.97:0/913298384 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80a4a60 con 0x7f40cc151bf0 2023-12-04T05:37:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40c3fff640 1 -- 172.21.15.97:0/913298384 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80a4df0 con 0x7f40cc151bf0 2023-12-04T05:37:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 -- 172.21.15.97:0/913298384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 msgr2=0x7f40cc0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 --2- 172.21.15.97:0/913298384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0abbb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009870 tx=0x7f40c801c0c0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 -- 172.21.15.97:0/913298384 shutdown_connections 2023-12-04T05:37:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 --2- 172.21.15.97:0/913298384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0abbb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 -- 172.21.15.97:0/913298384 >> 172.21.15.97:0/913298384 conn(0x7f40cc073550 msgr2=0x7f40cc073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 -- 172.21.15.97:0/913298384 shutdown_connections 2023-12-04T05:37:06.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.971+0000 7f40d32bb640 1 -- 172.21.15.97:0/913298384 wait complete. 2023-12-04T05:37:06.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 Processor -- start 2023-12-04T05:37:06.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- start start 2023-12-04T05:37:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40cc0c7ef0 0x7f40cc0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40cc155370 0x7f40cc0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc148290 con 0x7f40cc151bf0 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1f2e30 con 0x7f40cc155370 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1f2220 con 0x7f40cc0c7ef0 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47754/0 (socket says 172.21.15.97:47754) 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 -- 172.21.15.97:0/2558324197 learned_addr learned my addr 172.21.15.97:0/2558324197 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d1057640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40cc0c7ef0 0x7f40cc0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d1858640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40cc155370 0x7f40cc0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 -- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40cc0c7ef0 msgr2=0x7f40cc0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40cc0c7ef0 0x7f40cc0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 -- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40cc155370 msgr2=0x7f40cc0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40cc155370 0x7f40cc0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 -- 172.21.15.97:0/2558324197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80094d0 con 0x7f40cc151bf0 2023-12-04T05:37:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d0856640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c410 tx=0x7f40bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011790 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0118f0 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc011ce0 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc1f2500 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc1f2ac0 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.975+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc1f2fe0 con 0x7f40cc151bf0 2023-12-04T05:37:06.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.979+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f40bc01c460 con 0x7f40cc151bf0 2023-12-04T05:37:06.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.979+0000 7f40c1ffb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 0x7f40b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:06.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.979+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40bc0840d0 con 0x7f40cc151bf0 2023-12-04T05:37:06.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.979+0000 7f40d1057640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 0x7f40b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:06.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.979+0000 7f40d1057640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 0x7f40b0068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ae000 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:06.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:06.983+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40bc051330 con 0x7f40cc151bf0 2023-12-04T05:37:07.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.131+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40cc068440 con 0x7f40cc151bf0 2023-12-04T05:37:07.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40c1ffb640 1 -- 172.21.15.97:0/2558324197 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f40bc054950 con 0x7f40cc151bf0 2023-12-04T05:37:07.137 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:07.137 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 msgr2=0x7f40b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 0x7f40b0068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ae000 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 msgr2=0x7f40cc0ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00c410 tx=0x7f40bc00c8d0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 shutdown_connections 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40b00668d0 0x7f40b0068d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40cc155370 0x7f40cc0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40cc151bf0 0x7f40cc0ad0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 --2- 172.21.15.97:0/2558324197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40cc0c7ef0 0x7f40cc0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 >> 172.21.15.97:0/2558324197 conn(0x7f40cc073550 msgr2=0x7f40cc154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 shutdown_connections 2023-12-04T05:37:07.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.135+0000 7f40d32bb640 1 -- 172.21.15.97:0/2558324197 wait complete. 2023-12-04T05:37:07.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:07.162 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 Processor -- start 2023-12-04T05:37:07.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 -- start start 2023-12-04T05:37:07.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 0x7f2fe81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80aa240 con 0x7f2fe806d210 2023-12-04T05:37:07.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe80aa500 con 0x7f2fe806c440 2023-12-04T05:37:07.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fee972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe806c0c0 con 0x7f2fe80c1e70 2023-12-04T05:37:07.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fecf0f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2fe806d210 0x7f2fe806d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46052/0 (socket says 172.21.15.97:46052) 2023-12-04T05:37:07.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fecf0f640 1 -- 172.21.15.97:0/3127061297 learned_addr learned my addr 172.21.15.97:0/3127061297 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe7fff640 1 --2- 172.21.15.97:0/3127061297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 0x7f2fe81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119577640 0 0) 0x7f2fe80aa240 con 0x7f2fe806d210 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd0003530 con 0x7f2fe806d210 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986583907 0 0) 0x7f2fe80aa500 con 0x7f2fe806c440 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe80aa240 con 0x7f2fe806c440 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe7fff640 1 -- 172.21.15.97:0/3127061297 >> v1:172.21.15.143:6789/0 conn(0x7f2fe806c440 legacy=0x7f2fe80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263958134 0 0) 0x7f2fd0003530 con 0x7f2fe806d210 2023-12-04T05:37:07.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe7fff640 1 -- 172.21.15.97:0/3127061297 >> v1:172.21.15.97:6789/0 conn(0x7f2fe806d210 legacy=0x7f2fe806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.307+0000 7f2fe7fff640 1 -- 172.21.15.97:0/3127061297 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80aa7e0 con 0x7f2fe80c1e70 2023-12-04T05:37:07.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fe7fff640 1 --2- 172.21.15.97:0/3127061297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 0x7f2fe81524e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80097f0 tx=0x7f2fd801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0159e99d66c1cdc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0001a00 con 0x7f2fe80c1e70 2023-12-04T05:37:07.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a7050 con 0x7f2fe80c1e70 2023-12-04T05:37:07.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fe6ffd640 1 -- 172.21.15.97:0/3127061297 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004250 con 0x7f2fe80c1e70 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 -- 172.21.15.97:0/3127061297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 msgr2=0x7f2fe81524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 --2- 172.21.15.97:0/3127061297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 0x7f2fe81524e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80097f0 tx=0x7f2fd801c3b0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 -- 172.21.15.97:0/3127061297 shutdown_connections 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 --2- 172.21.15.97:0/3127061297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe80c1e70 0x7f2fe81524e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 -- 172.21.15.97:0/3127061297 >> 172.21.15.97:0/3127061297 conn(0x7f2fe80c5e70 msgr2=0x7f2fe80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 -- 172.21.15.97:0/3127061297 shutdown_connections 2023-12-04T05:37:07.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.311+0000 7f2fee972640 1 -- 172.21.15.97:0/3127061297 wait complete. 2023-12-04T05:37:07.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 Processor -- start 2023-12-04T05:37:07.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- start start 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe806c440 0x7f2fe8149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe80c1e70 0x7f2fe814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe814b430 con 0x7f2fe806d210 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe814c5a0 con 0x7f2fe80c1e70 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81ecec0 con 0x7f2fe806c440 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47768/0 (socket says 172.21.15.97:47768) 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 -- 172.21.15.97:0/1189848189 learned_addr learned my addr 172.21.15.97:0/1189848189 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe7fff640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe806c440 0x7f2fe8149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fecf0f640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe80c1e70 0x7f2fe814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 -- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe806c440 msgr2=0x7f2fe8149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe806c440 0x7f2fe8149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 -- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe80c1e70 msgr2=0x7f2fe814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe80c1e70 0x7f2fe814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 -- 172.21.15.97:0/1189848189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8009420 con 0x7f2fe806d210 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe77fe640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c430 tx=0x7f2fdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0052d0 con 0x7f2fe806d210 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc005450 con 0x7f2fe806d210 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc003840 con 0x7f2fe806d210 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe814b610 con 0x7f2fe806d210 2023-12-04T05:37:07.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.315+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe81ed160 con 0x7f2fe806d210 2023-12-04T05:37:07.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80c05c0 con 0x7f2fe806d210 2023-12-04T05:37:07.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2fdc0039a0 con 0x7f2fe806d210 2023-12-04T05:37:07.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fe4ff9640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 0x7f2fd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc083ab0 con 0x7f2fe806d210 2023-12-04T05:37:07.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fe7fff640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 0x7f2fd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.319+0000 7f2fe7fff640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 0x7f2fd4068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ad000 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.323+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fdc050c70 con 0x7f2fe806d210 2023-12-04T05:37:07.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.475+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fe81ed2f0 con 0x7f2fe806d210 2023-12-04T05:37:07.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.475+0000 7f2fe4ff9640 1 -- 172.21.15.97:0/1189848189 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fdc017020 con 0x7f2fe806d210 2023-12-04T05:37:07.478 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:07.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 msgr2=0x7f2fd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 0x7f2fd4068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80ad000 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 msgr2=0x7f2fe814dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c430 tx=0x7f2fdc00c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 shutdown_connections 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2fd40668d0 0x7f2fd4068d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2fe80c1e70 0x7f2fe814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2fe806d210 0x7f2fe814dbf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 --2- 172.21.15.97:0/1189848189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2fe806c440 0x7f2fe8149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 >> 172.21.15.97:0/1189848189 conn(0x7f2fe80c5e70 msgr2=0x7f2fe80c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 shutdown_connections 2023-12-04T05:37:07.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.479+0000 7f2fee972640 1 -- 172.21.15.97:0/1189848189 wait complete. 2023-12-04T05:37:07.499 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:07.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.635+0000 7f7c4dd65640 1 Processor -- start 2023-12-04T05:37:07.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.635+0000 7f7c4dd65640 1 -- start start 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c4dd65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c48072800 0x7f7c480c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c4dd65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c48158800 0x7f7c4806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c4dd65640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c48154880 con 0x7f7c480c1fb0 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c4dd65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c48158c90 con 0x7f7c48072800 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c4dd65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4806e160 con 0x7f7c48158800 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c48072800 0x7f7c480c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7c48072800 0x7f7c480c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47782/0 (socket says 172.21.15.97:47782) 2023-12-04T05:37:07.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 -- 172.21.15.97:0/2713544428 learned_addr learned my addr 172.21.15.97:0/2713544428 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:07.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c47fff640 1 --2- 172.21.15.97:0/2713544428 >> v2:172.21.15.143:3300/0 conn(0x7f7c48158800 0x7f7c4806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 -- 172.21.15.97:0/2713544428 >> v2:172.21.15.143:3300/0 conn(0x7f7c48158800 msgr2=0x7f7c4806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:07.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 --2- 172.21.15.97:0/2713544428 >> v2:172.21.15.143:3300/0 conn(0x7f7c48158800 0x7f7c4806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 -- 172.21.15.97:0/2713544428 >> v1:172.21.15.143:6789/0 conn(0x7f7c480c1fb0 legacy=0x7f7c48155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:07.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.639+0000 7f7c46ffd640 1 -- 172.21.15.97:0/2713544428 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4806e440 con 0x7f7c48072800 2023-12-04T05:37:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c46ffd640 1 --2- 172.21.15.97:0/2713544428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c48072800 0x7f7c480c10c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072da0 tx=0x7f7c3c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfc70b84ea9cde0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c467fc640 1 -- 172.21.15.97:0/2713544428 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0ab600 con 0x7f7c48072800 2023-12-04T05:37:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c467fc640 1 -- 172.21.15.97:0/2713544428 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0a7050 con 0x7f7c48072800 2023-12-04T05:37:07.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c467fc640 1 -- 172.21.15.97:0/2713544428 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0ab980 con 0x7f7c48072800 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- 172.21.15.97:0/2713544428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c48072800 msgr2=0x7f7c480c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/2713544428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c48072800 0x7f7c480c10c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072da0 tx=0x7f7c3c01c370 comp rx=0 tx=0).stop 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- 172.21.15.97:0/2713544428 shutdown_connections 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/2713544428 >> v2:172.21.15.143:3300/0 conn(0x7f7c48158800 0x7f7c4806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/2713544428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c48072800 0x7f7c480c10c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- 172.21.15.97:0/2713544428 >> 172.21.15.97:0/2713544428 conn(0x7f7c480c31c0 msgr2=0x7f7c480c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- 172.21.15.97:0/2713544428 shutdown_connections 2023-12-04T05:37:07.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- 172.21.15.97:0/2713544428 wait complete. 2023-12-04T05:37:07.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 Processor -- start 2023-12-04T05:37:07.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.643+0000 7f7c4dd65640 1 -- start start 2023-12-04T05:37:07.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c48072800 0x7f7c48148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 0x7f7c480c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480aa3e0 con 0x7f7c480c1fb0 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480a9ed0 con 0x7f7c48072800 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480c5b20 con 0x7f7c48158800 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47798/0 (socket says 172.21.15.97:47798) 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 -- 172.21.15.97:0/640522434 learned_addr learned my addr 172.21.15.97:0/640522434 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c477fe640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c48072800 0x7f7c48148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c47fff640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 0x7f7c480c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 -- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 msgr2=0x7f7c480c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 0x7f7c480c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 -- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c48072800 msgr2=0x7f7c48148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c48072800 0x7f7c48148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 -- 172.21.15.97:0/640522434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0094d0 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c47fff640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 0x7f7c480c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c46ffd640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c019fa0 tx=0x7f7c3c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0b4620 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0b4780 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c480ab680 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0b4b30 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c480a9810 con 0x7f7c480c1fb0 2023-12-04T05:37:07.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.647+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c480aa010 con 0x7f7c480c1fb0 2023-12-04T05:37:07.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.651+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c3c0b2070 con 0x7f7c480c1fb0 2023-12-04T05:37:07.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.651+0000 7f7c2ffff640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 0x7f7c34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.651+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c3c11dfb0 con 0x7f7c480c1fb0 2023-12-04T05:37:07.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.651+0000 7f7c477fe640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 0x7f7c34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.651+0000 7f7c477fe640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 0x7f7c34068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098e0 tx=0x7f7c38009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.655+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c3c0eb1e0 con 0x7f7c480c1fb0 2023-12-04T05:37:07.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c48068440 con 0x7f7c480c1fb0 2023-12-04T05:37:07.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c2ffff640 1 -- 172.21.15.97:0/640522434 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c3c0ee800 con 0x7f7c480c1fb0 2023-12-04T05:37:07.813 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 msgr2=0x7f7c34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 0x7f7c34068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098e0 tx=0x7f7c38009060 comp rx=0 tx=0).stop 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 msgr2=0x7f7c480c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c019fa0 tx=0x7f7c3c019110 comp rx=0 tx=0).stop 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 shutdown_connections 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c340668d0 0x7f7c34068d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c48158800 0x7f7c480c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c480c1fb0 0x7f7c480c55e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 --2- 172.21.15.97:0/640522434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c48072800 0x7f7c48148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 >> 172.21.15.97:0/640522434 conn(0x7f7c480c31c0 msgr2=0x7f7c48151bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 shutdown_connections 2023-12-04T05:37:07.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.811+0000 7f7c4dd65640 1 -- 172.21.15.97:0/640522434 wait complete. 2023-12-04T05:37:07.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:07.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 Processor -- start 2023-12-04T05:37:07.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 -- start start 2023-12-04T05:37:07.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94a00c1e70 0x7f94a01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 0x7f94a006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00aa240 con 0x7f94a006c440 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a006c0c0 con 0x7f94a00c1e70 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a75d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00aa500 con 0x7f94a006d210 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a536d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94a00c1e70 0x7f94a01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a536d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94a00c1e70 0x7f94a01524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47814/0 (socket says 172.21.15.97:47814) 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.971+0000 7f94a536d640 1 -- 172.21.15.97:0/1829455762 learned_addr learned my addr 172.21.15.97:0/1829455762 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a5b6e640 1 --2- 172.21.15.97:0/1829455762 >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 0x7f94a006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a536d640 1 -- 172.21.15.97:0/1829455762 >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 msgr2=0x7f94a006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:07.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a536d640 1 --2- 172.21.15.97:0/1829455762 >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 0x7f94a006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a536d640 1 -- 172.21.15.97:0/1829455762 >> v1:172.21.15.143:6789/0 conn(0x7f94a006c440 legacy=0x7f94a00a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a536d640 1 -- 172.21.15.97:0/1829455762 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00aa7e0 con 0x7f94a00c1e70 2023-12-04T05:37:07.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a5b6e640 1 --2- 172.21.15.97:0/1829455762 >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 0x7f94a006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:07.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a536d640 1 --2- 172.21.15.97:0/1829455762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a00c1e70 0x7f94a01524e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94a0150020 tx=0x7f949c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb95ba175785a57e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f9497fff640 1 -- 172.21.15.97:0/1829455762 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0ac640 con 0x7f94a00c1e70 2023-12-04T05:37:07.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f9497fff640 1 -- 172.21.15.97:0/1829455762 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0ac7a0 con 0x7f94a00c1e70 2023-12-04T05:37:07.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f9497fff640 1 -- 172.21.15.97:0/1829455762 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0acb30 con 0x7f94a00c1e70 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a75d1640 1 -- 172.21.15.97:0/1829455762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a00c1e70 msgr2=0x7f94a01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.975+0000 7f94a75d1640 1 --2- 172.21.15.97:0/1829455762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a00c1e70 0x7f94a01524e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94a0150020 tx=0x7f949c01c4d0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- 172.21.15.97:0/1829455762 shutdown_connections 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 --2- 172.21.15.97:0/1829455762 >> v2:172.21.15.143:3300/0 conn(0x7f94a006d210 0x7f94a006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 --2- 172.21.15.97:0/1829455762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a00c1e70 0x7f94a01524e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- 172.21.15.97:0/1829455762 >> 172.21.15.97:0/1829455762 conn(0x7f94a00c5e70 msgr2=0x7f94a00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:07.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- 172.21.15.97:0/1829455762 shutdown_connections 2023-12-04T05:37:07.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- 172.21.15.97:0/1829455762 wait complete. 2023-12-04T05:37:07.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 Processor -- start 2023-12-04T05:37:07.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- start start 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 0x7f94a01f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94a00c1e70 0x7f94a015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a01eed60 con 0x7f94a006c440 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a013fe00 con 0x7f94a006d210 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a75d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a01ee9c0 con 0x7f94a00c1e70 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47830/0 (socket says 172.21.15.97:47830) 2023-12-04T05:37:07.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 -- 172.21.15.97:0/2344862156 learned_addr learned my addr 172.21.15.97:0/2344862156 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a5b6e640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94a00c1e70 0x7f94a015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a4b6c640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 0x7f94a01f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 -- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94a00c1e70 msgr2=0x7f94a015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94a00c1e70 0x7f94a015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 -- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 msgr2=0x7f94a01f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 0x7f94a01f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 -- 172.21.15.97:0/2344862156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0094d0 con 0x7f94a006c440 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a4b6c640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 0x7f94a01f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.979+0000 7f94a536d640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f949c0190e0 tx=0x7f949c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b5640 con 0x7f94a006c440 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0b57a0 con 0x7f94a006c440 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b5b10 con 0x7f94a006c440 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00c3560 con 0x7f94a006c440 2023-12-04T05:37:07.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00c3280 con 0x7f94a006c440 2023-12-04T05:37:07.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a01ee820 con 0x7f94a006c440 2023-12-04T05:37:07.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f949c0b3070 con 0x7f94a006c440 2023-12-04T05:37:07.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:07.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f949c11e7b0 con 0x7f94a006c440 2023-12-04T05:37:07.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.983+0000 7f94a4b6c640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:07.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.987+0000 7f94a4b6c640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 0x7f9484068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94a01406e0 tx=0x7f9490009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:07.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:07.987+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94a01ee820 con 0x7f94a006c440 2023-12-04T05:37:08.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.135+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94a01ee820 con 0x7f94a006c440 2023-12-04T05:37:08.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.135+0000 7f9495ffb640 1 -- 172.21.15.97:0/2344862156 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94a01ee820 con 0x7f94a006c440 2023-12-04T05:37:08.140 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 msgr2=0x7f9484068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 0x7f9484068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f94a01406e0 tx=0x7f9490009040 comp rx=0 tx=0).stop 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 msgr2=0x7f94a00c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f949c0190e0 tx=0x7f949c019270 comp rx=0 tx=0).stop 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 shutdown_connections 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94840668d0 0x7f9484068d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94a00c1e70 0x7f94a015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94a006d210 0x7f94a01f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 --2- 172.21.15.97:0/2344862156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94a006c440 0x7f94a00c4ae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 >> 172.21.15.97:0/2344862156 conn(0x7f94a00c5e70 msgr2=0x7f94a00c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 shutdown_connections 2023-12-04T05:37:08.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.139+0000 7f94a75d1640 1 -- 172.21.15.97:0/2344862156 wait complete. 2023-12-04T05:37:08.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:37:08.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 Processor -- start 2023-12-04T05:37:08.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 -- start start 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbadc0c7f00 0x7fbadc154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc0ca780 con 0x7fbadc0cac10 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc158720 con 0x7fbadc151f10 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae2be6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc158cc0 con 0x7fbadc0c7f00 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbadbfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbadc0c7f00 0x7fbadc154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae1183640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbadc0cac10 0x7fbadc15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46056/0 (socket says 172.21.15.97:46056) 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbae1183640 1 -- 172.21.15.97:0/4077216421 learned_addr learned my addr 172.21.15.97:0/4077216421 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:08.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbadbfff640 1 -- 172.21.15.97:0/4077216421 >> v1:172.21.15.143:6789/0 conn(0x7fbadc151f10 legacy=0x7fbadc0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbadbfff640 1 -- 172.21.15.97:0/4077216421 >> v1:172.21.15.97:6789/0 conn(0x7fbadc0cac10 legacy=0x7fbadc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbadbfff640 1 -- 172.21.15.97:0/4077216421 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc0bd830 con 0x7fbadc0c7f00 2023-12-04T05:37:08.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.299+0000 7fbadb7fe640 1 -- 172.21.15.97:0/4077216421 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753713230 0 0) 0x7fbadc0ca780 con 0x7fbadc0cac10 2023-12-04T05:37:08.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbadbfff640 1 --2- 172.21.15.97:0/4077216421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc0c7f00 0x7fbadc154720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6308e4262d79cbc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbadb7fe640 1 -- 172.21.15.97:0/4077216421 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab600 con 0x7fbadc0c7f00 2023-12-04T05:37:08.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbadb7fe640 1 -- 172.21.15.97:0/4077216421 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80a7050 con 0x7fbadc0c7f00 2023-12-04T05:37:08.306 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbadb7fe640 1 -- 172.21.15.97:0/4077216421 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab980 con 0x7fbadc0c7f00 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 -- 172.21.15.97:0/4077216421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc0c7f00 msgr2=0x7fbadc154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 --2- 172.21.15.97:0/4077216421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc0c7f00 0x7fbadc154720 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c360 comp rx=0 tx=0).stop 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 -- 172.21.15.97:0/4077216421 shutdown_connections 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 --2- 172.21.15.97:0/4077216421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc0c7f00 0x7fbadc154720 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 -- 172.21.15.97:0/4077216421 >> 172.21.15.97:0/4077216421 conn(0x7fbadc073950 msgr2=0x7fbadc073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 -- 172.21.15.97:0/4077216421 shutdown_connections 2023-12-04T05:37:08.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.303+0000 7fbae2be6640 1 -- 172.21.15.97:0/4077216421 wait complete. 2023-12-04T05:37:08.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 Processor -- start 2023-12-04T05:37:08.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- start start 2023-12-04T05:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbadc0c7f00 0x7fbadc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 0x7fbadc1f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0afd90 con 0x7fbadc151f10 2023-12-04T05:37:08.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c3c30 con 0x7fbadc0cac10 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c4420 con 0x7fbadc0c7f00 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47840/0 (socket says 172.21.15.97:47840) 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 -- 172.21.15.97:0/294047839 learned_addr learned my addr 172.21.15.97:0/294047839 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbadbfff640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 0x7fbadc1f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae0982640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbadc0c7f00 0x7fbadc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 -- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbadc0c7f00 msgr2=0x7fbadc0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbadc0c7f00 0x7fbadc0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 -- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 msgr2=0x7fbadc1f0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 0x7fbadc1f0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 -- 172.21.15.97:0/294047839 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009420 con 0x7fbadc151f10 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbadbfff640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 0x7fbadc1f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:08.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae1183640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c750 tx=0x7fbad400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400ce60 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad400a640 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc0c3e60 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad400a9b0 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.307+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc1f0870 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc1f0a60 con 0x7fbadc151f10 2023-12-04T05:37:08.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbad400ab10 con 0x7fbadc151f10 2023-12-04T05:37:08.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbad97fa640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 0x7fbac0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbad4083c40 con 0x7fbadc151f10 2023-12-04T05:37:08.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbae0982640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 0x7fbac0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.311+0000 7fbae0982640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 0x7fbac0068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbad0000f70 tx=0x7fbad0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.315+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbad4050f10 con 0x7fbadc151f10 2023-12-04T05:37:08.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.475+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbadc068440 con 0x7fbadc151f10 2023-12-04T05:37:08.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.475+0000 7fbad97fa640 1 -- 172.21.15.97:0/294047839 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbad4018070 con 0x7fbadc151f10 2023-12-04T05:37:08.479 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 msgr2=0x7fbac0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 0x7fbac0068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbad0000f70 tx=0x7fbad0009040 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 msgr2=0x7fbadc1f12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c750 tx=0x7fbad400cc10 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 shutdown_connections 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbac0066900 0x7fbac0068dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbadc151f10 0x7fbadc1f12d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbadc0cac10 0x7fbadc1f0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 --2- 172.21.15.97:0/294047839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbadc0c7f00 0x7fbadc0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 >> 172.21.15.97:0/294047839 conn(0x7fbadc073950 msgr2=0x7fbadc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:08.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 shutdown_connections 2023-12-04T05:37:08.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.479+0000 7fbae2be6640 1 -- 172.21.15.97:0/294047839 wait complete. 2023-12-04T05:37:08.500 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T05:37:08.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:08.500 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-04T05:37:08.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:37:08.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:08.548 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T05:37:08.606 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:08.606 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:08.616 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:08.616 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:08.675 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:08.676 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:08.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:08.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 Processor -- start 2023-12-04T05:37:08.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 -- start start 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f40abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f41547d0 con 0x7f21f4155370 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f4158b80 con 0x7f21f40c7ef0 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fbcc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c4aa0 con 0x7f21f4151bf0 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fa266640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f21f4155370 0x7f21f415efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46064/0 (socket says 172.21.15.97:46064) 2023-12-04T05:37:08.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21fa266640 1 -- 172.21.15.97:0/70742166 learned_addr learned my addr 172.21.15.97:0/70742166 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f9a65640 1 --2- 172.21.15.97:0/70742166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f40abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f8a63640 1 -- 172.21.15.97:0/70742166 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679675977 0 0) 0x7f21f41547d0 con 0x7f21f4155370 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f8a63640 1 -- 172.21.15.97:0/70742166 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e0003530 con 0x7f21f4155370 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f9a65640 1 -- 172.21.15.97:0/70742166 >> v1:172.21.15.143:6789/0 conn(0x7f21f40c7ef0 legacy=0x7f21f4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f9a65640 1 -- 172.21.15.97:0/70742166 >> v1:172.21.15.97:6789/0 conn(0x7f21f4155370 legacy=0x7f21f415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.863+0000 7f21f9a65640 1 -- 172.21.15.97:0/70742166 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40c4d40 con 0x7f21f4151bf0 2023-12-04T05:37:08.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21f9a65640 1 --2- 172.21.15.97:0/70742166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f40abbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009820 tx=0x7f21f001c060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4991380b13a9263d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21f8a63640 1 -- 172.21.15.97:0/70742166 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a48a0 con 0x7f21f4151bf0 2023-12-04T05:37:08.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21f8a63640 1 -- 172.21.15.97:0/70742166 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00a4a00 con 0x7f21f4151bf0 2023-12-04T05:37:08.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21f8a63640 1 -- 172.21.15.97:0/70742166 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a4d90 con 0x7f21f4151bf0 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 -- 172.21.15.97:0/70742166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 msgr2=0x7f21f40abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/70742166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f40abbb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009820 tx=0x7f21f001c060 comp rx=0 tx=0).stop 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 -- 172.21.15.97:0/70742166 shutdown_connections 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/70742166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f40abbb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 -- 172.21.15.97:0/70742166 >> 172.21.15.97:0/70742166 conn(0x7f21f4073550 msgr2=0x7f21f4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 -- 172.21.15.97:0/70742166 shutdown_connections 2023-12-04T05:37:08.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.867+0000 7f21fbcc9640 1 -- 172.21.15.97:0/70742166 wait complete. 2023-12-04T05:37:08.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 Processor -- start 2023-12-04T05:37:08.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- start start 2023-12-04T05:37:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f21f40c7ef0 0x7f21f4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40af720 con 0x7f21f4155370 2023-12-04T05:37:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f41ef850 con 0x7f21f40c7ef0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f414ae40 con 0x7f21f4151bf0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47846/0 (socket says 172.21.15.97:47846) 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 -- 172.21.15.97:0/1239422996 learned_addr learned my addr 172.21.15.97:0/1239422996 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21f9a65640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f21f40c7ef0 0x7f21f4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21f9264640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 -- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 msgr2=0x7f21f414a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f414a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 -- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f21f40c7ef0 msgr2=0x7f21f4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f21f40c7ef0 0x7f21f4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 -- 172.21.15.97:0/1239422996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009420 con 0x7f21f4155370 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fa266640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00caa0 tx=0x7f21ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00ac00 con 0x7f21f4155370 2023-12-04T05:37:08.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00ad60 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec012600 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f414b090 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.871+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f41ef470 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f41ef990 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f21ec007070 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21ea7fc640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 0x7f21d8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21ec084330 con 0x7f21f4155370 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21f9a65640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 0x7f21d8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.875+0000 7f21f9a65640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 0x7f21d8068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ae000 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:08.879+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21f41ef990 con 0x7f21f4155370 2023-12-04T05:37:09.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.027+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21f41ef990 con 0x7f21f4155370 2023-12-04T05:37:09.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21ea7fc640 1 -- 172.21.15.97:0/1239422996 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f21f41ef990 con 0x7f21f4155370 2023-12-04T05:37:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:09.033 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:09.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 msgr2=0x7f21d8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 0x7f21d8068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21f00ae000 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 msgr2=0x7f21f4148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00caa0 tx=0x7f21ec00cf60 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 shutdown_connections 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f21d8066900 0x7f21d8068dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f21f4155370 0x7f21f4148420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f21f4151bf0 0x7f21f414a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 --2- 172.21.15.97:0/1239422996 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f21f40c7ef0 0x7f21f4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 >> 172.21.15.97:0/1239422996 conn(0x7f21f4073550 msgr2=0x7f21f4154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 shutdown_connections 2023-12-04T05:37:09.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.031+0000 7f21fbcc9640 1 -- 172.21.15.97:0/1239422996 wait complete. 2023-12-04T05:37:09.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:09.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:09.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 Processor -- start 2023-12-04T05:37:09.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 -- start start 2023-12-04T05:37:09.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb39006eb20 0x7fb390153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb3900c0ad0 0x7fb39015af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb390072270 con 0x7fb390153bc0 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39006c8f0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb397bd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb390154670 con 0x7fb39006eb20 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39596d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb390153bc0 0x7fb39006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46076/0 (socket says 172.21.15.97:46076) 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39596d640 1 -- 172.21.15.97:0/1186550127 learned_addr learned my addr 172.21.15.97:0/1186550127 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39616e640 1 --2- 172.21.15.97:0/1186550127 >> v2:172.21.15.97:3300/0 conn(0x7fb3900c0ad0 0x7fb39015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39516c640 1 --2- 172.21.15.97:0/1186550127 >> v2:172.21.15.143:3300/0 conn(0x7fb39006eb20 0x7fb390153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39616e640 1 -- 172.21.15.97:0/1186550127 >> v2:172.21.15.143:3300/0 conn(0x7fb39006eb20 msgr2=0x7fb390153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:09.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39616e640 1 --2- 172.21.15.97:0/1186550127 >> v2:172.21.15.143:3300/0 conn(0x7fb39006eb20 0x7fb390153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39616e640 1 -- 172.21.15.97:0/1186550127 >> v1:172.21.15.97:6789/0 conn(0x7fb390153bc0 legacy=0x7fb39006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39616e640 1 -- 172.21.15.97:0/1186550127 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390154950 con 0x7fb3900c0ad0 2023-12-04T05:37:09.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.195+0000 7fb39496b640 1 -- 172.21.15.97:0/1186550127 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722596948 0 0) 0x7fb390072270 con 0x7fb390153bc0 2023-12-04T05:37:09.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb39616e640 1 --2- 172.21.15.97:0/1186550127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb39015af50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3900c2b30 tx=0x7fb38801d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2160e5ea3e744a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb39496b640 1 -- 172.21.15.97:0/1186550127 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38800a2d0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb39496b640 1 -- 172.21.15.97:0/1186550127 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880a6810 con 0x7fb3900c0ad0 2023-12-04T05:37:09.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb39496b640 1 -- 172.21.15.97:0/1186550127 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3880a6ba0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 -- 172.21.15.97:0/1186550127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 msgr2=0x7fb39015af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 --2- 172.21.15.97:0/1186550127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb39015af50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3900c2b30 tx=0x7fb38801d910 comp rx=0 tx=0).stop 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 -- 172.21.15.97:0/1186550127 shutdown_connections 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 --2- 172.21.15.97:0/1186550127 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb39015af50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 --2- 172.21.15.97:0/1186550127 >> v2:172.21.15.143:3300/0 conn(0x7fb39006eb20 0x7fb390153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 -- 172.21.15.97:0/1186550127 >> 172.21.15.97:0/1186550127 conn(0x7fb3900c62a0 msgr2=0x7fb3900c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 -- 172.21.15.97:0/1186550127 shutdown_connections 2023-12-04T05:37:09.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.199+0000 7fb397bd1640 1 -- 172.21.15.97:0/1186550127 wait complete. 2023-12-04T05:37:09.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 Processor -- start 2023-12-04T05:37:09.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- start start 2023-12-04T05:37:09.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb39006eb20 0x7fb39014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb390153bc0 0x7fb390149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3900c5280 con 0x7fb3900c0ad0 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39013f0e0 con 0x7fb39006eb20 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39013f3c0 con 0x7fb390153bc0 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47852/0 (socket says 172.21.15.97:47852) 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 -- 172.21.15.97:0/979981341 learned_addr learned my addr 172.21.15.97:0/979981341 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39616e640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb390153bc0 0x7fb390149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39596d640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb39006eb20 0x7fb39014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 -- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb390153bc0 msgr2=0x7fb390149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb390153bc0 0x7fb390149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 -- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb39006eb20 msgr2=0x7fb39014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb39006eb20 0x7fb39014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 -- 172.21.15.97:0/979981341 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38800ab80 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb39516c640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb38000d800 tx=0x7fb38000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38000b6c0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38000b820 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3900c4f10 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38000bb90 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb390149d70 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.203+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39006dea0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.207+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb38000bcf0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.207+0000 7fb3867fc640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 0x7fb374068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.207+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb380084970 con 0x7fb3900c0ad0 2023-12-04T05:37:09.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.207+0000 7fb39596d640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 0x7fb374068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.207+0000 7fb39596d640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 0x7fb374068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0098d0 tx=0x7fb38c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.211+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb380051ba0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb390068440 con 0x7fb3900c0ad0 2023-12-04T05:37:09.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb3867fc640 1 -- 172.21.15.97:0/979981341 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3800551c0 con 0x7fb3900c0ad0 2023-12-04T05:37:09.366 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 msgr2=0x7fb374068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 0x7fb374068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0098d0 tx=0x7fb38c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 msgr2=0x7fb3901ee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.363+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb38000d800 tx=0x7fb38000dcc0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 shutdown_connections 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb3740668d0 0x7fb374068d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb390153bc0 0x7fb390149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3900c0ad0 0x7fb3901ee9c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 --2- 172.21.15.97:0/979981341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb39006eb20 0x7fb39014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 >> 172.21.15.97:0/979981341 conn(0x7fb3900c62a0 msgr2=0x7fb39013fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 shutdown_connections 2023-12-04T05:37:09.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.367+0000 7fb397bd1640 1 -- 172.21.15.97:0/979981341 wait complete. 2023-12-04T05:37:09.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 Processor -- start 2023-12-04T05:37:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 -- start start 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 0x7fe32014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe32014f790 0x7fe3201548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe320154640 con 0x7fe320154e10 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200c0bd0 con 0x7fe32014f790 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe324bc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32014ef10 con 0x7fe32014eb30 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe320154e10 0x7fe320151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46080/0 (socket says 172.21.15.97:46080) 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31ed9d640 1 -- 172.21.15.97:0/3059940476 learned_addr learned my addr 172.21.15.97:0/3059940476 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe315d9b640 1 --2- 172.21.15.97:0/3059940476 >> v2:172.21.15.143:3300/0 conn(0x7fe32014f790 0x7fe3201548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31e59c640 1 --2- 172.21.15.97:0/3059940476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 0x7fe32014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31dd9b640 1 -- 172.21.15.97:0/3059940476 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472788410 0 0) 0x7fe320154640 con 0x7fe320154e10 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31dd9b640 1 -- 172.21.15.97:0/3059940476 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c003530 con 0x7fe320154e10 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31e59c640 1 -- 172.21.15.97:0/3059940476 >> v2:172.21.15.143:3300/0 conn(0x7fe32014f790 msgr2=0x7fe3201548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31e59c640 1 --2- 172.21.15.97:0/3059940476 >> v2:172.21.15.143:3300/0 conn(0x7fe32014f790 0x7fe3201548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31e59c640 1 -- 172.21.15.97:0/3059940476 >> v1:172.21.15.97:6789/0 conn(0x7fe320154e10 legacy=0x7fe320151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.527+0000 7fe31e59c640 1 -- 172.21.15.97:0/3059940476 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3201535a0 con 0x7fe32014eb30 2023-12-04T05:37:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe31e59c640 1 --2- 172.21.15.97:0/3059940476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 0x7fe32014f250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea50aaf102eaf62 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe31dd9b640 1 -- 172.21.15.97:0/3059940476 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ad660 con 0x7fe32014eb30 2023-12-04T05:37:09.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe31dd9b640 1 -- 172.21.15.97:0/3059940476 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100ad7c0 con 0x7fe32014eb30 2023-12-04T05:37:09.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe31dd9b640 1 -- 172.21.15.97:0/3059940476 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100adb50 con 0x7fe32014eb30 2023-12-04T05:37:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 -- 172.21.15.97:0/3059940476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 msgr2=0x7fe32014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 --2- 172.21.15.97:0/3059940476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 0x7fe32014f250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c450 comp rx=0 tx=0).stop 2023-12-04T05:37:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 -- 172.21.15.97:0/3059940476 shutdown_connections 2023-12-04T05:37:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 --2- 172.21.15.97:0/3059940476 >> v2:172.21.15.143:3300/0 conn(0x7fe32014f790 0x7fe3201548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 --2- 172.21.15.97:0/3059940476 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe32014eb30 0x7fe32014f250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 -- 172.21.15.97:0/3059940476 >> 172.21.15.97:0/3059940476 conn(0x7fe3200c5e70 msgr2=0x7fe3200c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 -- 172.21.15.97:0/3059940476 shutdown_connections 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.531+0000 7fe324bc4640 1 -- 172.21.15.97:0/3059940476 wait complete. 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 Processor -- start 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- start start 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 0x7fe320071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 0x7fe32013d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320143660 con 0x7fe32014eb30 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32014a3a0 con 0x7fe32014f790 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32014a8a0 con 0x7fe320154e10 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47868/0 (socket says 172.21.15.97:47868) 2023-12-04T05:37:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 -- 172.21.15.97:0/425930777 learned_addr learned my addr 172.21.15.97:0/425930777 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe315d9b640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 0x7fe320071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31ed9d640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 0x7fe32013d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 -- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 msgr2=0x7fe32013d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 0x7fe32013d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 -- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 msgr2=0x7fe320071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 0x7fe320071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 -- 172.21.15.97:0/425930777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009420 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe315d9b640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 0x7fe320071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31ed9d640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 0x7fe32013d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe31e59c640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b0040 tx=0x7fe31001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b9650 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100b97f0 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3201426e0 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b9ba0 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32014a0c0 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.535+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe320068440 con 0x7fe32014eb30 2023-12-04T05:37:09.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.539+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3100b9d00 con 0x7fe32014eb30 2023-12-04T05:37:09.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.539+0000 7fe3177fe640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.539+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe31011f0c0 con 0x7fe32014eb30 2023-12-04T05:37:09.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.539+0000 7fe315d9b640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.539+0000 7fe315d9b640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 0x7fe300068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe32014acf0 tx=0x7fe30800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.543+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3100ec410 con 0x7fe32014eb30 2023-12-04T05:37:09.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.691+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3200a8ac0 con 0x7fe32014eb30 2023-12-04T05:37:09.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.691+0000 7fe3177fe640 1 -- 172.21.15.97:0/425930777 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3100efa30 con 0x7fe32014eb30 2023-12-04T05:37:09.696 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 msgr2=0x7fe300068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 0x7fe300068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe32014acf0 tx=0x7fe30800b040 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 msgr2=0x7fe320142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b0040 tx=0x7fe31001ac90 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 shutdown_connections 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe320154e10 0x7fe32013d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe32014f790 0x7fe320071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 --2- 172.21.15.97:0/425930777 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe32014eb30 0x7fe320142050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 >> 172.21.15.97:0/425930777 conn(0x7fe3200c5e70 msgr2=0x7fe320144cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 shutdown_connections 2023-12-04T05:37:09.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.695+0000 7fe324bc4640 1 -- 172.21.15.97:0/425930777 wait complete. 2023-12-04T05:37:09.717 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 Processor -- start 2023-12-04T05:37:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 -- start start 2023-12-04T05:37:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f4188155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41880c8620 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41880c6ff0 con 0x7f41881586c0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41880c5680 con 0x7f41880c67d0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f417ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f41880c6bb0 0x7f41880c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46092/0 (socket says 172.21.15.97:46092) 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f417ffff640 1 -- 172.21.15.97:0/1543174178 learned_addr learned my addr 172.21.15.97:0/1543174178 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418659c640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f4188155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598729748 0 0) 0x7f41880c8620 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4174003530 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3172438066 0 0) 0x7f4174003530 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 msgr2=0x7f4188155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f4188155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 >> v1:172.21.15.143:6789/0 conn(0x7f41881586c0 legacy=0x7f418815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188158b40 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f4170001680 con 0x7f41880c6bb0 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 >> v1:172.21.15.97:6789/0 conn(0x7f41880c6bb0 legacy=0x7f41880c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f41740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4174003ef0 0x7f41740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4174004d10 0x7f4174005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41880c5680 con 0x7f4174003ef0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417400b9f0 con 0x7f4174004d10 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417400bbb0 con 0x7f41880c67d0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f417ffff640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4174003ef0 0x7f41740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f4186d9d640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4174004d10 0x7f4174005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.855+0000 7f418659c640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f41740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 -- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 msgr2=0x7f41740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41880c67d0 0x7f41740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 -- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4174004d10 msgr2=0x7f4174005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4174004d10 0x7f4174005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 -- 172.21.15.97:0/1543174178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174003530 con 0x7f4174003ef0 2023-12-04T05:37:09.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f4186d9d640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4174004d10 0x7f4174005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f417ffff640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4174003ef0 0x7f41740047d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4188068170 tx=0x7f417001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117bfe95811e6b4d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170005ae0 con 0x7f4174003ef0 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170005c60 con 0x7f4174003ef0 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f4185d9b640 1 -- 172.21.15.97:0/1543174178 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700072b0 con 0x7f4174003ef0 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f418759e640 1 -- 172.21.15.97:0/1543174178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4174003ef0 msgr2=0x7f41740047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f418759e640 1 --2- 172.21.15.97:0/1543174178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4174003ef0 0x7f41740047d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4188068170 tx=0x7f417001cb40 comp rx=0 tx=0).stop 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f4186d9d640 1 -- 172.21.15.97:0/1543174178 reap_dead start 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f418759e640 1 -- 172.21.15.97:0/1543174178 shutdown_connections 2023-12-04T05:37:09.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.859+0000 7f418759e640 1 -- 172.21.15.97:0/1543174178 >> 172.21.15.97:0/1543174178 conn(0x7f41880ab980 msgr2=0x7f41880abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:09.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- 172.21.15.97:0/1543174178 shutdown_connections 2023-12-04T05:37:09.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- 172.21.15.97:0/1543174178 wait complete. 2023-12-04T05:37:09.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 Processor -- start 2023-12-04T05:37:09.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- start start 2023-12-04T05:37:09.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4174003ef0 0x7f41881561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4188153730 0x7f41880c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41880c13f0 con 0x7f41880c2310 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41880c0bd0 con 0x7f4188153730 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41880c1940 con 0x7f4174003ef0 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47886/0 (socket says 172.21.15.97:47886) 2023-12-04T05:37:09.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 -- 172.21.15.97:0/986843718 learned_addr learned my addr 172.21.15.97:0/986843718 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418659c640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4174003ef0 0x7f41881561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f417ffff640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4188153730 0x7f41880c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 -- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4174003ef0 msgr2=0x7f41881561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4174003ef0 0x7f41881561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 -- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4188153730 msgr2=0x7f41880c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4188153730 0x7f41880c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 -- 172.21.15.97:0/986843718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188156dd0 con 0x7f41880c2310 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f4186d9d640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41880aca40 tx=0x7f418000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180003980 con 0x7f41880c2310 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180003b00 con 0x7f41880c2310 2023-12-04T05:37:09.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800050d0 con 0x7f41880c2310 2023-12-04T05:37:09.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.863+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41881570b0 con 0x7f41880c2310 2023-12-04T05:37:09.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41880c15d0 con 0x7f41880c2310 2023-12-04T05:37:09.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41881575d0 con 0x7f41880c2310 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4180005230 con 0x7f41880c2310 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f417effd640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 0x7f4168068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41800843b0 con 0x7f41880c2310 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f418659c640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 0x7f4168068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.867+0000 7f418659c640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 0x7f4168068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41780099b0 tx=0x7f4178008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:09.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:09.871+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41881575d0 con 0x7f41880c2310 2023-12-04T05:37:10.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41881575d0 con 0x7f41880c2310 2023-12-04T05:37:10.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f417effd640 1 -- 172.21.15.97:0/986843718 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41881575d0 con 0x7f41880c2310 2023-12-04T05:37:10.025 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:10.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 msgr2=0x7f4168068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 0x7f4168068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41780099b0 tx=0x7f4178008040 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 msgr2=0x7f41881f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41880aca40 tx=0x7f418000eb90 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 shutdown_connections 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41680668d0 0x7f4168068d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41880c2310 0x7f41881f0530 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4188153730 0x7f41880c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 --2- 172.21.15.97:0/986843718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4174003ef0 0x7f41881561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 >> 172.21.15.97:0/986843718 conn(0x7f41880ab980 msgr2=0x7f4188150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 shutdown_connections 2023-12-04T05:37:10.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.023+0000 7f418759e640 1 -- 172.21.15.97:0/986843718 wait complete. 2023-12-04T05:37:10.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:37:10.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 Processor -- start 2023-12-04T05:37:10.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 -- start start 2023-12-04T05:37:10.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5880c7f00 0x7fb588154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 0x7fb588154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880ca780 con 0x7fb588151f10 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb588158cc0 con 0x7fb5880c7f00 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb58d85a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880c5700 con 0x7fb5880cac10 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5880c7f00 0x7fb588154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5880c7f00 0x7fb588154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47890/0 (socket says 172.21.15.97:47890) 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 -- 172.21.15.97:0/4210477428 learned_addr learned my addr 172.21.15.97:0/4210477428 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb5877fe640 1 --2- 172.21.15.97:0/4210477428 >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 0x7fb588154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 -- 172.21.15.97:0/4210477428 >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 msgr2=0x7fb588154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 --2- 172.21.15.97:0/4210477428 >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 0x7fb588154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 -- 172.21.15.97:0/4210477428 >> v1:172.21.15.143:6789/0 conn(0x7fb588151f10 legacy=0x7fb5880c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb57e7fc640 1 -- 172.21.15.97:0/4210477428 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588158720 con 0x7fb5880c7f00 2023-12-04T05:37:10.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.183+0000 7fb5877fe640 1 --2- 172.21.15.97:0/4210477428 >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 0x7fb588154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:10.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb57e7fc640 1 --2- 172.21.15.97:0/4210477428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5880c7f00 0x7fb588154720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb58806bcd0 tx=0x7fb57001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f828bc7e959edf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb5867fc640 1 -- 172.21.15.97:0/4210477428 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700ac410 con 0x7fb5880c7f00 2023-12-04T05:37:10.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb5867fc640 1 -- 172.21.15.97:0/4210477428 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5700ac570 con 0x7fb5880c7f00 2023-12-04T05:37:10.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb5867fc640 1 -- 172.21.15.97:0/4210477428 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700ac900 con 0x7fb5880c7f00 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 -- 172.21.15.97:0/4210477428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5880c7f00 msgr2=0x7fb588154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 --2- 172.21.15.97:0/4210477428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5880c7f00 0x7fb588154720 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb58806bcd0 tx=0x7fb57001c3b0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 -- 172.21.15.97:0/4210477428 shutdown_connections 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 --2- 172.21.15.97:0/4210477428 >> v2:172.21.15.143:3300/0 conn(0x7fb5880cac10 0x7fb588154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 --2- 172.21.15.97:0/4210477428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5880c7f00 0x7fb588154720 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 -- 172.21.15.97:0/4210477428 >> 172.21.15.97:0/4210477428 conn(0x7fb588073950 msgr2=0x7fb588073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 -- 172.21.15.97:0/4210477428 shutdown_connections 2023-12-04T05:37:10.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.187+0000 7fb58d85a640 1 -- 172.21.15.97:0/4210477428 wait complete. 2023-12-04T05:37:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 Processor -- start 2023-12-04T05:37:10.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- start start 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 0x7fb5881ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 0x7fb58814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880ab380 con 0x7fb588151f10 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881538a0 con 0x7fb5880c7f00 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb588152c20 con 0x7fb5880cac10 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47902/0 (socket says 172.21.15.97:47902) 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 -- 172.21.15.97:0/2817581986 learned_addr learned my addr 172.21.15.97:0/2817581986 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 -- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 msgr2=0x7fb58814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb586ffd640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 0x7fb5881ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb57e7fc640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 0x7fb58814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 0x7fb58814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 -- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 msgr2=0x7fb5881ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 0x7fb5881ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 -- 172.21.15.97:0/2817581986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700094d0 con 0x7fb588151f10 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb586ffd640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 0x7fb5881ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb57e7fc640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 0x7fb58814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb5877fe640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d5c0 tx=0x7fb58000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800125f0 con 0x7fb588151f10 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580012770 con 0x7fb588151f10 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb588152f00 con 0x7fb588151f10 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580012b20 con 0x7fb588151f10 2023-12-04T05:37:10.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.191+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5881534c0 con 0x7fb588151f10 2023-12-04T05:37:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5881539e0 con 0x7fb588151f10 2023-12-04T05:37:10.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb580012c80 con 0x7fb588151f10 2023-12-04T05:37:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb584ff9640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 0x7fb568068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb580084920 con 0x7fb588151f10 2023-12-04T05:37:10.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb586ffd640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 0x7fb568068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.195+0000 7fb586ffd640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 0x7fb568068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb578007fd0 tx=0x7fb578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.199+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5881539e0 con 0x7fb588151f10 2023-12-04T05:37:10.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.363+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5881539e0 con 0x7fb588151f10 2023-12-04T05:37:10.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.363+0000 7fb584ff9640 1 -- 172.21.15.97:0/2817581986 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5881539e0 con 0x7fb588151f10 2023-12-04T05:37:10.366 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:37:10.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 msgr2=0x7fb568068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 0x7fb568068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb578007fd0 tx=0x7fb578009040 comp rx=0 tx=0).stop 2023-12-04T05:37:10.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 msgr2=0x7fb588153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d5c0 tx=0x7fb58000da80 comp rx=0 tx=0).stop 2023-12-04T05:37:10.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 shutdown_connections 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5680668d0 0x7fb568068d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb588151f10 0x7fb588153cc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5880cac10 0x7fb58814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 --2- 172.21.15.97:0/2817581986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5880c7f00 0x7fb5881ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 >> 172.21.15.97:0/2817581986 conn(0x7fb588073950 msgr2=0x7fb58815e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 shutdown_connections 2023-12-04T05:37:10.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.367+0000 7fb58d85a640 1 -- 172.21.15.97:0/2817581986 wait complete. 2023-12-04T05:37:10.388 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:37:10.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:10.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-04T05:37:10.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:37:10.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:10.431 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:37:10.503 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-04T05:37:10.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 Processor -- start 2023-12-04T05:37:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 -- start start 2023-12-04T05:37:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff90c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c0739b0 con 0x7ff90c06b860 2023-12-04T05:37:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c155710 con 0x7ff90c0c1030 2023-12-04T05:37:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff91305a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0c15a0 con 0x7ff90c0c2a00 2023-12-04T05:37:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff910df6640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff90c06b860 0x7ff90c151b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46096/0 (socket says 172.21.15.97:46096) 2023-12-04T05:37:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff910df6640 1 -- 172.21.15.97:0/1834075706 learned_addr learned my addr 172.21.15.97:0/1834075706 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449176669 0 0) 0x7ff90c0739b0 con 0x7ff90c06b860 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f4003530 con 0x7ff90c06b860 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff90c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126673565 0 0) 0x7ff8f4003530 con 0x7ff90c06b860 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 msgr2=0x7ff90c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff90c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 >> v1:172.21.15.143:6789/0 conn(0x7ff90c0c1030 legacy=0x7ff90c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c073680 con 0x7ff90c06b860 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7ff908001680 con 0x7ff90c06b860 2023-12-04T05:37:10.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff90c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 >> v1:172.21.15.97:6789/0 conn(0x7ff90c06b860 legacy=0x7ff90c151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f40039b0 0x7ff8f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff8f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8f4004d10 0x7ff8f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0c15a0 con 0x7ff8f4004d10 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f400bb50 con 0x7ff8f40039b0 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f400bd10 con 0x7ff90c0c2a00 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8f4004d10 0x7ff8f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff903fff640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff8f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.639+0000 7ff910df6640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f40039b0 0x7ff8f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 -- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 msgr2=0x7ff8f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0c2a00 0x7ff8f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 -- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f40039b0 msgr2=0x7ff8f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:10.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8f40039b0 0x7ff8f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 -- 172.21.15.97:0/1834075706 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4003530 con 0x7ff8f4004d10 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8f4004d10 0x7ff8f4005190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9040073e0 tx=0x7ff90401cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02272e86ac5a71a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040a5ca0 con 0x7ff8f4004d10 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040a5e00 con 0x7ff8f4004d10 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9037fe640 1 -- 172.21.15.97:0/1834075706 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040ad640 con 0x7ff8f4004d10 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff91305a640 1 -- 172.21.15.97:0/1834075706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8f4004d10 msgr2=0x7ff8f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff91305a640 1 --2- 172.21.15.97:0/1834075706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8f4004d10 0x7ff8f4005190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff9040073e0 tx=0x7ff90401cea0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff9115f7640 1 -- 172.21.15.97:0/1834075706 reap_dead start 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff91305a640 1 -- 172.21.15.97:0/1834075706 shutdown_connections 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff91305a640 1 -- 172.21.15.97:0/1834075706 >> 172.21.15.97:0/1834075706 conn(0x7ff90c0c3130 msgr2=0x7ff90c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:10.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.643+0000 7ff91305a640 1 -- 172.21.15.97:0/1834075706 shutdown_connections 2023-12-04T05:37:10.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 -- 172.21.15.97:0/1834075706 wait complete. 2023-12-04T05:37:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 Processor -- start 2023-12-04T05:37:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 -- start start 2023-12-04T05:37:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f4004d10 0x7ff90c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c071150 0x7ff90c14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c0c63b0 con 0x7ff90c072820 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1ed800 con 0x7ff90c071150 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff91305a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c1edae0 con 0x7ff8f4004d10 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47914/0 (socket says 172.21.15.97:47914) 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 -- 172.21.15.97:0/2641306673 learned_addr learned my addr 172.21.15.97:0/2641306673 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff910df6640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f4004d10 0x7ff90c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff903fff640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c071150 0x7ff90c14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 -- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f4004d10 msgr2=0x7ff90c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f4004d10 0x7ff90c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 -- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c071150 msgr2=0x7ff90c14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c071150 0x7ff90c14ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 -- 172.21.15.97:0/2641306673 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c0c5d60 con 0x7ff90c072820 2023-12-04T05:37:10.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9115f7640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9040073e0 tx=0x7ff8f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.647+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040039a0 con 0x7ff90c072820 2023-12-04T05:37:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff904003b00 con 0x7ff90c072820 2023-12-04T05:37:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c0c6040 con 0x7ff90c072820 2023-12-04T05:37:10.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904003e70 con 0x7ff90c072820 2023-12-04T05:37:10.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c070770 con 0x7ff90c072820 2023-12-04T05:37:10.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c0c6200 con 0x7ff90c072820 2023-12-04T05:37:10.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff9040b4070 con 0x7ff90c072820 2023-12-04T05:37:10.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff9017fa640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 0x7ff8f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff90411dfe0 con 0x7ff90c072820 2023-12-04T05:37:10.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff910df6640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 0x7ff8f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.651+0000 7ff910df6640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 0x7ff8f8068dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c10 tx=0x7ff908009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:10.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.655+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9040eb230 con 0x7ff90c072820 2023-12-04T05:37:10.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.835+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff90c1e9850 con 0x7ff90c072820 2023-12-04T05:37:10.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.835+0000 7ff9017fa640 1 -- 172.21.15.97:0/2641306673 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7ff90c1e9850 con 0x7ff90c072820 2023-12-04T05:37:10.838 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:10.839 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:37:10.839 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:37:10.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 msgr2=0x7ff8f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 0x7ff8f8068dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff908000c10 tx=0x7ff908009040 comp rx=0 tx=0).stop 2023-12-04T05:37:10.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 msgr2=0x7ff90c1e9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9040073e0 tx=0x7ff8f4005800 comp rx=0 tx=0).stop 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 shutdown_connections 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff8f8066900 0x7ff8f8068dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff90c072820 0x7ff90c1e9b30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c071150 0x7ff90c14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 --2- 172.21.15.97:0/2641306673 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8f4004d10 0x7ff90c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 >> 172.21.15.97:0/2641306673 conn(0x7ff90c0c3130 msgr2=0x7ff90c06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 shutdown_connections 2023-12-04T05:37:10.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.839+0000 7ff91305a640 1 -- 172.21.15.97:0/2641306673 wait complete. 2023-12-04T05:37:10.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:10.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 Processor -- start 2023-12-04T05:37:10.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 -- start start 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f41e406be00 0x7f41e406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 0x7f41e40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e4152300 con 0x7f41e414e970 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e4071580 con 0x7f41e406be00 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e9701640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e414ed50 con 0x7f41e406ca50 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41da7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f41e406be00 0x7f41e406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f41e414e970 0x7f41e4071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46104/0 (socket says 172.21.15.97:46104) 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e2ffd640 1 -- 172.21.15.97:0/2777462851 learned_addr learned my addr 172.21.15.97:0/2777462851 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e37fe640 1 --2- 172.21.15.97:0/2777462851 >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 0x7f41e40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41da7fc640 1 -- 172.21.15.97:0/2777462851 >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 msgr2=0x7f41e40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41da7fc640 1 --2- 172.21.15.97:0/2777462851 >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 0x7f41e40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:10.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41da7fc640 1 -- 172.21.15.97:0/2777462851 >> v1:172.21.15.97:6789/0 conn(0x7f41e414e970 legacy=0x7f41e4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41da7fc640 1 -- 172.21.15.97:0/2777462851 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4151d60 con 0x7f41e406be00 2023-12-04T05:37:11.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.995+0000 7f41e37fe640 1 --2- 172.21.15.97:0/2777462851 >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 0x7f41e40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:11.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41da7fc640 1 --2- 172.21.15.97:0/2777462851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e406e150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f41e406fef0 tx=0x7f41d401e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dfe80b32780066 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e27fc640 1 -- 172.21.15.97:0/2777462851 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40aa410 con 0x7f41e406be00 2023-12-04T05:37:11.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e27fc640 1 -- 172.21.15.97:0/2777462851 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d40aa570 con 0x7f41e406be00 2023-12-04T05:37:11.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e27fc640 1 -- 172.21.15.97:0/2777462851 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40aa900 con 0x7f41e406be00 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 -- 172.21.15.97:0/2777462851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 msgr2=0x7f41e406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 --2- 172.21.15.97:0/2777462851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e406e150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f41e406fef0 tx=0x7f41d401e5e0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 -- 172.21.15.97:0/2777462851 shutdown_connections 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 --2- 172.21.15.97:0/2777462851 >> v2:172.21.15.143:3300/0 conn(0x7f41e406ca50 0x7f41e40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 --2- 172.21.15.97:0/2777462851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e406e150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 -- 172.21.15.97:0/2777462851 >> 172.21.15.97:0/2777462851 conn(0x7f41e40c2970 msgr2=0x7f41e40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 -- 172.21.15.97:0/2777462851 shutdown_connections 2023-12-04T05:37:11.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:10.999+0000 7f41e9701640 1 -- 172.21.15.97:0/2777462851 wait complete. 2023-12-04T05:37:11.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 Processor -- start 2023-12-04T05:37:11.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- start start 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41e406ca50 0x7f41e413bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 0x7f41e413c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e4142fc0 con 0x7f41e406be00 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e4155770 con 0x7f41e414e970 2023-12-04T05:37:11.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e41ecca0 con 0x7f41e406ca50 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47934/0 (socket says 172.21.15.97:47934) 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 -- 172.21.15.97:0/4039327911 learned_addr learned my addr 172.21.15.97:0/4039327911 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41da7fc640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41e406ca50 0x7f41e413bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 -- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41e406ca50 msgr2=0x7f41e413bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e37fe640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 0x7f41e413c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41e406ca50 0x7f41e413bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 -- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 msgr2=0x7f41e413c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 0x7f41e413c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 -- 172.21.15.97:0/4039327911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009420 con 0x7f41e406be00 2023-12-04T05:37:11.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e37fe640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 0x7f41e413c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e2ffd640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c400 tx=0x7f41cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc005cf0 con 0x7f41e406be00 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc005e50 con 0x7f41e406be00 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0072d0 con 0x7f41e406be00 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e41424d0 con 0x7f41e406be00 2023-12-04T05:37:11.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.003+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e4140260 con 0x7f41e406be00 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e4068440 con 0x7f41e406be00 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41cc007430 con 0x7f41e406be00 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41dbfff640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 0x7f41c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41cc083690 con 0x7f41e406be00 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41da7fc640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 0x7f41c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.007+0000 7f41da7fc640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 0x7f41c4068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d40b1000 tx=0x7f41d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.011+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41cc0509f0 con 0x7f41e406be00 2023-12-04T05:37:11.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.163+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41e4152300 con 0x7f41e406be00 2023-12-04T05:37:11.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.163+0000 7f41dbfff640 1 -- 172.21.15.97:0/4039327911 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f41e4152300 con 0x7f41e406be00 2023-12-04T05:37:11.167 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:11.167 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:11.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 msgr2=0x7f41c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 0x7f41c4068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d40b1000 tx=0x7f41d4008040 comp rx=0 tx=0).stop 2023-12-04T05:37:11.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 msgr2=0x7f41e413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c400 tx=0x7f41cc00c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 shutdown_connections 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f41c40668d0 0x7f41c4068d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41e414e970 0x7f41e413c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41e406ca50 0x7f41e413bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 --2- 172.21.15.97:0/4039327911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41e406be00 0x7f41e413fd20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 >> 172.21.15.97:0/4039327911 conn(0x7f41e40c2970 msgr2=0x7f41e4150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 shutdown_connections 2023-12-04T05:37:11.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.167+0000 7f41e9701640 1 -- 172.21.15.97:0/4039327911 wait complete. 2023-12-04T05:37:11.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:36:38.478537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:36:39.262349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:11.189 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:11.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 Processor -- start 2023-12-04T05:37:11.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 -- start start 2023-12-04T05:37:11.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0c5c0c1e70 0x7f0c5c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0aa240 con 0x7f0c5c06c440 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c0aa500 con 0x7f0c5c06d210 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c63b0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c06c0c0 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c610aa640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0c5c06c440 0x7f0c5c0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46110/0 (socket says 172.21.15.97:46110) 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c610aa640 1 -- 172.21.15.97:0/3480107586 learned_addr learned my addr 172.21.15.97:0/3480107586 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c618ab640 1 --2- 172.21.15.97:0/3480107586 >> v2:172.21.15.143:3300/0 conn(0x7f0c5c0c1e70 0x7f0c5c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c608a9640 1 -- 172.21.15.97:0/3480107586 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243608483 0 0) 0x7f0c5c0aa240 con 0x7f0c5c06c440 2023-12-04T05:37:11.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c608a9640 1 -- 172.21.15.97:0/3480107586 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c48003530 con 0x7f0c5c06c440 2023-12-04T05:37:11.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c618ab640 1 -- 172.21.15.97:0/3480107586 >> v1:172.21.15.143:6789/0 conn(0x7f0c5c06d210 legacy=0x7f0c5c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c618ab640 1 -- 172.21.15.97:0/3480107586 >> v1:172.21.15.97:6789/0 conn(0x7f0c5c06c440 legacy=0x7f0c5c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.327+0000 7f0c618ab640 1 -- 172.21.15.97:0/3480107586 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0aa7e0 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c618ab640 1 --2- 172.21.15.97:0/3480107586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1524e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097c0 tx=0x7f0c5801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0459a04722f11 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c608a9640 1 -- 172.21.15.97:0/3480107586 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ab650 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c608a9640 1 -- 172.21.15.97:0/3480107586 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580ab7b0 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c608a9640 1 -- 172.21.15.97:0/3480107586 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580abb20 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3480107586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 msgr2=0x7f0c5c1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3480107586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1524e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c580097c0 tx=0x7f0c5801c450 comp rx=0 tx=0).stop 2023-12-04T05:37:11.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3480107586 shutdown_connections 2023-12-04T05:37:11.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3480107586 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1524e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3480107586 >> 172.21.15.97:0/3480107586 conn(0x7f0c5c0c5e70 msgr2=0x7f0c5c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3480107586 shutdown_connections 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.331+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3480107586 wait complete. 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 Processor -- start 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- start start 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c5c06c440 0x7f0c5c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0c1530 con 0x7f0c5c06d210 2023-12-04T05:37:11.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c1edba0 con 0x7f0c5c0c1e70 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c149db0 con 0x7f0c5c06c440 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47940/0 (socket says 172.21.15.97:47940) 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 -- 172.21.15.97:0/3180961789 learned_addr learned my addr 172.21.15.97:0/3180961789 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c620ac640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c618ab640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c5c06c440 0x7f0c5c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 -- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c5c06c440 msgr2=0x7f0c5c147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c5c06c440 0x7f0c5c147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 -- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 msgr2=0x7f0c5c1eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 -- 172.21.15.97:0/3180961789 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009420 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c610aa640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c450 tx=0x7f0c4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c005cf0 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c005e50 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c007270 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c149780 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.335+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c1eeab0 con 0x7f0c5c06d210 2023-12-04T05:37:11.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c068440 con 0x7f0c5c06d210 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c4c0073d0 con 0x7f0c5c06d210 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c527fc640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 0x7f0c40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c4c0838b0 con 0x7f0c5c06d210 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c618ab640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 0x7f0c40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.339+0000 7f0c618ab640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 0x7f0c40068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c580af000 tx=0x7f0c580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.343+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c4c050b00 con 0x7f0c5c06d210 2023-12-04T05:37:11.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.495+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c5c15dc50 con 0x7f0c5c06d210 2023-12-04T05:37:11.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.495+0000 7f0c527fc640 1 -- 172.21.15.97:0/3180961789 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c4c017020 con 0x7f0c5c06d210 2023-12-04T05:37:11.499 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:11.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 msgr2=0x7f0c40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 0x7f0c40068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c580af000 tx=0x7f0c580a7000 comp rx=0 tx=0).stop 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 msgr2=0x7f0c5c1eaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c450 tx=0x7f0c4c00c910 comp rx=0 tx=0).stop 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 shutdown_connections 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0c400668d0 0x7f0c40068d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c5c0c1e70 0x7f0c5c1eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0c5c06d210 0x7f0c5c1eaba0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 --2- 172.21.15.97:0/3180961789 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c5c06c440 0x7f0c5c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 >> 172.21.15.97:0/3180961789 conn(0x7f0c5c0c5e70 msgr2=0x7f0c5c150350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 shutdown_connections 2023-12-04T05:37:11.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.499+0000 7f0c63b0f640 1 -- 172.21.15.97:0/3180961789 wait complete. 2023-12-04T05:37:11.531 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.667+0000 7f5f479f8640 1 Processor -- start 2023-12-04T05:37:11.672 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 -- start start 2023-12-04T05:37:11.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5f40156070 0x7f5f400c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f4006e410 0x7f5f40071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f40071380 con 0x7f5f400c0db0 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4006cc20 con 0x7f5f4006e410 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f479f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4006cf00 con 0x7f5f40156070 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f4006e410 0x7f5f40071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f45f95640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5f400c0db0 0x7f5f40158a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46124/0 (socket says 172.21.15.97:46124) 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5f4006e410 0x7f5f40071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47946/0 (socket says 172.21.15.97:47946) 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f45f95640 1 -- 172.21.15.97:0/345793083 learned_addr learned my addr 172.21.15.97:0/345793083 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:11.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f45794640 1 --2- 172.21.15.97:0/345793083 >> v2:172.21.15.143:3300/0 conn(0x7f5f40156070 0x7f5f400c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 -- 172.21.15.97:0/345793083 >> v2:172.21.15.143:3300/0 conn(0x7f5f40156070 msgr2=0x7f5f400c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:11.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 --2- 172.21.15.97:0/345793083 >> v2:172.21.15.143:3300/0 conn(0x7f5f40156070 0x7f5f400c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 -- 172.21.15.97:0/345793083 >> v1:172.21.15.97:6789/0 conn(0x7f5f400c0db0 legacy=0x7f5f40158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f44f93640 1 -- 172.21.15.97:0/345793083 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4015cbb0 con 0x7f5f4006e410 2023-12-04T05:37:11.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.671+0000 7f5f37fff640 1 -- 172.21.15.97:0/345793083 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478515783 0 0) 0x7f5f40071380 con 0x7f5f400c0db0 2023-12-04T05:37:11.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f44f93640 1 --2- 172.21.15.97:0/345793083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40071d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f4006e870 tx=0x7f5f3001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5a5533ebb7a25c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f37fff640 1 -- 172.21.15.97:0/345793083 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300ad660 con 0x7f5f4006e410 2023-12-04T05:37:11.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f37fff640 1 -- 172.21.15.97:0/345793083 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300ad7c0 con 0x7f5f4006e410 2023-12-04T05:37:11.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f37fff640 1 -- 172.21.15.97:0/345793083 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300adb50 con 0x7f5f4006e410 2023-12-04T05:37:11.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 -- 172.21.15.97:0/345793083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 msgr2=0x7f5f40071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 --2- 172.21.15.97:0/345793083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40071d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f4006e870 tx=0x7f5f3001c3d0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 -- 172.21.15.97:0/345793083 shutdown_connections 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 --2- 172.21.15.97:0/345793083 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40071d60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 --2- 172.21.15.97:0/345793083 >> v2:172.21.15.143:3300/0 conn(0x7f5f40156070 0x7f5f400c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 -- 172.21.15.97:0/345793083 >> 172.21.15.97:0/345793083 conn(0x7f5f400c5e70 msgr2=0x7f5f400c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 -- 172.21.15.97:0/345793083 shutdown_connections 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 -- 172.21.15.97:0/345793083 wait complete. 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.675+0000 7f5f479f8640 1 Processor -- start 2023-12-04T05:37:11.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- start start 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 0x7f5f4014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f40156070 0x7f5f40159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40157870 con 0x7f5f4006e410 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4015ae00 con 0x7f5f400c0db0 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f401f5df0 con 0x7f5f40156070 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47950/0 (socket says 172.21.15.97:47950) 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 -- 172.21.15.97:0/1331811068 learned_addr learned my addr 172.21.15.97:0/1331811068 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f44f93640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 0x7f5f4014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45f95640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f40156070 0x7f5f40159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 -- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f40156070 msgr2=0x7f5f40159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f40156070 0x7f5f40159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 -- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 msgr2=0x7f5f4014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 0x7f5f4014b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 -- 172.21.15.97:0/1331811068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009420 con 0x7f5f4006e410 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f44f93640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 0x7f5f4014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f45794640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00e870 tx=0x7f5f3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c009530 con 0x7f5f4006e410 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00c940 con 0x7f5f4006e410 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00ccd0 con 0x7f5f4006e410 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f401f60d0 con 0x7f5f4006e410 2023-12-04T05:37:11.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4015b330 con 0x7f5f4006e410 2023-12-04T05:37:11.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.679+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4015b520 con 0x7f5f4006e410 2023-12-04T05:37:11.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.683+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5f3c013470 con 0x7f5f4006e410 2023-12-04T05:37:11.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.683+0000 7f5f35ffb640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 0x7f5f24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:11.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.683+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f3c084650 con 0x7f5f4006e410 2023-12-04T05:37:11.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.683+0000 7f5f44f93640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 0x7f5f24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:11.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.683+0000 7f5f44f93640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 0x7f5f24068d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f300af000 tx=0x7f5f30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:11.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.687+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f3c0517f0 con 0x7f5f4006e410 2023-12-04T05:37:11.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.835+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f40068440 con 0x7f5f4006e410 2023-12-04T05:37:11.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.835+0000 7f5f35ffb640 1 -- 172.21.15.97:0/1331811068 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f3c054e10 con 0x7f5f4006e410 2023-12-04T05:37:11.839 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 msgr2=0x7f5f24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 0x7f5f24068d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5f300af000 tx=0x7f5f30008040 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 msgr2=0x7f5f40146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00e870 tx=0x7f5f3c00ed30 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 shutdown_connections 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5f240668d0 0x7f5f24068d90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f40156070 0x7f5f40159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f400c0db0 0x7f5f4014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 --2- 172.21.15.97:0/1331811068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f4006e410 0x7f5f40146c80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 >> 172.21.15.97:0/1331811068 conn(0x7f5f400c5e70 msgr2=0x7f5f40071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 shutdown_connections 2023-12-04T05:37:11.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:11.839+0000 7f5f479f8640 1 -- 172.21.15.97:0/1331811068 wait complete. 2023-12-04T05:37:11.863 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:12.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 Processor -- start 2023-12-04T05:37:12.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 -- start start 2023-12-04T05:37:12.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35b414eb30 0x7f35b414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b4154640 con 0x7f35b4154e10 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40c0bd0 con 0x7f35b414eb30 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35baee3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b414ef10 con 0x7f35b414f790 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35b414eb30 0x7f35b414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f35b414eb30 0x7f35b414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47966/0 (socket says 172.21.15.97:47966) 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2500836443 learned_addr learned my addr 172.21.15.97:0/2500836443 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35abfff640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2500836443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 msgr2=0x7f35b41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b41548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2500836443 >> v1:172.21.15.143:6789/0 conn(0x7f35b4154e10 legacy=0x7f35b4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.003+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2500836443 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b41535a0 con 0x7f35b414eb30 2023-12-04T05:37:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35b8c7f640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b414f250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009870 tx=0x7f35b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55edd8290c5ed597 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35ab7fe640 1 -- 172.21.15.97:0/2500836443 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00ab620 con 0x7f35b414eb30 2023-12-04T05:37:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35ab7fe640 1 -- 172.21.15.97:0/2500836443 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00ab780 con 0x7f35b414eb30 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35ab7fe640 1 -- 172.21.15.97:0/2500836443 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00abb10 con 0x7f35b414eb30 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 -- 172.21.15.97:0/2500836443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 msgr2=0x7f35b414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b414f250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009870 tx=0x7f35b001c510 comp rx=0 tx=0).stop 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 -- 172.21.15.97:0/2500836443 shutdown_connections 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b41548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 --2- 172.21.15.97:0/2500836443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b414f250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 -- 172.21.15.97:0/2500836443 >> 172.21.15.97:0/2500836443 conn(0x7f35b40c5e70 msgr2=0x7f35b40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 -- 172.21.15.97:0/2500836443 shutdown_connections 2023-12-04T05:37:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.007+0000 7f35baee3640 1 -- 172.21.15.97:0/2500836443 wait complete. 2023-12-04T05:37:12.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 Processor -- start 2023-12-04T05:37:12.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- start start 2023-12-04T05:37:12.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b40bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35b4154e10 0x7f35b413b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415faf0 con 0x7f35b414eb30 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4141730 con 0x7f35b4154e10 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415ed20 con 0x7f35b414f790 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47968/0 (socket says 172.21.15.97:47968) 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2892281011 learned_addr learned my addr 172.21.15.97:0/2892281011 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35abfff640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b40bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b9480640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35b4154e10 0x7f35b413b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 msgr2=0x7f35b40bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b40bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35b4154e10 msgr2=0x7f35b413b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35b4154e10 0x7f35b413b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 -- 172.21.15.97:0/2892281011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b00094d0 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35abfff640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b40bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35b8c7f640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ad040 tx=0x7f35b001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00be3f0 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00be570 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b40c0180 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00be920 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b415f2a0 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.011+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4068440 con 0x7f35b414eb30 2023-12-04T05:37:12.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.015+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f35b00b43f0 con 0x7f35b414eb30 2023-12-04T05:37:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.015+0000 7f35a97fa640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 0x7f35a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.015+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35b011e7e0 con 0x7f35b414eb30 2023-12-04T05:37:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.015+0000 7f35abfff640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 0x7f35a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.015+0000 7f35abfff640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 0x7f35a0068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35b41408e0 tx=0x7f35a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.019+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35b00ebac0 con 0x7f35b414eb30 2023-12-04T05:37:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.167+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35b40a8ac0 con 0x7f35b414eb30 2023-12-04T05:37:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35a97fa640 1 -- 172.21.15.97:0/2892281011 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35b00ef0e0 con 0x7f35b414eb30 2023-12-04T05:37:12.173 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:12.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 msgr2=0x7f35a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 0x7f35a0068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f35b41408e0 tx=0x7f35a4008040 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 msgr2=0x7f35b415f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ad040 tx=0x7f35b001ad50 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 shutdown_connections 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35a00668d0 0x7f35a0068d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f35b4154e10 0x7f35b413b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35b414f790 0x7f35b40bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 --2- 172.21.15.97:0/2892281011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f35b414eb30 0x7f35b415f5b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 >> 172.21.15.97:0/2892281011 conn(0x7f35b40c5e70 msgr2=0x7f35b415c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 shutdown_connections 2023-12-04T05:37:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.171+0000 7f35baee3640 1 -- 172.21.15.97:0/2892281011 wait complete. 2023-12-04T05:37:12.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:12.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 Processor -- start 2023-12-04T05:37:12.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 -- start start 2023-12-04T05:37:12.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72000c7ef0 0x7f7200154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72001547d0 con 0x7f7200151bf0 2023-12-04T05:37:12.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7200158b80 con 0x7f7200158630 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f7205cc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72000c4aa0 con 0x7f72000c7ef0 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71ff7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7200151bf0 0x7f72000abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46140/0 (socket says 172.21.15.97:46140) 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71ff7fe640 1 -- 172.21.15.97:0/1288694472 learned_addr learned my addr 172.21.15.97:0/1288694472 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71f7fff640 1 --2- 172.21.15.97:0/1288694472 >> v2:172.21.15.97:3300/0 conn(0x7f72000c7ef0 0x7f7200154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71feffd640 1 -- 172.21.15.97:0/1288694472 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16643473 0 0) 0x7f72001547d0 con 0x7f7200151bf0 2023-12-04T05:37:12.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71feffd640 1 -- 172.21.15.97:0/1288694472 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ec003530 con 0x7f7200151bf0 2023-12-04T05:37:12.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71f7fff640 1 -- 172.21.15.97:0/1288694472 >> v1:172.21.15.143:6789/0 conn(0x7f7200158630 legacy=0x7f720015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:12.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71f7fff640 1 -- 172.21.15.97:0/1288694472 >> v1:172.21.15.97:6789/0 conn(0x7f7200151bf0 legacy=0x7f72000abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.331+0000 7f71f7fff640 1 -- 172.21.15.97:0/1288694472 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000c4d40 con 0x7f72000c7ef0 2023-12-04T05:37:12.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f71f7fff640 1 --2- 172.21.15.97:0/1288694472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72000c7ef0 0x7f7200154c60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71e80097c0 tx=0x7f71e801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f48ad699bfb701 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f71feffd640 1 -- 172.21.15.97:0/1288694472 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80a4770 con 0x7f72000c7ef0 2023-12-04T05:37:12.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f71feffd640 1 -- 172.21.15.97:0/1288694472 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80a48d0 con 0x7f72000c7ef0 2023-12-04T05:37:12.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f71feffd640 1 -- 172.21.15.97:0/1288694472 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80a4c60 con 0x7f72000c7ef0 2023-12-04T05:37:12.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- 172.21.15.97:0/1288694472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72000c7ef0 msgr2=0x7f7200154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 --2- 172.21.15.97:0/1288694472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72000c7ef0 0x7f7200154c60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f71e80097c0 tx=0x7f71e801c040 comp rx=0 tx=0).stop 2023-12-04T05:37:12.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- 172.21.15.97:0/1288694472 shutdown_connections 2023-12-04T05:37:12.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 --2- 172.21.15.97:0/1288694472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72000c7ef0 0x7f7200154c60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- 172.21.15.97:0/1288694472 >> 172.21.15.97:0/1288694472 conn(0x7f7200073550 msgr2=0x7f7200073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- 172.21.15.97:0/1288694472 shutdown_connections 2023-12-04T05:37:12.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- 172.21.15.97:0/1288694472 wait complete. 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 Processor -- start 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.335+0000 7f7205cc9640 1 -- start start 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72000c7ef0 0x7f72000ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7200151bf0 0x7f72000aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000adee0 con 0x7f7200158630 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000af230 con 0x7f72000c7ef0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000ad080 con 0x7f7200151bf0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:47998/0 (socket says 172.21.15.97:47998) 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 -- 172.21.15.97:0/2465405119 learned_addr learned my addr 172.21.15.97:0/2465405119 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71f7fff640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7200151bf0 0x7f72000aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71ff7fe640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72000c7ef0 0x7f72000ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 -- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7200151bf0 msgr2=0x7f72000aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7200151bf0 0x7f72000aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 -- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72000c7ef0 msgr2=0x7f72000ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72000c7ef0 0x7f72000ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 -- 172.21.15.97:0/2465405119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009420 con 0x7f7200158630 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fffff640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c770 tx=0x7f71f800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8003b80 con 0x7f7200158630 2023-12-04T05:37:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8003ce0 con 0x7f7200158630 2023-12-04T05:37:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800aa30 con 0x7f7200158630 2023-12-04T05:37:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72001edf50 con 0x7f7200158630 2023-12-04T05:37:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72001ee1d0 con 0x7f7200158630 2023-12-04T05:37:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200068440 con 0x7f7200158630 2023-12-04T05:37:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.339+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71f800ab90 con 0x7f7200158630 2023-12-04T05:37:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.343+0000 7f71fcff9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.343+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71f8084270 con 0x7f7200158630 2023-12-04T05:37:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.343+0000 7f71ff7fe640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.343+0000 7f71ff7fe640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 0x7f71e0068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71f00011f0 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.347+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71f80514a0 con 0x7f7200158630 2023-12-04T05:37:12.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.527+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f720006c970 con 0x7f7200158630 2023-12-04T05:37:12.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.527+0000 7f71fcff9640 1 -- 172.21.15.97:0/2465405119 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f71f8054ac0 con 0x7f7200158630 2023-12-04T05:37:12.531 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:12.531 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:37:12.531 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 msgr2=0x7f71e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 0x7f71e0068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71f00011f0 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 msgr2=0x7f7200156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c770 tx=0x7f71f800cc30 comp rx=0 tx=0).stop 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 shutdown_connections 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f71e00668d0 0x7f71e0068d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7200158630 0x7f7200156200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7200151bf0 0x7f72000aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 --2- 172.21.15.97:0/2465405119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72000c7ef0 0x7f72000ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 >> 172.21.15.97:0/2465405119 conn(0x7f7200073550 msgr2=0x7f7200153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 shutdown_connections 2023-12-04T05:37:12.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.531+0000 7f7205cc9640 1 -- 172.21.15.97:0/2465405119 wait complete. 2023-12-04T05:37:12.552 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:12.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 Processor -- start 2023-12-04T05:37:12.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 -- start start 2023-12-04T05:37:12.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 0x7fb8bc06ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc152300 con 0x7fb8bc14e970 2023-12-04T05:37:12.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc071580 con 0x7fb8bc06be00 2023-12-04T05:37:12.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.687+0000 7fb8c2980640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc14ed50 con 0x7fb8bc06e150 2023-12-04T05:37:12.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8bbfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb8bc14e970 0x7fb8bc071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46144/0 (socket says 172.21.15.97:46144) 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8bbfff640 1 -- 172.21.15.97:0/3659944948 learned_addr learned my addr 172.21.15.97:0/3659944948 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8c0f1d640 1 --2- 172.21.15.97:0/3659944948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 0x7fb8bc06ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498553402 0 0) 0x7fb8ac001120 con 0x7fb8bc14e970 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a4003530 con 0x7fb8bc14e970 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622724655 0 0) 0x7fb8bc071580 con 0x7fb8bc06be00 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac001120 con 0x7fb8bc06be00 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8c0f1d640 1 -- 172.21.15.97:0/3659944948 >> v1:172.21.15.143:6789/0 conn(0x7fb8bc06be00 legacy=0x7fb8bc0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8c0f1d640 1 -- 172.21.15.97:0/3659944948 >> v1:172.21.15.97:6789/0 conn(0x7fb8bc14e970 legacy=0x7fb8bc071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8c0f1d640 1 -- 172.21.15.97:0/3659944948 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc151d60 con 0x7fb8bc06e150 2023-12-04T05:37:12.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8c0f1d640 1 --2- 172.21.15.97:0/3659944948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 0x7fb8bc06ca50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009dc0 tx=0x7fb8b401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78d34bc30d131fe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40a59a0 con 0x7fb8bc06e150 2023-12-04T05:37:12.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40a5b00 con 0x7fb8bc06e150 2023-12-04T05:37:12.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.691+0000 7fb8baffd640 1 -- 172.21.15.97:0/3659944948 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40a5e90 con 0x7fb8bc06e150 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- 172.21.15.97:0/3659944948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 msgr2=0x7fb8bc06ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 --2- 172.21.15.97:0/3659944948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 0x7fb8bc06ca50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009dc0 tx=0x7fb8b401c8e0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- 172.21.15.97:0/3659944948 shutdown_connections 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 --2- 172.21.15.97:0/3659944948 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06e150 0x7fb8bc06ca50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- 172.21.15.97:0/3659944948 >> 172.21.15.97:0/3659944948 conn(0x7fb8bc0c2970 msgr2=0x7fb8bc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- 172.21.15.97:0/3659944948 shutdown_connections 2023-12-04T05:37:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- 172.21.15.97:0/3659944948 wait complete. 2023-12-04T05:37:12.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 Processor -- start 2023-12-04T05:37:12.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- start start 2023-12-04T05:37:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 0x7fb8bc1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc06e150 0x7fb8bc0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc155100 con 0x7fb8bc14e970 2023-12-04T05:37:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0a9ee0 con 0x7fb8bc06e150 2023-12-04T05:37:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c2980640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0aa1c0 con 0x7fb8bc06be00 2023-12-04T05:37:12.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c0f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c0f1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48000/0 (socket says 172.21.15.97:48000) 2023-12-04T05:37:12.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8bbfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 0x7fb8bc1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8c0f1d640 1 -- 172.21.15.97:0/1250609150 learned_addr learned my addr 172.21.15.97:0/1250609150 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:12.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.695+0000 7fb8bb7fe640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc06e150 0x7fb8bc0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 -- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc06e150 msgr2=0x7fb8bc0bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc06e150 0x7fb8bc0bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 -- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 msgr2=0x7fb8bc0aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 -- 172.21.15.97:0/1250609150 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009a70 con 0x7fb8bc06be00 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8c0f1d640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:12.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bbfff640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 0x7fb8bc1524a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c700 tx=0x7fb8ac00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac005a60 con 0x7fb8bc06be00 2023-12-04T05:37:12.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac005bc0 con 0x7fb8bc06be00 2023-12-04T05:37:12.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac007070 con 0x7fb8bc06be00 2023-12-04T05:37:12.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc0aa4a0 con 0x7fb8bc06be00 2023-12-04T05:37:12.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc0aaa60 con 0x7fb8bc06be00 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc068440 con 0x7fb8bc06be00 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb8ac0071d0 con 0x7fb8bc06be00 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 0x7fb8a8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8ac083860 con 0x7fb8bc06be00 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.699+0000 7fb8bb7fe640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 0x7fb8a8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.703+0000 7fb8bb7fe640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 0x7fb8a8068dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0bfd40 tx=0x7fb8b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.707+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8ac050c00 con 0x7fb8bc06be00 2023-12-04T05:37:12.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.859+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8bc152300 con 0x7fb8bc06be00 2023-12-04T05:37:12.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.859+0000 7fb8b8ff9640 1 -- 172.21.15.97:0/1250609150 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fb8bc152300 con 0x7fb8bc06be00 2023-12-04T05:37:12.862 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:12.862 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:12.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 msgr2=0x7fb8a8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 0x7fb8a8068dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0bfd40 tx=0x7fb8b0009040 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 msgr2=0x7fb8bc1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 0x7fb8bc1524a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c700 tx=0x7fb8ac00cbc0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 shutdown_connections 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb8a8066900 0x7fb8a8068dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb8bc14e970 0x7fb8bc0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc06e150 0x7fb8bc0bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 --2- 172.21.15.97:0/1250609150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb8bc06be00 0x7fb8bc1524a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 >> 172.21.15.97:0/1250609150 conn(0x7fb8bc0c2970 msgr2=0x7fb8bc14c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 shutdown_connections 2023-12-04T05:37:12.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:12.863+0000 7fb8c2980640 1 -- 172.21.15.97:0/1250609150 wait complete. 2023-12-04T05:37:12.884 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T05:37:12.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.023+0000 7fc86571d640 1 Processor -- start 2023-12-04T05:37:13.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.023+0000 7fc86571d640 1 -- start start 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc860151e10 0x7fc8600c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc8600c5d40 0x7fc860158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8600a7290 0x7fc8600c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600c3cd0 con 0x7fc860151e10 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc860157dc0 con 0x7fc8600c5d40 2023-12-04T05:37:13.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc86571d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601521f0 con 0x7fc8600a7290 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc860151e10 0x7fc8600c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc860151e10 0x7fc8600c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48004/0 (socket says 172.21.15.97:48004) 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 -- 172.21.15.97:0/4167978032 learned_addr learned my addr 172.21.15.97:0/4167978032 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 -- 172.21.15.97:0/4167978032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8600a7290 msgr2=0x7fc8600c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 --2- 172.21.15.97:0/4167978032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8600a7290 0x7fc8600c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 -- 172.21.15.97:0/4167978032 >> v2:172.21.15.143:3300/0 conn(0x7fc8600c5d40 msgr2=0x7fc860158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 --2- 172.21.15.97:0/4167978032 >> v2:172.21.15.143:3300/0 conn(0x7fc8600c5d40 0x7fc860158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.027+0000 7fc85effd640 1 -- 172.21.15.97:0/4167978032 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600704a0 con 0x7fc860151e10 2023-12-04T05:37:13.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc85effd640 1 --2- 172.21.15.97:0/4167978032 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc860151e10 0x7fc8600c1270 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8600c5610 tx=0x7fc85001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e870e7fcf75d46b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc85e7fc640 1 -- 172.21.15.97:0/4167978032 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500ac640 con 0x7fc860151e10 2023-12-04T05:37:13.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc85e7fc640 1 -- 172.21.15.97:0/4167978032 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500ac7a0 con 0x7fc860151e10 2023-12-04T05:37:13.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc85e7fc640 1 -- 172.21.15.97:0/4167978032 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500acb30 con 0x7fc860151e10 2023-12-04T05:37:13.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- 172.21.15.97:0/4167978032 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc860151e10 msgr2=0x7fc8600c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- 172.21.15.97:0/4167978032 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc860151e10 0x7fc8600c1270 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc8600c5610 tx=0x7fc85001c440 comp rx=0 tx=0).stop 2023-12-04T05:37:13.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- 172.21.15.97:0/4167978032 shutdown_connections 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- 172.21.15.97:0/4167978032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8600a7290 0x7fc8600c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- 172.21.15.97:0/4167978032 >> v2:172.21.15.143:3300/0 conn(0x7fc8600c5d40 0x7fc860158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- 172.21.15.97:0/4167978032 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc860151e10 0x7fc8600c1270 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- 172.21.15.97:0/4167978032 >> 172.21.15.97:0/4167978032 conn(0x7fc8600c7e40 msgr2=0x7fc8600c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- 172.21.15.97:0/4167978032 shutdown_connections 2023-12-04T05:37:13.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- 172.21.15.97:0/4167978032 wait complete. 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 Processor -- start 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- start start 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8600c5d40 0x7fc86014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 0x7fc860150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860159920 con 0x7fc8600a7290 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860157c30 con 0x7fc8600c5d40 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.031+0000 7fc86571d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86006b700 con 0x7fc860151e10 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48018/0 (socket says 172.21.15.97:48018) 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 -- 172.21.15.97:0/3086150215 learned_addr learned my addr 172.21.15.97:0/3086150215 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc857fff640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8600c5d40 0x7fc86014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85f7fe640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 0x7fc860150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 -- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 msgr2=0x7fc860150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 0x7fc860150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 -- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8600c5d40 msgr2=0x7fc86014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8600c5d40 0x7fc86014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 -- 172.21.15.97:0/3086150215 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500094d0 con 0x7fc8600a7290 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85f7fe640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 0x7fc860150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:13.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc85effd640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc8500af040 tx=0x7fc8500191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500b7830 con 0x7fc8600a7290 2023-12-04T05:37:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500b79b0 con 0x7fc8600a7290 2023-12-04T05:37:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500b7d60 con 0x7fc8600a7290 2023-12-04T05:37:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8601ed960 con 0x7fc8600a7290 2023-12-04T05:37:13.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8601edf20 con 0x7fc8600a7290 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860068440 con 0x7fc8600a7290 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8500b3040 con 0x7fc8600a7290 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.035+0000 7fc8577fe640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 0x7fc840068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.039+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc85011ee30 con 0x7fc8600a7290 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.039+0000 7fc857fff640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 0x7fc840068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.039+0000 7fc857fff640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 0x7fc840068dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8600a6cd0 tx=0x7fc848006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.039+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8500ec110 con 0x7fc8600a7290 2023-12-04T05:37:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.223+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8600c5660 con 0x7fc8600a7290 2023-12-04T05:37:13.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.223+0000 7fc8577fe640 1 -- 172.21.15.97:0/3086150215 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fc8500ef730 con 0x7fc8600a7290 2023-12-04T05:37:13.227 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:13.227 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:37:13.228 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:37:13.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 msgr2=0x7fc840068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 0x7fc840068dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8600a6cd0 tx=0x7fc848006f90 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 msgr2=0x7fc86006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc8500af040 tx=0x7fc8500191e0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 shutdown_connections 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc840066900 0x7fc840068dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc860151e10 0x7fc860150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8600c5d40 0x7fc86014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 --2- 172.21.15.97:0/3086150215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8600a7290 0x7fc86006ce10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 >> 172.21.15.97:0/3086150215 conn(0x7fc8600c7e40 msgr2=0x7fc8600a83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 shutdown_connections 2023-12-04T05:37:13.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.227+0000 7fc86571d640 1 -- 172.21.15.97:0/3086150215 wait complete. 2023-12-04T05:37:13.252 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:13.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 Processor -- start 2023-12-04T05:37:13.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 -- start start 2023-12-04T05:37:13.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f05700abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 0x7f0570154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0570158630 0x7f05701551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05701547d0 con 0x7f0570158630 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0570158b80 con 0x7f05700c7ef0 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f05761f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c4aa0 con 0x7f0570151bf0 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0570158630 0x7f05701551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0570158630 0x7f05701551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48020/0 (socket says 172.21.15.97:48020) 2023-12-04T05:37:13.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 -- 172.21.15.97:0/3795855234 learned_addr learned my addr 172.21.15.97:0/3795855234 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:13.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056f7fe640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f05700abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f0567fff640 1 --2- 172.21.15.97:0/3795855234 >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 0x7f0570154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 -- 172.21.15.97:0/3795855234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 msgr2=0x7f05700abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f05700abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 -- 172.21.15.97:0/3795855234 >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 msgr2=0x7f0570154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 --2- 172.21.15.97:0/3795855234 >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 0x7f0570154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056ffff640 1 -- 172.21.15.97:0/3795855234 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700c4d40 con 0x7f0570158630 2023-12-04T05:37:13.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f056f7fe640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f05700abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:13.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.391+0000 7f0567fff640 1 --2- 172.21.15.97:0/3795855234 >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 0x7f0570154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f056ffff640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0570158630 0x7f05701551a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05700ac660 tx=0x7f056801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32321aac265015f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f056effd640 1 -- 172.21.15.97:0/3795855234 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680a4ca0 con 0x7f0570158630 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f056effd640 1 -- 172.21.15.97:0/3795855234 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680a4e00 con 0x7f0570158630 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f056effd640 1 -- 172.21.15.97:0/3795855234 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680ac610 con 0x7f0570158630 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 -- 172.21.15.97:0/3795855234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0570158630 msgr2=0x7f05701551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0570158630 0x7f05701551a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05700ac660 tx=0x7f056801c590 comp rx=0 tx=0).stop 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 -- 172.21.15.97:0/3795855234 shutdown_connections 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0570158630 0x7f05701551a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 --2- 172.21.15.97:0/3795855234 >> v2:172.21.15.143:3300/0 conn(0x7f05700c7ef0 0x7f0570154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 --2- 172.21.15.97:0/3795855234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f05700abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 -- 172.21.15.97:0/3795855234 >> 172.21.15.97:0/3795855234 conn(0x7f0570073550 msgr2=0x7f0570073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 -- 172.21.15.97:0/3795855234 shutdown_connections 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.395+0000 7f05761f8640 1 -- 172.21.15.97:0/3795855234 wait complete. 2023-12-04T05:37:13.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 Processor -- start 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- start start 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f057014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0570158630 0x7f057014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c4420 con 0x7f05700c7ef0 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700abe70 con 0x7f0570158630 2023-12-04T05:37:13.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f2550 con 0x7f0570151bf0 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48034/0 (socket says 172.21.15.97:48034) 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 -- 172.21.15.97:0/150005933 learned_addr learned my addr 172.21.15.97:0/150005933 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f0567fff640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f057014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056ffff640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0570158630 0x7f057014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 -- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 msgr2=0x7f057014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f057014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 -- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0570158630 msgr2=0x7f057014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0570158630 0x7f057014bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 -- 172.21.15.97:0/150005933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009b30 con 0x7f05700c7ef0 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056f7fe640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f056000c7f0 tx=0x7f056000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560007820 con 0x7f05700c7ef0 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560007980 con 0x7f05700c7ef0 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560007d30 con 0x7f05700c7ef0 2023-12-04T05:37:13.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05700ab2f0 con 0x7f05700c7ef0 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700ab8b0 con 0x7f05700c7ef0 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.399+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570068440 con 0x7f05700c7ef0 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.403+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f05600113f0 con 0x7f05700c7ef0 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.403+0000 7f056cff9640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 0x7f0550068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.403+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0560084650 con 0x7f05700c7ef0 2023-12-04T05:37:13.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.403+0000 7f0567fff640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 0x7f0550068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.403+0000 7f0567fff640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 0x7f0550068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.407+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0560051900 con 0x7f05700c7ef0 2023-12-04T05:37:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f057006c970 con 0x7f05700c7ef0 2023-12-04T05:37:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f056cff9640 1 -- 172.21.15.97:0/150005933 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f0560054f20 con 0x7f05700c7ef0 2023-12-04T05:37:13.592 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:13.592 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1354103877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":1354103877},{"type":"v1","addr":"172.21.15.143:6835","nonce":1354103877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/3689839522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3689839522},{"type":"v1","addr":"172.21.15.97:6836","nonce":3689839522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4134036013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4134036013},{"type":"v1","addr":"172.21.15.97:6837","nonce":4134036013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:36:40.271902+0000","modified":"2023-12-04T05:36:43.356654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6834/3822856223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":3822856223},{"type":"v1","addr":"172.21.15.143:6834","nonce":3822856223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 8 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 msgr2=0x7f0550068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 0x7f0550068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0558006fd0 tx=0x7f0558008040 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 msgr2=0x7f05701f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f056000c7f0 tx=0x7f056000ccb0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 shutdown_connections 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05500668d0 0x7f0550068d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0570158630 0x7f057014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0570151bf0 0x7f057014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 --2- 172.21.15.97:0/150005933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05700c7ef0 0x7f05701f2010 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 >> 172.21.15.97:0/150005933 conn(0x7f0570073550 msgr2=0x7f05700c9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 shutdown_connections 2023-12-04T05:37:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.587+0000 7f05761f8640 1 -- 172.21.15.97:0/150005933 wait complete. 2023-12-04T05:37:13.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 Processor -- start 2023-12-04T05:37:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 -- start start 2023-12-04T05:37:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f389406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f389406be00 0x7f389406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3894152300 con 0x7f3894071a10 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3894071580 con 0x7f389406be00 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f389b454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389414ed50 con 0x7f389414e970 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38999f1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3894071a10 0x7f38940c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46148/0 (socket says 172.21.15.97:46148) 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38999f1640 1 -- 172.21.15.97:0/421524423 learned_addr learned my addr 172.21.15.97:0/421524423 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38989ef640 1 --2- 172.21.15.97:0/421524423 >> v2:172.21.15.143:3300/0 conn(0x7f389406be00 0x7f389406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f389406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210605873 0 0) 0x7f388c0014a0 con 0x7f3894071a10 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880003530 con 0x7f3894071a10 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744767890 0 0) 0x7f3880003530 con 0x7f3894071a10 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 msgr2=0x7f389406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f389406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 >> v2:172.21.15.143:3300/0 conn(0x7f389406be00 msgr2=0x7f389406ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 --2- 172.21.15.97:0/421524423 >> v2:172.21.15.143:3300/0 conn(0x7f389406be00 0x7f389406ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894151d60 con 0x7f3894071a10 2023-12-04T05:37:13.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f388c001b90 con 0x7f3894071a10 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 >> v1:172.21.15.97:6789/0 conn(0x7f3894071a10 legacy=0x7f38940c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3880003980 0x7f3880003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38800047d0 0x7f3880004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f3880005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894071580 con 0x7f3880003980 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389414ed50 con 0x7f38800047d0 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000ba70 con 0x7f389414e970 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3880003980 0x7f3880003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38989ef640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38800047d0 0x7f3880004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38999f1640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f3880005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 -- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 msgr2=0x7f3880005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f389414e970 0x7f3880005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 -- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38800047d0 msgr2=0x7f3880004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:13.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38800047d0 0x7f3880004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.747+0000 7f38991f0640 1 -- 172.21.15.97:0/421524423 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880003530 con 0x7f3880003980 2023-12-04T05:37:13.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f38991f0640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3880003980 0x7f3880003da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3890009a90 tx=0x7f389001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8b5ad7edc946e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900a5590 con 0x7f3880003980 2023-12-04T05:37:13.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38900a5710 con 0x7f3880003980 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f388bfff640 1 -- 172.21.15.97:0/421524423 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900a5ac0 con 0x7f3880003980 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 -- 172.21.15.97:0/421524423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3880003980 msgr2=0x7f3880003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 --2- 172.21.15.97:0/421524423 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3880003980 0x7f3880003da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3890009a90 tx=0x7f389001c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f38999f1640 1 -- 172.21.15.97:0/421524423 reap_dead start 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 -- 172.21.15.97:0/421524423 shutdown_connections 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 -- 172.21.15.97:0/421524423 >> 172.21.15.97:0/421524423 conn(0x7f38940c2970 msgr2=0x7f38940c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 -- 172.21.15.97:0/421524423 shutdown_connections 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.751+0000 7f389b454640 1 -- 172.21.15.97:0/421524423 wait complete. 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 Processor -- start 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 -- start start 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3880003980 0x7f389415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3894149c00 0x7f3894148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389415a420 con 0x7f38940a9d40 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38941ec800 con 0x7f3894149c00 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894157de0 con 0x7f3880003980 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48050/0 (socket says 172.21.15.97:48050) 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 -- 172.21.15.97:0/1740968019 learned_addr learned my addr 172.21.15.97:0/1740968019 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38991f0640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3880003980 0x7f389415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38999f1640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3894149c00 0x7f3894148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 -- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3880003980 msgr2=0x7f389415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3880003980 0x7f389415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 -- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3894149c00 msgr2=0x7f3894148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3894149c00 0x7f3894148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 -- 172.21.15.97:0/1740968019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894158080 con 0x7f38940a9d40 2023-12-04T05:37:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f38989ef640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3884011660 tx=0x7f3884011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400f9c0 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400fb20 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940c5570 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.755+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400fe90 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941487c0 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940c5a20 con 0x7f38940a9d40 2023-12-04T05:37:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3884015460 con 0x7f38940a9d40 2023-12-04T05:37:13.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f3889ffb640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 0x7f3878068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:13.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3884084b70 con 0x7f38940a9d40 2023-12-04T05:37:13.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f38991f0640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 0x7f3878068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:13.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.759+0000 7f38991f0640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 0x7f3878068d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38900af000 tx=0x7f38900046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:13.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.763+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3884051e50 con 0x7f38940a9d40 2023-12-04T05:37:13.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.911+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3894068440 con 0x7f38940a9d40 2023-12-04T05:37:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f3889ffb640 1 -- 172.21.15.97:0/1740968019 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f3884055470 con 0x7f38940a9d40 2023-12-04T05:37:13.917 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:13.917 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":20,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:36:41.888499+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:36:38.478537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T05:36:39.262349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:13.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 msgr2=0x7f3878068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 0x7f3878068d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38900af000 tx=0x7f38900046d0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 msgr2=0x7f38941496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3884011660 tx=0x7f3884011b20 comp rx=0 tx=0).stop 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 shutdown_connections 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38780668d0 0x7f3878068d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3894149c00 0x7f3894148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38940a9d40 0x7f38941496c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 --2- 172.21.15.97:0/1740968019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3880003980 0x7f389415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 >> 172.21.15.97:0/1740968019 conn(0x7f38940c2970 msgr2=0x7f3894148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 shutdown_connections 2023-12-04T05:37:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:13.915+0000 7f389b454640 1 -- 172.21.15.97:0/1740968019 wait complete. 2023-12-04T05:37:13.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-04T05:37:14.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 Processor -- start 2023-12-04T05:37:14.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 -- start start 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 0x7f4e88152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e8806b600 0x7f4e8806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880a9b30 con 0x7f4e8806b600 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e88152b60 con 0x7f4e8806ec90 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.079+0000 7f4e8e05f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88156100 con 0x7f4e8814fd00 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e8806b600 0x7f4e8806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4e8806b600 0x7f4e8806ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48052/0 (socket says 172.21.15.97:48052) 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 -- 172.21.15.97:0/2664723061 learned_addr learned my addr 172.21.15.97:0/2664723061 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e877fe640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/2664723061 >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 0x7f4e88152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 -- 172.21.15.97:0/2664723061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 msgr2=0x7f4e88155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 -- 172.21.15.97:0/2664723061 >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 msgr2=0x7f4e88152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 --2- 172.21.15.97:0/2664723061 >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 0x7f4e88152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 -- 172.21.15.97:0/2664723061 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880abc80 con 0x7f4e8806b600 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e877fe640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:14.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/2664723061 >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 0x7f4e88152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:14.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e87fff640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e8806ba70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4e880abe10 tx=0x7f4e8001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ebace9979ee804 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e86ffd640 1 -- 172.21.15.97:0/2664723061 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800a56b0 con 0x7f4e8806b600 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e86ffd640 1 -- 172.21.15.97:0/2664723061 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e800a5810 con 0x7f4e8806b600 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.083+0000 7f4e86ffd640 1 -- 172.21.15.97:0/2664723061 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800a5ba0 con 0x7f4e8806b600 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- 172.21.15.97:0/2664723061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 msgr2=0x7f4e8806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e8806ba70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4e880abe10 tx=0x7f4e8001c940 comp rx=0 tx=0).stop 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- 172.21.15.97:0/2664723061 shutdown_connections 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e8806ba70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/2664723061 >> v2:172.21.15.143:3300/0 conn(0x7f4e8806ec90 0x7f4e88152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/2664723061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- 172.21.15.97:0/2664723061 >> 172.21.15.97:0/2664723061 conn(0x7f4e880c31c0 msgr2=0x7f4e880c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- 172.21.15.97:0/2664723061 shutdown_connections 2023-12-04T05:37:14.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- 172.21.15.97:0/2664723061 wait complete. 2023-12-04T05:37:14.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 Processor -- start 2023-12-04T05:37:14.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- start start 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 0x7f4e881ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880a7460 con 0x7f4e8806b600 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880a7dc0 con 0x7f4e8806ec90 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e8e05f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e881ec050 con 0x7f4e8814fd00 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:48068/0 (socket says 172.21.15.97:48068) 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 -- 172.21.15.97:0/1050045784 learned_addr learned my addr 172.21.15.97:0/1050045784 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:14.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 0x7f4e881ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e87fff640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 -- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 msgr2=0x7f4e88150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 -- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 msgr2=0x7f4e881ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 0x7f4e881ebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e877fe640 1 -- 172.21.15.97:0/1050045784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80009b30 con 0x7f4e8806b600 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.087+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 0x7f4e881ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e877fe640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800d860 tx=0x7f4e7800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800de50 con 0x7f4e8806b600 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e78009870 con 0x7f4e8806b600 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e880a6e30 con 0x7f4e8806b600 2023-12-04T05:37:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78009c20 con 0x7f4e8806b600 2023-12-04T05:37:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e880a8a60 con 0x7f4e8806b600 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e88068440 con 0x7f4e8806b600 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e78014410 con 0x7f4e8806b600 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 0x7f4e68068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e78084b80 con 0x7f4e8806b600 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.091+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 0x7f4e68068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.095+0000 7f4e7ffff640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 0x7f4e68068dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e880c09c0 tx=0x7f4e70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.095+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e78051d20 con 0x7f4e8806b600 2023-12-04T05:37:14.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.279+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4e880a5bc0 con 0x7f4e8806b600 2023-12-04T05:37:14.284 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:37:14.279+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:37:14.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.283+0000 7f4e84ff9640 1 -- 172.21.15.97:0/1050045784 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4e78084e60 con 0x7f4e8806b600 2023-12-04T05:37:14.286 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:37:14.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 msgr2=0x7f4e68068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 0x7f4e68068dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e880c09c0 tx=0x7f4e70008040 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 msgr2=0x7f4e880a7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800d860 tx=0x7f4e7800dd20 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 shutdown_connections 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e68066900 0x7f4e68068dc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e8814fd00 0x7f4e88150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e8806ec90 0x7f4e881ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 --2- 172.21.15.97:0/1050045784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e8806b600 0x7f4e880a7880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 >> 172.21.15.97:0/1050045784 conn(0x7f4e880c31c0 msgr2=0x7f4e881504c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 shutdown_connections 2023-12-04T05:37:14.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.287+0000 7f4e8e05f640 1 -- 172.21.15.97:0/1050045784 wait complete. 2023-12-04T05:37:14.299 INFO:tasks.ceph.mds.b.smithi143.stderr: -5317> 2023-12-04T05:36:44.866+0000 7f99e75d7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:37:14.308 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-04T05:37:14.349 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-04T05:37:14.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 Processor -- start 2023-12-04T05:37:14.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 -- start start 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f63c0151f10 0x7f63c00c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00ca780 con 0x7f63c00cac10 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0158720 con 0x7f63c00c7f00 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c6596640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c0158cc0 con 0x7f63c0151f10 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c4b33640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f63c00cac10 0x7f63c015f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43642/0 (socket says 172.21.15.97:43642) 2023-12-04T05:37:14.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63c4b33640 1 -- 172.21.15.97:0/2681251251 learned_addr learned my addr 172.21.15.97:0/2681251251 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63bffff640 1 --2- 172.21.15.97:0/2681251251 >> v2:172.21.15.143:3300/0 conn(0x7f63c0151f10 0x7f63c00c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63beffd640 1 -- 172.21.15.97:0/2681251251 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385808112 0 0) 0x7f63c00ca780 con 0x7f63c00cac10 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63beffd640 1 -- 172.21.15.97:0/2681251251 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003530 con 0x7f63c00cac10 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63bffff640 1 -- 172.21.15.97:0/2681251251 >> v1:172.21.15.143:6789/0 conn(0x7f63c00c7f00 legacy=0x7f63c0154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63bffff640 1 -- 172.21.15.97:0/2681251251 >> v1:172.21.15.97:6789/0 conn(0x7f63c00cac10 legacy=0x7f63c015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.447+0000 7f63bffff640 1 -- 172.21.15.97:0/2681251251 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00bd830 con 0x7f63c0151f10 2023-12-04T05:37:14.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63bffff640 1 --2- 172.21.15.97:0/2681251251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c00c4980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097c0 tx=0x7f63b001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de766022616ce627 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63beffd640 1 -- 172.21.15.97:0/2681251251 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00ab600 con 0x7f63c0151f10 2023-12-04T05:37:14.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63beffd640 1 -- 172.21.15.97:0/2681251251 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b00a7050 con 0x7f63c0151f10 2023-12-04T05:37:14.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63beffd640 1 -- 172.21.15.97:0/2681251251 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00ab980 con 0x7f63c0151f10 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 -- 172.21.15.97:0/2681251251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 msgr2=0x7f63c00c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 --2- 172.21.15.97:0/2681251251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c00c4980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63b00097c0 tx=0x7f63b001c360 comp rx=0 tx=0).stop 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 -- 172.21.15.97:0/2681251251 shutdown_connections 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 --2- 172.21.15.97:0/2681251251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c00c4980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 -- 172.21.15.97:0/2681251251 >> 172.21.15.97:0/2681251251 conn(0x7f63c0073950 msgr2=0x7f63c0073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 -- 172.21.15.97:0/2681251251 shutdown_connections 2023-12-04T05:37:14.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.451+0000 7f63c6596640 1 -- 172.21.15.97:0/2681251251 wait complete. 2023-12-04T05:37:14.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 Processor -- start 2023-12-04T05:37:14.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 -- start start 2023-12-04T05:37:14.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63c00c7f00 0x7f63c01f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014b720 con 0x7f63c00cac10 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014a530 con 0x7f63c0151f10 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014a250 con 0x7f63c00c7f00 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c4b33640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40576/0 (socket says 172.21.15.97:40576) 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 -- 172.21.15.97:0/232902451 learned_addr learned my addr 172.21.15.97:0/232902451 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:14.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bffff640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63c00c7f00 0x7f63c01f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 -- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63c00c7f00 msgr2=0x7f63c01f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63c00c7f00 0x7f63c01f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 -- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 msgr2=0x7f63c014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 -- 172.21.15.97:0/232902451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009420 con 0x7f63c00cac10 2023-12-04T05:37:14.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bf7fe640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c3c0 tx=0x7f63b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b40052d0 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4005430 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c014edb0 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.455+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4003840 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0145a90 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0068440 con 0x7f63c00cac10 2023-12-04T05:37:14.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63b40039a0 con 0x7f63c00cac10 2023-12-04T05:37:14.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63bcff9640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:14.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f63b40838c0 con 0x7f63c00cac10 2023-12-04T05:37:14.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.459+0000 7f63bffff640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:14.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.463+0000 7f63bffff640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 0x7f63ac068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63b00ad000 tx=0x7f63b00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:14.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.463+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63b4050bc0 con 0x7f63c00cac10 2023-12-04T05:37:14.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:14.647+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63c01605a0 con 0x7f63c00cac10 2023-12-04T05:37:15.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63bcff9640 1 -- 172.21.15.97:0/232902451 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63b40541e0 con 0x7f63c00cac10 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 msgr2=0x7f63ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 0x7f63ac068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63b00ad000 tx=0x7f63b00a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 msgr2=0x7f63c0145550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c3c0 tx=0x7f63b400c880 comp rx=0 tx=0).stop 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 shutdown_connections 2023-12-04T05:37:15.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f63c0151f10 0x7f63c014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63c00cac10 0x7f63c0145550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 --2- 172.21.15.97:0/232902451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f63c00c7f00 0x7f63c01f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 >> 172.21.15.97:0/232902451 conn(0x7f63c0073950 msgr2=0x7f63c0073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 shutdown_connections 2023-12-04T05:37:15.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.287+0000 7f63c6596640 1 -- 172.21.15.97:0/232902451 wait complete. 2023-12-04T05:37:15.314 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-04T05:37:15.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 Processor -- start 2023-12-04T05:37:15.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 -- start start 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a900a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9014feb0 con 0x7f8a901527a0 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9006d560 con 0x7f8a9014fad0 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.455+0000 7f8a96afe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9006d840 con 0x7f8a900c3570 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a9509b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8a901527a0 0x7f8a90152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43650/0 (socket says 172.21.15.97:43650) 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a9509b640 1 -- 172.21.15.97:0/889578364 learned_addr learned my addr 172.21.15.97:0/889578364 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8ffff640 1 --2- 172.21.15.97:0/889578364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a900a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127332743 0 0) 0x7f8a9014feb0 con 0x7f8a901527a0 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a80003530 con 0x7f8a901527a0 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183683298 0 0) 0x7f8a9006d560 con 0x7f8a9014fad0 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a9014feb0 con 0x7f8a9014fad0 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8ffff640 1 -- 172.21.15.97:0/889578364 >> v1:172.21.15.143:6789/0 conn(0x7f8a9014fad0 legacy=0x7f8a900c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8ffff640 1 -- 172.21.15.97:0/889578364 >> v1:172.21.15.97:6789/0 conn(0x7f8a901527a0 legacy=0x7f8a90152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1027793736 0 0) 0x7f8a80003530 con 0x7f8a901527a0 2023-12-04T05:37:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8ffff640 1 -- 172.21.15.97:0/889578364 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9006db20 con 0x7f8a900c3570 2023-12-04T05:37:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.459+0000 7f8a8ffff640 1 --2- 172.21.15.97:0/889578364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a900a8e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0097f0 tx=0x7f8a7c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf98f7b2a8fb87d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88001a00 con 0x7f8a900c3570 2023-12-04T05:37:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c0a7050 con 0x7f8a900c3570 2023-12-04T05:37:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8f7fe640 1 -- 172.21.15.97:0/889578364 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0ab600 con 0x7f8a900c3570 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- 172.21.15.97:0/889578364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 msgr2=0x7f8a900a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 --2- 172.21.15.97:0/889578364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a900a8e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0097f0 tx=0x7f8a7c01c3e0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- 172.21.15.97:0/889578364 shutdown_connections 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 --2- 172.21.15.97:0/889578364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a900a8e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- 172.21.15.97:0/889578364 >> 172.21.15.97:0/889578364 conn(0x7f8a900c2a50 msgr2=0x7f8a900c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- 172.21.15.97:0/889578364 shutdown_connections 2023-12-04T05:37:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- 172.21.15.97:0/889578364 wait complete. 2023-12-04T05:37:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 Processor -- start 2023-12-04T05:37:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- start start 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a9014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a901527a0 0x7f8a900c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a900712d0 con 0x7f8a9014fad0 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a901506d0 con 0x7f8a901527a0 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a96afe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a90071520 con 0x7f8a900c3570 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40580/0 (socket says 172.21.15.97:40580) 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a8ffff640 1 -- 172.21.15.97:0/2128533753 learned_addr learned my addr 172.21.15.97:0/2128533753 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a9509b640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a901527a0 0x7f8a900c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.463+0000 7f8a9489a640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a9014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:15.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 -- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 msgr2=0x7f8a9014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a9014b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 -- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a901527a0 msgr2=0x7f8a900c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:15.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a901527a0 0x7f8a900c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:15.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 -- 172.21.15.97:0/2128533753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c009420 con 0x7f8a9014fad0 2023-12-04T05:37:15.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8ffff640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000c10 tx=0x7f8a7c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0abd00 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c0abe60 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0b4600 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a90071800 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a900bfb90 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a90071990 con 0x7f8a9014fad0 2023-12-04T05:37:15.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a7c0b2040 con 0x7f8a9014fad0 2023-12-04T05:37:15.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 0x7f8a74068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:15.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8a7c11db70 con 0x7f8a9014fad0 2023-12-04T05:37:15.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.467+0000 7f8a9489a640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 0x7f8a74068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:15.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.471+0000 7f8a9489a640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 0x7f8a74068dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000f70 tx=0x7f8a84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:15.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.471+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a7c0eadf0 con 0x7f8a9014fad0 2023-12-04T05:37:15.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:15.627+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a90068440 con 0x7f8a9014fad0 2023-12-04T05:37:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.287+0000 7f8a8d7fa640 1 -- 172.21.15.97:0/2128533753 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8a7c0b00d0 con 0x7f8a9014fad0 2023-12-04T05:37:16.291 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-12-04T05:37:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 msgr2=0x7f8a74068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 0x7f8a74068dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000f70 tx=0x7f8a84009040 comp rx=0 tx=0).stop 2023-12-04T05:37:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 msgr2=0x7f8a900bf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:16.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c000c10 tx=0x7f8a7c019180 comp rx=0 tx=0).stop 2023-12-04T05:37:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 shutdown_connections 2023-12-04T05:37:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a74066900 0x7f8a74068dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a901527a0 0x7f8a900c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a9014fad0 0x7f8a900bf650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 --2- 172.21.15.97:0/2128533753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a900c3570 0x7f8a9014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 >> 172.21.15.97:0/2128533753 conn(0x7f8a900c2a50 msgr2=0x7f8a9014dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 shutdown_connections 2023-12-04T05:37:16.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.291+0000 7f8a96afe640 1 -- 172.21.15.97:0/2128533753 wait complete. 2023-12-04T05:37:16.320 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-04T05:37:16.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 Processor -- start 2023-12-04T05:37:16.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 -- start start 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcd00ca180 0x7fbcd00ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 0x7fbcd00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 0x7fbcd00c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd00c6920 con 0x7fbcd00ca180 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd0151e50 con 0x7fbcd006cad0 2023-12-04T05:37:16.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd6156640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00c4930 con 0x7fbcd0154eb0 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcd00ca180 0x7fbcd00ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbcd00ca180 0x7fbcd00ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40596/0 (socket says 172.21.15.97:40596) 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 -- 172.21.15.97:0/678655651 learned_addr learned my addr 172.21.15.97:0/678655651 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 -- 172.21.15.97:0/678655651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 msgr2=0x7fbcd00c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd4953640 1 --2- 172.21.15.97:0/678655651 >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 0x7fbcd00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5955640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 0x7fbcd00c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 0x7fbcd00c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 -- 172.21.15.97:0/678655651 >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 msgr2=0x7fbcd00c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 --2- 172.21.15.97:0/678655651 >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 0x7fbcd00c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5154640 1 -- 172.21.15.97:0/678655651 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd01553a0 con 0x7fbcd00ca180 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd4953640 1 --2- 172.21.15.97:0/678655651 >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 0x7fbcd00c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:16.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.467+0000 7fbcd5955640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 0x7fbcd00c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:16.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd5154640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd00ca180 0x7fbcd00ca560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0074530 tx=0x7fbccc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab2c56972b5e049 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:16.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcc7fff640 1 -- 172.21.15.97:0/678655651 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0ab600 con 0x7fbcd00ca180 2023-12-04T05:37:16.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcc7fff640 1 -- 172.21.15.97:0/678655651 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0a7050 con 0x7fbcd00ca180 2023-12-04T05:37:16.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcc7fff640 1 -- 172.21.15.97:0/678655651 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0ab980 con 0x7fbcd00ca180 2023-12-04T05:37:16.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- 172.21.15.97:0/678655651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd00ca180 msgr2=0x7fbcd00ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:16.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd00ca180 0x7fbcd00ca560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0074530 tx=0x7fbccc01c470 comp rx=0 tx=0).stop 2023-12-04T05:37:16.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- 172.21.15.97:0/678655651 shutdown_connections 2023-12-04T05:37:16.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd0154eb0 0x7fbcd00c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 --2- 172.21.15.97:0/678655651 >> v2:172.21.15.143:3300/0 conn(0x7fbcd006cad0 0x7fbcd00c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 --2- 172.21.15.97:0/678655651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd00ca180 0x7fbcd00ca560 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- 172.21.15.97:0/678655651 >> 172.21.15.97:0/678655651 conn(0x7fbcd0073720 msgr2=0x7fbcd0073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- 172.21.15.97:0/678655651 shutdown_connections 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- 172.21.15.97:0/678655651 wait complete. 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 Processor -- start 2023-12-04T05:37:16.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.471+0000 7fbcd6156640 1 -- start start 2023-12-04T05:37:16.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd00ca180 0x7fbcd01538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 0x7fbcd01f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd014a650 con 0x7fbcd006cad0 2023-12-04T05:37:16.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd014b170 con 0x7fbcd0154eb0 2023-12-04T05:37:16.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0152830 con 0x7fbcd00ca180 2023-12-04T05:37:16.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40600/0 (socket says 172.21.15.97:40600) 2023-12-04T05:37:16.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 -- 172.21.15.97:0/2839240499 learned_addr learned my addr 172.21.15.97:0/2839240499 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:16.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 -- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd00ca180 msgr2=0x7fbcd01538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd00ca180 0x7fbcd01538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 -- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 msgr2=0x7fbcd01f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5955640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 0x7fbcd01f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 0x7fbcd01f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 -- 172.21.15.97:0/2839240499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0094d0 con 0x7fbcd006cad0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5955640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 0x7fbcd01f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd5154640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbccc01cd10 tx=0x7fbccc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b6620 con 0x7fbcd006cad0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0b67a0 con 0x7fbcd006cad0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0b6b50 con 0x7fbcd006cad0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd014b980 con 0x7fbcd006cad0 2023-12-04T05:37:16.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd014b6a0 con 0x7fbcd006cad0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd00c5330 con 0x7fbcd006cad0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.475+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbccc0b2040 con 0x7fbcd006cad0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.479+0000 7fbcc5ffb640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.479+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fbccc11e840 con 0x7fbcd006cad0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.479+0000 7fbcd4953640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.479+0000 7fbcd4953640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 0x7fbcb4068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0154980 tx=0x7fbcc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:16.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.483+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbccc0ebbd0 con 0x7fbcd006cad0 2023-12-04T05:37:16.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:16.631+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcd004e890 con 0x7fbcd006cad0 2023-12-04T05:37:17.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.291+0000 7fbcc5ffb640 1 -- 172.21.15.97:0/2839240499 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbccc0ef1f0 con 0x7fbcd006cad0 2023-12-04T05:37:17.293 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-12-04T05:37:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.291+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 msgr2=0x7fbcb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.291+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 0x7fbcb4068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0154980 tx=0x7fbcc0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.291+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 msgr2=0x7fbcd01522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.291+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbccc01cd10 tx=0x7fbccc01acb0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 shutdown_connections 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbcd0154eb0 0x7fbcd01f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbcd00ca180 0x7fbcd01538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 --2- 172.21.15.97:0/2839240499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbcd006cad0 0x7fbcd01522f0 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbccc01cd10 tx=0x7fbccc01acb0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 >> 172.21.15.97:0/2839240499 conn(0x7fbcd0073720 msgr2=0x7fbcd0073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:17.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 shutdown_connections 2023-12-04T05:37:17.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.295+0000 7fbcd6156640 1 -- 172.21.15.97:0/2839240499 wait complete. 2023-12-04T05:37:17.324 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T05:37:17.324 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-04T05:37:17.324 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-04T05:37:17.324 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:37:17.324 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T05:37:17.324 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-04T05:37:17.325 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-04T05:37:17.325 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:37:17.325 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T05:37:17.325 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-04T05:37:17.325 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-04T05:37:17.325 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:37:17.325 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T05:37:17.325 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-04T05:37:17.326 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-04T05:37:17.326 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:37:17.340 INFO:tasks.ceph.mds.a:Stopped 2023-12-04T05:37:17.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T05:37:17.341 INFO:tasks.ceph.mds.c:Stopped 2023-12-04T05:37:17.341 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T05:37:17.344 INFO:tasks.ceph.mds.d:Stopped 2023-12-04T05:37:17.345 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T05:37:17.345 INFO:tasks.ceph.mds.b:Stopped 2023-12-04T05:37:17.345 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T05:37:17.387 INFO:tasks.ceph.mds.a:Started 2023-12-04T05:37:17.387 DEBUG:teuthology.parallel:result is None 2023-12-04T05:37:17.389 INFO:tasks.ceph.mds.c:Started 2023-12-04T05:37:17.389 DEBUG:teuthology.parallel:result is None 2023-12-04T05:37:17.391 INFO:tasks.ceph.mds.d:Started 2023-12-04T05:37:17.391 DEBUG:teuthology.parallel:result is None 2023-12-04T05:37:17.393 INFO:tasks.ceph.mds.b:Started 2023-12-04T05:37:17.393 DEBUG:teuthology.parallel:result is None 2023-12-04T05:37:17.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-04T05:37:17.479 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-04T05:37:17.479 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-04T05:37:17.480 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:37:17.482 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:37:17.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 Processor -- start 2023-12-04T05:37:17.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 -- start start 2023-12-04T05:37:17.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fea240705f0 0x7fea2413d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea24070a20 con 0x7fea24071920 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2406da10 con 0x7fea2406dea0 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2c1c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2406d120 con 0x7fea240705f0 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2975f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2a761640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fea240705f0 0x7fea2413d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2975f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40638/0 (socket says 172.21.15.97:40638) 2023-12-04T05:37:17.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2975f640 1 -- 172.21.15.97:0/720033918 learned_addr learned my addr 172.21.15.97:0/720033918 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2a761640 1 -- 172.21.15.97:0/720033918 >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 msgr2=0x7fea240700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2a761640 1 --2- 172.21.15.97:0/720033918 >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea2a761640 1 -- 172.21.15.97:0/720033918 >> v1:172.21.15.143:6789/0 conn(0x7fea24071920 legacy=0x7fea240bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2a761640 1 -- 172.21.15.97:0/720033918 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240bf9b0 con 0x7fea240705f0 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.543+0000 7fea28f5e640 1 -- 172.21.15.97:0/720033918 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662874233 0 0) 0x7fea24070a20 con 0x7fea24071920 2023-12-04T05:37:17.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2975f640 1 --2- 172.21.15.97:0/720033918 >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2a761640 1 --2- 172.21.15.97:0/720033918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea240705f0 0x7fea2413d490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea24072760 tx=0x7fea1c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b5d211b11108d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea28f5e640 1 -- 172.21.15.97:0/720033918 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0a59a0 con 0x7fea240705f0 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea28f5e640 1 -- 172.21.15.97:0/720033918 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c0a5b00 con 0x7fea240705f0 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea28f5e640 1 -- 172.21.15.97:0/720033918 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0a5e90 con 0x7fea240705f0 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 -- 172.21.15.97:0/720033918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea240705f0 msgr2=0x7fea2413d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/720033918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea240705f0 0x7fea2413d490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fea24072760 tx=0x7fea1c01c8e0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 -- 172.21.15.97:0/720033918 shutdown_connections 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/720033918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea240705f0 0x7fea2413d490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/720033918 >> v2:172.21.15.97:3300/0 conn(0x7fea2406dea0 0x7fea240700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 -- 172.21.15.97:0/720033918 >> 172.21.15.97:0/720033918 conn(0x7fea240c5e70 msgr2=0x7fea240c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:17.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 -- 172.21.15.97:0/720033918 shutdown_connections 2023-12-04T05:37:17.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.547+0000 7fea2c1c4640 1 -- 172.21.15.97:0/720033918 wait complete. 2023-12-04T05:37:17.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 Processor -- start 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- start start 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea240705f0 0x7fea2413c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea24071920 0x7fea24151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240a8460 con 0x7fea2406dea0 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240a9ad0 con 0x7fea24071920 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240a8640 con 0x7fea240705f0 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40650/0 (socket says 172.21.15.97:40650) 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 -- 172.21.15.97:0/194414897 learned_addr learned my addr 172.21.15.97:0/194414897 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2a761640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea24071920 0x7fea24151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2975f640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea240705f0 0x7fea2413c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 -- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea240705f0 msgr2=0x7fea2413c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea240705f0 0x7fea2413c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 -- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea24071920 msgr2=0x7fea24151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea24071920 0x7fea24151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 -- 172.21.15.97:0/194414897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140094d0 con 0x7fea2406dea0 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea29f60640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fea20001ec0 tx=0x7fea2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200054e0 con 0x7fea2406dea0 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea20003600 con 0x7fea2406dea0 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200039b0 con 0x7fea2406dea0 2023-12-04T05:37:17.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c009a70 con 0x7fea2406dea0 2023-12-04T05:37:17.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.551+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea240a8c00 con 0x7fea2406dea0 2023-12-04T05:37:17.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24068440 con 0x7fea2406dea0 2023-12-04T05:37:17.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea20003b10 con 0x7fea2406dea0 2023-12-04T05:37:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea1a7fc640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 0x7fea08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea200836a0 con 0x7fea2406dea0 2023-12-04T05:37:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea2975f640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 0x7fea08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:17.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.555+0000 7fea2975f640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 0x7fea08068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fea2413cc00 tx=0x7fea14009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:17.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.559+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea20050c80 con 0x7fea2406dea0 2023-12-04T05:37:17.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:17.719+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fea2406c000 con 0x7fea2406dea0 2023-12-04T05:37:18.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea1a7fc640 1 -- 172.21.15.97:0/194414897 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea20017020 con 0x7fea2406dea0 2023-12-04T05:37:18.304 INFO:teuthology.orchestra.run.smithi097.stderr: removed all blocklist entries 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 msgr2=0x7fea08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 0x7fea08068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fea2413cc00 tx=0x7fea14009240 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 msgr2=0x7fea241368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fea20001ec0 tx=0x7fea2000c8e0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 shutdown_connections 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea080668d0 0x7fea08068d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea24071920 0x7fea24151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea240705f0 0x7fea2413c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 --2- 172.21.15.97:0/194414897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fea2406dea0 0x7fea241368c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 >> 172.21.15.97:0/194414897 conn(0x7fea240c5e70 msgr2=0x7fea24152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:18.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 shutdown_connections 2023-12-04T05:37:18.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.303+0000 7fea2c1c4640 1 -- 172.21.15.97:0/194414897 wait complete. 2023-12-04T05:37:18.330 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-04T05:37:18.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 Processor -- start 2023-12-04T05:37:18.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 -- start start 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f43e80c7ef0 0x7f43e8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e81547d0 con 0x7f43e8158630 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e8158b80 con 0x7f43e8151bf0 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ef39d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80c4aa0 con 0x7f43e80c7ef0 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed93a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f43e8158630 0x7f43e815efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43686/0 (socket says 172.21.15.97:43686) 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed93a640 1 -- 172.21.15.97:0/795544436 learned_addr learned my addr 172.21.15.97:0/795544436 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 --2- 172.21.15.97:0/795544436 >> v2:172.21.15.143:3300/0 conn(0x7f43e80c7ef0 0x7f43e8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145034707 0 0) 0x7f43e81547d0 con 0x7f43e8158630 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d4003530 con 0x7f43e8158630 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482895614 0 0) 0x7f43d4003530 con 0x7f43e8158630 2023-12-04T05:37:18.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 >> v2:172.21.15.143:3300/0 conn(0x7f43e80c7ef0 msgr2=0x7f43e8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 --2- 172.21.15.97:0/795544436 >> v2:172.21.15.143:3300/0 conn(0x7f43e80c7ef0 0x7f43e8154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 >> v1:172.21.15.143:6789/0 conn(0x7f43e8151bf0 legacy=0x7f43e80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80c4d40 con 0x7f43e8158630 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f43e0001a00 con 0x7f43e8158630 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 >> v1:172.21.15.97:6789/0 conn(0x7f43e8158630 legacy=0x7f43e815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43d4003980 0x7f43d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 0x7f43d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40052b0 0x7f43d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80c4aa0 con 0x7f43d40047d0 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d400c180 con 0x7f43d40052b0 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d400c340 con 0x7f43d4003980 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 0x7f43d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed139640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43d4003980 0x7f43d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed93a640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40052b0 0x7f43d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 -- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43d4003980 msgr2=0x7f43d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43d4003980 0x7f43d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 -- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40052b0 msgr2=0x7f43d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40052b0 0x7f43d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ec938640 1 -- 172.21.15.97:0/795544436 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4003530 con 0x7f43d40047d0 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed93a640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40052b0 0x7f43d400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:18.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.467+0000 7f43ed93a640 1 -- 172.21.15.97:0/795544436 reap_dead start 2023-12-04T05:37:18.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ec938640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 0x7f43d4004c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43e80c8350 tx=0x7f43d801c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3a87f670803a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80a4b30 con 0x7f43d40047d0 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80a4c90 con 0x7f43d40047d0 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43dffff640 1 -- 172.21.15.97:0/795544436 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80a4e40 con 0x7f43d40047d0 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 -- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 msgr2=0x7f43d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 0x7f43d4004c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43e80c8350 tx=0x7f43d801c6d0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 -- 172.21.15.97:0/795544436 shutdown_connections 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 --2- 172.21.15.97:0/795544436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43d40047d0 0x7f43d4004c50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 -- 172.21.15.97:0/795544436 >> 172.21.15.97:0/795544436 conn(0x7f43e8073550 msgr2=0x7f43e8073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 -- 172.21.15.97:0/795544436 shutdown_connections 2023-12-04T05:37:18.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.471+0000 7f43ef39d640 1 -- 172.21.15.97:0/795544436 wait complete. 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 Processor -- start 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- start start 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40047d0 0x7f43e80c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e81f1240 0x7f43e80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8155a70 con 0x7f43e8156b10 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8155d50 con 0x7f43d40047d0 2023-12-04T05:37:18.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e8156030 con 0x7f43e81f1240 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40662/0 (socket says 172.21.15.97:40662) 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 -- 172.21.15.97:0/2852272266 learned_addr learned my addr 172.21.15.97:0/2852272266 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ec938640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e81f1240 0x7f43e80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed139640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40047d0 0x7f43e80c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 -- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e81f1240 msgr2=0x7f43e80ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e81f1240 0x7f43e80ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 -- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40047d0 msgr2=0x7f43e80c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40047d0 0x7f43e80c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 -- 172.21.15.97:0/2852272266 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8156310 con 0x7f43e8156b10 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ed93a640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43e8154630 tx=0x7f43e000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000eb90 con 0x7f43e8156b10 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e000ecf0 con 0x7f43e8156b10 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0013660 con 0x7f43e8156b10 2023-12-04T05:37:18.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e81565f0 con 0x7f43e8156b10 2023-12-04T05:37:18.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.475+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e8157160 con 0x7f43e8156b10 2023-12-04T05:37:18.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e8068440 con 0x7f43e8156b10 2023-12-04T05:37:18.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f43e00137c0 con 0x7f43e8156b10 2023-12-04T05:37:18.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ddffb640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 0x7f43cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43e0084300 con 0x7f43e8156b10 2023-12-04T05:37:18.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ed139640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 0x7f43cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.479+0000 7f43ed139640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 0x7f43cc068dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43e4007fd0 tx=0x7f43e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.483+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43e00519d0 con 0x7f43e8156b10 2023-12-04T05:37:18.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43e806c970 con 0x7f43e8156b10 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ddffb640 1 -- 172.21.15.97:0/2852272266 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f43e0054ff0 con 0x7f43e8156b10 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_dump": [ 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.686 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.a", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lOIFILRAAicRg3crgxeVlsV7NM1n7mw==", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.b", 2023-12-04T05:37:18.687 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lYdJoOhAA/pXezZGzriXfC7PkJPYzxw==", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.c", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ljoayNBAA5Quugau8ZuP7purlpz5Ilw==", 2023-12-04T05:37:18.688 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.689 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.696 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.d", 2023-12-04T05:37:18.696 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l86FvBhAARfh7Pfe7OxC55XiemjCXYw==", 2023-12-04T05:37:18.696 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.0", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQArZW1lgv9DGxAAESL7fT3cBtlDP3ZL+8SiEQ==", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.697 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.1", 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAuZW1lpkkDIxAAemUKa7Rs4XiY7eaOnzCZRw==", 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.2", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAxZW1lsGxCKRAAVWWNEXg7H3hUauiE4BtjfA==", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.3", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA0ZW1lUFbXLxAA2YUaH5LIpJU8Qq2k64ARFg==", 2023-12-04T05:37:18.699 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.4", 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA6ZW1lJsdpOxAAtvDjgGrfndThS7iJdSYxZA==", 2023-12-04T05:37:18.700 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.5", 2023-12-04T05:37:18.701 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA+ZW1lZzyUBhAAwZO11IA60hqFX9N9osxCXA==", 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.6", 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBBZW1lZbuLDRAAPQBdTdQHhezNoymtejlsvA==", 2023-12-04T05:37:18.702 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.7", 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBEZW1l1q8+ExAAaoF2kTbzNXGmjW03HTVXeA==", 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:37:18.703 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.0", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg==", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.1", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ==", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow r", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rwx" 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.admin", 2023-12-04T05:37:18.705 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ly44ACxAA1iafTImcOQmxRzlURmohcw==", 2023-12-04T05:37:18.706 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.706 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:37:18.706 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:37:18.707 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:37:18.707 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.708 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.708 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-mds", 2023-12-04T05:37:18.709 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1lwc3VChAAdNEYl3LmL4tOLFzzH2oGGg==", 2023-12-04T05:37:18.709 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-mds" 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-mgr", 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1lZNfVChAAqdMEV5QrgcHa+EdyAKkQXA==", 2023-12-04T05:37:18.710 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.711 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-04T05:37:18.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-osd", 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1l7N/VChAAKy3SWXMxjLBYlBi5iSiubw==", 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-osd" 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rbd", 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1laujVChAAKeXqQ2pzzMn0UAeCurkTuA==", 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1lBfHVChAAU2sSpvcKe3Eak3/oeQT1MA==", 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.bootstrap-rgw", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBPZW1l+frVChAAoJICVPT9+S8/8fllmtm3Sw==", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.x", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lLP/pKBAA0n+KwZOZL9N93B4cduwStQ==", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.714 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.y", 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1l8dDaJBAANHBgEjKz2FTTo8OrJVB1pw==", 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-12-04T05:37:18.715 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 msgr2=0x7f43cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 0x7f43cc068dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43e4007fd0 tx=0x7f43e4009040 comp rx=0 tx=0).stop 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 msgr2=0x7f43e80c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43e8154630 tx=0x7f43e000e530 comp rx=0 tx=0).stop 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 shutdown_connections 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f43cc066900 0x7f43cc068dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43e8156b10 0x7f43e80c1320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.717 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e81f1240 0x7f43e80ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 --2- 172.21.15.97:0/2852272266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43d40047d0 0x7f43e80c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 >> 172.21.15.97:0/2852272266 conn(0x7f43e8073550 msgr2=0x7f43e814fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 shutdown_connections 2023-12-04T05:37:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.683+0000 7f43ef39d640 1 -- 172.21.15.97:0/2852272266 wait complete. 2023-12-04T05:37:18.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-04T05:37:18.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 Processor -- start 2023-12-04T05:37:18.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 -- start start 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14eb30 0x7f680c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f680c14f790 0x7f680c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c154640 con 0x7f680c154e10 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0c0bd0 con 0x7f680c14f790 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6810dd8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c14ef10 con 0x7f680c14eb30 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f680ad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f680c154e10 0x7f680c151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43690/0 (socket says 172.21.15.97:43690) 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f680ad9d640 1 -- 172.21.15.97:0/1110489471 learned_addr learned my addr 172.21.15.97:0/1110489471 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6803fff640 1 --2- 172.21.15.97:0/1110489471 >> v2:172.21.15.143:3300/0 conn(0x7f680c14f790 0x7f680c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f680a59c640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14eb30 0x7f680c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6809d9b640 1 -- 172.21.15.97:0/1110489471 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167299106 0 0) 0x7f680c154640 con 0x7f680c154e10 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6809d9b640 1 -- 172.21.15.97:0/1110489471 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f8003530 con 0x7f680c154e10 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6803fff640 1 -- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14eb30 msgr2=0x7f680c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6803fff640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14eb30 0x7f680c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6803fff640 1 -- 172.21.15.97:0/1110489471 >> v1:172.21.15.97:6789/0 conn(0x7f680c154e10 legacy=0x7f680c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.855+0000 7f6803fff640 1 -- 172.21.15.97:0/1110489471 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c1535a0 con 0x7f680c14f790 2023-12-04T05:37:18.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6803fff640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14f790 0x7f680c1548d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097c0 tx=0x7f67f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9599b30f651115fa server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6809d9b640 1 -- 172.21.15.97:0/1110489471 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40ad660 con 0x7f680c14f790 2023-12-04T05:37:18.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6809d9b640 1 -- 172.21.15.97:0/1110489471 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40ad7c0 con 0x7f680c14f790 2023-12-04T05:37:18.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6809d9b640 1 -- 172.21.15.97:0/1110489471 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40adb50 con 0x7f680c14f790 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 -- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14f790 msgr2=0x7f680c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14f790 0x7f680c1548d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097c0 tx=0x7f67f401c450 comp rx=0 tx=0).stop 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 -- 172.21.15.97:0/1110489471 shutdown_connections 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14f790 0x7f680c1548d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 --2- 172.21.15.97:0/1110489471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14eb30 0x7f680c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 -- 172.21.15.97:0/1110489471 >> 172.21.15.97:0/1110489471 conn(0x7f680c0c5e70 msgr2=0x7f680c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 -- 172.21.15.97:0/1110489471 shutdown_connections 2023-12-04T05:37:18.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.859+0000 7f6810dd8640 1 -- 172.21.15.97:0/1110489471 wait complete. 2023-12-04T05:37:18.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 Processor -- start 2023-12-04T05:37:18.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- start start 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 0x7f680c13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14f790 0x7f680c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c06c280 con 0x7f680c154e10 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c06bf50 con 0x7f680c14eb30 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0718c0 con 0x7f680c14f790 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40668/0 (socket says 172.21.15.97:40668) 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 -- 172.21.15.97:0/670656642 learned_addr learned my addr 172.21.15.97:0/670656642 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680a59c640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 0x7f680c13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6803fff640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14f790 0x7f680c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 -- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14f790 msgr2=0x7f680c149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14f790 0x7f680c149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 -- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 msgr2=0x7f680c13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 0x7f680c13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 -- 172.21.15.97:0/670656642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009420 con 0x7f680c154e10 2023-12-04T05:37:18.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680a59c640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 0x7f680c13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f680ad9d640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f680400cb40 tx=0x7f680400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680400aca0 con 0x7f680c154e10 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680400ae00 con 0x7f680c154e10 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c071ba0 con 0x7f680c154e10 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6804012620 con 0x7f680c154e10 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.863+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c1498a0 con 0x7f680c154e10 2023-12-04T05:37:18.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c14e680 con 0x7f680c154e10 2023-12-04T05:37:18.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6804007070 con 0x7f680c154e10 2023-12-04T05:37:18.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f6802ffd640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 0x7f67ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:18.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68040840d0 con 0x7f680c154e10 2023-12-04T05:37:18.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f680a59c640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 0x7f67ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:18.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.867+0000 7f680a59c640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 0x7f67ec068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f680c0ab380 tx=0x7f67fc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:18.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:18.871+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6804051700 con 0x7f680c154e10 2023-12-04T05:37:19.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.071+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f680c068440 con 0x7f680c154e10 2023-12-04T05:37:19.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.075+0000 7f6802ffd640 1 -- 172.21.15.97:0/670656642 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6804054d20 con 0x7f680c154e10 2023-12-04T05:37:19.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 msgr2=0x7f67ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 0x7f67ec068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f680c0ab380 tx=0x7f67fc009190 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 msgr2=0x7f680c070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f680400cb40 tx=0x7f680400a060 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 shutdown_connections 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f67ec0668d0 0x7f67ec068d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f680c154e10 0x7f680c070ec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f680c14f790 0x7f680c149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 --2- 172.21.15.97:0/670656642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f680c14eb30 0x7f680c13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 >> 172.21.15.97:0/670656642 conn(0x7f680c0c5e70 msgr2=0x7f680c14fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:19.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 shutdown_connections 2023-12-04T05:37:19.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.079+0000 7f6810dd8640 1 -- 172.21.15.97:0/670656642 wait complete. 2023-12-04T05:37:19.100 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-04T05:37:19.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 Processor -- start 2023-12-04T05:37:19.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 -- start start 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1f8014eb30 0x7f1f8014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f8014f790 0x7f1f801548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f80154e10 0x7f1f80151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f800c0bd0 con 0x7f1f80154e10 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f80154640 con 0x7f1f8014eb30 2023-12-04T05:37:19.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f8831d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8014ef10 con 0x7f1f8014f790 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f868ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f80154e10 0x7f1f80151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f868ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1f80154e10 0x7f1f80151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40672/0 (socket says 172.21.15.97:40672) 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.235+0000 7f1f868ba640 1 -- 172.21.15.97:0/3496151304 learned_addr learned my addr 172.21.15.97:0/3496151304 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f860b9640 1 --2- 172.21.15.97:0/3496151304 >> v2:172.21.15.143:3300/0 conn(0x7f1f8014eb30 0x7f1f8014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f858b8640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f8014f790 0x7f1f801548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 -- 172.21.15.97:0/3496151304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f8014f790 msgr2=0x7f1f801548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f8014f790 0x7f1f801548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 -- 172.21.15.97:0/3496151304 >> v2:172.21.15.143:3300/0 conn(0x7f1f8014eb30 msgr2=0x7f1f8014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 --2- 172.21.15.97:0/3496151304 >> v2:172.21.15.143:3300/0 conn(0x7f1f8014eb30 0x7f1f8014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 -- 172.21.15.97:0/3496151304 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f801535a0 con 0x7f1f80154e10 2023-12-04T05:37:19.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f868ba640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f80154e10 0x7f1f80151310 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f800c0a80 tx=0x7f1f7801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fae6860c7d5275f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f850b7640 1 -- 172.21.15.97:0/3496151304 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780a5730 con 0x7f1f80154e10 2023-12-04T05:37:19.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f850b7640 1 -- 172.21.15.97:0/3496151304 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f780a5890 con 0x7f1f80154e10 2023-12-04T05:37:19.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.239+0000 7f1f850b7640 1 -- 172.21.15.97:0/3496151304 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780a5c20 con 0x7f1f80154e10 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- 172.21.15.97:0/3496151304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f80154e10 msgr2=0x7f1f80151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f80154e10 0x7f1f80151310 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f800c0a80 tx=0x7f1f7801c9a0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- 172.21.15.97:0/3496151304 shutdown_connections 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f8014f790 0x7f1f801548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- 172.21.15.97:0/3496151304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f80154e10 0x7f1f80151310 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- 172.21.15.97:0/3496151304 >> v2:172.21.15.143:3300/0 conn(0x7f1f8014eb30 0x7f1f8014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- 172.21.15.97:0/3496151304 >> 172.21.15.97:0/3496151304 conn(0x7f1f800c5e70 msgr2=0x7f1f800c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- 172.21.15.97:0/3496151304 shutdown_connections 2023-12-04T05:37:19.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- 172.21.15.97:0/3496151304 wait complete. 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 Processor -- start 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- start start 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8014eb30 0x7f1f800c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f80154e10 0x7f1f80147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8015a6c0 con 0x7f1f8014f790 2023-12-04T05:37:19.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8014bf60 con 0x7f1f8014eb30 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f8831d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801f1890 con 0x7f1f80154e10 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40680/0 (socket says 172.21.15.97:40680) 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 -- 172.21.15.97:0/2507027668 learned_addr learned my addr 172.21.15.97:0/2507027668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 -- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f80154e10 msgr2=0x7f1f80147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f80154e10 0x7f1f80147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 -- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8014eb30 msgr2=0x7f1f800c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8014eb30 0x7f1f800c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 -- 172.21.15.97:0/2507027668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009b30 con 0x7f1f8014f790 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.243+0000 7f1f858b8640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000d830 tx=0x7f1f7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000b6c0 con 0x7f1f8014f790 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7000b820 con 0x7f1f8014f790 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7000bb90 con 0x7f1f8014f790 2023-12-04T05:37:19.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8014bc80 con 0x7f1f8014f790 2023-12-04T05:37:19.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800c5870 con 0x7f1f8014f790 2023-12-04T05:37:19.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800c2630 con 0x7f1f8014f790 2023-12-04T05:37:19.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1f7001e460 con 0x7f1f8014f790 2023-12-04T05:37:19.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 0x7f1f64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f70084860 con 0x7f1f8014f790 2023-12-04T05:37:19.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f860b9640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 0x7f1f64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.247+0000 7f1f860b9640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 0x7f1f64068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0098f0 tx=0x7f1f7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.251+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f70051de0 con 0x7f1f8014f790 2023-12-04T05:37:19.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.459+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1f801f1380 con 0x7f1f8014f790 2023-12-04T05:37:19.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f76ffd640 1 -- 172.21.15.97:0/2507027668 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1f801f1380 con 0x7f1f8014f790 2023-12-04T05:37:19.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 msgr2=0x7f1f64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 0x7f1f64068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0098f0 tx=0x7f1f7c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 msgr2=0x7f1f801477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000d830 tx=0x7f1f7000dcf0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 shutdown_connections 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f640668d0 0x7f1f64068d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f80154e10 0x7f1f80147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1f8014f790 0x7f1f801477c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 --2- 172.21.15.97:0/2507027668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f8014eb30 0x7f1f800c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 >> 172.21.15.97:0/2507027668 conn(0x7f1f800c5e70 msgr2=0x7f1f800700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 shutdown_connections 2023-12-04T05:37:19.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.463+0000 7f1f8831d640 1 -- 172.21.15.97:0/2507027668 wait complete. 2023-12-04T05:37:19.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-04T05:37:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.619+0000 7faa54ddf640 1 Processor -- start 2023-12-04T05:37:19.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.619+0000 7faa54ddf640 1 -- start start 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa54ddf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 0x7faa500c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa54ddf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faa50155160 0x7faa50158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa54ddf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500cad70 con 0x7faa500bd720 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa54ddf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa50158cd0 con 0x7faa50155160 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa54ddf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50155630 con 0x7faa5014e700 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa4ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7faa500bd720 0x7faa501585c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43698/0 (socket says 172.21.15.97:43698) 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa4ed9d640 1 -- 172.21.15.97:0/4289293773 learned_addr learned my addr 172.21.15.97:0/4289293773 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa45d9b640 1 --2- 172.21.15.97:0/4289293773 >> v2:172.21.15.97:3300/0 conn(0x7faa50155160 0x7faa50158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa4e59c640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 0x7faa500c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa4dd9b640 1 -- 172.21.15.97:0/4289293773 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303777683 0 0) 0x7faa500cad70 con 0x7faa500bd720 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa45d9b640 1 -- 172.21.15.97:0/4289293773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 msgr2=0x7faa500c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:19.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa45d9b640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 0x7faa500c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa45d9b640 1 -- 172.21.15.97:0/4289293773 >> v1:172.21.15.97:6789/0 conn(0x7faa500bd720 legacy=0x7faa501585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa45d9b640 1 -- 172.21.15.97:0/4289293773 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ca4d0 con 0x7faa50155160 2023-12-04T05:37:19.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.623+0000 7faa4e59c640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 0x7faa500c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa45d9b640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa50155160 0x7faa50158080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faa38009d90 tx=0x7faa3801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcf6f59c3f4707 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa4dd9b640 1 -- 172.21.15.97:0/4289293773 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a58c0 con 0x7faa50155160 2023-12-04T05:37:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa4dd9b640 1 -- 172.21.15.97:0/4289293773 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380a5a20 con 0x7faa50155160 2023-12-04T05:37:19.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa4dd9b640 1 -- 172.21.15.97:0/4289293773 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a5db0 con 0x7faa50155160 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- 172.21.15.97:0/4289293773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa50155160 msgr2=0x7faa50158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa50155160 0x7faa50158080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faa38009d90 tx=0x7faa3801c800 comp rx=0 tx=0).stop 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- 172.21.15.97:0/4289293773 shutdown_connections 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa50155160 0x7faa50158080 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 --2- 172.21.15.97:0/4289293773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa5014e700 0x7faa500c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- 172.21.15.97:0/4289293773 >> 172.21.15.97:0/4289293773 conn(0x7faa50073720 msgr2=0x7faa50073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- 172.21.15.97:0/4289293773 shutdown_connections 2023-12-04T05:37:19.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- 172.21.15.97:0/4289293773 wait complete. 2023-12-04T05:37:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 Processor -- start 2023-12-04T05:37:19.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.627+0000 7faa54ddf640 1 -- start start 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa500bd720 0x7faa50145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa50155160 0x7faa500bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500beae0 con 0x7faa5014e700 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501455a0 con 0x7faa500bd720 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501f1530 con 0x7faa50155160 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40698/0 (socket says 172.21.15.97:40698) 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 -- 172.21.15.97:0/150321177 learned_addr learned my addr 172.21.15.97:0/150321177 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa4ed9d640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa50155160 0x7faa500bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa4e59c640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa500bd720 0x7faa50145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 -- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa50155160 msgr2=0x7faa500bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa50155160 0x7faa500bef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 -- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa500bd720 msgr2=0x7faa50145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa500bd720 0x7faa50145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 -- 172.21.15.97:0/150321177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009a70 con 0x7faa5014e700 2023-12-04T05:37:19.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa45d9b640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa380b0040 tx=0x7faa380195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380ad8d0 con 0x7faa5014e700 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380ada30 con 0x7faa5014e700 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501f09b0 con 0x7faa5014e700 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380adde0 con 0x7faa5014e700 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501f0f70 con 0x7faa5014e700 2023-12-04T05:37:19.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50068440 con 0x7faa5014e700 2023-12-04T05:37:19.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.631+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faa380b9450 con 0x7faa5014e700 2023-12-04T05:37:19.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.635+0000 7faa477fe640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 0x7faa30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:19.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.635+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa3811f740 con 0x7faa5014e700 2023-12-04T05:37:19.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.635+0000 7faa4e59c640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 0x7faa30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:19.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.635+0000 7faa4e59c640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 0x7faa30068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa40006fd0 tx=0x7faa40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:19.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.639+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa380ecc40 con 0x7faa5014e700 2023-12-04T05:37:19.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.839+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7faa50147d10 con 0x7faa5014e700 2023-12-04T05:37:19.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.843+0000 7faa477fe640 1 -- 172.21.15.97:0/150321177 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7faa380f0260 con 0x7faa5014e700 2023-12-04T05:37:19.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 msgr2=0x7faa30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 0x7faa30068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa40006fd0 tx=0x7faa40008040 comp rx=0 tx=0).stop 2023-12-04T05:37:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 msgr2=0x7faa5014b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa380b0040 tx=0x7faa380195a0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 shutdown_connections 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faa300668d0 0x7faa30068d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa50155160 0x7faa500bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa5014e700 0x7faa5014b9c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 --2- 172.21.15.97:0/150321177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa500bd720 0x7faa50145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 >> 172.21.15.97:0/150321177 conn(0x7faa50073720 msgr2=0x7faa500c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 shutdown_connections 2023-12-04T05:37:19.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:19.847+0000 7faa54ddf640 1 -- 172.21.15.97:0/150321177 wait complete. 2023-12-04T05:37:19.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-04T05:37:20.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 Processor -- start 2023-12-04T05:37:20.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 -- start start 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 0x7f4b6c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b6c154af0 0x7f4b6c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c150bc0 con 0x7f4b6c0c1360 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c154fd0 con 0x7f4b6c154af0 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b72e79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c151a70 con 0x7f4b6c06c000 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b71416640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b6c154af0 0x7f4b6c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b70c15640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4b6c0c1360 0x7f4b6c151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:56796/0 (socket says 172.21.15.97:56796) 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b70c15640 1 -- 172.21.15.97:0/3799748683 learned_addr learned my addr 172.21.15.97:0/3799748683 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:20.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 0x7f4b6c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b71416640 1 -- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 msgr2=0x7f4b6c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b71416640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 0x7f4b6c0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b71416640 1 -- 172.21.15.97:0/3799748683 >> v1:172.21.15.143:6789/0 conn(0x7f4b6c0c1360 legacy=0x7f4b6c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b71416640 1 -- 172.21.15.97:0/3799748683 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c072160 con 0x7f4b6c154af0 2023-12-04T05:37:20.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.007+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 0x7f4b6c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:20.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b71416640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c154af0 0x7f4b6c14dce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e3c0aecb71a2d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/3799748683 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640a5870 con 0x7f4b6c154af0 2023-12-04T05:37:20.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/3799748683 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b640a59d0 con 0x7f4b6c154af0 2023-12-04T05:37:20.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b6b7fe640 1 -- 172.21.15.97:0/3799748683 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640a5d60 con 0x7f4b6c154af0 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 -- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c154af0 msgr2=0x7f4b6c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c154af0 0x7f4b6c14dce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6401c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 -- 172.21.15.97:0/3799748683 shutdown_connections 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c154af0 0x7f4b6c14dce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 --2- 172.21.15.97:0/3799748683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c06c000 0x7f4b6c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 -- 172.21.15.97:0/3799748683 >> 172.21.15.97:0/3799748683 conn(0x7f4b6c0c5e70 msgr2=0x7f4b6c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 -- 172.21.15.97:0/3799748683 shutdown_connections 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.011+0000 7f4b72e79640 1 -- 172.21.15.97:0/3799748683 wait complete. 2023-12-04T05:37:20.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 Processor -- start 2023-12-04T05:37:20.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- start start 2023-12-04T05:37:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c06c000 0x7f4b6c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c0c1360 0x7f4b6c1edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0a8dc0 con 0x7f4b6c154af0 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1eda30 con 0x7f4b6c06c000 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14c8d0 con 0x7f4b6c0c1360 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40712/0 (socket says 172.21.15.97:40712) 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 -- 172.21.15.97:0/1526710053 learned_addr learned my addr 172.21.15.97:0/1526710053 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b70c15640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c06c000 0x7f4b6c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b6bfff640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c0c1360 0x7f4b6c1edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 -- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c0c1360 msgr2=0x7f4b6c1edec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c0c1360 0x7f4b6c1edec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 -- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c06c000 msgr2=0x7f4b6c14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c06c000 0x7f4b6c14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 -- 172.21.15.97:0/1526710053 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58009420 con 0x7f4b6c154af0 2023-12-04T05:37:20.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b71416640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4b640b0040 tx=0x7f4b64019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640b9650 con 0x7f4b6c154af0 2023-12-04T05:37:20.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b640b97b0 con 0x7f4b6c154af0 2023-12-04T05:37:20.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b64009a70 con 0x7f4b6c154af0 2023-12-04T05:37:20.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640b9b40 con 0x7f4b6c154af0 2023-12-04T05:37:20.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.015+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c14cb70 con 0x7f4b6c154af0 2023-12-04T05:37:20.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c068440 con 0x7f4b6c154af0 2023-12-04T05:37:20.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4b640b9ca0 con 0x7f4b6c154af0 2023-12-04T05:37:20.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b697fa640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 0x7f4b50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b6411f2e0 con 0x7f4b6c154af0 2023-12-04T05:37:20.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b70c15640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 0x7f4b50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.019+0000 7f4b70c15640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 0x7f4b50068d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b60005890 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.023+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b640ec890 con 0x7f4b6c154af0 2023-12-04T05:37:20.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.231+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4b6c1edb70 con 0x7f4b6c154af0 2023-12-04T05:37:20.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.231+0000 7f4b697fa640 1 -- 172.21.15.97:0/1526710053 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4b640efeb0 con 0x7f4b6c154af0 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 msgr2=0x7f4b50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 0x7f4b50068d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b60005890 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 msgr2=0x7f4b6c153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4b640b0040 tx=0x7f4b64019660 comp rx=0 tx=0).stop 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 shutdown_connections 2023-12-04T05:37:20.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b500668d0 0x7f4b50068d90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b6c154af0 0x7f4b6c153570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b6c0c1360 0x7f4b6c1edec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 --2- 172.21.15.97:0/1526710053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b6c06c000 0x7f4b6c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 >> 172.21.15.97:0/1526710053 conn(0x7f4b6c0c5e70 msgr2=0x7f4b6c06ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 shutdown_connections 2023-12-04T05:37:20.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.235+0000 7f4b72e79640 1 -- 172.21.15.97:0/1526710053 wait complete. 2023-12-04T05:37:20.259 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-04T05:37:20.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.395+0000 7fa0cf46b640 1 Processor -- start 2023-12-04T05:37:20.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 -- start start 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c8151f10 0x7fa0c80c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa0c80c7f00 0x7fa0c8154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0c80cac10 0x7fa0c8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c8158cc0 con 0x7fa0c80cac10 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c80c5700 con 0x7fa0c80c7f00 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cf46b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c80ca780 con 0x7fa0c8151f10 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0c80cac10 0x7fa0c8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0c80cac10 0x7fa0c8154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40722/0 (socket says 172.21.15.97:40722) 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 -- 172.21.15.97:0/989266330 learned_addr learned my addr 172.21.15.97:0/989266330 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:20.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cd207640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c8151f10 0x7fa0c80c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cca06640 1 --2- 172.21.15.97:0/989266330 >> v2:172.21.15.143:3300/0 conn(0x7fa0c80c7f00 0x7fa0c8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 -- 172.21.15.97:0/989266330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c8151f10 msgr2=0x7fa0c80c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c8151f10 0x7fa0c80c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 -- 172.21.15.97:0/989266330 >> v2:172.21.15.143:3300/0 conn(0x7fa0c80c7f00 msgr2=0x7fa0c8154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 --2- 172.21.15.97:0/989266330 >> v2:172.21.15.143:3300/0 conn(0x7fa0c80c7f00 0x7fa0c8154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.399+0000 7fa0cda08640 1 -- 172.21.15.97:0/989266330 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8158720 con 0x7fa0c80cac10 2023-12-04T05:37:20.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cda08640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c80cac10 0x7fa0c8154c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa0c806cfb0 tx=0x7fa0c001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5197bc063b40e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0bffff640 1 -- 172.21.15.97:0/989266330 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00a5700 con 0x7fa0c80cac10 2023-12-04T05:37:20.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0bffff640 1 -- 172.21.15.97:0/989266330 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00a5860 con 0x7fa0c80cac10 2023-12-04T05:37:20.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0bffff640 1 -- 172.21.15.97:0/989266330 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00a5bf0 con 0x7fa0c80cac10 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- 172.21.15.97:0/989266330 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c80cac10 msgr2=0x7fa0c8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c80cac10 0x7fa0c8154c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa0c806cfb0 tx=0x7fa0c001c880 comp rx=0 tx=0).stop 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- 172.21.15.97:0/989266330 shutdown_connections 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c80cac10 0x7fa0c8154c60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/989266330 >> v2:172.21.15.143:3300/0 conn(0x7fa0c80c7f00 0x7fa0c8154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/989266330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c8151f10 0x7fa0c80c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- 172.21.15.97:0/989266330 >> 172.21.15.97:0/989266330 conn(0x7fa0c8073950 msgr2=0x7fa0c8073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:20.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- 172.21.15.97:0/989266330 shutdown_connections 2023-12-04T05:37:20.407 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- 172.21.15.97:0/989266330 wait complete. 2023-12-04T05:37:20.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 Processor -- start 2023-12-04T05:37:20.408 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.403+0000 7fa0cf46b640 1 -- start start 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 0x7fa0c81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c80cac10 0x7fa0c8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c81540e0 con 0x7fa0c8151f10 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8154330 con 0x7fa0c80c7f00 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8154610 con 0x7fa0c80cac10 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40732/0 (socket says 172.21.15.97:40732) 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 -- 172.21.15.97:0/415492732 learned_addr learned my addr 172.21.15.97:0/415492732 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:20.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cca06640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c80cac10 0x7fa0c8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cd207640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 0x7fa0c81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 -- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c80cac10 msgr2=0x7fa0c8156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c80cac10 0x7fa0c8156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 -- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 msgr2=0x7fa0c81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 0x7fa0c81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 -- 172.21.15.97:0/415492732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0009b30 con 0x7fa0c8151f10 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cd207640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 0x7fa0c81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cda08640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0c001af30 tx=0x7fa0c0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00b8670 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00b87d0 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00b8b60 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c81548f0 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c81571c0 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.407+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c8154e10 con 0x7fa0c8151f10 2023-12-04T05:37:20.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.411+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0c00b8cc0 con 0x7fa0c8151f10 2023-12-04T05:37:20.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.411+0000 7fa0bdffb640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 0x7fa0ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.411+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa0c011f6c0 con 0x7fa0c8151f10 2023-12-04T05:37:20.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.411+0000 7fa0cd207640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 0x7fa0ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.411+0000 7fa0cd207640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 0x7fa0ac068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400b9f0 tx=0x7fa0c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.415+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0c8154e10 con 0x7fa0c8151f10 2023-12-04T05:37:20.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.615+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa0c8154e10 con 0x7fa0c8151f10 2023-12-04T05:37:20.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.619+0000 7fa0bdffb640 1 -- 172.21.15.97:0/415492732 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa0c8154e10 con 0x7fa0c8151f10 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 msgr2=0x7fa0ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 0x7fa0ac068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400b9f0 tx=0x7fa0c4008040 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 msgr2=0x7fa0c80c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0c001af30 tx=0x7fa0c0019620 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 shutdown_connections 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0ac0668d0 0x7fa0ac068d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0c8151f10 0x7fa0c80c10d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0c80cac10 0x7fa0c8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 --2- 172.21.15.97:0/415492732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0c80c7f00 0x7fa0c81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 >> 172.21.15.97:0/415492732 conn(0x7fa0c8073950 msgr2=0x7fa0c8073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:20.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 shutdown_connections 2023-12-04T05:37:20.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.623+0000 7fa0cf46b640 1 -- 172.21.15.97:0/415492732 wait complete. 2023-12-04T05:37:20.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-04T05:37:20.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 Processor -- start 2023-12-04T05:37:20.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 -- start start 2023-12-04T05:37:20.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1cd00c4590 0x7f1cd00a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1cd00a5290 0x7f1cd0155f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00c3b60 con 0x7f1cd00c0660 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd0155b40 con 0x7f1cd00a5290 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd6d57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd0072970 con 0x7f1cd00c4590 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cc7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1cd00a5290 0x7f1cd0155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd52f4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1cd00c0660 0x7f1cd01564a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43714/0 (socket says 172.21.15.97:43714) 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd52f4640 1 -- 172.21.15.97:0/2931097772 learned_addr learned my addr 172.21.15.97:0/2931097772 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.779+0000 7f1cd4af3640 1 --2- 172.21.15.97:0/2931097772 >> v2:172.21.15.143:3300/0 conn(0x7f1cd00c4590 0x7f1cd00a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc7fff640 1 -- 172.21.15.97:0/2931097772 >> v2:172.21.15.143:3300/0 conn(0x7f1cd00c4590 msgr2=0x7f1cd00a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:20.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc7fff640 1 --2- 172.21.15.97:0/2931097772 >> v2:172.21.15.143:3300/0 conn(0x7f1cd00c4590 0x7f1cd00a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc7fff640 1 -- 172.21.15.97:0/2931097772 >> v1:172.21.15.97:6789/0 conn(0x7f1cd00c0660 legacy=0x7f1cd01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc7fff640 1 -- 172.21.15.97:0/2931097772 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00c5520 con 0x7f1cd00a5290 2023-12-04T05:37:20.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc77fe640 1 -- 172.21.15.97:0/2931097772 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015497960 0 0) 0x7f1cd00c3b60 con 0x7f1cd00c0660 2023-12-04T05:37:20.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc7fff640 1 --2- 172.21.15.97:0/2931097772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00a5290 0x7f1cd0155f60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00c6b70 tx=0x7f1cc001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4614776ebb3539d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc77fe640 1 -- 172.21.15.97:0/2931097772 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00ab600 con 0x7f1cd00a5290 2023-12-04T05:37:20.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc77fe640 1 -- 172.21.15.97:0/2931097772 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00a7050 con 0x7f1cd00a5290 2023-12-04T05:37:20.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.783+0000 7f1cc77fe640 1 -- 172.21.15.97:0/2931097772 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00ab980 con 0x7f1cd00a5290 2023-12-04T05:37:20.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- 172.21.15.97:0/2931097772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00a5290 msgr2=0x7f1cd0155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/2931097772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00a5290 0x7f1cd0155f60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00c6b70 tx=0x7f1cc001c3a0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- 172.21.15.97:0/2931097772 shutdown_connections 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/2931097772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00a5290 0x7f1cd0155f60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/2931097772 >> v2:172.21.15.143:3300/0 conn(0x7f1cd00c4590 0x7f1cd00a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- 172.21.15.97:0/2931097772 >> 172.21.15.97:0/2931097772 conn(0x7f1cd00c5c60 msgr2=0x7f1cd00c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- 172.21.15.97:0/2931097772 shutdown_connections 2023-12-04T05:37:20.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- 172.21.15.97:0/2931097772 wait complete. 2023-12-04T05:37:20.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 Processor -- start 2023-12-04T05:37:20.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- start start 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1cd00a5290 0x7f1cd00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 0x7f1cd013db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd01f1270 con 0x7f1cd00c0660 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd014c400 con 0x7f1cd00c4590 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd6d57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00a6580 con 0x7f1cd00a5290 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40742/0 (socket says 172.21.15.97:40742) 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 -- 172.21.15.97:0/280006261 learned_addr learned my addr 172.21.15.97:0/280006261 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd4af3640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1cd00a5290 0x7f1cd00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd52f4640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 0x7f1cd013db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 -- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1cd00a5290 msgr2=0x7f1cd00712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1cd00a5290 0x7f1cd00712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 -- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 msgr2=0x7f1cd013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 0x7f1cd013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cc7fff640 1 -- 172.21.15.97:0/280006261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc0009420 con 0x7f1cd00c0660 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.787+0000 7f1cd52f4640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 0x7f1cd013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:20.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc7fff640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0019fd0 tx=0x7f1cc0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00b4430 con 0x7f1cd00c0660 2023-12-04T05:37:20.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00b45b0 con 0x7f1cd00c0660 2023-12-04T05:37:20.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00b4960 con 0x7f1cd00c0660 2023-12-04T05:37:20.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd01f0cb0 con 0x7f1cd00c0660 2023-12-04T05:37:20.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd00a5f30 con 0x7f1cd00c0660 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd0068440 con 0x7f1cd00c0660 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1cc00b2040 con 0x7f1cd00c0660 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 0x7f1cbc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1cc011dfa0 con 0x7f1cd00c0660 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.791+0000 7f1cd4af3640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 0x7f1cbc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:20.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.795+0000 7f1cd4af3640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 0x7f1cbc068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009b60 tx=0x7f1ccc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:20.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:20.795+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cc00eb520 con 0x7f1cd00c0660 2023-12-04T05:37:21.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.003+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1cd00c5180 con 0x7f1cd00c0660 2023-12-04T05:37:21.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.003+0000 7f1cc57fa640 1 -- 172.21.15.97:0/280006261 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1cc00eeb40 con 0x7f1cd00c0660 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 msgr2=0x7f1cbc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 0x7f1cbc068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009b60 tx=0x7f1ccc009190 comp rx=0 tx=0).stop 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 msgr2=0x7f1cd00c20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0019fd0 tx=0x7f1cc0019140 comp rx=0 tx=0).stop 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 shutdown_connections 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1cbc0668d0 0x7f1cbc068d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cd00c4590 0x7f1cd013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cd00c0660 0x7f1cd00c20d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 --2- 172.21.15.97:0/280006261 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1cd00a5290 0x7f1cd00712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 >> 172.21.15.97:0/280006261 conn(0x7f1cd00c5c60 msgr2=0x7f1cd014ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 shutdown_connections 2023-12-04T05:37:21.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.007+0000 7f1cd6d57640 1 -- 172.21.15.97:0/280006261 wait complete. 2023-12-04T05:37:21.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 Processor -- start 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 -- start start 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d34154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d341547d0 con 0x7f2d34158630 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d34158b80 con 0x7f2d34151bf0 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3c032640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c4aa0 con 0x7f2d340c7ef0 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3a5cf640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2d34158630 0x7f2d3415efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43724/0 (socket says 172.21.15.97:43724) 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d3a5cf640 1 -- 172.21.15.97:0/937560962 learned_addr learned my addr 172.21.15.97:0/937560962 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d395cd640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d34154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389555323 0 0) 0x7f2d341547d0 con 0x7f2d34158630 2023-12-04T05:37:21.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d20003530 con 0x7f2d34158630 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493259322 0 0) 0x7f2d34158b80 con 0x7f2d34151bf0 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d341547d0 con 0x7f2d34151bf0 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295638735 0 0) 0x7f2d20003530 con 0x7f2d34158630 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 msgr2=0x7f2d34154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d34154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 >> v1:172.21.15.143:6789/0 conn(0x7f2d34151bf0 legacy=0x7f2d340abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340c4d40 con 0x7f2d34158630 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f2d2c001a00 con 0x7f2d34158630 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 >> v1:172.21.15.97:6789/0 conn(0x7f2d34158630 legacy=0x7f2d3415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d20003b40 0x7f2d20003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20004d10 0x7f2d20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c4aa0 con 0x7f2d20003b40 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2000bba0 con 0x7f2d20004d10 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.163+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2000bd60 con 0x7f2d340c7ef0 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d20003b40 0x7f2d20003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d395cd640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d3a5cf640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20004d10 0x7f2d20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 -- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 msgr2=0x7f2d200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c7ef0 0x7f2d200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 -- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20004d10 msgr2=0x7f2d20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20004d10 0x7f2d20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 -- 172.21.15.97:0/937560962 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20003530 con 0x7f2d20003b40 2023-12-04T05:37:21.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d3a5cf640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20004d10 0x7f2d20005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:21.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d39dce640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d20003b40 0x7f2d20003f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d300018d0 tx=0x7f2d3001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3466bbf8b7e37a07 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d300052d0 con 0x7f2d20003b40 2023-12-04T05:37:21.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30005450 con 0x7f2d20003b40 2023-12-04T05:37:21.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.167+0000 7f2d38dcc640 1 -- 172.21.15.97:0/937560962 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d300a48e0 con 0x7f2d20003b40 2023-12-04T05:37:21.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- 172.21.15.97:0/937560962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d20003b40 msgr2=0x7f2d20003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 --2- 172.21.15.97:0/937560962 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d20003b40 0x7f2d20003f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d300018d0 tx=0x7f2d3001c240 comp rx=0 tx=0).stop 2023-12-04T05:37:21.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3a5cf640 1 -- 172.21.15.97:0/937560962 reap_dead start 2023-12-04T05:37:21.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- 172.21.15.97:0/937560962 shutdown_connections 2023-12-04T05:37:21.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- 172.21.15.97:0/937560962 >> 172.21.15.97:0/937560962 conn(0x7f2d34073550 msgr2=0x7f2d34073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- 172.21.15.97:0/937560962 shutdown_connections 2023-12-04T05:37:21.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- 172.21.15.97:0/937560962 wait complete. 2023-12-04T05:37:21.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 Processor -- start 2023-12-04T05:37:21.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- start start 2023-12-04T05:37:21.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 0x7f2d341f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c3800 0x7f2d3414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d341565d0 con 0x7f2d341f1d90 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34155c10 con 0x7f2d20003b40 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3c032640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d341f24f0 con 0x7f2d340c3800 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40770/0 (socket says 172.21.15.97:40770) 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 -- 172.21.15.97:0/1512390449 learned_addr learned my addr 172.21.15.97:0/1512390449 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d3a5cf640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c3800 0x7f2d3414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d39dce640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 0x7f2d341f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 -- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c3800 msgr2=0x7f2d3414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c3800 0x7f2d3414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 -- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 msgr2=0x7f2d341f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 0x7f2d341f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d395cd640 1 -- 172.21.15.97:0/1512390449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34155e60 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.171+0000 7f2d39dce640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 0x7f2d341f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d395cd640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d240118e0 tx=0x7f2d24011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400faf0 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400fc50 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24014440 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d341f2210 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d340cac90 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34156740 con 0x7f2d341f1d90 2023-12-04T05:37:21.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2d240145a0 con 0x7f2d341f1d90 2023-12-04T05:37:21.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 0x7f2d18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2d24084a50 con 0x7f2d341f1d90 2023-12-04T05:37:21.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.175+0000 7f2d39dce640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 0x7f2d18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.179+0000 7f2d39dce640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 0x7f2d18068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d300ac000 tx=0x7f2d300a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.179+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d34156740 con 0x7f2d341f1d90 2023-12-04T05:37:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d34156710 con 0x7f2d341f1d90 2023-12-04T05:37:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d2a7fc640 1 -- 172.21.15.97:0/1512390449 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12845 (secure 0 0 0) 0x7f2d24055b00 con 0x7f2d341f1d90 2023-12-04T05:37:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:21.339 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":27,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:18.313035+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 msgr2=0x7f2d18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 0x7f2d18068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d300ac000 tx=0x7f2d300a6070 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 msgr2=0x7f2d3414ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.335+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2d240118e0 tx=0x7f2d24011da0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 shutdown_connections 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d180668d0 0x7f2d18068d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d340c3800 0x7f2d3414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d341f1d90 0x7f2d3414ab30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 --2- 172.21.15.97:0/1512390449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d20003b40 0x7f2d341f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 >> 172.21.15.97:0/1512390449 conn(0x7f2d34073550 msgr2=0x7f2d3414fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 shutdown_connections 2023-12-04T05:37:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.339+0000 7f2d3c032640 1 -- 172.21.15.97:0/1512390449 wait complete. 2023-12-04T05:37:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:21.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:21.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 Processor -- start 2023-12-04T05:37:21.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 -- start start 2023-12-04T05:37:21.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 0x7fcb440c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb440c0db0 0x7fcb44163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb44071380 con 0x7fcb4406e410 2023-12-04T05:37:21.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4406cc20 con 0x7fcb440c0db0 2023-12-04T05:37:21.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4bc9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4406cf00 con 0x7fcb44156070 2023-12-04T05:37:21.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4a239640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb440c0db0 0x7fcb44163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb49a38640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 0x7fcb440c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb49237640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fcb4406e410 0x7fcb44071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:56824/0 (socket says 172.21.15.97:56824) 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb49237640 1 -- 172.21.15.97:0/1596078849 learned_addr learned my addr 172.21.15.97:0/1596078849 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4a239640 1 -- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 msgr2=0x7fcb440c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4a239640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 0x7fcb440c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4a239640 1 -- 172.21.15.97:0/1596078849 >> v1:172.21.15.143:6789/0 conn(0x7fcb4406e410 legacy=0x7fcb44071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb48a36640 1 -- 172.21.15.97:0/1596078849 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638718094 0 0) 0x7fcb44071380 con 0x7fcb4406e410 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb4a239640 1 -- 172.21.15.97:0/1596078849 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4415cbb0 con 0x7fcb440c0db0 2023-12-04T05:37:21.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.499+0000 7fcb49a38640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 0x7fcb440c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4a239640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44163390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca7cb6ea59d0752 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb48a36640 1 -- 172.21.15.97:0/1596078849 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0a59a0 con 0x7fcb440c0db0 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb48a36640 1 -- 172.21.15.97:0/1596078849 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0a5b00 con 0x7fcb440c0db0 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb48a36640 1 -- 172.21.15.97:0/1596078849 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0a5e90 con 0x7fcb440c0db0 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 msgr2=0x7fcb44163390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44163390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c01c950 comp rx=0 tx=0).stop 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/1596078849 shutdown_connections 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44163390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/1596078849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb44156070 0x7fcb440c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/1596078849 >> 172.21.15.97:0/1596078849 conn(0x7fcb440c5e70 msgr2=0x7fcb440c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/1596078849 shutdown_connections 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.503+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/1596078849 wait complete. 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 Processor -- start 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- start start 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb4406e410 0x7fcb441f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb441f15b0 con 0x7fcb44156070 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb441f1850 con 0x7fcb440c0db0 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb441f5a70 con 0x7fcb4406e410 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40782/0 (socket says 172.21.15.97:40782) 2023-12-04T05:37:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 -- 172.21.15.97:0/3084027356 learned_addr learned my addr 172.21.15.97:0/3084027356 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb49237640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb49a38640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb4406e410 0x7fcb441f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 -- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb4406e410 msgr2=0x7fcb441f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb4406e410 0x7fcb441f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 -- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 msgr2=0x7fcb44151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 -- 172.21.15.97:0/3084027356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009420 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4a239640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c01b000 tx=0x7fcb44156660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0add70 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c009450 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b8660 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c009a70 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.507+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb44156a60 con 0x7fcb44156070 2023-12-04T05:37:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb441f1a00 con 0x7fcb44156070 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb3c0b4040 con 0x7fcb44156070 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb3a7fc640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 0x7fcb28068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb3c11ea70 con 0x7fcb44156070 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb49a38640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 0x7fcb28068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.511+0000 7fcb49a38640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 0x7fcb28068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009be0 tx=0x7fcb40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.515+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb3c0ec0a0 con 0x7fcb44156070 2023-12-04T05:37:21.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.667+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb44068440 con 0x7fcb44156070 2023-12-04T05:37:21.671 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.667+0000 7fcb3a7fc640 1 -- 172.21.15.97:0/3084027356 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb3c0ef6c0 con 0x7fcb44156070 2023-12-04T05:37:21.671 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 msgr2=0x7fcb28068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 0x7fcb28068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009be0 tx=0x7fcb40008040 comp rx=0 tx=0).stop 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 msgr2=0x7fcb441f1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c01b000 tx=0x7fcb44156660 comp rx=0 tx=0).stop 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 shutdown_connections 2023-12-04T05:37:21.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb28066900 0x7fcb28068dc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb44156070 0x7fcb441f1ce0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb440c0db0 0x7fcb44151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 --2- 172.21.15.97:0/3084027356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb4406e410 0x7fcb441f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 >> 172.21.15.97:0/3084027356 conn(0x7fcb440c5e70 msgr2=0x7fcb440c1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 shutdown_connections 2023-12-04T05:37:21.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.671+0000 7fcb4bc9c640 1 -- 172.21.15.97:0/3084027356 wait complete. 2023-12-04T05:37:21.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:37:21.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 Processor -- start 2023-12-04T05:37:21.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 -- start start 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde8c151bf0 0x7fde8c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0c7ef0 0x7fde8c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c1547d0 con 0x7fde8c158630 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c158b80 con 0x7fde8c151bf0 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde93165640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0c4aa0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde8c151bf0 0x7fde8c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde8c151bf0 0x7fde8c0abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40788/0 (socket says 172.21.15.97:40788) 2023-12-04T05:37:21.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 -- 172.21.15.97:0/2792570809 learned_addr learned my addr 172.21.15.97:0/2792570809 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde83fff640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0c7ef0 0x7fde8c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 -- 172.21.15.97:0/2792570809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0c7ef0 msgr2=0x7fde8c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0c7ef0 0x7fde8c154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 -- 172.21.15.97:0/2792570809 >> v1:172.21.15.143:6789/0 conn(0x7fde8c158630 legacy=0x7fde8c0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.827+0000 7fde90f01640 1 -- 172.21.15.97:0/2792570809 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0c4d40 con 0x7fde8c151bf0 2023-12-04T05:37:21.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde90f01640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c151bf0 0x7fde8c0abbb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda1dcd384cdd586 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde837fe640 1 -- 172.21.15.97:0/2792570809 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880a4720 con 0x7fde8c151bf0 2023-12-04T05:37:21.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde837fe640 1 -- 172.21.15.97:0/2792570809 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880a4880 con 0x7fde8c151bf0 2023-12-04T05:37:21.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde837fe640 1 -- 172.21.15.97:0/2792570809 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880a4c10 con 0x7fde8c151bf0 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 -- 172.21.15.97:0/2792570809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c151bf0 msgr2=0x7fde8c0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c151bf0 0x7fde8c0abbb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c100 comp rx=0 tx=0).stop 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 -- 172.21.15.97:0/2792570809 shutdown_connections 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c0c7ef0 0x7fde8c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 --2- 172.21.15.97:0/2792570809 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c151bf0 0x7fde8c0abbb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 -- 172.21.15.97:0/2792570809 >> 172.21.15.97:0/2792570809 conn(0x7fde8c073550 msgr2=0x7fde8c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:21.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 -- 172.21.15.97:0/2792570809 shutdown_connections 2023-12-04T05:37:21.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.831+0000 7fde93165640 1 -- 172.21.15.97:0/2792570809 wait complete. 2023-12-04T05:37:21.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 Processor -- start 2023-12-04T05:37:21.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- start start 2023-12-04T05:37:21.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c151bf0 0x7fde8c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 0x7fde8c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0afea0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1f16b0 con 0x7fde8c151bf0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1f1900 con 0x7fde8c158630 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40804/0 (socket says 172.21.15.97:40804) 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 -- 172.21.15.97:0/2809800011 learned_addr learned my addr 172.21.15.97:0/2809800011 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde91702640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 0x7fde8c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde83fff640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c151bf0 0x7fde8c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 -- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 msgr2=0x7fde8c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 0x7fde8c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 -- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c151bf0 msgr2=0x7fde8c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c151bf0 0x7fde8c149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 -- 172.21.15.97:0/2809800011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880094d0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde91702640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 0x7fde8c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde90f01640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fde88019f40 tx=0x7fde880191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880b5640 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880a4710 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c1f1be0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880b59e0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.835+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c1f21a0 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c1ee190 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fde880b3070 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde817fa640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 0x7fde78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:21.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde8811d320 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde83fff640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 0x7fde78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:21.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.839+0000 7fde83fff640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 0x7fde78068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0c9ed0 tx=0x7fde7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:21.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.843+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde880eaa60 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.991+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fde8c0c0a60 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde817fa640 1 -- 172.21.15.97:0/2809800011 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fde880b1060 con 0x7fde8c0c7ef0 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:37:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:37:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:21.999 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 msgr2=0x7fde78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 0x7fde78068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0c9ed0 tx=0x7fde7c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 msgr2=0x7fde8c0aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fde88019f40 tx=0x7fde880191c0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 shutdown_connections 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde780668d0 0x7fde78068d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde8c158630 0x7fde8c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde8c151bf0 0x7fde8c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 --2- 172.21.15.97:0/2809800011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde8c0c7ef0 0x7fde8c0aae10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 >> 172.21.15.97:0/2809800011 conn(0x7fde8c073550 msgr2=0x7fde8c15f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 shutdown_connections 2023-12-04T05:37:22.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:21.995+0000 7fde93165640 1 -- 172.21.15.97:0/2809800011 wait complete. 2023-12-04T05:37:22.017 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T05:37:22.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T05:37:22.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.155+0000 7f1a15cc9640 1 Processor -- start 2023-12-04T05:37:22.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.155+0000 7f1a15cc9640 1 -- start start 2023-12-04T05:37:22.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a15cc9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a1013db70 0x7f1a100c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a15cc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1a10155190 0x7f1a10071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a15cc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a10158c00 con 0x7f1a100c1ea0 2023-12-04T05:37:22.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a15cc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a10155700 con 0x7f1a10155190 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a15cc9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a10157c50 con 0x7f1a1013db70 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a07fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1a100c1ea0 0x7f1a10071500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43726/0 (socket says 172.21.15.97:43726) 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a07fff640 1 -- 172.21.15.97:0/2887203109 learned_addr learned my addr 172.21.15.97:0/2887203109 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/2887203109 >> v2:172.21.15.97:3300/0 conn(0x7f1a10155190 0x7f1a10071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0f7fe640 1 --2- 172.21.15.97:0/2887203109 >> v2:172.21.15.143:3300/0 conn(0x7f1a1013db70 0x7f1a100c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0effd640 1 -- 172.21.15.97:0/2887203109 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321821181 0 0) 0x7f1a10158c00 con 0x7f1a100c1ea0 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0effd640 1 -- 172.21.15.97:0/2887203109 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19fc003530 con 0x7f1a100c1ea0 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0ffff640 1 -- 172.21.15.97:0/2887203109 >> v2:172.21.15.143:3300/0 conn(0x7f1a1013db70 msgr2=0x7f1a100c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/2887203109 >> v2:172.21.15.143:3300/0 conn(0x7f1a1013db70 0x7f1a100c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0ffff640 1 -- 172.21.15.97:0/2887203109 >> v1:172.21.15.97:6789/0 conn(0x7f1a100c1ea0 legacy=0x7f1a10071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.159+0000 7f1a0ffff640 1 -- 172.21.15.97:0/2887203109 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1013df50 con 0x7f1a10155190 2023-12-04T05:37:22.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/2887203109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a10071c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006f7e0 tx=0x7f1a0801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea216f7ac9b9ab34 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:22.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a0effd640 1 -- 172.21.15.97:0/2887203109 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a5910 con 0x7f1a10155190 2023-12-04T05:37:22.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a0effd640 1 -- 172.21.15.97:0/2887203109 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080a5a70 con 0x7f1a10155190 2023-12-04T05:37:22.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a0effd640 1 -- 172.21.15.97:0/2887203109 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080a5e00 con 0x7f1a10155190 2023-12-04T05:37:22.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- 172.21.15.97:0/2887203109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 msgr2=0x7f1a10071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/2887203109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a10071c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006f7e0 tx=0x7f1a0801c850 comp rx=0 tx=0).stop 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- 172.21.15.97:0/2887203109 shutdown_connections 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/2887203109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a10071c10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/2887203109 >> v2:172.21.15.143:3300/0 conn(0x7f1a1013db70 0x7f1a100c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- 172.21.15.97:0/2887203109 >> 172.21.15.97:0/2887203109 conn(0x7f1a100c2a50 msgr2=0x7f1a100c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- 172.21.15.97:0/2887203109 shutdown_connections 2023-12-04T05:37:22.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- 172.21.15.97:0/2887203109 wait complete. 2023-12-04T05:37:22.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 Processor -- start 2023-12-04T05:37:22.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.163+0000 7f1a15cc9640 1 -- start start 2023-12-04T05:37:22.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a100c1ea0 0x7f1a101ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a1013db70 0x7f1a1012e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1012f730 con 0x7f1a10155190 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1006c2a0 con 0x7f1a100c1ea0 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1006c580 con 0x7f1a1013db70 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40812/0 (socket says 172.21.15.97:40812) 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 -- 172.21.15.97:0/1948274463 learned_addr learned my addr 172.21.15.97:0/1948274463 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a07fff640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a1013db70 0x7f1a1012e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0f7fe640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a100c1ea0 0x7f1a101ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 -- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a1013db70 msgr2=0x7f1a1012e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a1013db70 0x7f1a1012e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 -- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a100c1ea0 msgr2=0x7f1a101ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a100c1ea0 0x7f1a101ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 -- 172.21.15.97:0/1948274463 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08009a70 con 0x7f1a10155190 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0ffff640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a080b0040 tx=0x7f1a080195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080b9860 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080b99c0 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1012f9a0 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080b9db0 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1006c860 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1012fbc0 con 0x7f1a10155190 2023-12-04T05:37:22.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.167+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a080ad440 con 0x7f1a10155190 2023-12-04T05:37:22.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.171+0000 7f1a0cff9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 0x7f19f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:22.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.171+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a0811f580 con 0x7f1a10155190 2023-12-04T05:37:22.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.171+0000 7f1a0f7fe640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 0x7f19f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:22.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.171+0000 7f1a0f7fe640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 0x7f19f0068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007a60 tx=0x7f1a00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:22.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.175+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a080ecc40 con 0x7f1a10155190 2023-12-04T05:37:22.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:22.327+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1a10068440 con 0x7f1a10155190 2023-12-04T05:37:23.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.319+0000 7f1a0cff9640 1 -- 172.21.15.97:0/1948274463 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1a080f0260 con 0x7f1a10155190 2023-12-04T05:37:23.324 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 msgr2=0x7f19f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 0x7f19f0068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007a60 tx=0x7f1a00008040 comp rx=0 tx=0).stop 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 msgr2=0x7f1a101515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1a080b0040 tx=0x7f1a080195f0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 shutdown_connections 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19f00668d0 0x7f19f0068d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1a10155190 0x7f1a101515f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a1013db70 0x7f1a1012e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 --2- 172.21.15.97:0/1948274463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a100c1ea0 0x7f1a101ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 >> 172.21.15.97:0/1948274463 conn(0x7f1a100c2a50 msgr2=0x7f1a100bf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:23.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 shutdown_connections 2023-12-04T05:37:23.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.323+0000 7f1a15cc9640 1 -- 172.21.15.97:0/1948274463 wait complete. 2023-12-04T05:37:23.354 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:37:23.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 Processor -- start 2023-12-04T05:37:23.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 -- start start 2023-12-04T05:37:23.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814f960 0x7f19381548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1938154e10 0x7f193815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1938154640 con 0x7f193814eb30 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380c0bd0 con 0x7f1938154e10 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f193d8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193814ef10 con 0x7f193814f960 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f1936ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f193814eb30 0x7f193814f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:43728/0 (socket says 172.21.15.97:43728) 2023-12-04T05:37:23.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.495+0000 7f1936ffd640 1 -- 172.21.15.97:0/4007589775 learned_addr learned my addr 172.21.15.97:0/4007589775 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 --2- 172.21.15.97:0/4007589775 >> v2:172.21.15.143:3300/0 conn(0x7f1938154e10 0x7f193815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f192e7fc640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814f960 0x7f19381548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180291232 0 0) 0x7f1938154640 con 0x7f193814eb30 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1924003530 con 0x7f193814eb30 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1699702037 0 0) 0x7f1924003530 con 0x7f193814eb30 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 -- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814f960 msgr2=0x7f19381548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814f960 0x7f19381548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 -- 172.21.15.97:0/4007589775 >> v1:172.21.15.97:6789/0 conn(0x7f193814eb30 legacy=0x7f193814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 -- 172.21.15.97:0/4007589775 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19381535a0 con 0x7f1938154e10 2023-12-04T05:37:23.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19377fe640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1938154e10 0x7f193815bc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1930009dc0 tx=0x7f193001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4875b3d32d0c44ea server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:23.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928001680 con 0x7f1938154e10 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19300a64a0 con 0x7f1938154e10 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.499+0000 7f19367fc640 1 -- 172.21.15.97:0/4007589775 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300a6810 con 0x7f1938154e10 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1938154e10 msgr2=0x7f193815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1938154e10 0x7f193815bc60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1930009dc0 tx=0x7f193001c850 comp rx=0 tx=0).stop 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- 172.21.15.97:0/4007589775 shutdown_connections 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1938154e10 0x7f193815bc60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- 172.21.15.97:0/4007589775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814f960 0x7f19381548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- 172.21.15.97:0/4007589775 >> 172.21.15.97:0/4007589775 conn(0x7f19380c5e70 msgr2=0x7f19380c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- 172.21.15.97:0/4007589775 shutdown_connections 2023-12-04T05:37:23.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- 172.21.15.97:0/4007589775 wait complete. 2023-12-04T05:37:23.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 Processor -- start 2023-12-04T05:37:23.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- start start 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814eb30 0x7f1938140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193814f960 0x7f19380c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381eea90 con 0x7f1938154e10 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193806dc40 con 0x7f193814f960 2023-12-04T05:37:23.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f193d8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380c4ee0 con 0x7f193814eb30 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f19377fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f19377fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40824/0 (socket says 172.21.15.97:40824) 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f19377fe640 1 -- 172.21.15.97:0/3930573434 learned_addr learned my addr 172.21.15.97:0/3930573434 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f192e7fc640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193814f960 0x7f19380c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.503+0000 7f1936ffd640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814eb30 0x7f1938140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 -- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814eb30 msgr2=0x7f1938140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814eb30 0x7f1938140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 -- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193814f960 msgr2=0x7f19380c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193814f960 0x7f19380c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 -- 172.21.15.97:0/3930573434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930009a70 con 0x7f1938154e10 2023-12-04T05:37:23.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f19377fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f193001d0f0 tx=0x7f19300195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19300b6070 con 0x7f1938154e10 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930009450 con 0x7f1938154e10 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193806de90 con 0x7f1938154e10 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930007000 con 0x7f1938154e10 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19381ec420 con 0x7f1938154e10 2023-12-04T05:37:23.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193806e0a0 con 0x7f1938154e10 2023-12-04T05:37:23.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19300a7680 con 0x7f1938154e10 2023-12-04T05:37:23.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 0x7f1918068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:23.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.507+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f193011e8a0 con 0x7f1938154e10 2023-12-04T05:37:23.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.511+0000 7f1936ffd640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 0x7f1918068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:23.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.511+0000 7f1936ffd640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 0x7f1918068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1928006b60 tx=0x7f1928001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:23.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.511+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19300ebde0 con 0x7f1938154e10 2023-12-04T05:37:23.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:23.663+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19380a8760 con 0x7f1938154e10 2023-12-04T05:37:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.331+0000 7f1934ff9640 1 -- 172.21.15.97:0/3930573434 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f19300ac0d0 con 0x7f1938154e10 2023-12-04T05:37:24.335 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-12-04T05:37:24.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 msgr2=0x7f1918068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 0x7f1918068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1928006b60 tx=0x7f1928001dd0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 msgr2=0x7f19381eee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f193001d0f0 tx=0x7f19300195f0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 shutdown_connections 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19180668d0 0x7f1918068d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1938154e10 0x7f19381eee30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193814f960 0x7f19380c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 --2- 172.21.15.97:0/3930573434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193814eb30 0x7f1938140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 >> 172.21.15.97:0/3930573434 conn(0x7f19380c5e70 msgr2=0x7f19380c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 shutdown_connections 2023-12-04T05:37:24.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.335+0000 7f193d8fe640 1 -- 172.21.15.97:0/3930573434 wait complete. 2023-12-04T05:37:24.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T05:37:24.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 Processor -- start 2023-12-04T05:37:24.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 -- start start 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e80c7f00 0x7fa7e8154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa7e80cac10 0x7fa7e8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80ca780 con 0x7fa7e8151f10 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8158cc0 con 0x7fa7e80cac10 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ecfe6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c5700 con 0x7fa7e80c7f00 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa7e8151f10 0x7fa7e80c4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49836/0 (socket says 172.21.15.97:49836) 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e659c640 1 -- 172.21.15.97:0/648472827 learned_addr learned my addr 172.21.15.97:0/648472827 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:24.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e6d9d640 1 --2- 172.21.15.97:0/648472827 >> v2:172.21.15.97:3300/0 conn(0x7fa7e80cac10 0x7fa7e8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7ddd9b640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e80c7f00 0x7fa7e8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e5d9b640 1 -- 172.21.15.97:0/648472827 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509404944 0 0) 0x7fa7e80ca780 con 0x7fa7e8151f10 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e5d9b640 1 -- 172.21.15.97:0/648472827 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d4003530 con 0x7fa7e8151f10 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e6d9d640 1 -- 172.21.15.97:0/648472827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e80c7f00 msgr2=0x7fa7e8154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e6d9d640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e80c7f00 0x7fa7e8154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e6d9d640 1 -- 172.21.15.97:0/648472827 >> v1:172.21.15.97:6789/0 conn(0x7fa7e8151f10 legacy=0x7fa7e80c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.518+0000 7fa7e6d9d640 1 -- 172.21.15.97:0/648472827 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8158720 con 0x7fa7e80cac10 2023-12-04T05:37:24.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7e6d9d640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e8154c60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097c0 tx=0x7fa7e001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680d3038d37e8cce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:24.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7e5d9b640 1 -- 172.21.15.97:0/648472827 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ab600 con 0x7fa7e80cac10 2023-12-04T05:37:24.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7e5d9b640 1 -- 172.21.15.97:0/648472827 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e00a7050 con 0x7fa7e80cac10 2023-12-04T05:37:24.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7e5d9b640 1 -- 172.21.15.97:0/648472827 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ab960 con 0x7fa7e80cac10 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/648472827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 msgr2=0x7fa7e8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e8154c60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097c0 tx=0x7fa7e001c330 comp rx=0 tx=0).stop 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/648472827 shutdown_connections 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e8154c60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/648472827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e80c7f00 0x7fa7e8154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/648472827 >> 172.21.15.97:0/648472827 conn(0x7fa7e8073950 msgr2=0x7fa7e8073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/648472827 shutdown_connections 2023-12-04T05:37:24.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.522+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/648472827 wait complete. 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 Processor -- start 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- start start 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7e80c7f00 0x7fa7e8146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e8151f10 0x7fa7e81f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c1160 con 0x7fa7e80cac10 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c14b0 con 0x7fa7e80c7f00 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81f0da0 con 0x7fa7e8151f10 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44334/0 (socket says 172.21.15.97:44334) 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 -- 172.21.15.97:0/1244705456 learned_addr learned my addr 172.21.15.97:0/1244705456 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7e659c640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7e80c7f00 0x7fa7e8146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7e6d9d640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e8151f10 0x7fa7e81f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 -- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e8151f10 msgr2=0x7fa7e81f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e8151f10 0x7fa7e81f0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 -- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7e80c7f00 msgr2=0x7fa7e8146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7e80c7f00 0x7fa7e8146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 -- 172.21.15.97:0/1244705456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009420 con 0x7fa7e80cac10 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ddd9b640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e870 tx=0x7fa7d000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0009510 con 0x7fa7e80cac10 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000eec0 con 0x7fa7e80cac10 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000cb40 con 0x7fa7e80cac10 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e8157350 con 0x7fa7e80cac10 2023-12-04T05:37:24.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.526+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e8156870 con 0x7fa7e80cac10 2023-12-04T05:37:24.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e8068440 con 0x7fa7e80cac10 2023-12-04T05:37:24.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa7d000ccc0 con 0x7fa7e80cac10 2023-12-04T05:37:24.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7df7fe640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 0x7fa7c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:24.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa7d0084420 con 0x7fa7e80cac10 2023-12-04T05:37:24.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7e659c640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 0x7fa7c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:24.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.530+0000 7fa7e659c640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 0x7fa7c8068d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005c10 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:24.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.534+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7d0051760 con 0x7fa7e80cac10 2023-12-04T05:37:24.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:24.718+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa7e80c5390 con 0x7fa7e80cac10 2023-12-04T05:37:25.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7df7fe640 1 -- 172.21.15.97:0/1244705456 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa7d0054d80 con 0x7fa7e80cac10 2023-12-04T05:37:25.337 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 4 and data pool 5 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 msgr2=0x7fa7c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 0x7fa7c8068d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8005c10 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 msgr2=0x7fa7e81437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000e870 tx=0x7fa7d000ec70 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 shutdown_connections 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7c80668d0 0x7fa7c8068d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa7e8151f10 0x7fa7e81f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7e80cac10 0x7fa7e81437f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 --2- 172.21.15.97:0/1244705456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa7e80c7f00 0x7fa7e8146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 >> 172.21.15.97:0/1244705456 conn(0x7fa7e8073950 msgr2=0x7fa7e80aaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 shutdown_connections 2023-12-04T05:37:25.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.334+0000 7fa7ecfe6640 1 -- 172.21.15.97:0/1244705456 wait complete. 2023-12-04T05:37:25.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:25.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 Processor -- start 2023-12-04T05:37:25.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 -- start start 2023-12-04T05:37:25.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f383414e970 0x7f383406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f383406be00 0x7f383406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 0x7f38340c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3834152300 con 0x7f383406be00 2023-12-04T05:37:25.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3834071580 con 0x7f3834071a10 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3839b55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383414ed50 con 0x7f383414e970 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.502+0000 7f3832ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f383406be00 0x7f383406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f383406be00 0x7f383406ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44342/0 (socket says 172.21.15.97:44342) 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 -- 172.21.15.97:0/2782202579 learned_addr learned my addr 172.21.15.97:0/2782202579 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f38337fe640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f383414e970 0x7f383406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3833fff640 1 --2- 172.21.15.97:0/2782202579 >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 0x7f38340c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 -- 172.21.15.97:0/2782202579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f383414e970 msgr2=0x7f383406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f383414e970 0x7f383406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 -- 172.21.15.97:0/2782202579 >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 msgr2=0x7f38340c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 --2- 172.21.15.97:0/2782202579 >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 0x7f38340c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 -- 172.21.15.97:0/2782202579 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834151d60 con 0x7f383406be00 2023-12-04T05:37:25.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3833fff640 1 --2- 172.21.15.97:0/2782202579 >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 0x7f38340c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:25.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f3832ffd640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383406ca50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3834155970 tx=0x7f382801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e019048e1493b30d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f38327fc640 1 -- 172.21.15.97:0/2782202579 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280ab600 con 0x7f383406be00 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f38327fc640 1 -- 172.21.15.97:0/2782202579 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38280a7050 con 0x7f383406be00 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.506+0000 7f38327fc640 1 -- 172.21.15.97:0/2782202579 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280ab980 con 0x7f383406be00 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- 172.21.15.97:0/2782202579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 msgr2=0x7f383406ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383406ca50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3834155970 tx=0x7f382801c3b0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- 172.21.15.97:0/2782202579 shutdown_connections 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- 172.21.15.97:0/2782202579 >> v2:172.21.15.143:3300/0 conn(0x7f3834071a10 0x7f38340c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383406ca50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- 172.21.15.97:0/2782202579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f383414e970 0x7f383406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- 172.21.15.97:0/2782202579 >> 172.21.15.97:0/2782202579 conn(0x7f38340c2970 msgr2=0x7f38340c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:25.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- 172.21.15.97:0/2782202579 shutdown_connections 2023-12-04T05:37:25.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- 172.21.15.97:0/2782202579 wait complete. 2023-12-04T05:37:25.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 Processor -- start 2023-12-04T05:37:25.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- start start 2023-12-04T05:37:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3834071a10 0x7f38341eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f383414e970 0x7f3834153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38340aa830 con 0x7f383406be00 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38341eb390 con 0x7f383414e970 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3839b55640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3834153410 con 0x7f3834071a10 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44344/0 (socket says 172.21.15.97:44344) 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 -- 172.21.15.97:0/1681624770 learned_addr learned my addr 172.21.15.97:0/1681624770 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3832ffd640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3834071a10 0x7f38341eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f3833fff640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f383414e970 0x7f3834153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 -- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3834071a10 msgr2=0x7f38341eae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3834071a10 0x7f38341eae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 -- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f383414e970 msgr2=0x7f3834153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f383414e970 0x7f3834153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.510+0000 7f38337fe640 1 -- 172.21.15.97:0/1681624770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280094d0 con 0x7f383406be00 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f38337fe640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f382400d5f0 tx=0x7f382400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38240125f0 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824012750 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38341536f0 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824012ae0 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38340aad40 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340aa200 con 0x7f383406be00 2023-12-04T05:37:25.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3824012c40 con 0x7f383406be00 2023-12-04T05:37:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 0x7f3820068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38240847f0 con 0x7f383406be00 2023-12-04T05:37:25.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.514+0000 7f3832ffd640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 0x7f3820068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.518+0000 7f3832ffd640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 0x7f3820068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f38280ad000 tx=0x7f3828008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.518+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38340aa200 con 0x7f383406be00 2023-12-04T05:37:25.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38340aa200 con 0x7f383406be00 2023-12-04T05:37:25.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f381bfff640 1 -- 172.21.15.97:0/1681624770 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16570 (secure 0 0 0) 0x7f38340aa200 con 0x7f383406be00 2023-12-04T05:37:25.678 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:25.678 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":30,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:24.724099+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 msgr2=0x7f3820068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 0x7f3820068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f38280ad000 tx=0x7f3828008040 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 msgr2=0x7f383414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f382400d5f0 tx=0x7f382400dab0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 shutdown_connections 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38200668d0 0x7f3820068d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f383414e970 0x7f3834153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3834071a10 0x7f38341eae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 --2- 172.21.15.97:0/1681624770 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f383406be00 0x7f383414ef20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 >> 172.21.15.97:0/1681624770 conn(0x7f38340c2970 msgr2=0x7f383414c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:25.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.674+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 shutdown_connections 2023-12-04T05:37:25.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.678+0000 7f3839b55640 1 -- 172.21.15.97:0/1681624770 wait complete. 2023-12-04T05:37:25.700 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:25.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 Processor -- start 2023-12-04T05:37:25.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 -- start start 2023-12-04T05:37:25.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efc380c1880 0x7efc380c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3814b440 con 0x7efc38155230 2023-12-04T05:37:25.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc38154670 con 0x7efc3806be00 2023-12-04T05:37:25.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3ec17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3806caf0 con 0x7efc380c1880 2023-12-04T05:37:25.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3d1b4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efc38155230 0x7efc3815eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49852/0 (socket says 172.21.15.97:49852) 2023-12-04T05:37:25.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3d1b4640 1 -- 172.21.15.97:0/305477030 learned_addr learned my addr 172.21.15.97:0/305477030 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.834+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> v2:172.21.15.143:3300/0 conn(0x7efc380c1880 0x7efc380c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804245713 0 0) 0x7efc3814b440 con 0x7efc38155230 2023-12-04T05:37:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc20003530 con 0x7efc38155230 2023-12-04T05:37:25.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766690498 0 0) 0x7efc38154670 con 0x7efc3806be00 2023-12-04T05:37:25.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc3814b440 con 0x7efc3806be00 2023-12-04T05:37:25.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414810637 0 0) 0x7efc20003530 con 0x7efc38155230 2023-12-04T05:37:25.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 >> v2:172.21.15.143:3300/0 conn(0x7efc380c1880 msgr2=0x7efc380c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:25.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 --2- 172.21.15.97:0/305477030 >> v2:172.21.15.143:3300/0 conn(0x7efc380c1880 0x7efc380c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 >> v1:172.21.15.143:6789/0 conn(0x7efc3806be00 legacy=0x7efc38154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380c02a0 con 0x7efc38155230 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7efc30001980 con 0x7efc38155230 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 >> v1:172.21.15.97:6789/0 conn(0x7efc38155230 legacy=0x7efc3815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc20003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc200047d0 0x7efc20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc20005190 0x7efc2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000c060 con 0x7efc20003b60 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000c1a0 con 0x7efc20005190 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2000c360 con 0x7efc200047d0 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> v2:172.21.15.143:3300/0 conn(0x7efc380c1880 0x7efc380c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3d1b4640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc20005190 0x7efc2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc2ffff640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc200047d0 0x7efc20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc20003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 -- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc200047d0 msgr2=0x7efc20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc200047d0 0x7efc20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 -- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc20005190 msgr2=0x7efc2000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc20005190 0x7efc2000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3c9b3640 1 -- 172.21.15.97:0/305477030 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20003530 con 0x7efc20003b60 2023-12-04T05:37:25.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.838+0000 7efc3d1b4640 1 -- 172.21.15.97:0/305477030 reap_dead start 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc20003f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc34009c90 tx=0x7efc3401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f14ab99afc9da76 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34004020 con 0x7efc20003b60 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34004180 con 0x7efc20003b60 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc2f7fe640 1 -- 172.21.15.97:0/305477030 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a5870 con 0x7efc20003b60 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 msgr2=0x7efc20003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc20003f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7efc34009c90 tx=0x7efc3401cbd0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- 172.21.15.97:0/305477030 shutdown_connections 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 --2- 172.21.15.97:0/305477030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc20003f60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- 172.21.15.97:0/305477030 >> 172.21.15.97:0/305477030 conn(0x7efc380c2970 msgr2=0x7efc380c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- 172.21.15.97:0/305477030 shutdown_connections 2023-12-04T05:37:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- 172.21.15.97:0/305477030 wait complete. 2023-12-04T05:37:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 Processor -- start 2023-12-04T05:37:25.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- start start 2023-12-04T05:37:25.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc3814b950 0x7efc381eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc381ef4a0 0x7efc380a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc381eead0 con 0x7efc20003b60 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc381ee4a0 con 0x7efc3814b950 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.842+0000 7efc3ec17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc381f1110 con 0x7efc381ef4a0 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44362/0 (socket says 172.21.15.97:44362) 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 -- 172.21.15.97:0/258296359 learned_addr learned my addr 172.21.15.97:0/258296359 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3d1b4640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc381ef4a0 0x7efc380a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc2ffff640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc3814b950 0x7efc381eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 -- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc381ef4a0 msgr2=0x7efc380a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc381ef4a0 0x7efc380a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 -- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc3814b950 msgr2=0x7efc381eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc3814b950 0x7efc381eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 -- 172.21.15.97:0/258296359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc381ee760 con 0x7efc20003b60 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3c9b3640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efc3401ca00 tx=0x7efc20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a5a70 con 0x7efc20003b60 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34004500 con 0x7efc20003b60 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc340a5e30 con 0x7efc20003b60 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc380aa9d0 con 0x7efc20003b60 2023-12-04T05:37:25.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc381f0de0 con 0x7efc20003b60 2023-12-04T05:37:25.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc381ee8f0 con 0x7efc20003b60 2023-12-04T05:37:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.846+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc34006040 con 0x7efc20003b60 2023-12-04T05:37:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.850+0000 7efc2d7fa640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 0x7efc24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.850+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc3411ed70 con 0x7efc20003b60 2023-12-04T05:37:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.850+0000 7efc2ffff640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 0x7efc24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:25.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.850+0000 7efc2ffff640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 0x7efc24068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc380ab580 tx=0x7efc28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:25.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:25.854+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc340ec050 con 0x7efc20003b60 2023-12-04T05:37:26.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.006+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc38068440 con 0x7efc20003b60 2023-12-04T05:37:26.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.006+0000 7efc2d7fa640 1 -- 172.21.15.97:0/258296359 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16557 (secure 0 0 0) 0x7efc340ba070 con 0x7efc20003b60 2023-12-04T05:37:26.010 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:26.011 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":31,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:25.971926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:26.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 msgr2=0x7efc24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 0x7efc24068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc380ab580 tx=0x7efc28009040 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 msgr2=0x7efc381566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efc3401ca00 tx=0x7efc20005800 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 shutdown_connections 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efc240668d0 0x7efc24068d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc381ef4a0 0x7efc380a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc3814b950 0x7efc381eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 --2- 172.21.15.97:0/258296359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc20003b60 0x7efc381566f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 >> 172.21.15.97:0/258296359 conn(0x7efc380c2970 msgr2=0x7efc38158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 shutdown_connections 2023-12-04T05:37:26.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.010+0000 7efc3ec17640 1 -- 172.21.15.97:0/258296359 wait complete. 2023-12-04T05:37:26.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T05:37:26.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.170+0000 7fd87359e640 1 Processor -- start 2023-12-04T05:37:26.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.170+0000 7fd87359e640 1 -- start start 2023-12-04T05:37:26.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87359e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd8740c4cc0 0x7fd874153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740c0960 con 0x7fd874071ea0 2023-12-04T05:37:26.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87359e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87406c820 con 0x7fd8740c11c0 2023-12-04T05:37:26.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87359e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87406cde0 con 0x7fd8740c4cc0 2023-12-04T05:37:26.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd86bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd874071ea0 0x7fd8740c2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49856/0 (socket says 172.21.15.97:49856) 2023-12-04T05:37:26.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd86bfff640 1 -- 172.21.15.97:0/790307081 learned_addr learned my addr 172.21.15.97:0/790307081 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:26.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 --2- 172.21.15.97:0/790307081 >> v2:172.21.15.143:3300/0 conn(0x7fd8740c4cc0 0x7fd874153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520185952 0 0) 0x7fd8740c0960 con 0x7fd874071ea0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003530 con 0x7fd874071ea0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867527942 0 0) 0x7fd860003530 con 0x7fd874071ea0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 >> v2:172.21.15.143:3300/0 conn(0x7fd8740c4cc0 msgr2=0x7fd874153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 --2- 172.21.15.97:0/790307081 >> v2:172.21.15.143:3300/0 conn(0x7fd8740c4cc0 0x7fd874153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 >> v1:172.21.15.143:6789/0 conn(0x7fd8740c11c0 legacy=0x7fd8740c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87406cb00 con 0x7fd874071ea0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fd85c001680 con 0x7fd874071ea0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 >> v1:172.21.15.97:6789/0 conn(0x7fd874071ea0 legacy=0x7fd8740c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8600047d0 0x7fd860004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8600051e0 0x7fd86000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87406cde0 con 0x7fd860003980 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000e340 con 0x7fd8600051e0 2023-12-04T05:37:26.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000e500 con 0x7fd8600047d0 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd86bfff640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8600047d0 0x7fd860004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd872d9d640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8600051e0 0x7fd86000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 -- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8600047d0 msgr2=0x7fd860004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8600047d0 0x7fd860004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 -- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8600051e0 msgr2=0x7fd86000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8600051e0 0x7fd86000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd87259c640 1 -- 172.21.15.97:0/790307081 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003530 con 0x7fd860003980 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd872d9d640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8600051e0 0x7fd86000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:26.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.174+0000 7fd872d9d640 1 -- 172.21.15.97:0/790307081 reap_dead start 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87259c640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003d60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd864009ae0 tx=0x7fd86401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceffe150c646f93c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a6430 con 0x7fd860003980 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8640a6590 con 0x7fd860003980 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd871d9b640 1 -- 172.21.15.97:0/790307081 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a6940 con 0x7fd860003980 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 -- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 msgr2=0x7fd860003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003d60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd864009ae0 tx=0x7fd86401ca50 comp rx=0 tx=0).stop 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 -- 172.21.15.97:0/790307081 shutdown_connections 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 --2- 172.21.15.97:0/790307081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003d60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 -- 172.21.15.97:0/790307081 >> 172.21.15.97:0/790307081 conn(0x7fd87406ad80 msgr2=0x7fd8740c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 -- 172.21.15.97:0/790307081 shutdown_connections 2023-12-04T05:37:26.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 -- 172.21.15.97:0/790307081 wait complete. 2023-12-04T05:37:26.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.178+0000 7fd87359e640 1 Processor -- start 2023-12-04T05:37:26.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- start start 2023-12-04T05:37:26.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd860003980 0x7fd8740aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8740712e0 0x7fd874149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740a85e0 con 0x7fd8741506a0 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87414e4f0 con 0x7fd8740712e0 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87414a750 con 0x7fd860003980 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44392/0 (socket says 172.21.15.97:44392) 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 -- 172.21.15.97:0/3756275401 learned_addr learned my addr 172.21.15.97:0/3756275401 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87259c640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd860003980 0x7fd8740aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd86bfff640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8740712e0 0x7fd874149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 -- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd860003980 msgr2=0x7fd8740aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd860003980 0x7fd8740aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 -- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8740712e0 msgr2=0x7fd874149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:26.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8740712e0 0x7fd874149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:26.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 -- 172.21.15.97:0/3756275401 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740a7b90 con 0x7fd8741506a0 2023-12-04T05:37:26.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd872d9d640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd87406e380 tx=0x7fd86c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:26.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c003d90 con 0x7fd8741506a0 2023-12-04T05:37:26.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c005070 con 0x7fd8741506a0 2023-12-04T05:37:26.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c005420 con 0x7fd8741506a0 2023-12-04T05:37:26.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8740a7e70 con 0x7fd8741506a0 2023-12-04T05:37:26.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740aa6c0 con 0x7fd8741506a0 2023-12-04T05:37:26.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.182+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87406d3a0 con 0x7fd8741506a0 2023-12-04T05:37:26.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.186+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd86c005580 con 0x7fd8741506a0 2023-12-04T05:37:26.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.186+0000 7fd86affd640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:26.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.186+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd86c084100 con 0x7fd8741506a0 2023-12-04T05:37:26.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.186+0000 7fd87259c640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:26.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.186+0000 7fd87259c640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ad000 tx=0x7fd8640b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:26.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.190+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd86c051330 con 0x7fd8741506a0 2023-12-04T05:37:26.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:26.374+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd87404e890 con 0x7fd8741506a0 2023-12-04T05:37:27.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd86affd640 1 -- 172.21.15.97:0/3756275401 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd86c054950 con 0x7fd8741506a0 2023-12-04T05:37:27.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 msgr2=0x7fd854068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8640ad000 tx=0x7fd8640b2040 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 msgr2=0x7fd87414a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd87406e380 tx=0x7fd86c00dac0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 shutdown_connections 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8741506a0 0x7fd87414a210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8740712e0 0x7fd874149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 --2- 172.21.15.97:0/3756275401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd860003980 0x7fd8740aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 >> 172.21.15.97:0/3756275401 conn(0x7fd87406ad80 msgr2=0x7fd8740c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 shutdown_connections 2023-12-04T05:37:27.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.354+0000 7fd87359e640 1 -- 172.21.15.97:0/3756275401 wait complete. 2023-12-04T05:37:27.383 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:37:27.383 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T05:37:27.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 Processor -- start 2023-12-04T05:37:27.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 -- start start 2023-12-04T05:37:27.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f64500bd560 0x7f64500c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6450155450 con 0x7f6450154f50 2023-12-04T05:37:27.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645006b2f0 con 0x7f64500bd560 2023-12-04T05:37:27.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f6455609640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6450157840 con 0x7f6450157460 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f64467fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f64500bd560 0x7f64500c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:51078/0 (socket says 172.21.15.97:51078) 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 -- 172.21.15.97:0/457617143 learned_addr learned my addr 172.21.15.97:0/457617143 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 -- 172.21.15.97:0/457617143 >> v2:172.21.15.143:3300/0 conn(0x7f64500bd560 msgr2=0x7f64500c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 --2- 172.21.15.97:0/457617143 >> v2:172.21.15.143:3300/0 conn(0x7f64500bd560 0x7f64500c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 -- 172.21.15.97:0/457617143 >> v1:172.21.15.143:6789/0 conn(0x7f6450154f50 legacy=0x7f645006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.526+0000 7f644effd640 1 -- 172.21.15.97:0/457617143 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500c49d0 con 0x7f6450157460 2023-12-04T05:37:27.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f644effd640 1 --2- 172.21.15.97:0/457617143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6440009870 tx=0x7f644001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c349c771346bfa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f644e7fc640 1 -- 172.21.15.97:0/457617143 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400aa430 con 0x7f6450157460 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f644e7fc640 1 -- 172.21.15.97:0/457617143 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64400aa590 con 0x7f6450157460 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f644e7fc640 1 -- 172.21.15.97:0/457617143 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400aa920 con 0x7f6450157460 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 -- 172.21.15.97:0/457617143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 msgr2=0x7f64500c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 --2- 172.21.15.97:0/457617143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6440009870 tx=0x7f644001c510 comp rx=0 tx=0).stop 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 -- 172.21.15.97:0/457617143 shutdown_connections 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 --2- 172.21.15.97:0/457617143 >> v2:172.21.15.143:3300/0 conn(0x7f64500bd560 0x7f64500c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 --2- 172.21.15.97:0/457617143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6450157460 0x7f64500c67a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 -- 172.21.15.97:0/457617143 >> 172.21.15.97:0/457617143 conn(0x7f64500aba80 msgr2=0x7f64500abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 -- 172.21.15.97:0/457617143 shutdown_connections 2023-12-04T05:37:27.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.530+0000 7f6455609640 1 -- 172.21.15.97:0/457617143 wait complete. 2023-12-04T05:37:27.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 Processor -- start 2023-12-04T05:37:27.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- start start 2023-12-04T05:37:27.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64500bd560 0x7f645014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6450154f50 0x7f64500c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645014a400 con 0x7f6450157460 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645014c7b0 con 0x7f6450154f50 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64501524e0 con 0x7f64500bd560 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44408/0 (socket says 172.21.15.97:44408) 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 -- 172.21.15.97:0/429520537 learned_addr learned my addr 172.21.15.97:0/429520537 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644effd640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64500bd560 0x7f645014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f64467fc640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6450154f50 0x7f64500c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 -- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64500bd560 msgr2=0x7f645014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64500bd560 0x7f645014c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 -- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6450154f50 msgr2=0x7f64500c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:27.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6450154f50 0x7f64500c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:27.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 -- 172.21.15.97:0/429520537 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400094d0 con 0x7f6450157460 2023-12-04T05:37:27.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f644f7fe640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f644800c400 tx=0x7f644800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480052d0 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448005430 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448003800 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64501527c0 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450152d80 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.534+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64500c1d20 con 0x7f6450157460 2023-12-04T05:37:27.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.538+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6448003960 con 0x7f6450157460 2023-12-04T05:37:27.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.538+0000 7f6447fff640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 0x7f6430068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:27.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.538+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64480838a0 con 0x7f6450157460 2023-12-04T05:37:27.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.538+0000 7f644effd640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 0x7f6430068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:27.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.538+0000 7f644effd640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 0x7f6430068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64400ae000 tx=0x7f64400b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:27.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.542+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64500c1d20 con 0x7f6450157460 2023-12-04T05:37:27.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:27.722+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f64500c1d20 con 0x7f6450157460 2023-12-04T05:37:28.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.358+0000 7f6447fff640 1 -- 172.21.15.97:0/429520537 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64500c1d20 con 0x7f6450157460 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 msgr2=0x7f6430068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 0x7f6430068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64400ae000 tx=0x7f64400b5040 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 msgr2=0x7f64501532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f644800c400 tx=0x7f644800c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 shutdown_connections 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f64300668d0 0x7f6430068d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6450157460 0x7f64501532a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6450154f50 0x7f64500c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 --2- 172.21.15.97:0/429520537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64500bd560 0x7f645014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 >> 172.21.15.97:0/429520537 conn(0x7f64500aba80 msgr2=0x7f64500ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 shutdown_connections 2023-12-04T05:37:28.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.362+0000 7f6455609640 1 -- 172.21.15.97:0/429520537 wait complete. 2023-12-04T05:37:28.386 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T05:37:28.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.518+0000 7fba374bb640 1 Processor -- start 2023-12-04T05:37:28.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.518+0000 7fba374bb640 1 -- start start 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba374bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 0x7fba301584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba374bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba300739b0 con 0x7fba3006b860 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba374bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba30155710 con 0x7fba300c1030 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba374bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300c15a0 con 0x7fba300c2a00 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35257640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fba3006b860 0x7fba30151b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49870/0 (socket says 172.21.15.97:49870) 2023-12-04T05:37:28.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35257640 1 -- 172.21.15.97:0/3949044863 learned_addr learned my addr 172.21.15.97:0/3949044863 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35a58640 1 --2- 172.21.15.97:0/3949044863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 0x7fba301584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523588974 0 0) 0x7fba300739b0 con 0x7fba3006b860 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba1c003530 con 0x7fba3006b860 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454267888 0 0) 0x7fba30155710 con 0x7fba300c1030 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba300739b0 con 0x7fba300c1030 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863756114 0 0) 0x7fba1c003530 con 0x7fba3006b860 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35a58640 1 -- 172.21.15.97:0/3949044863 >> v1:172.21.15.143:6789/0 conn(0x7fba300c1030 legacy=0x7fba30157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35a58640 1 -- 172.21.15.97:0/3949044863 >> v1:172.21.15.97:6789/0 conn(0x7fba3006b860 legacy=0x7fba30151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.522+0000 7fba35a58640 1 -- 172.21.15.97:0/3949044863 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30073680 con 0x7fba300c2a00 2023-12-04T05:37:28.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba35a58640 1 --2- 172.21.15.97:0/3949044863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 0x7fba301584b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba28009dc0 tx=0x7fba2801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4b90e2ccff6eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c001680 con 0x7fba300c2a00 2023-12-04T05:37:28.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba280a5550 con 0x7fba300c2a00 2023-12-04T05:37:28.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba27fff640 1 -- 172.21.15.97:0/3949044863 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280a58e0 con 0x7fba300c2a00 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- 172.21.15.97:0/3949044863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 msgr2=0x7fba301584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 --2- 172.21.15.97:0/3949044863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 0x7fba301584b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fba28009dc0 tx=0x7fba2801c800 comp rx=0 tx=0).stop 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- 172.21.15.97:0/3949044863 shutdown_connections 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 --2- 172.21.15.97:0/3949044863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba300c2a00 0x7fba301584b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- 172.21.15.97:0/3949044863 >> 172.21.15.97:0/3949044863 conn(0x7fba300c3130 msgr2=0x7fba300c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:28.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- 172.21.15.97:0/3949044863 shutdown_connections 2023-12-04T05:37:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- 172.21.15.97:0/3949044863 wait complete. 2023-12-04T05:37:28.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 Processor -- start 2023-12-04T05:37:28.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.526+0000 7fba374bb640 1 -- start start 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba3006b860 0x7fba30071e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba300c1030 0x7fba301f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300aba10 con 0x7fba300c2a00 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014ce60 con 0x7fba300c1030 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014d0b0 con 0x7fba3006b860 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35257640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba3006b860 0x7fba30071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44420/0 (socket says 172.21.15.97:44420) 2023-12-04T05:37:28.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 -- 172.21.15.97:0/1579852218 learned_addr learned my addr 172.21.15.97:0/1579852218 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:28.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba34a56640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba300c1030 0x7fba301f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 -- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba3006b860 msgr2=0x7fba30071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba3006b860 0x7fba30071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 -- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba300c1030 msgr2=0x7fba301f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba300c1030 0x7fba301f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 -- 172.21.15.97:0/1579852218 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28009a70 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba35a58640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba280b0040 tx=0x7fba280195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28003ba0 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28003d20 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28004270 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba300ab450 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba301ec7e0 con 0x7fba300c2a00 2023-12-04T05:37:28.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.530+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba301efe40 con 0x7fba300c2a00 2023-12-04T05:37:28.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.534+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fba280b4050 con 0x7fba300c2a00 2023-12-04T05:37:28.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.534+0000 7fba25ffb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 0x7fba14068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.534+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba2811f190 con 0x7fba300c2a00 2023-12-04T05:37:28.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.534+0000 7fba35257640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 0x7fba14068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.534+0000 7fba35257640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 0x7fba14068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000f70 tx=0x7fba2c0016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.538+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba301efe40 con 0x7fba300c2a00 2023-12-04T05:37:28.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.718+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba301efe40 con 0x7fba300c2a00 2023-12-04T05:37:28.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.718+0000 7fba25ffb640 1 -- 172.21.15.97:0/1579852218 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fba301efe40 con 0x7fba300c2a00 2023-12-04T05:37:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:28.723 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-04T05:37:28.723 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 17 2023-12-04T05:37:28.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.718+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 msgr2=0x7fba14068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 0x7fba14068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba2c000f70 tx=0x7fba2c0016c0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 msgr2=0x7fba301f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba280b0040 tx=0x7fba280195a0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 shutdown_connections 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fba140668d0 0x7fba14068d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fba300c2a00 0x7fba301f0660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fba300c1030 0x7fba301f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 --2- 172.21.15.97:0/1579852218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fba3006b860 0x7fba30071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 >> 172.21.15.97:0/1579852218 conn(0x7fba300c3130 msgr2=0x7fba30156130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 shutdown_connections 2023-12-04T05:37:28.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.722+0000 7fba374bb640 1 -- 172.21.15.97:0/1579852218 wait complete. 2023-12-04T05:37:28.743 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:28.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.874+0000 7f4c0589c640 1 Processor -- start 2023-12-04T05:37:28.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 -- start start 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006be00 0x7f4c0006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c0006ca50 0x7f4c000c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c00152300 con 0x7f4c0014e970 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c00071580 con 0x7f4c0006ca50 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4c0589c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014ed50 con 0x7f4c0006be00 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bff7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c0006ca50 0x7f4c000c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bfeffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4c0014e970 0x7f4c00071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49874/0 (socket says 172.21.15.97:49874) 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bfeffd640 1 -- 172.21.15.97:0/1683773419 learned_addr learned my addr 172.21.15.97:0/1683773419 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:28.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bf67fc640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006be00 0x7f4c0006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bff7fe640 1 -- 172.21.15.97:0/1683773419 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006be00 msgr2=0x7f4c0006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:28.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bff7fe640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006be00 0x7f4c0006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bff7fe640 1 -- 172.21.15.97:0/1683773419 >> v1:172.21.15.97:6789/0 conn(0x7f4c0014e970 legacy=0x7f4c00071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bff7fe640 1 -- 172.21.15.97:0/1683773419 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0006cea0 con 0x7f4c0006ca50 2023-12-04T05:37:28.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.878+0000 7f4bfe7fc640 1 -- 172.21.15.97:0/1683773419 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810007427 0 0) 0x7f4bf0001120 con 0x7f4c0014e970 2023-12-04T05:37:28.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4bff7fe640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0006ca50 0x7f4c000c1880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b62106c1b1fe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4bfe7fc640 1 -- 172.21.15.97:0/1683773419 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80a58f0 con 0x7f4c0006ca50 2023-12-04T05:37:28.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4bfe7fc640 1 -- 172.21.15.97:0/1683773419 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf80a5a50 con 0x7f4c0006ca50 2023-12-04T05:37:28.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4bfe7fc640 1 -- 172.21.15.97:0/1683773419 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80a5de0 con 0x7f4c0006ca50 2023-12-04T05:37:28.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- 172.21.15.97:0/1683773419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0006ca50 msgr2=0x7f4c000c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0006ca50 0x7f4c000c1880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf801c830 comp rx=0 tx=0).stop 2023-12-04T05:37:28.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- 172.21.15.97:0/1683773419 shutdown_connections 2023-12-04T05:37:28.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0006ca50 0x7f4c000c1880 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 --2- 172.21.15.97:0/1683773419 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006be00 0x7f4c0006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- 172.21.15.97:0/1683773419 >> 172.21.15.97:0/1683773419 conn(0x7f4c000c2970 msgr2=0x7f4c000c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:28.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- 172.21.15.97:0/1683773419 shutdown_connections 2023-12-04T05:37:28.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- 172.21.15.97:0/1683773419 wait complete. 2023-12-04T05:37:28.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 Processor -- start 2023-12-04T05:37:28.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.882+0000 7f4c0589c640 1 -- start start 2023-12-04T05:37:28.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 0x7f4c0014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 0x7f4c00148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014de00 con 0x7f4c0014e970 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014da80 con 0x7f4c0006be00 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014baf0 con 0x7f4c0006ca50 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44432/0 (socket says 172.21.15.97:44432) 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 -- 172.21.15.97:0/3309273396 learned_addr learned my addr 172.21.15.97:0/3309273396 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bf67fc640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 0x7f4c00148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfeffd640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 0x7f4c0014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 -- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 msgr2=0x7f4c00148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 0x7f4c00148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 -- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 msgr2=0x7f4c0014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 0x7f4c0014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:28.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 -- 172.21.15.97:0/3309273396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009a70 con 0x7f4c0014e970 2023-12-04T05:37:28.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfeffd640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 0x7f4c0014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:28.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bf67fc640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 0x7f4c00148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:28.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bff7fe640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bf801aee0 tx=0x7f4bf80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80ad8d0 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf80ada30 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c001f1140 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80adda0 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0014cd40 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c00068440 con 0x7f4c0014e970 2023-12-04T05:37:28.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.886+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4bf80b4050 con 0x7f4c0014e970 2023-12-04T05:37:28.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.890+0000 7f4bfcff9640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 0x7f4be0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:28.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.890+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bf811f790 con 0x7f4c0014e970 2023-12-04T05:37:28.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.890+0000 7f4bfeffd640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 0x7f4be0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:28.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.890+0000 7f4bfeffd640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 0x7f4be0068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0000f70 tx=0x7f4bf0007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:28.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:28.894+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bf80ec9c0 con 0x7f4c0014e970 2023-12-04T05:37:29.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.046+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c000c2560 con 0x7f4c0014e970 2023-12-04T05:37:29.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4bfcff9640 1 -- 172.21.15.97:0/3309273396 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16557 (secure 0 0 0) 0x7f4bf80b2090 con 0x7f4c0014e970 2023-12-04T05:37:29.053 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:29.053 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":31,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:25.971926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:29.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 msgr2=0x7f4be0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 0x7f4be0068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0000f70 tx=0x7f4bf0007cb0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 msgr2=0x7f4c001467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bf801aee0 tx=0x7f4bf80195d0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 shutdown_connections 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4be00668d0 0x7f4be0068d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c0014e970 0x7f4c001467b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c0006ca50 0x7f4c00148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 --2- 172.21.15.97:0/3309273396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c0006be00 0x7f4c0014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 >> 172.21.15.97:0/3309273396 conn(0x7f4c000c2970 msgr2=0x7f4c0015a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 shutdown_connections 2023-12-04T05:37:29.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.050+0000 7f4c0589c640 1 -- 172.21.15.97:0/3309273396 wait complete. 2023-12-04T05:37:29.075 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:37:29.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:29.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 Processor -- start 2023-12-04T05:37:29.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 -- start start 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f893406d510 0x7f89340c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89340c7760 0x7f89340c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8934070a30 con 0x7f8934155490 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340c3df0 con 0x7f89340c7760 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893af56640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340c2180 con 0x7f893406d510 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89340c7760 0x7f89340c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f89340c7760 0x7f89340c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44434/0 (socket says 172.21.15.97:44434) 2023-12-04T05:37:29.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 -- 172.21.15.97:0/1072031958 learned_addr learned my addr 172.21.15.97:0/1072031958 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f8939753640 1 --2- 172.21.15.97:0/1072031958 >> v2:172.21.15.143:3300/0 conn(0x7f893406d510 0x7f89340c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 -- 172.21.15.97:0/1072031958 >> v2:172.21.15.143:3300/0 conn(0x7f893406d510 msgr2=0x7f89340c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:29.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 --2- 172.21.15.97:0/1072031958 >> v2:172.21.15.143:3300/0 conn(0x7f893406d510 0x7f89340c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 -- 172.21.15.97:0/1072031958 >> v1:172.21.15.143:6789/0 conn(0x7f8934155490 legacy=0x7f89340c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:29.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.210+0000 7f893a755640 1 -- 172.21.15.97:0/1072031958 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340c2a90 con 0x7f89340c7760 2023-12-04T05:37:29.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893a755640 1 --2- 172.21.15.97:0/1072031958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89340c7760 0x7f89340c60a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89340c5820 tx=0x7f892c01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec4270e84b38d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f8938f52640 1 -- 172.21.15.97:0/1072031958 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0a5700 con 0x7f89340c7760 2023-12-04T05:37:29.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f8938f52640 1 -- 172.21.15.97:0/1072031958 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0a5860 con 0x7f89340c7760 2023-12-04T05:37:29.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f8938f52640 1 -- 172.21.15.97:0/1072031958 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0a5bf0 con 0x7f89340c7760 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 -- 172.21.15.97:0/1072031958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89340c7760 msgr2=0x7f89340c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 --2- 172.21.15.97:0/1072031958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89340c7760 0x7f89340c60a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89340c5820 tx=0x7f892c01c840 comp rx=0 tx=0).stop 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 -- 172.21.15.97:0/1072031958 shutdown_connections 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 --2- 172.21.15.97:0/1072031958 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89340c7760 0x7f89340c60a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 --2- 172.21.15.97:0/1072031958 >> v2:172.21.15.143:3300/0 conn(0x7f893406d510 0x7f89340c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 -- 172.21.15.97:0/1072031958 >> 172.21.15.97:0/1072031958 conn(0x7f89340a9a10 msgr2=0x7f89340a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 -- 172.21.15.97:0/1072031958 shutdown_connections 2023-12-04T05:37:29.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.214+0000 7f893af56640 1 -- 172.21.15.97:0/1072031958 wait complete. 2023-12-04T05:37:29.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 Processor -- start 2023-12-04T05:37:29.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- start start 2023-12-04T05:37:29.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 0x7f8934152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8934155490 0x7f893414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341f0340 con 0x7f893406d510 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341f0620 con 0x7f8934155490 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89341f0900 con 0x7f89340c7760 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44436/0 (socket says 172.21.15.97:44436) 2023-12-04T05:37:29.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 -- 172.21.15.97:0/1013417103 learned_addr learned my addr 172.21.15.97:0/1013417103 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893a755640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8934155490 0x7f893414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939753640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 0x7f8934152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 -- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 msgr2=0x7f8934152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 0x7f8934152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 -- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8934155490 msgr2=0x7f893414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8934155490 0x7f893414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 -- 172.21.15.97:0/1013417103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009b30 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939753640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 0x7f8934152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f8939f54640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f893000b410 tx=0x7f893000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930004020 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930004180 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89341f0be0 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011630 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893406f530 con 0x7f893406d510 2023-12-04T05:37:29.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.218+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893404e890 con 0x7f893406d510 2023-12-04T05:37:29.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.222+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8930011790 con 0x7f893406d510 2023-12-04T05:37:29.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.222+0000 7f892a7fc640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 0x7f8918068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.222+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8930084140 con 0x7f893406d510 2023-12-04T05:37:29.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.222+0000 7f8939753640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 0x7f8918068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.222+0000 7f8939753640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 0x7f8918068dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f893406f8a0 tx=0x7f8924008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.226+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8930051370 con 0x7f893406d510 2023-12-04T05:37:29.311 INFO:tasks.ceph.mds.a.smithi097.stderr:2023-12-04T05:37:29.306+0000 7ff129fc0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:37:29.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.378+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89340c2780 con 0x7f8918066900 2023-12-04T05:37:29.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.386+0000 7f892a7fc640 1 -- 172.21.15.97:0/1013417103 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249910 (secure 0 0 0) 0x7f8924004030 con 0x7f8918066900 2023-12-04T05:37:29.393 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:29.395 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:29.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 msgr2=0x7f8918068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 0x7f8918068dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f893406f8a0 tx=0x7f8924008040 comp rx=0 tx=0).stop 2023-12-04T05:37:29.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 msgr2=0x7f89341ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f893000b410 tx=0x7f893000b8d0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 shutdown_connections 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8918066900 0x7f8918068dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8934155490 0x7f893414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89340c7760 0x7f8934152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 --2- 172.21.15.97:0/1013417103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f893406d510 0x7f89341ed7f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 >> 172.21.15.97:0/1013417103 conn(0x7f89340a9a10 msgr2=0x7f89340a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 shutdown_connections 2023-12-04T05:37:29.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.390+0000 7f893af56640 1 -- 172.21.15.97:0/1013417103 wait complete. 2023-12-04T05:37:29.413 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-04T05:37:28.200553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219736,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3579904,"data_stored":2052280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875155"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-04T05:37:17.760710+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:17.760710+0000","last_peered":"2023-12-04T05:37:17.760710+0000","last_clean":"2023-12-04T05:37:17.760710+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:17.760710+0000","last_undegraded":"2023-12-04T05:37:17.760710+0000","last_fullsized":"2023-12-04T05:37:17.760710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:29.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 Processor -- start 2023-12-04T05:37:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 -- start start 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcfe4154f90 0x7fcfe40c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe40c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe414ea30 con 0x7fcfe414e650 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40c6720 con 0x7fcfe4154f90 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe98fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c49b0 con 0x7fcfe406cae0 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcfe4154f90 0x7fcfe40c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcfe4154f90 0x7fcfe40c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44446/0 (socket says 172.21.15.97:44446) 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 -- 172.21.15.97:0/3346350349 learned_addr learned my addr 172.21.15.97:0/3346350349 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfe37fe640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe40c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 -- 172.21.15.97:0/3346350349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 msgr2=0x7fcfe40c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe40c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 -- 172.21.15.97:0/3346350349 >> v1:172.21.15.143:6789/0 conn(0x7fcfe414e650 legacy=0x7fcfe40abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.590+0000 7fcfda7fc640 1 -- 172.21.15.97:0/3346350349 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40c4c50 con 0x7fcfe4154f90 2023-12-04T05:37:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfda7fc640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c6bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a422a510ac7dddd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe27fc640 1 -- 172.21.15.97:0/3346350349 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a5680 con 0x7fcfe4154f90 2023-12-04T05:37:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe27fc640 1 -- 172.21.15.97:0/3346350349 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0a57e0 con 0x7fcfe4154f90 2023-12-04T05:37:29.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe27fc640 1 -- 172.21.15.97:0/3346350349 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a5b70 con 0x7fcfe4154f90 2023-12-04T05:37:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 -- 172.21.15.97:0/3346350349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 msgr2=0x7fcfe40c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c6bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009e50 tx=0x7fcfcc01c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 -- 172.21.15.97:0/3346350349 shutdown_connections 2023-12-04T05:37:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe40c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/3346350349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c6bb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 -- 172.21.15.97:0/3346350349 >> 172.21.15.97:0/3346350349 conn(0x7fcfe4073550 msgr2=0x7fcfe4073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 -- 172.21.15.97:0/3346350349 shutdown_connections 2023-12-04T05:37:29.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.594+0000 7fcfe98fe640 1 -- 172.21.15.97:0/3346350349 wait complete. 2023-12-04T05:37:29.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 Processor -- start 2023-12-04T05:37:29.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- start start 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe4154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe414e650 0x7fcfe4152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c1c80 con 0x7fcfe4154f90 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4148580 con 0x7fcfe414e650 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c30c0 con 0x7fcfe406cae0 2023-12-04T05:37:29.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44458/0 (socket says 172.21.15.97:44458) 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 -- 172.21.15.97:0/1520211346 learned_addr learned my addr 172.21.15.97:0/1520211346 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe2ffd640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfda7fc640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe414e650 0x7fcfe4152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 -- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 msgr2=0x7fcfe4154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe4154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 -- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe414e650 msgr2=0x7fcfe4152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe414e650 0x7fcfe4152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 -- 172.21.15.97:0/1520211346 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc009b30 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe37fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d560 tx=0x7fcfdc00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0125f0 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc012770 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012b20 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe41548b0 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40c13e0 con 0x7fcfe4154f90 2023-12-04T05:37:29.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.598+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe4068440 con 0x7fcfe4154f90 2023-12-04T05:37:29.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.602+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcfdc012c80 con 0x7fcfe4154f90 2023-12-04T05:37:29.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.602+0000 7fcfe0ff9640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 0x7fcfc4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.602+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfdc084840 con 0x7fcfe4154f90 2023-12-04T05:37:29.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.602+0000 7fcfe2ffd640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 0x7fcfc4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.602+0000 7fcfe2ffd640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 0x7fcfc4068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4007fd0 tx=0x7fcfd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.606+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfdc051a90 con 0x7fcfe4154f90 2023-12-04T05:37:29.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.754+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfe40c7630 con 0x7fcfc4066900 2023-12-04T05:37:29.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.758+0000 7fcfe0ff9640 1 -- 172.21.15.97:0/1520211346 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249910 (secure 0 0 0) 0x7fcfd4001450 con 0x7fcfc4066900 2023-12-04T05:37:29.765 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:29.767 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 msgr2=0x7fcfc4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 0x7fcfc4068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4007fd0 tx=0x7fcfd4009040 comp rx=0 tx=0).stop 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 msgr2=0x7fcfe40c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d560 tx=0x7fcfdc00da20 comp rx=0 tx=0).stop 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 shutdown_connections 2023-12-04T05:37:29.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcfc4066900 0x7fcfc4068dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcfe4154f90 0x7fcfe40c35a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe414e650 0x7fcfe4152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 --2- 172.21.15.97:0/1520211346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfe406cae0 0x7fcfe4154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 >> 172.21.15.97:0/1520211346 conn(0x7fcfe4073550 msgr2=0x7fcfe40aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 shutdown_connections 2023-12-04T05:37:29.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.762+0000 7fcfe98fe640 1 -- 172.21.15.97:0/1520211346 wait complete. 2023-12-04T05:37:29.787 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-04T05:37:28.200553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219736,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3579904,"data_stored":2052280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875155"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-04T05:37:17.760710+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:17.760710+0000","last_peered":"2023-12-04T05:37:17.760710+0000","last_clean":"2023-12-04T05:37:17.760710+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:17.760710+0000","last_undegraded":"2023-12-04T05:37:17.760710+0000","last_fullsized":"2023-12-04T05:37:17.760710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:29.792 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:29.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 Processor -- start 2023-12-04T05:37:29.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 -- start start 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c814fbb0 0x7ff7c80a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7c80a88e0 0x7ff7c8152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c81530e0 con 0x7ff7c80a8460 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c814ff90 con 0x7ff7c80a88e0 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7ccf80640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80a9770 con 0x7ff7c814fbb0 2023-12-04T05:37:29.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7c80a88e0 0x7ff7c8152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7c80a88e0 0x7ff7c8152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44472/0 (socket says 172.21.15.97:44472) 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/2605183447 learned_addr learned my addr 172.21.15.97:0/2605183447 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c659c640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c814fbb0 0x7ff7c80a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/2605183447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c814fbb0 msgr2=0x7ff7c80a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c814fbb0 0x7ff7c80a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/2605183447 >> v1:172.21.15.143:6789/0 conn(0x7ff7c80a8460 legacy=0x7ff7c8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.962+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/2605183447 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8071730 con 0x7ff7c80a88e0 2023-12-04T05:37:29.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7c6d9d640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8152ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e50 tx=0x7ff7c001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ef8092fc07b0cd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7c559a640 1 -- 172.21.15.97:0/2605183447 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00a57b0 con 0x7ff7c80a88e0 2023-12-04T05:37:29.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7c559a640 1 -- 172.21.15.97:0/2605183447 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c00a5910 con 0x7ff7c80a88e0 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7c559a640 1 -- 172.21.15.97:0/2605183447 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00a5ca0 con 0x7ff7c80a88e0 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 -- 172.21.15.97:0/2605183447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c80a88e0 msgr2=0x7ff7c8152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8152ba0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e50 tx=0x7ff7c001c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 -- 172.21.15.97:0/2605183447 shutdown_connections 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8152ba0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/2605183447 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c814fbb0 0x7ff7c80a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 -- 172.21.15.97:0/2605183447 >> 172.21.15.97:0/2605183447 conn(0x7ff7c80c2970 msgr2=0x7ff7c80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 -- 172.21.15.97:0/2605183447 shutdown_connections 2023-12-04T05:37:29.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.966+0000 7ff7ccf80640 1 -- 172.21.15.97:0/2605183447 wait complete. 2023-12-04T05:37:29.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 Processor -- start 2023-12-04T05:37:29.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- start start 2023-12-04T05:37:29.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c80a8460 0x7ff7c81514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c81569b0 con 0x7ff7c814fbb0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8150e50 con 0x7ff7c80a88e0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8156760 con 0x7ff7c80a8460 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44474/0 (socket says 172.21.15.97:44474) 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/1150930386 learned_addr learned my addr 172.21.15.97:0/1150930386 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c659c640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c80a8460 0x7ff7c81514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c5d9b640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c80a8460 msgr2=0x7ff7c81514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c80a8460 0x7ff7c81514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7c80a88e0 msgr2=0x7ff7c8142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 -- 172.21.15.97:0/1150930386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0009b30 con 0x7ff7c814fbb0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7c6d9d640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff7c001a520 tx=0x7ff7c0019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00b8670 con 0x7ff7c814fbb0 2023-12-04T05:37:29.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c00b87d0 con 0x7ff7c814fbb0 2023-12-04T05:37:29.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00b8b40 con 0x7ff7c814fbb0 2023-12-04T05:37:29.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c81eb3c0 con 0x7ff7c814fbb0 2023-12-04T05:37:29.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.970+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c81eb640 con 0x7ff7c814fbb0 2023-12-04T05:37:29.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c814b360 con 0x7ff7c814fbb0 2023-12-04T05:37:29.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7c00b8ca0 con 0x7ff7c814fbb0 2023-12-04T05:37:29.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7b6ffd640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 0x7ff7a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:29.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c011f670 con 0x7ff7c814fbb0 2023-12-04T05:37:29.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7c659c640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 0x7ff7a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:29.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.974+0000 7ff7c659c640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 0x7ff7a8068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806e1c0 tx=0x7ff7b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:29.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:29.978+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7c814b360 con 0x7ff7c814fbb0 2023-12-04T05:37:30.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.126+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7c80c04a0 con 0x7ff7a80668d0 2023-12-04T05:37:30.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.134+0000 7ff7b6ffd640 1 -- 172.21.15.97:0/1150930386 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249910 (secure 0 0 0) 0x7ff7b8004030 con 0x7ff7a80668d0 2023-12-04T05:37:30.140 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:30.141 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 msgr2=0x7ff7a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 0x7ff7a8068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806e1c0 tx=0x7ff7b8008040 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 msgr2=0x7ff7c8142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff7c001a520 tx=0x7ff7c0019690 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 shutdown_connections 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7a80668d0 0x7ff7a8068d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7c814fbb0 0x7ff7c8142b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7c80a88e0 0x7ff7c8142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 --2- 172.21.15.97:0/1150930386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7c80a8460 0x7ff7c81514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 >> 172.21.15.97:0/1150930386 conn(0x7ff7c80c2970 msgr2=0x7ff7c815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:30.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 shutdown_connections 2023-12-04T05:37:30.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.138+0000 7ff7ccf80640 1 -- 172.21.15.97:0/1150930386 wait complete. 2023-12-04T05:37:30.160 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-04T05:37:28.200553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219736,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3579904,"data_stored":2052280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875155"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:24.325105+0000","last_change":"2023-12-04T05:37:24.325105+0000","last_active":"2023-12-04T05:37:24.325105+0000","last_peered":"2023-12-04T05:37:24.325105+0000","last_clean":"2023-12-04T05:37:24.325105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:24.325105+0000","last_undegraded":"2023-12-04T05:37:24.325105+0000","last_fullsized":"2023-12-04T05:37:24.325105+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:37:23.317049+0000","last_change":"2023-12-04T05:37:23.317049+0000","last_active":"2023-12-04T05:37:23.317049+0000","last_peered":"2023-12-04T05:37:23.317049+0000","last_clean":"2023-12-04T05:37:23.317049+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:37:23.317049+0000","last_undegraded":"2023-12-04T05:37:23.317049+0000","last_fullsized":"2023-12-04T05:37:23.317049+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-04T05:37:17.760710+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:17.760710+0000","last_peered":"2023-12-04T05:37:17.760710+0000","last_clean":"2023-12-04T05:37:17.760710+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:17.760710+0000","last_undegraded":"2023-12-04T05:37:17.760710+0000","last_fullsized":"2023-12-04T05:37:17.760710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:30.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-04T05:37:30.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-04T05:37:30.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-04T05:37:30.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-04T05:37:30.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-04T05:37:30.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-04T05:37:30.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-04T05:37:30.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-04T05:37:30.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-04T05:37:30.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-04T05:37:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-04T05:37:30.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-04T05:37:30.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-04T05:37:30.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-04T05:37:30.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-04T05:37:30.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-04T05:37:30.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:24.325105+0000', 'last_change': '2023-12-04T05:37:24.325105+0000', 'last_active': '2023-12-04T05:37:24.325105+0000', 'last_peered': '2023-12-04T05:37:24.325105+0000', 'last_clean': '2023-12-04T05:37:24.325105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:24.325105+0000', 'last_undegraded': '2023-12-04T05:37:24.325105+0000', 'last_fullsized': '2023-12-04T05:37:24.325105+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:24.325105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-04T05:37:30.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:37:23.317049+0000', 'last_change': '2023-12-04T05:37:23.317049+0000', 'last_active': '2023-12-04T05:37:23.317049+0000', 'last_peered': '2023-12-04T05:37:23.317049+0000', 'last_clean': '2023-12-04T05:37:23.317049+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:37:23.317049+0000', 'last_undegraded': '2023-12-04T05:37:23.317049+0000', 'last_fullsized': '2023-12-04T05:37:23.317049+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'last_clean_scrub_stamp': '2023-12-04T05:37:23.317049+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:37:30.192 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-04T05:37:30.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 Processor -- start 2023-12-04T05:37:30.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 -- start start 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f59880c7d20 0x7f5988157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5988158380 0x7f598815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59880ca2a0 con 0x7f59880af6b0 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59880caad0 con 0x7f5988158380 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598e4ad640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59880ca510 con 0x7f59880c7d20 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598d4ab640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f59880af6b0 0x7f59880c47a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49882/0 (socket says 172.21.15.97:49882) 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.338+0000 7f598d4ab640 1 -- 172.21.15.97:0/461204300 learned_addr learned my addr 172.21.15.97:0/461204300 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 --2- 172.21.15.97:0/461204300 >> v2:172.21.15.97:3300/0 conn(0x7f5988158380 0x7f598815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598ccaa640 1 --2- 172.21.15.97:0/461204300 >> v2:172.21.15.143:3300/0 conn(0x7f59880c7d20 0x7f5988157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f597ffff640 1 -- 172.21.15.97:0/461204300 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798735572 0 0) 0x7f59880ca2a0 con 0x7f59880af6b0 2023-12-04T05:37:30.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f597ffff640 1 -- 172.21.15.97:0/461204300 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5974003530 con 0x7f59880af6b0 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 -- 172.21.15.97:0/461204300 >> v2:172.21.15.143:3300/0 conn(0x7f59880c7d20 msgr2=0x7f5988157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 --2- 172.21.15.97:0/461204300 >> v2:172.21.15.143:3300/0 conn(0x7f59880c7d20 0x7f5988157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 -- 172.21.15.97:0/461204300 >> v1:172.21.15.97:6789/0 conn(0x7f59880af6b0 legacy=0x7f59880c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 -- 172.21.15.97:0/461204300 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880ca7f0 con 0x7f5988158380 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f598dcac640 1 --2- 172.21.15.97:0/461204300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5988158380 0x7f598815eef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f598806c890 tx=0x7f598001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329e2c0c124396b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f597ffff640 1 -- 172.21.15.97:0/461204300 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59800b0440 con 0x7f5988158380 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f597ffff640 1 -- 172.21.15.97:0/461204300 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59800b05a0 con 0x7f5988158380 2023-12-04T05:37:30.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.342+0000 7f597ffff640 1 -- 172.21.15.97:0/461204300 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59800b0930 con 0x7f5988158380 2023-12-04T05:37:30.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- 172.21.15.97:0/461204300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5988158380 msgr2=0x7f598815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- 172.21.15.97:0/461204300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5988158380 0x7f598815eef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f598806c890 tx=0x7f598001f0f0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- 172.21.15.97:0/461204300 shutdown_connections 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- 172.21.15.97:0/461204300 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5988158380 0x7f598815eef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- 172.21.15.97:0/461204300 >> v2:172.21.15.143:3300/0 conn(0x7f59880c7d20 0x7f5988157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- 172.21.15.97:0/461204300 >> 172.21.15.97:0/461204300 conn(0x7f5988073720 msgr2=0x7f5988073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- 172.21.15.97:0/461204300 shutdown_connections 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- 172.21.15.97:0/461204300 wait complete. 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 Processor -- start 2023-12-04T05:37:30.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- start start 2023-12-04T05:37:30.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 0x7f59880c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5988158380 0x7f5988152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59880bf470 con 0x7f59880c7d20 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59881ecb90 con 0x7f59880af6b0 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598e4ad640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59880abea0 con 0x7f5988158380 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44494/0 (socket says 172.21.15.97:44494) 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 -- 172.21.15.97:0/259330670 learned_addr learned my addr 172.21.15.97:0/259330670 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598dcac640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5988158380 0x7f5988152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598d4ab640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 0x7f59880c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 -- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5988158380 msgr2=0x7f5988152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5988158380 0x7f5988152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 -- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 msgr2=0x7f59880c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 0x7f59880c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 -- 172.21.15.97:0/259330670 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009a70 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598d4ab640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 0x7f59880c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.346+0000 7f598ccaa640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f597800e8d0 tx=0x7f597800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978009630 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800c940 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800ccb0 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59880ac6b0 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59880ac0f0 con 0x7f59880c7d20 2023-12-04T05:37:30.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598804e890 con 0x7f59880c7d20 2023-12-04T05:37:30.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5978013470 con 0x7f59880c7d20 2023-12-04T05:37:30.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 0x7f596c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5978084540 con 0x7f59880c7d20 2023-12-04T05:37:30.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f598d4ab640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 0x7f596c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.350+0000 7f598d4ab640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 0x7f596c068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59840011f0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.354+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5978051810 con 0x7f59880c7d20 2023-12-04T05:37:30.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.554+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f59881e9620 con 0x7f59880c7d20 2023-12-04T05:37:30.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.554+0000 7f597dffb640 1 -- 172.21.15.97:0/259330670 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2634 (secure 0 0 0) 0x7f5978017a60 con 0x7f59880c7d20 2023-12-04T05:37:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:30.560 INFO:teuthology.orchestra.run.smithi097.stdout:{"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1701668187,"num_in_osds":8,"osd_in_since":1701668177,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225009664,"bytes_avail":772869103616,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-04T05:37:22.199496+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 msgr2=0x7f596c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 0x7f596c068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59840011f0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 msgr2=0x7f59880c0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f597800e8d0 tx=0x7f597800ed90 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 shutdown_connections 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f596c066900 0x7f596c068dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5988158380 0x7f5988152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59880c7d20 0x7f59880c0280 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 --2- 172.21.15.97:0/259330670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59880af6b0 0x7f59880c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 >> 172.21.15.97:0/259330670 conn(0x7f5988073720 msgr2=0x7f598806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 shutdown_connections 2023-12-04T05:37:30.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.558+0000 7f598e4ad640 1 -- 172.21.15.97:0/259330670 wait complete. 2023-12-04T05:37:30.581 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-04T05:37:30.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.714+0000 7fd21b99d640 1 Processor -- start 2023-12-04T05:37:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.714+0000 7fd21b99d640 1 -- start start 2023-12-04T05:37:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd21b99d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd21406be00 0x7fd21406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd21b99d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406ca50 0x7fd2140c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd21b99d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214152300 con 0x7fd21414e970 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd21b99d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd214071580 con 0x7fd21406be00 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd21b99d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414ed50 con 0x7fd21406ca50 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd219739640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd21414e970 0x7fd214071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49898/0 (socket says 172.21.15.97:49898) 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd219739640 1 -- 172.21.15.97:0/3833969791 learned_addr learned my addr 172.21.15.97:0/3833969791 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd218f38640 1 --2- 172.21.15.97:0/3833969791 >> v2:172.21.15.143:3300/0 conn(0x7fd21406be00 0x7fd21406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd219f3a640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406ca50 0x7fd2140c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289177251 0 0) 0x7fd210001120 con 0x7fd21414e970 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd200003530 con 0x7fd21414e970 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502823792 0 0) 0x7fd200003530 con 0x7fd21414e970 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd218f38640 1 -- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406ca50 msgr2=0x7fd2140c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd218f38640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406ca50 0x7fd2140c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd218f38640 1 -- 172.21.15.97:0/3833969791 >> v1:172.21.15.97:6789/0 conn(0x7fd21414e970 legacy=0x7fd214071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.718+0000 7fd218f38640 1 -- 172.21.15.97:0/3833969791 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21406cea0 con 0x7fd21406be00 2023-12-04T05:37:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd218f38640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21406be00 0x7fd21406e150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097c0 tx=0x7fd20401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67cf153679b8b7fb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210001810 con 0x7fd21406be00 2023-12-04T05:37:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2040a7050 con 0x7fd21406be00 2023-12-04T05:37:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd20bfff640 1 -- 172.21.15.97:0/3833969791 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040ab600 con 0x7fd21406be00 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21406be00 msgr2=0x7fd21406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21406be00 0x7fd21406e150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2040097c0 tx=0x7fd20401c310 comp rx=0 tx=0).stop 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- 172.21.15.97:0/3833969791 shutdown_connections 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406ca50 0x7fd2140c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 --2- 172.21.15.97:0/3833969791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21406be00 0x7fd21406e150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- 172.21.15.97:0/3833969791 >> 172.21.15.97:0/3833969791 conn(0x7fd2140c2970 msgr2=0x7fd2140c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- 172.21.15.97:0/3833969791 shutdown_connections 2023-12-04T05:37:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- 172.21.15.97:0/3833969791 wait complete. 2023-12-04T05:37:30.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 Processor -- start 2023-12-04T05:37:30.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.722+0000 7fd21b99d640 1 -- start start 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 0x7fd2140a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21414e970 0x7fd21415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141604b0 con 0x7fd21406ca50 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21415f000 con 0x7fd21414e970 2023-12-04T05:37:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140aa280 con 0x7fd21406be00 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44504/0 (socket says 172.21.15.97:44504) 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 -- 172.21.15.97:0/2035306055 learned_addr learned my addr 172.21.15.97:0/2035306055 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd219f3a640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21414e970 0x7fd21415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd219739640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 0x7fd2140a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 -- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 msgr2=0x7fd2140a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 0x7fd2140a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 -- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21414e970 msgr2=0x7fd21415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21414e970 0x7fd21415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 -- 172.21.15.97:0/2035306055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009420 con 0x7fd21406ca50 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd219739640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 0x7fd2140a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd218f38640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c10 tx=0x7fd2040190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040b4600 con 0x7fd21406ca50 2023-12-04T05:37:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2040b4760 con 0x7fd21406ca50 2023-12-04T05:37:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040b4ad0 con 0x7fd21406ca50 2023-12-04T05:37:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21415f9d0 con 0x7fd21406ca50 2023-12-04T05:37:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2141f1430 con 0x7fd21406ca50 2023-12-04T05:37:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21415f170 con 0x7fd21406ca50 2023-12-04T05:37:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.726+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd2040b2040 con 0x7fd21406ca50 2023-12-04T05:37:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.730+0000 7fd209ffb640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 0x7fd1f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.730+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd20411e450 con 0x7fd21406ca50 2023-12-04T05:37:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.730+0000 7fd219739640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 0x7fd1f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.730+0000 7fd219739640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 0x7fd1f8068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd210001ec0 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.734+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2040eb850 con 0x7fd21406ca50 2023-12-04T05:37:30.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.882+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd21415b820 con 0x7fd1f80668d0 2023-12-04T05:37:30.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.890+0000 7fd209ffb640 1 -- 172.21.15.97:0/2035306055 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267876 (secure 0 0 0) 0x7fd21415b820 con 0x7fd1f80668d0 2023-12-04T05:37:30.896 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:30.897 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:30.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 msgr2=0x7fd1f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 0x7fd1f8068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd210001ec0 tx=0x7fd210009040 comp rx=0 tx=0).stop 2023-12-04T05:37:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 msgr2=0x7fd21415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c10 tx=0x7fd2040190b0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 shutdown_connections 2023-12-04T05:37:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd1f80668d0 0x7fd1f8068d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd21414e970 0x7fd21415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd21406ca50 0x7fd21415f490 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 --2- 172.21.15.97:0/2035306055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd21406be00 0x7fd2140a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 >> 172.21.15.97:0/2035306055 conn(0x7fd2140c2970 msgr2=0x7fd2141453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 shutdown_connections 2023-12-04T05:37:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:30.894+0000 7fd21b99d640 1 -- 172.21.15.97:0/2035306055 wait complete. 2023-12-04T05:37:30.916 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-04T05:37:30.200999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220112,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754608,"statfs":{"total":773094113280,"available":772868718592,"internally_reserved":0,"allocated":4038656,"data_stored":2258372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978883+0000","last_change":"2023-12-04T05:37:24.991447+0000","last_active":"2023-12-04T05:37:25.978883+0000","last_peered":"2023-12-04T05:37:25.978883+0000","last_clean":"2023-12-04T05:37:25.978883+0000","last_became_active":"2023-12-04T05:37:24.991120+0000","last_became_peered":"2023-12-04T05:37:24.991120+0000","last_unstale":"2023-12-04T05:37:25.978883+0000","last_undegraded":"2023-12-04T05:37:25.978883+0000","last_fullsized":"2023-12-04T05:37:25.978883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:23.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435473+0000","last_change":"2023-12-04T05:37:24.992517+0000","last_active":"2023-12-04T05:37:26.435473+0000","last_peered":"2023-12-04T05:37:26.435473+0000","last_clean":"2023-12-04T05:37:26.435473+0000","last_became_active":"2023-12-04T05:37:24.991809+0000","last_became_peered":"2023-12-04T05:37:24.991809+0000","last_unstale":"2023-12-04T05:37:26.435473+0000","last_undegraded":"2023-12-04T05:37:26.435473+0000","last_fullsized":"2023-12-04T05:37:26.435473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:09.871491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937247+0000","last_change":"2023-12-04T05:37:24.996407+0000","last_active":"2023-12-04T05:37:26.937247+0000","last_peered":"2023-12-04T05:37:26.937247+0000","last_clean":"2023-12-04T05:37:26.937247+0000","last_became_active":"2023-12-04T05:37:24.996150+0000","last_became_peered":"2023-12-04T05:37:24.996150+0000","last_unstale":"2023-12-04T05:37:26.937247+0000","last_undegraded":"2023-12-04T05:37:26.937247+0000","last_fullsized":"2023-12-04T05:37:26.937247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935699+0000","last_change":"2023-12-04T05:37:24.990710+0000","last_active":"2023-12-04T05:37:26.935699+0000","last_peered":"2023-12-04T05:37:26.935699+0000","last_clean":"2023-12-04T05:37:26.935699+0000","last_became_active":"2023-12-04T05:37:24.990190+0000","last_became_peered":"2023-12-04T05:37:24.990190+0000","last_unstale":"2023-12-04T05:37:26.935699+0000","last_undegraded":"2023-12-04T05:37:26.935699+0000","last_fullsized":"2023-12-04T05:37:26.935699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935348+0000","last_change":"2023-12-04T05:37:24.991321+0000","last_active":"2023-12-04T05:37:26.935348+0000","last_peered":"2023-12-04T05:37:26.935348+0000","last_clean":"2023-12-04T05:37:26.935348+0000","last_became_active":"2023-12-04T05:37:24.990855+0000","last_became_peered":"2023-12-04T05:37:24.990855+0000","last_unstale":"2023-12-04T05:37:26.935348+0000","last_undegraded":"2023-12-04T05:37:26.935348+0000","last_fullsized":"2023-12-04T05:37:26.935348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:46:45.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435183+0000","last_change":"2023-12-04T05:37:24.997159+0000","last_active":"2023-12-04T05:37:26.435183+0000","last_peered":"2023-12-04T05:37:26.435183+0000","last_clean":"2023-12-04T05:37:26.435183+0000","last_became_active":"2023-12-04T05:37:24.996505+0000","last_became_peered":"2023-12-04T05:37:24.996505+0000","last_unstale":"2023-12-04T05:37:26.435183+0000","last_undegraded":"2023-12-04T05:37:26.435183+0000","last_fullsized":"2023-12-04T05:37:26.435183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936773+0000","last_change":"2023-12-04T05:37:25.001425+0000","last_active":"2023-12-04T05:37:26.936773+0000","last_peered":"2023-12-04T05:37:26.936773+0000","last_clean":"2023-12-04T05:37:26.936773+0000","last_became_active":"2023-12-04T05:37:25.001143+0000","last_became_peered":"2023-12-04T05:37:25.001143+0000","last_unstale":"2023-12-04T05:37:26.936773+0000","last_undegraded":"2023-12-04T05:37:26.936773+0000","last_fullsized":"2023-12-04T05:37:26.936773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936197+0000","last_change":"2023-12-04T05:37:24.999115+0000","last_active":"2023-12-04T05:37:26.936197+0000","last_peered":"2023-12-04T05:37:26.936197+0000","last_clean":"2023-12-04T05:37:26.936197+0000","last_became_active":"2023-12-04T05:37:24.997938+0000","last_became_peered":"2023-12-04T05:37:24.997938+0000","last_unstale":"2023-12-04T05:37:26.936197+0000","last_undegraded":"2023-12-04T05:37:26.936197+0000","last_fullsized":"2023-12-04T05:37:26.936197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978206+0000","last_change":"2023-12-04T05:37:24.990417+0000","last_active":"2023-12-04T05:37:25.978206+0000","last_peered":"2023-12-04T05:37:25.978206+0000","last_clean":"2023-12-04T05:37:25.978206+0000","last_became_active":"2023-12-04T05:37:24.989761+0000","last_became_peered":"2023-12-04T05:37:24.989761+0000","last_unstale":"2023-12-04T05:37:25.978206+0000","last_undegraded":"2023-12-04T05:37:25.978206+0000","last_fullsized":"2023-12-04T05:37:25.978206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935778+0000","last_change":"2023-12-04T05:37:24.994217+0000","last_active":"2023-12-04T05:37:26.935778+0000","last_peered":"2023-12-04T05:37:26.935778+0000","last_clean":"2023-12-04T05:37:26.935778+0000","last_became_active":"2023-12-04T05:37:24.993859+0000","last_became_peered":"2023-12-04T05:37:24.993859+0000","last_unstale":"2023-12-04T05:37:26.935778+0000","last_undegraded":"2023-12-04T05:37:26.935778+0000","last_fullsized":"2023-12-04T05:37:26.935778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936635+0000","last_change":"2023-12-04T05:37:25.002836+0000","last_active":"2023-12-04T05:37:26.936635+0000","last_peered":"2023-12-04T05:37:26.936635+0000","last_clean":"2023-12-04T05:37:26.936635+0000","last_became_active":"2023-12-04T05:37:25.002504+0000","last_became_peered":"2023-12-04T05:37:25.002504+0000","last_unstale":"2023-12-04T05:37:26.936635+0000","last_undegraded":"2023-12-04T05:37:26.936635+0000","last_fullsized":"2023-12-04T05:37:26.936635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937037+0000","last_change":"2023-12-04T05:37:25.001854+0000","last_active":"2023-12-04T05:37:26.937037+0000","last_peered":"2023-12-04T05:37:26.937037+0000","last_clean":"2023-12-04T05:37:26.937037+0000","last_became_active":"2023-12-04T05:37:25.001471+0000","last_became_peered":"2023-12-04T05:37:25.001471+0000","last_unstale":"2023-12-04T05:37:26.937037+0000","last_undegraded":"2023-12-04T05:37:26.937037+0000","last_fullsized":"2023-12-04T05:37:26.937037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935348+0000","last_change":"2023-12-04T05:37:24.991168+0000","last_active":"2023-12-04T05:37:26.935348+0000","last_peered":"2023-12-04T05:37:26.935348+0000","last_clean":"2023-12-04T05:37:26.935348+0000","last_became_active":"2023-12-04T05:37:24.990517+0000","last_became_peered":"2023-12-04T05:37:24.990517+0000","last_unstale":"2023-12-04T05:37:26.935348+0000","last_undegraded":"2023-12-04T05:37:26.935348+0000","last_fullsized":"2023-12-04T05:37:26.935348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:07.947991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435177+0000","last_change":"2023-12-04T05:37:24.987512+0000","last_active":"2023-12-04T05:37:26.435177+0000","last_peered":"2023-12-04T05:37:26.435177+0000","last_clean":"2023-12-04T05:37:26.435177+0000","last_became_active":"2023-12-04T05:37:24.987236+0000","last_became_peered":"2023-12-04T05:37:24.987236+0000","last_unstale":"2023-12-04T05:37:26.435177+0000","last_undegraded":"2023-12-04T05:37:26.435177+0000","last_fullsized":"2023-12-04T05:37:26.435177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936803+0000","last_change":"2023-12-04T05:37:24.998811+0000","last_active":"2023-12-04T05:37:26.936803+0000","last_peered":"2023-12-04T05:37:26.936803+0000","last_clean":"2023-12-04T05:37:26.936803+0000","last_became_active":"2023-12-04T05:37:24.998548+0000","last_became_peered":"2023-12-04T05:37:24.998548+0000","last_unstale":"2023-12-04T05:37:26.936803+0000","last_undegraded":"2023-12-04T05:37:26.936803+0000","last_fullsized":"2023-12-04T05:37:26.936803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936685+0000","last_change":"2023-12-04T05:37:25.002873+0000","last_active":"2023-12-04T05:37:26.936685+0000","last_peered":"2023-12-04T05:37:26.936685+0000","last_clean":"2023-12-04T05:37:26.936685+0000","last_became_active":"2023-12-04T05:37:25.002555+0000","last_became_peered":"2023-12-04T05:37:25.002555+0000","last_unstale":"2023-12-04T05:37:26.936685+0000","last_undegraded":"2023-12-04T05:37:26.936685+0000","last_fullsized":"2023-12-04T05:37:26.936685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936330+0000","last_change":"2023-12-04T05:37:25.002114+0000","last_active":"2023-12-04T05:37:26.936330+0000","last_peered":"2023-12-04T05:37:26.936330+0000","last_clean":"2023-12-04T05:37:26.936330+0000","last_became_active":"2023-12-04T05:37:24.999380+0000","last_became_peered":"2023-12-04T05:37:24.999380+0000","last_unstale":"2023-12-04T05:37:26.936330+0000","last_undegraded":"2023-12-04T05:37:26.936330+0000","last_fullsized":"2023-12-04T05:37:26.936330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435546+0000","last_change":"2023-12-04T05:37:24.992143+0000","last_active":"2023-12-04T05:37:26.435546+0000","last_peered":"2023-12-04T05:37:26.435546+0000","last_clean":"2023-12-04T05:37:26.435546+0000","last_became_active":"2023-12-04T05:37:24.991537+0000","last_became_peered":"2023-12-04T05:37:24.991537+0000","last_unstale":"2023-12-04T05:37:26.435546+0000","last_undegraded":"2023-12-04T05:37:26.435546+0000","last_fullsized":"2023-12-04T05:37:26.435546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:07.720393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435359+0000","last_change":"2023-12-04T05:37:24.996641+0000","last_active":"2023-12-04T05:37:26.435359+0000","last_peered":"2023-12-04T05:37:26.435359+0000","last_clean":"2023-12-04T05:37:26.435359+0000","last_became_active":"2023-12-04T05:37:24.993802+0000","last_became_peered":"2023-12-04T05:37:24.993802+0000","last_unstale":"2023-12-04T05:37:26.435359+0000","last_undegraded":"2023-12-04T05:37:26.435359+0000","last_fullsized":"2023-12-04T05:37:26.435359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:31.280029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935757+0000","last_change":"2023-12-04T05:37:24.997746+0000","last_active":"2023-12-04T05:37:26.935757+0000","last_peered":"2023-12-04T05:37:26.935757+0000","last_clean":"2023-12-04T05:37:26.935757+0000","last_became_active":"2023-12-04T05:37:24.997501+0000","last_became_peered":"2023-12-04T05:37:24.997501+0000","last_unstale":"2023-12-04T05:37:26.935757+0000","last_undegraded":"2023-12-04T05:37:26.935757+0000","last_fullsized":"2023-12-04T05:37:26.935757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:28:18.462079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977977+0000","last_change":"2023-12-04T05:37:24.990903+0000","last_active":"2023-12-04T05:37:25.977977+0000","last_peered":"2023-12-04T05:37:25.977977+0000","last_clean":"2023-12-04T05:37:25.977977+0000","last_became_active":"2023-12-04T05:37:24.990595+0000","last_became_peered":"2023-12-04T05:37:24.990595+0000","last_unstale":"2023-12-04T05:37:25.977977+0000","last_undegraded":"2023-12-04T05:37:25.977977+0000","last_fullsized":"2023-12-04T05:37:25.977977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978281+0000","last_change":"2023-12-04T05:37:24.990315+0000","last_active":"2023-12-04T05:37:25.978281+0000","last_peered":"2023-12-04T05:37:25.978281+0000","last_clean":"2023-12-04T05:37:25.978281+0000","last_became_active":"2023-12-04T05:37:24.990020+0000","last_became_peered":"2023-12-04T05:37:24.990020+0000","last_unstale":"2023-12-04T05:37:25.978281+0000","last_undegraded":"2023-12-04T05:37:25.978281+0000","last_fullsized":"2023-12-04T05:37:25.978281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976700+0000","last_change":"2023-12-04T05:37:25.004665+0000","last_active":"2023-12-04T05:37:25.976700+0000","last_peered":"2023-12-04T05:37:25.976700+0000","last_clean":"2023-12-04T05:37:25.976700+0000","last_became_active":"2023-12-04T05:37:25.004324+0000","last_became_peered":"2023-12-04T05:37:25.004324+0000","last_unstale":"2023-12-04T05:37:25.976700+0000","last_undegraded":"2023-12-04T05:37:25.976700+0000","last_fullsized":"2023-12-04T05:37:25.976700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936028+0000","last_change":"2023-12-04T05:37:24.993347+0000","last_active":"2023-12-04T05:37:26.936028+0000","last_peered":"2023-12-04T05:37:26.936028+0000","last_clean":"2023-12-04T05:37:26.936028+0000","last_became_active":"2023-12-04T05:37:24.993089+0000","last_became_peered":"2023-12-04T05:37:24.993089+0000","last_unstale":"2023-12-04T05:37:26.936028+0000","last_undegraded":"2023-12-04T05:37:26.936028+0000","last_fullsized":"2023-12-04T05:37:26.936028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936212+0000","last_change":"2023-12-04T05:37:24.995638+0000","last_active":"2023-12-04T05:37:26.936212+0000","last_peered":"2023-12-04T05:37:26.936212+0000","last_clean":"2023-12-04T05:37:26.936212+0000","last_became_active":"2023-12-04T05:37:24.995363+0000","last_became_peered":"2023-12-04T05:37:24.995363+0000","last_unstale":"2023-12-04T05:37:26.936212+0000","last_undegraded":"2023-12-04T05:37:26.936212+0000","last_fullsized":"2023-12-04T05:37:26.936212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435536+0000","last_change":"2023-12-04T05:37:24.998832+0000","last_active":"2023-12-04T05:37:26.435536+0000","last_peered":"2023-12-04T05:37:26.435536+0000","last_clean":"2023-12-04T05:37:26.435536+0000","last_became_active":"2023-12-04T05:37:24.998544+0000","last_became_peered":"2023-12-04T05:37:24.998544+0000","last_unstale":"2023-12-04T05:37:26.435536+0000","last_undegraded":"2023-12-04T05:37:26.435536+0000","last_fullsized":"2023-12-04T05:37:26.435536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:12.838061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936137+0000","last_change":"2023-12-04T05:37:24.994373+0000","last_active":"2023-12-04T05:37:26.936137+0000","last_peered":"2023-12-04T05:37:26.936137+0000","last_clean":"2023-12-04T05:37:26.936137+0000","last_became_active":"2023-12-04T05:37:24.994052+0000","last_became_peered":"2023-12-04T05:37:24.994052+0000","last_unstale":"2023-12-04T05:37:26.936137+0000","last_undegraded":"2023-12-04T05:37:26.936137+0000","last_fullsized":"2023-12-04T05:37:26.936137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937052+0000","last_change":"2023-12-04T05:37:24.993220+0000","last_active":"2023-12-04T05:37:26.937052+0000","last_peered":"2023-12-04T05:37:26.937052+0000","last_clean":"2023-12-04T05:37:26.937052+0000","last_became_active":"2023-12-04T05:37:24.992903+0000","last_became_peered":"2023-12-04T05:37:24.992903+0000","last_unstale":"2023-12-04T05:37:26.937052+0000","last_undegraded":"2023-12-04T05:37:26.937052+0000","last_fullsized":"2023-12-04T05:37:26.937052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978681+0000","last_change":"2023-12-04T05:37:24.985403+0000","last_active":"2023-12-04T05:37:25.978681+0000","last_peered":"2023-12-04T05:37:25.978681+0000","last_clean":"2023-12-04T05:37:25.978681+0000","last_became_active":"2023-12-04T05:37:24.985108+0000","last_became_peered":"2023-12-04T05:37:24.985108+0000","last_unstale":"2023-12-04T05:37:25.978681+0000","last_undegraded":"2023-12-04T05:37:25.978681+0000","last_fullsized":"2023-12-04T05:37:25.978681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936677+0000","last_change":"2023-12-04T05:37:25.001679+0000","last_active":"2023-12-04T05:37:26.936677+0000","last_peered":"2023-12-04T05:37:26.936677+0000","last_clean":"2023-12-04T05:37:26.936677+0000","last_became_active":"2023-12-04T05:37:25.001125+0000","last_became_peered":"2023-12-04T05:37:25.001125+0000","last_unstale":"2023-12-04T05:37:26.936677+0000","last_undegraded":"2023-12-04T05:37:26.936677+0000","last_fullsized":"2023-12-04T05:37:26.936677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978027+0000","last_change":"2023-12-04T05:37:24.991739+0000","last_active":"2023-12-04T05:37:25.978027+0000","last_peered":"2023-12-04T05:37:25.978027+0000","last_clean":"2023-12-04T05:37:25.978027+0000","last_became_active":"2023-12-04T05:37:24.991386+0000","last_became_peered":"2023-12-04T05:37:24.991386+0000","last_unstale":"2023-12-04T05:37:25.978027+0000","last_undegraded":"2023-12-04T05:37:25.978027+0000","last_fullsized":"2023-12-04T05:37:25.978027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:39.738739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936820+0000","last_change":"2023-12-04T05:37:24.999330+0000","last_active":"2023-12-04T05:37:26.936820+0000","last_peered":"2023-12-04T05:37:26.936820+0000","last_clean":"2023-12-04T05:37:26.936820+0000","last_became_active":"2023-12-04T05:37:24.998449+0000","last_became_peered":"2023-12-04T05:37:24.998449+0000","last_unstale":"2023-12-04T05:37:26.936820+0000","last_undegraded":"2023-12-04T05:37:26.936820+0000","last_fullsized":"2023-12-04T05:37:26.936820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977179+0000","last_change":"2023-12-04T05:37:24.999666+0000","last_active":"2023-12-04T05:37:25.977179+0000","last_peered":"2023-12-04T05:37:25.977179+0000","last_clean":"2023-12-04T05:37:25.977179+0000","last_became_active":"2023-12-04T05:37:24.999338+0000","last_became_peered":"2023-12-04T05:37:24.999338+0000","last_unstale":"2023-12-04T05:37:25.977179+0000","last_undegraded":"2023-12-04T05:37:25.977179+0000","last_fullsized":"2023-12-04T05:37:25.977179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978974+0000","last_change":"2023-12-04T05:37:24.359031+0000","last_active":"2023-12-04T05:37:25.978974+0000","last_peered":"2023-12-04T05:37:25.978974+0000","last_clean":"2023-12-04T05:37:25.978974+0000","last_became_active":"2023-12-04T05:37:24.358600+0000","last_became_peered":"2023-12-04T05:37:24.358600+0000","last_unstale":"2023-12-04T05:37:25.978974+0000","last_undegraded":"2023-12-04T05:37:25.978974+0000","last_fullsized":"2023-12-04T05:37:25.978974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978897+0000","last_change":"2023-12-04T05:37:24.989453+0000","last_active":"2023-12-04T05:37:25.978897+0000","last_peered":"2023-12-04T05:37:25.978897+0000","last_clean":"2023-12-04T05:37:25.978897+0000","last_became_active":"2023-12-04T05:37:24.988948+0000","last_became_peered":"2023-12-04T05:37:24.988948+0000","last_unstale":"2023-12-04T05:37:25.978897+0000","last_undegraded":"2023-12-04T05:37:25.978897+0000","last_fullsized":"2023-12-04T05:37:25.978897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:14.283024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977216+0000","last_change":"2023-12-04T05:37:24.367828+0000","last_active":"2023-12-04T05:37:25.977216+0000","last_peered":"2023-12-04T05:37:25.977216+0000","last_clean":"2023-12-04T05:37:25.977216+0000","last_became_active":"2023-12-04T05:37:24.367323+0000","last_became_peered":"2023-12-04T05:37:24.367323+0000","last_unstale":"2023-12-04T05:37:25.977216+0000","last_undegraded":"2023-12-04T05:37:25.977216+0000","last_fullsized":"2023-12-04T05:37:25.977216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978301+0000","last_change":"2023-12-04T05:37:24.991648+0000","last_active":"2023-12-04T05:37:25.978301+0000","last_peered":"2023-12-04T05:37:25.978301+0000","last_clean":"2023-12-04T05:37:25.978301+0000","last_became_active":"2023-12-04T05:37:24.991299+0000","last_became_peered":"2023-12-04T05:37:24.991299+0000","last_unstale":"2023-12-04T05:37:25.978301+0000","last_undegraded":"2023-12-04T05:37:25.978301+0000","last_fullsized":"2023-12-04T05:37:25.978301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435362+0000","last_change":"2023-12-04T05:37:24.362899+0000","last_active":"2023-12-04T05:37:26.435362+0000","last_peered":"2023-12-04T05:37:26.435362+0000","last_clean":"2023-12-04T05:37:26.435362+0000","last_became_active":"2023-12-04T05:37:24.362589+0000","last_became_peered":"2023-12-04T05:37:24.362589+0000","last_unstale":"2023-12-04T05:37:26.435362+0000","last_undegraded":"2023-12-04T05:37:26.435362+0000","last_fullsized":"2023-12-04T05:37:26.435362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:52:59.772803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936149+0000","last_change":"2023-12-04T05:37:24.990915+0000","last_active":"2023-12-04T05:37:26.936149+0000","last_peered":"2023-12-04T05:37:26.936149+0000","last_clean":"2023-12-04T05:37:26.936149+0000","last_became_active":"2023-12-04T05:37:24.990302+0000","last_became_peered":"2023-12-04T05:37:24.990302+0000","last_unstale":"2023-12-04T05:37:26.936149+0000","last_undegraded":"2023-12-04T05:37:26.936149+0000","last_fullsized":"2023-12-04T05:37:26.936149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935831+0000","last_change":"2023-12-04T05:37:24.353356+0000","last_active":"2023-12-04T05:37:26.935831+0000","last_peered":"2023-12-04T05:37:26.935831+0000","last_clean":"2023-12-04T05:37:26.935831+0000","last_became_active":"2023-12-04T05:37:24.353060+0000","last_became_peered":"2023-12-04T05:37:24.353060+0000","last_unstale":"2023-12-04T05:37:26.935831+0000","last_undegraded":"2023-12-04T05:37:26.935831+0000","last_fullsized":"2023-12-04T05:37:26.935831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:15.976925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936544+0000","last_change":"2023-12-04T05:37:25.001831+0000","last_active":"2023-12-04T05:37:26.936544+0000","last_peered":"2023-12-04T05:37:26.936544+0000","last_clean":"2023-12-04T05:37:26.936544+0000","last_became_active":"2023-12-04T05:37:25.001421+0000","last_became_peered":"2023-12-04T05:37:25.001421+0000","last_unstale":"2023-12-04T05:37:26.936544+0000","last_undegraded":"2023-12-04T05:37:26.936544+0000","last_fullsized":"2023-12-04T05:37:26.936544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978100+0000","last_change":"2023-12-04T05:37:24.361558+0000","last_active":"2023-12-04T05:37:25.978100+0000","last_peered":"2023-12-04T05:37:25.978100+0000","last_clean":"2023-12-04T05:37:25.978100+0000","last_became_active":"2023-12-04T05:37:24.361213+0000","last_became_peered":"2023-12-04T05:37:24.361213+0000","last_unstale":"2023-12-04T05:37:25.978100+0000","last_undegraded":"2023-12-04T05:37:25.978100+0000","last_fullsized":"2023-12-04T05:37:25.978100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936518+0000","last_change":"2023-12-04T05:37:24.998367+0000","last_active":"2023-12-04T05:37:26.936518+0000","last_peered":"2023-12-04T05:37:26.936518+0000","last_clean":"2023-12-04T05:37:26.936518+0000","last_became_active":"2023-12-04T05:37:24.997864+0000","last_became_peered":"2023-12-04T05:37:24.997864+0000","last_unstale":"2023-12-04T05:37:26.936518+0000","last_undegraded":"2023-12-04T05:37:26.936518+0000","last_fullsized":"2023-12-04T05:37:26.936518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978370+0000","last_change":"2023-12-04T05:37:24.362048+0000","last_active":"2023-12-04T05:37:25.978370+0000","last_peered":"2023-12-04T05:37:25.978370+0000","last_clean":"2023-12-04T05:37:25.978370+0000","last_became_active":"2023-12-04T05:37:24.361734+0000","last_became_peered":"2023-12-04T05:37:24.361734+0000","last_unstale":"2023-12-04T05:37:25.978370+0000","last_undegraded":"2023-12-04T05:37:25.978370+0000","last_fullsized":"2023-12-04T05:37:25.978370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977876+0000","last_change":"2023-12-04T05:37:24.981306+0000","last_active":"2023-12-04T05:37:25.977876+0000","last_peered":"2023-12-04T05:37:25.977876+0000","last_clean":"2023-12-04T05:37:25.977876+0000","last_became_active":"2023-12-04T05:37:24.980836+0000","last_became_peered":"2023-12-04T05:37:24.980836+0000","last_unstale":"2023-12-04T05:37:25.977876+0000","last_undegraded":"2023-12-04T05:37:25.977876+0000","last_fullsized":"2023-12-04T05:37:25.977876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435095+0000","last_change":"2023-12-04T05:37:24.360838+0000","last_active":"2023-12-04T05:37:26.435095+0000","last_peered":"2023-12-04T05:37:26.435095+0000","last_clean":"2023-12-04T05:37:26.435095+0000","last_became_active":"2023-12-04T05:37:24.360507+0000","last_became_peered":"2023-12-04T05:37:24.360507+0000","last_unstale":"2023-12-04T05:37:26.435095+0000","last_undegraded":"2023-12-04T05:37:26.435095+0000","last_fullsized":"2023-12-04T05:37:26.435095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935760+0000","last_change":"2023-12-04T05:37:24.996089+0000","last_active":"2023-12-04T05:37:26.935760+0000","last_peered":"2023-12-04T05:37:26.935760+0000","last_clean":"2023-12-04T05:37:26.935760+0000","last_became_active":"2023-12-04T05:37:24.995809+0000","last_became_peered":"2023-12-04T05:37:24.995809+0000","last_unstale":"2023-12-04T05:37:26.935760+0000","last_undegraded":"2023-12-04T05:37:26.935760+0000","last_fullsized":"2023-12-04T05:37:26.935760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977969+0000","last_change":"2023-12-04T05:37:24.354659+0000","last_active":"2023-12-04T05:37:25.977969+0000","last_peered":"2023-12-04T05:37:25.977969+0000","last_clean":"2023-12-04T05:37:25.977969+0000","last_became_active":"2023-12-04T05:37:24.354363+0000","last_became_peered":"2023-12-04T05:37:24.354363+0000","last_unstale":"2023-12-04T05:37:25.977969+0000","last_undegraded":"2023-12-04T05:37:25.977969+0000","last_fullsized":"2023-12-04T05:37:25.977969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937180+0000","last_change":"2023-12-04T05:37:24.999935+0000","last_active":"2023-12-04T05:37:26.937180+0000","last_peered":"2023-12-04T05:37:26.937180+0000","last_clean":"2023-12-04T05:37:26.937180+0000","last_became_active":"2023-12-04T05:37:24.999626+0000","last_became_peered":"2023-12-04T05:37:24.999626+0000","last_unstale":"2023-12-04T05:37:26.937180+0000","last_undegraded":"2023-12-04T05:37:26.937180+0000","last_fullsized":"2023-12-04T05:37:26.937180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435712+0000","last_change":"2023-12-04T05:37:24.367803+0000","last_active":"2023-12-04T05:37:26.435712+0000","last_peered":"2023-12-04T05:37:26.435712+0000","last_clean":"2023-12-04T05:37:26.435712+0000","last_became_active":"2023-12-04T05:37:24.367420+0000","last_became_peered":"2023-12-04T05:37:24.367420+0000","last_unstale":"2023-12-04T05:37:26.435712+0000","last_undegraded":"2023-12-04T05:37:26.435712+0000","last_fullsized":"2023-12-04T05:37:26.435712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:24.234900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435660+0000","last_change":"2023-12-04T05:37:24.996824+0000","last_active":"2023-12-04T05:37:26.435660+0000","last_peered":"2023-12-04T05:37:26.435660+0000","last_clean":"2023-12-04T05:37:26.435660+0000","last_became_active":"2023-12-04T05:37:24.996612+0000","last_became_peered":"2023-12-04T05:37:24.996612+0000","last_unstale":"2023-12-04T05:37:26.435660+0000","last_undegraded":"2023-12-04T05:37:26.435660+0000","last_fullsized":"2023-12-04T05:37:26.435660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:17.183378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977265+0000","last_change":"2023-12-04T05:37:24.364875+0000","last_active":"2023-12-04T05:37:25.977265+0000","last_peered":"2023-12-04T05:37:25.977265+0000","last_clean":"2023-12-04T05:37:25.977265+0000","last_became_active":"2023-12-04T05:37:24.364601+0000","last_became_peered":"2023-12-04T05:37:24.364601+0000","last_unstale":"2023-12-04T05:37:25.977265+0000","last_undegraded":"2023-12-04T05:37:25.977265+0000","last_fullsized":"2023-12-04T05:37:25.977265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435395+0000","last_change":"2023-12-04T05:37:25.006262+0000","last_active":"2023-12-04T05:37:26.435395+0000","last_peered":"2023-12-04T05:37:26.435395+0000","last_clean":"2023-12-04T05:37:26.435395+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:26.435395+0000","last_undegraded":"2023-12-04T05:37:26.435395+0000","last_fullsized":"2023-12-04T05:37:26.435395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:30:51.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937265+0000","last_change":"2023-12-04T05:37:24.360821+0000","last_active":"2023-12-04T05:37:26.937265+0000","last_peered":"2023-12-04T05:37:26.937265+0000","last_clean":"2023-12-04T05:37:26.937265+0000","last_became_active":"2023-12-04T05:37:24.360531+0000","last_became_peered":"2023-12-04T05:37:24.360531+0000","last_unstale":"2023-12-04T05:37:26.937265+0000","last_undegraded":"2023-12-04T05:37:26.937265+0000","last_fullsized":"2023-12-04T05:37:26.937265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937151+0000","last_change":"2023-12-04T05:37:24.997014+0000","last_active":"2023-12-04T05:37:26.937151+0000","last_peered":"2023-12-04T05:37:26.937151+0000","last_clean":"2023-12-04T05:37:26.937151+0000","last_became_active":"2023-12-04T05:37:24.996398+0000","last_became_peered":"2023-12-04T05:37:24.996398+0000","last_unstale":"2023-12-04T05:37:26.937151+0000","last_undegraded":"2023-12-04T05:37:26.937151+0000","last_fullsized":"2023-12-04T05:37:26.937151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435404+0000","last_change":"2023-12-04T05:37:24.355898+0000","last_active":"2023-12-04T05:37:26.435404+0000","last_peered":"2023-12-04T05:37:26.435404+0000","last_clean":"2023-12-04T05:37:26.435404+0000","last_became_active":"2023-12-04T05:37:24.355292+0000","last_became_peered":"2023-12-04T05:37:24.355292+0000","last_unstale":"2023-12-04T05:37:26.435404+0000","last_undegraded":"2023-12-04T05:37:26.435404+0000","last_fullsized":"2023-12-04T05:37:26.435404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:42.819254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935617+0000","last_change":"2023-12-04T05:37:24.995114+0000","last_active":"2023-12-04T05:37:26.935617+0000","last_peered":"2023-12-04T05:37:26.935617+0000","last_clean":"2023-12-04T05:37:26.935617+0000","last_became_active":"2023-12-04T05:37:24.994792+0000","last_became_peered":"2023-12-04T05:37:24.994792+0000","last_unstale":"2023-12-04T05:37:26.935617+0000","last_undegraded":"2023-12-04T05:37:26.935617+0000","last_fullsized":"2023-12-04T05:37:26.935617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978235+0000","last_change":"2023-12-04T05:37:24.354980+0000","last_active":"2023-12-04T05:37:25.978235+0000","last_peered":"2023-12-04T05:37:25.978235+0000","last_clean":"2023-12-04T05:37:25.978235+0000","last_became_active":"2023-12-04T05:37:24.354672+0000","last_became_peered":"2023-12-04T05:37:24.354672+0000","last_unstale":"2023-12-04T05:37:25.978235+0000","last_undegraded":"2023-12-04T05:37:25.978235+0000","last_fullsized":"2023-12-04T05:37:25.978235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435328+0000","last_change":"2023-12-04T05:37:24.990852+0000","last_active":"2023-12-04T05:37:26.435328+0000","last_peered":"2023-12-04T05:37:26.435328+0000","last_clean":"2023-12-04T05:37:26.435328+0000","last_became_active":"2023-12-04T05:37:24.990594+0000","last_became_peered":"2023-12-04T05:37:24.990594+0000","last_unstale":"2023-12-04T05:37:26.435328+0000","last_undegraded":"2023-12-04T05:37:26.435328+0000","last_fullsized":"2023-12-04T05:37:26.435328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935694+0000","last_change":"2023-12-04T05:37:24.355867+0000","last_active":"2023-12-04T05:37:26.935694+0000","last_peered":"2023-12-04T05:37:26.935694+0000","last_clean":"2023-12-04T05:37:26.935694+0000","last_became_active":"2023-12-04T05:37:24.354909+0000","last_became_peered":"2023-12-04T05:37:24.354909+0000","last_unstale":"2023-12-04T05:37:26.935694+0000","last_undegraded":"2023-12-04T05:37:26.935694+0000","last_fullsized":"2023-12-04T05:37:26.935694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936368+0000","last_change":"2023-12-04T05:37:25.001941+0000","last_active":"2023-12-04T05:37:26.936368+0000","last_peered":"2023-12-04T05:37:26.936368+0000","last_clean":"2023-12-04T05:37:26.936368+0000","last_became_active":"2023-12-04T05:37:24.998768+0000","last_became_peered":"2023-12-04T05:37:24.998768+0000","last_unstale":"2023-12-04T05:37:26.936368+0000","last_undegraded":"2023-12-04T05:37:26.936368+0000","last_fullsized":"2023-12-04T05:37:26.936368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435017+0000","last_change":"2023-12-04T05:37:24.365982+0000","last_active":"2023-12-04T05:37:26.435017+0000","last_peered":"2023-12-04T05:37:26.435017+0000","last_clean":"2023-12-04T05:37:26.435017+0000","last_became_active":"2023-12-04T05:37:24.365700+0000","last_became_peered":"2023-12-04T05:37:24.365700+0000","last_unstale":"2023-12-04T05:37:26.435017+0000","last_undegraded":"2023-12-04T05:37:26.435017+0000","last_fullsized":"2023-12-04T05:37:26.435017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978190+0000","last_change":"2023-12-04T05:37:24.987969+0000","last_active":"2023-12-04T05:37:25.978190+0000","last_peered":"2023-12-04T05:37:25.978190+0000","last_clean":"2023-12-04T05:37:25.978190+0000","last_became_active":"2023-12-04T05:37:24.986483+0000","last_became_peered":"2023-12-04T05:37:24.986483+0000","last_unstale":"2023-12-04T05:37:25.978190+0000","last_undegraded":"2023-12-04T05:37:25.978190+0000","last_fullsized":"2023-12-04T05:37:25.978190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:29.179535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435125+0000","last_change":"2023-12-04T05:37:24.370452+0000","last_active":"2023-12-04T05:37:26.435125+0000","last_peered":"2023-12-04T05:37:26.435125+0000","last_clean":"2023-12-04T05:37:26.435125+0000","last_became_active":"2023-12-04T05:37:24.369542+0000","last_became_peered":"2023-12-04T05:37:24.369542+0000","last_unstale":"2023-12-04T05:37:26.435125+0000","last_undegraded":"2023-12-04T05:37:26.435125+0000","last_fullsized":"2023-12-04T05:37:26.435125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:04.466402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978466+0000","last_change":"2023-12-04T05:37:24.991803+0000","last_active":"2023-12-04T05:37:25.978466+0000","last_peered":"2023-12-04T05:37:25.978466+0000","last_clean":"2023-12-04T05:37:25.978466+0000","last_became_active":"2023-12-04T05:37:24.991546+0000","last_became_peered":"2023-12-04T05:37:24.991546+0000","last_unstale":"2023-12-04T05:37:25.978466+0000","last_undegraded":"2023-12-04T05:37:25.978466+0000","last_fullsized":"2023-12-04T05:37:25.978466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936211+0000","last_change":"2023-12-04T05:37:24.364783+0000","last_active":"2023-12-04T05:37:26.936211+0000","last_peered":"2023-12-04T05:37:26.936211+0000","last_clean":"2023-12-04T05:37:26.936211+0000","last_became_active":"2023-12-04T05:37:24.364459+0000","last_became_peered":"2023-12-04T05:37:24.364459+0000","last_unstale":"2023-12-04T05:37:26.936211+0000","last_undegraded":"2023-12-04T05:37:26.936211+0000","last_fullsized":"2023-12-04T05:37:26.936211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:33.747521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937301+0000","last_change":"2023-12-04T05:37:24.995956+0000","last_active":"2023-12-04T05:37:26.937301+0000","last_peered":"2023-12-04T05:37:26.937301+0000","last_clean":"2023-12-04T05:37:26.937301+0000","last_became_active":"2023-12-04T05:37:24.995700+0000","last_became_peered":"2023-12-04T05:37:24.995700+0000","last_unstale":"2023-12-04T05:37:26.937301+0000","last_undegraded":"2023-12-04T05:37:26.937301+0000","last_fullsized":"2023-12-04T05:37:26.937301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978606+0000","last_change":"2023-12-04T05:37:24.354656+0000","last_active":"2023-12-04T05:37:25.978606+0000","last_peered":"2023-12-04T05:37:25.978606+0000","last_clean":"2023-12-04T05:37:25.978606+0000","last_became_active":"2023-12-04T05:37:24.354318+0000","last_became_peered":"2023-12-04T05:37:24.354318+0000","last_unstale":"2023-12-04T05:37:25.978606+0000","last_undegraded":"2023-12-04T05:37:25.978606+0000","last_fullsized":"2023-12-04T05:37:25.978606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:38.730683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935841+0000","last_change":"2023-12-04T05:37:24.990874+0000","last_active":"2023-12-04T05:37:26.935841+0000","last_peered":"2023-12-04T05:37:26.935841+0000","last_clean":"2023-12-04T05:37:26.935841+0000","last_became_active":"2023-12-04T05:37:24.990607+0000","last_became_peered":"2023-12-04T05:37:24.990607+0000","last_unstale":"2023-12-04T05:37:26.935841+0000","last_undegraded":"2023-12-04T05:37:26.935841+0000","last_fullsized":"2023-12-04T05:37:26.935841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978682+0000","last_change":"2023-12-04T05:37:24.363195+0000","last_active":"2023-12-04T05:37:25.978682+0000","last_peered":"2023-12-04T05:37:25.978682+0000","last_clean":"2023-12-04T05:37:25.978682+0000","last_became_active":"2023-12-04T05:37:24.362877+0000","last_became_peered":"2023-12-04T05:37:24.362877+0000","last_unstale":"2023-12-04T05:37:25.978682+0000","last_undegraded":"2023-12-04T05:37:25.978682+0000","last_fullsized":"2023-12-04T05:37:25.978682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935593+0000","last_change":"2023-12-04T05:37:25.005282+0000","last_active":"2023-12-04T05:37:26.935593+0000","last_peered":"2023-12-04T05:37:26.935593+0000","last_clean":"2023-12-04T05:37:26.935593+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:26.935593+0000","last_undegraded":"2023-12-04T05:37:26.935593+0000","last_fullsized":"2023-12-04T05:37:26.935593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:34.046063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978320+0000","last_change":"2023-12-04T05:37:24.364787+0000","last_active":"2023-12-04T05:37:25.978320+0000","last_peered":"2023-12-04T05:37:25.978320+0000","last_clean":"2023-12-04T05:37:25.978320+0000","last_became_active":"2023-12-04T05:37:24.364366+0000","last_became_peered":"2023-12-04T05:37:24.364366+0000","last_unstale":"2023-12-04T05:37:25.978320+0000","last_undegraded":"2023-12-04T05:37:25.978320+0000","last_fullsized":"2023-12-04T05:37:25.978320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935382+0000","last_change":"2023-12-04T05:37:24.992633+0000","last_active":"2023-12-04T05:37:26.935382+0000","last_peered":"2023-12-04T05:37:26.935382+0000","last_clean":"2023-12-04T05:37:26.935382+0000","last_became_active":"2023-12-04T05:37:24.992377+0000","last_became_peered":"2023-12-04T05:37:24.992377+0000","last_unstale":"2023-12-04T05:37:26.935382+0000","last_undegraded":"2023-12-04T05:37:26.935382+0000","last_fullsized":"2023-12-04T05:37:26.935382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:42.675557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976848+0000","last_change":"2023-12-04T05:37:24.355658+0000","last_active":"2023-12-04T05:37:25.976848+0000","last_peered":"2023-12-04T05:37:25.976848+0000","last_clean":"2023-12-04T05:37:25.976848+0000","last_became_active":"2023-12-04T05:37:24.353902+0000","last_became_peered":"2023-12-04T05:37:24.353902+0000","last_unstale":"2023-12-04T05:37:25.976848+0000","last_undegraded":"2023-12-04T05:37:25.976848+0000","last_fullsized":"2023-12-04T05:37:25.976848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935497+0000","last_change":"2023-12-04T05:37:24.991115+0000","last_active":"2023-12-04T05:37:26.935497+0000","last_peered":"2023-12-04T05:37:26.935497+0000","last_clean":"2023-12-04T05:37:26.935497+0000","last_became_active":"2023-12-04T05:37:24.990185+0000","last_became_peered":"2023-12-04T05:37:24.990185+0000","last_unstale":"2023-12-04T05:37:26.935497+0000","last_undegraded":"2023-12-04T05:37:26.935497+0000","last_fullsized":"2023-12-04T05:37:26.935497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:41:57.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978404+0000","last_change":"2023-12-04T05:37:24.368752+0000","last_active":"2023-12-04T05:37:25.978404+0000","last_peered":"2023-12-04T05:37:25.978404+0000","last_clean":"2023-12-04T05:37:25.978404+0000","last_became_active":"2023-12-04T05:37:24.368382+0000","last_became_peered":"2023-12-04T05:37:24.368382+0000","last_unstale":"2023-12-04T05:37:25.978404+0000","last_undegraded":"2023-12-04T05:37:25.978404+0000","last_fullsized":"2023-12-04T05:37:25.978404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935340+0000","last_change":"2023-12-04T05:37:24.989600+0000","last_active":"2023-12-04T05:37:26.935340+0000","last_peered":"2023-12-04T05:37:26.935340+0000","last_clean":"2023-12-04T05:37:26.935340+0000","last_became_active":"2023-12-04T05:37:24.989332+0000","last_became_peered":"2023-12-04T05:37:24.989332+0000","last_unstale":"2023-12-04T05:37:26.935340+0000","last_undegraded":"2023-12-04T05:37:26.935340+0000","last_fullsized":"2023-12-04T05:37:26.935340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:25:59.290418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978231+0000","last_change":"2023-12-04T05:37:24.364075+0000","last_active":"2023-12-04T05:37:25.978231+0000","last_peered":"2023-12-04T05:37:25.978231+0000","last_clean":"2023-12-04T05:37:25.978231+0000","last_became_active":"2023-12-04T05:37:24.363742+0000","last_became_peered":"2023-12-04T05:37:24.363742+0000","last_unstale":"2023-12-04T05:37:25.978231+0000","last_undegraded":"2023-12-04T05:37:25.978231+0000","last_fullsized":"2023-12-04T05:37:25.978231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936256+0000","last_change":"2023-12-04T05:37:25.001416+0000","last_active":"2023-12-04T05:37:26.936256+0000","last_peered":"2023-12-04T05:37:26.936256+0000","last_clean":"2023-12-04T05:37:26.936256+0000","last_became_active":"2023-12-04T05:37:25.001105+0000","last_became_peered":"2023-12-04T05:37:25.001105+0000","last_unstale":"2023-12-04T05:37:26.936256+0000","last_undegraded":"2023-12-04T05:37:26.936256+0000","last_fullsized":"2023-12-04T05:37:26.936256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936256+0000","last_change":"2023-12-04T05:37:24.365259+0000","last_active":"2023-12-04T05:37:26.936256+0000","last_peered":"2023-12-04T05:37:26.936256+0000","last_clean":"2023-12-04T05:37:26.936256+0000","last_became_active":"2023-12-04T05:37:24.364959+0000","last_became_peered":"2023-12-04T05:37:24.364959+0000","last_unstale":"2023-12-04T05:37:26.936256+0000","last_undegraded":"2023-12-04T05:37:26.936256+0000","last_fullsized":"2023-12-04T05:37:26.936256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935894+0000","last_change":"2023-12-04T05:37:24.993427+0000","last_active":"2023-12-04T05:37:26.935894+0000","last_peered":"2023-12-04T05:37:26.935894+0000","last_clean":"2023-12-04T05:37:26.935894+0000","last_became_active":"2023-12-04T05:37:24.993085+0000","last_became_peered":"2023-12-04T05:37:24.993085+0000","last_unstale":"2023-12-04T05:37:26.935894+0000","last_undegraded":"2023-12-04T05:37:26.935894+0000","last_fullsized":"2023-12-04T05:37:26.935894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:01:20.885419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936274+0000","last_change":"2023-12-04T05:37:24.363906+0000","last_active":"2023-12-04T05:37:26.936274+0000","last_peered":"2023-12-04T05:37:26.936274+0000","last_clean":"2023-12-04T05:37:26.936274+0000","last_became_active":"2023-12-04T05:37:24.363600+0000","last_became_peered":"2023-12-04T05:37:24.363600+0000","last_unstale":"2023-12-04T05:37:26.936274+0000","last_undegraded":"2023-12-04T05:37:26.936274+0000","last_fullsized":"2023-12-04T05:37:26.936274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:40.789742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937311+0000","last_change":"2023-12-04T05:37:24.997150+0000","last_active":"2023-12-04T05:37:26.937311+0000","last_peered":"2023-12-04T05:37:26.937311+0000","last_clean":"2023-12-04T05:37:26.937311+0000","last_became_active":"2023-12-04T05:37:24.996748+0000","last_became_peered":"2023-12-04T05:37:24.996748+0000","last_unstale":"2023-12-04T05:37:26.937311+0000","last_undegraded":"2023-12-04T05:37:26.937311+0000","last_fullsized":"2023-12-04T05:37:26.937311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:27.491973+0000","last_change":"2023-12-04T05:37:24.366158+0000","last_active":"2023-12-04T05:37:27.491973+0000","last_peered":"2023-12-04T05:37:27.491973+0000","last_clean":"2023-12-04T05:37:27.491973+0000","last_became_active":"2023-12-04T05:37:24.365900+0000","last_became_peered":"2023-12-04T05:37:24.365900+0000","last_unstale":"2023-12-04T05:37:27.491973+0000","last_undegraded":"2023-12-04T05:37:27.491973+0000","last_fullsized":"2023-12-04T05:37:27.491973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977113+0000","last_change":"2023-12-04T05:37:24.985398+0000","last_active":"2023-12-04T05:37:25.977113+0000","last_peered":"2023-12-04T05:37:25.977113+0000","last_clean":"2023-12-04T05:37:25.977113+0000","last_became_active":"2023-12-04T05:37:24.985152+0000","last_became_peered":"2023-12-04T05:37:24.985152+0000","last_unstale":"2023-12-04T05:37:25.977113+0000","last_undegraded":"2023-12-04T05:37:25.977113+0000","last_fullsized":"2023-12-04T05:37:25.977113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935962+0000","last_change":"2023-12-04T05:37:24.363919+0000","last_active":"2023-12-04T05:37:26.935962+0000","last_peered":"2023-12-04T05:37:26.935962+0000","last_clean":"2023-12-04T05:37:26.935962+0000","last_became_active":"2023-12-04T05:37:24.363592+0000","last_became_peered":"2023-12-04T05:37:24.363592+0000","last_unstale":"2023-12-04T05:37:26.935962+0000","last_undegraded":"2023-12-04T05:37:26.935962+0000","last_fullsized":"2023-12-04T05:37:26.935962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978321+0000","last_change":"2023-12-04T05:37:24.993989+0000","last_active":"2023-12-04T05:37:25.978321+0000","last_peered":"2023-12-04T05:37:25.978321+0000","last_clean":"2023-12-04T05:37:25.978321+0000","last_became_active":"2023-12-04T05:37:24.990547+0000","last_became_peered":"2023-12-04T05:37:24.990547+0000","last_unstale":"2023-12-04T05:37:25.978321+0000","last_undegraded":"2023-12-04T05:37:25.978321+0000","last_fullsized":"2023-12-04T05:37:25.978321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:18.892510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976949+0000","last_change":"2023-12-04T05:37:24.362595+0000","last_active":"2023-12-04T05:37:25.976949+0000","last_peered":"2023-12-04T05:37:25.976949+0000","last_clean":"2023-12-04T05:37:25.976949+0000","last_became_active":"2023-12-04T05:37:24.361717+0000","last_became_peered":"2023-12-04T05:37:24.361717+0000","last_unstale":"2023-12-04T05:37:25.976949+0000","last_undegraded":"2023-12-04T05:37:25.976949+0000","last_fullsized":"2023-12-04T05:37:25.976949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976825+0000","last_change":"2023-12-04T05:37:24.985550+0000","last_active":"2023-12-04T05:37:25.976825+0000","last_peered":"2023-12-04T05:37:25.976825+0000","last_clean":"2023-12-04T05:37:25.976825+0000","last_became_active":"2023-12-04T05:37:24.984659+0000","last_became_peered":"2023-12-04T05:37:24.984659+0000","last_unstale":"2023-12-04T05:37:25.976825+0000","last_undegraded":"2023-12-04T05:37:25.976825+0000","last_fullsized":"2023-12-04T05:37:25.976825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935776+0000","last_change":"2023-12-04T05:37:24.365186+0000","last_active":"2023-12-04T05:37:26.935776+0000","last_peered":"2023-12-04T05:37:26.935776+0000","last_clean":"2023-12-04T05:37:26.935776+0000","last_became_active":"2023-12-04T05:37:24.360434+0000","last_became_peered":"2023-12-04T05:37:24.360434+0000","last_unstale":"2023-12-04T05:37:26.935776+0000","last_undegraded":"2023-12-04T05:37:26.935776+0000","last_fullsized":"2023-12-04T05:37:26.935776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435041+0000","last_change":"2023-12-04T05:37:24.989352+0000","last_active":"2023-12-04T05:37:26.435041+0000","last_peered":"2023-12-04T05:37:26.435041+0000","last_clean":"2023-12-04T05:37:26.435041+0000","last_became_active":"2023-12-04T05:37:24.987078+0000","last_became_peered":"2023-12-04T05:37:24.987078+0000","last_unstale":"2023-12-04T05:37:26.435041+0000","last_undegraded":"2023-12-04T05:37:26.435041+0000","last_fullsized":"2023-12-04T05:37:26.435041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978627+0000","last_change":"2023-12-04T05:37:24.356767+0000","last_active":"2023-12-04T05:37:25.978627+0000","last_peered":"2023-12-04T05:37:25.978627+0000","last_clean":"2023-12-04T05:37:25.978627+0000","last_became_active":"2023-12-04T05:37:24.356474+0000","last_became_peered":"2023-12-04T05:37:24.356474+0000","last_unstale":"2023-12-04T05:37:25.978627+0000","last_undegraded":"2023-12-04T05:37:25.978627+0000","last_fullsized":"2023-12-04T05:37:25.978627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978127+0000","last_change":"2023-12-04T05:37:24.990350+0000","last_active":"2023-12-04T05:37:25.978127+0000","last_peered":"2023-12-04T05:37:25.978127+0000","last_clean":"2023-12-04T05:37:25.978127+0000","last_became_active":"2023-12-04T05:37:24.990101+0000","last_became_peered":"2023-12-04T05:37:24.990101+0000","last_unstale":"2023-12-04T05:37:25.978127+0000","last_undegraded":"2023-12-04T05:37:25.978127+0000","last_fullsized":"2023-12-04T05:37:25.978127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435049+0000","last_change":"2023-12-04T05:37:24.365579+0000","last_active":"2023-12-04T05:37:26.435049+0000","last_peered":"2023-12-04T05:37:26.435049+0000","last_clean":"2023-12-04T05:37:26.435049+0000","last_became_active":"2023-12-04T05:37:24.364918+0000","last_became_peered":"2023-12-04T05:37:24.364918+0000","last_unstale":"2023-12-04T05:37:26.435049+0000","last_undegraded":"2023-12-04T05:37:26.435049+0000","last_fullsized":"2023-12-04T05:37:26.435049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:07.118802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936395+0000","last_change":"2023-12-04T05:37:25.001807+0000","last_active":"2023-12-04T05:37:26.936395+0000","last_peered":"2023-12-04T05:37:26.936395+0000","last_clean":"2023-12-04T05:37:26.936395+0000","last_became_active":"2023-12-04T05:37:24.999364+0000","last_became_peered":"2023-12-04T05:37:24.999364+0000","last_unstale":"2023-12-04T05:37:26.936395+0000","last_undegraded":"2023-12-04T05:37:26.936395+0000","last_fullsized":"2023-12-04T05:37:26.936395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978531+0000","last_change":"2023-12-04T05:37:24.361054+0000","last_active":"2023-12-04T05:37:25.978531+0000","last_peered":"2023-12-04T05:37:25.978531+0000","last_clean":"2023-12-04T05:37:25.978531+0000","last_became_active":"2023-12-04T05:37:24.360700+0000","last_became_peered":"2023-12-04T05:37:24.360700+0000","last_unstale":"2023-12-04T05:37:25.978531+0000","last_undegraded":"2023-12-04T05:37:25.978531+0000","last_fullsized":"2023-12-04T05:37:25.978531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-04T05:37:24.984931+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:24.984931+0000","last_peered":"2023-12-04T05:37:24.984931+0000","last_clean":"2023-12-04T05:37:24.984931+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:24.984931+0000","last_undegraded":"2023-12-04T05:37:24.984931+0000","last_fullsized":"2023-12-04T05:37:24.984931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68300000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":724470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:33.333 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:37:33.337 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:37:33.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:34.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 Processor -- start 2023-12-04T05:37:34.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 -- start start 2023-12-04T05:37:34.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 0x7fa3f80c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 0x7fa3f8151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f80739b0 con 0x7fa3f8152090 2023-12-04T05:37:34.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80c15a0 con 0x7fa3f806b860 2023-12-04T05:37:34.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fefaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8155220 con 0x7fa3f80c1030 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fcd46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 0x7fa3f80c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3effff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 0x7fa3f8151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fd547640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa3f8152090 0x7fa3f8157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:45852/0 (socket says 172.21.15.97:45852) 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fd547640 1 -- 172.21.15.97:0/1817221614 learned_addr learned my addr 172.21.15.97:0/1817221614 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3ef7fe640 1 -- 172.21.15.97:0/1817221614 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125604134 0 0) 0x7fa3f80739b0 con 0x7fa3f8152090 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3ef7fe640 1 -- 172.21.15.97:0/1817221614 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e0003530 con 0x7fa3f8152090 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3effff640 1 -- 172.21.15.97:0/1817221614 >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 msgr2=0x7fa3f80c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3effff640 1 --2- 172.21.15.97:0/1817221614 >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 0x7fa3f80c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3effff640 1 -- 172.21.15.97:0/1817221614 >> v1:172.21.15.143:6789/0 conn(0x7fa3f8152090 legacy=0x7fa3f8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3effff640 1 -- 172.21.15.97:0/1817221614 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8155710 con 0x7fa3f80c1030 2023-12-04T05:37:34.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.070+0000 7fa3fcd46640 1 --2- 172.21.15.97:0/1817221614 >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 0x7fa3f80c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:34.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3effff640 1 --2- 172.21.15.97:0/1817221614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 0x7fa3f8151b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80097c0 tx=0x7fa3e801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a114a8ba23e0a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3ef7fe640 1 -- 172.21.15.97:0/1817221614 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80ab600 con 0x7fa3f80c1030 2023-12-04T05:37:34.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3ef7fe640 1 -- 172.21.15.97:0/1817221614 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e80a7050 con 0x7fa3f80c1030 2023-12-04T05:37:34.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3ef7fe640 1 -- 172.21.15.97:0/1817221614 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80ab980 con 0x7fa3f80c1030 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 -- 172.21.15.97:0/1817221614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 msgr2=0x7fa3f8151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/1817221614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 0x7fa3f8151b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80097c0 tx=0x7fa3e801c3f0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 -- 172.21.15.97:0/1817221614 shutdown_connections 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/1817221614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c1030 0x7fa3f8151b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/1817221614 >> v2:172.21.15.143:3300/0 conn(0x7fa3f806b860 0x7fa3f80c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 -- 172.21.15.97:0/1817221614 >> 172.21.15.97:0/1817221614 conn(0x7fa3f80c3130 msgr2=0x7fa3f80c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 -- 172.21.15.97:0/1817221614 shutdown_connections 2023-12-04T05:37:34.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.074+0000 7fa3fefaa640 1 -- 172.21.15.97:0/1817221614 wait complete. 2023-12-04T05:37:34.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 Processor -- start 2023-12-04T05:37:34.081 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 -- start start 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c1030 0x7fa3f814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8152090 0x7fa3f81ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80a7e80 con 0x7fa3f806b860 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81f0cb0 con 0x7fa3f80c1030 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81f0f90 con 0x7fa3f8152090 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:44512/0 (socket says 172.21.15.97:44512) 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 -- 172.21.15.97:0/4036050221 learned_addr learned my addr 172.21.15.97:0/4036050221 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:34.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fd547640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8152090 0x7fa3f81ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3effff640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c1030 0x7fa3f814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 -- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8152090 msgr2=0x7fa3f81ecc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8152090 0x7fa3f81ecc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 -- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c1030 msgr2=0x7fa3f814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c1030 0x7fa3f814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 -- 172.21.15.97:0/4036050221 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009420 con 0x7fa3f806b860 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fcd46640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ebe0 tx=0x7fa3f400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400eee0 con 0x7fa3f806b860 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400cc30 con 0x7fa3f806b860 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8009420 con 0x7fa3f806b860 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.078+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4013470 con 0x7fa3f806b860 2023-12-04T05:37:34.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f814b960 con 0x7fa3f806b860 2023-12-04T05:37:34.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f8072c70 con 0x7fa3f806b860 2023-12-04T05:37:34.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3f40135d0 con 0x7fa3f806b860 2023-12-04T05:37:34.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3ed7fa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 0x7fa3e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3f4084730 con 0x7fa3f806b860 2023-12-04T05:37:34.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.082+0000 7fa3effff640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 0x7fa3e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.086+0000 7fa3effff640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 0x7fa3e4068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80ad000 tx=0x7fa3e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.086+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3f4051980 con 0x7fa3f806b860 2023-12-04T05:37:34.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.234+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3f814b500 con 0x7fa3e40668d0 2023-12-04T05:37:34.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.242+0000 7fa3ed7fa640 1 -- 172.21.15.97:0/4036050221 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289365 (secure 0 0 0) 0x7fa3e80ab6a0 con 0x7fa3e40668d0 2023-12-04T05:37:34.251 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:34.252 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 msgr2=0x7fa3e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 0x7fa3e4068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80ad000 tx=0x7fa3e8008040 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 msgr2=0x7fa3f8148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400ebe0 tx=0x7fa3f400c520 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 shutdown_connections 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3e40668d0 0x7fa3e4068d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8152090 0x7fa3f81ecc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c1030 0x7fa3f814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 --2- 172.21.15.97:0/4036050221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f806b860 0x7fa3f8148a60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.246+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 >> 172.21.15.97:0/4036050221 conn(0x7fa3f80c3130 msgr2=0x7fa3f81500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.250+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 shutdown_connections 2023-12-04T05:37:34.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.250+0000 7fa3fefaa640 1 -- 172.21.15.97:0/4036050221 wait complete. 2023-12-04T05:37:34.273 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-12-04T05:37:34.202003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220112,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754608,"statfs":{"total":773094113280,"available":772868718592,"internally_reserved":0,"allocated":4038656,"data_stored":2258372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.229314"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978883+0000","last_change":"2023-12-04T05:37:24.991447+0000","last_active":"2023-12-04T05:37:25.978883+0000","last_peered":"2023-12-04T05:37:25.978883+0000","last_clean":"2023-12-04T05:37:25.978883+0000","last_became_active":"2023-12-04T05:37:24.991120+0000","last_became_peered":"2023-12-04T05:37:24.991120+0000","last_unstale":"2023-12-04T05:37:25.978883+0000","last_undegraded":"2023-12-04T05:37:25.978883+0000","last_fullsized":"2023-12-04T05:37:25.978883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:23.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435473+0000","last_change":"2023-12-04T05:37:24.992517+0000","last_active":"2023-12-04T05:37:26.435473+0000","last_peered":"2023-12-04T05:37:26.435473+0000","last_clean":"2023-12-04T05:37:26.435473+0000","last_became_active":"2023-12-04T05:37:24.991809+0000","last_became_peered":"2023-12-04T05:37:24.991809+0000","last_unstale":"2023-12-04T05:37:26.435473+0000","last_undegraded":"2023-12-04T05:37:26.435473+0000","last_fullsized":"2023-12-04T05:37:26.435473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:09.871491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937247+0000","last_change":"2023-12-04T05:37:24.996407+0000","last_active":"2023-12-04T05:37:26.937247+0000","last_peered":"2023-12-04T05:37:26.937247+0000","last_clean":"2023-12-04T05:37:26.937247+0000","last_became_active":"2023-12-04T05:37:24.996150+0000","last_became_peered":"2023-12-04T05:37:24.996150+0000","last_unstale":"2023-12-04T05:37:26.937247+0000","last_undegraded":"2023-12-04T05:37:26.937247+0000","last_fullsized":"2023-12-04T05:37:26.937247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935699+0000","last_change":"2023-12-04T05:37:24.990710+0000","last_active":"2023-12-04T05:37:26.935699+0000","last_peered":"2023-12-04T05:37:26.935699+0000","last_clean":"2023-12-04T05:37:26.935699+0000","last_became_active":"2023-12-04T05:37:24.990190+0000","last_became_peered":"2023-12-04T05:37:24.990190+0000","last_unstale":"2023-12-04T05:37:26.935699+0000","last_undegraded":"2023-12-04T05:37:26.935699+0000","last_fullsized":"2023-12-04T05:37:26.935699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935348+0000","last_change":"2023-12-04T05:37:24.991321+0000","last_active":"2023-12-04T05:37:26.935348+0000","last_peered":"2023-12-04T05:37:26.935348+0000","last_clean":"2023-12-04T05:37:26.935348+0000","last_became_active":"2023-12-04T05:37:24.990855+0000","last_became_peered":"2023-12-04T05:37:24.990855+0000","last_unstale":"2023-12-04T05:37:26.935348+0000","last_undegraded":"2023-12-04T05:37:26.935348+0000","last_fullsized":"2023-12-04T05:37:26.935348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:46:45.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435183+0000","last_change":"2023-12-04T05:37:24.997159+0000","last_active":"2023-12-04T05:37:26.435183+0000","last_peered":"2023-12-04T05:37:26.435183+0000","last_clean":"2023-12-04T05:37:26.435183+0000","last_became_active":"2023-12-04T05:37:24.996505+0000","last_became_peered":"2023-12-04T05:37:24.996505+0000","last_unstale":"2023-12-04T05:37:26.435183+0000","last_undegraded":"2023-12-04T05:37:26.435183+0000","last_fullsized":"2023-12-04T05:37:26.435183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936773+0000","last_change":"2023-12-04T05:37:25.001425+0000","last_active":"2023-12-04T05:37:26.936773+0000","last_peered":"2023-12-04T05:37:26.936773+0000","last_clean":"2023-12-04T05:37:26.936773+0000","last_became_active":"2023-12-04T05:37:25.001143+0000","last_became_peered":"2023-12-04T05:37:25.001143+0000","last_unstale":"2023-12-04T05:37:26.936773+0000","last_undegraded":"2023-12-04T05:37:26.936773+0000","last_fullsized":"2023-12-04T05:37:26.936773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936197+0000","last_change":"2023-12-04T05:37:24.999115+0000","last_active":"2023-12-04T05:37:26.936197+0000","last_peered":"2023-12-04T05:37:26.936197+0000","last_clean":"2023-12-04T05:37:26.936197+0000","last_became_active":"2023-12-04T05:37:24.997938+0000","last_became_peered":"2023-12-04T05:37:24.997938+0000","last_unstale":"2023-12-04T05:37:26.936197+0000","last_undegraded":"2023-12-04T05:37:26.936197+0000","last_fullsized":"2023-12-04T05:37:26.936197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978206+0000","last_change":"2023-12-04T05:37:24.990417+0000","last_active":"2023-12-04T05:37:25.978206+0000","last_peered":"2023-12-04T05:37:25.978206+0000","last_clean":"2023-12-04T05:37:25.978206+0000","last_became_active":"2023-12-04T05:37:24.989761+0000","last_became_peered":"2023-12-04T05:37:24.989761+0000","last_unstale":"2023-12-04T05:37:25.978206+0000","last_undegraded":"2023-12-04T05:37:25.978206+0000","last_fullsized":"2023-12-04T05:37:25.978206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935778+0000","last_change":"2023-12-04T05:37:24.994217+0000","last_active":"2023-12-04T05:37:26.935778+0000","last_peered":"2023-12-04T05:37:26.935778+0000","last_clean":"2023-12-04T05:37:26.935778+0000","last_became_active":"2023-12-04T05:37:24.993859+0000","last_became_peered":"2023-12-04T05:37:24.993859+0000","last_unstale":"2023-12-04T05:37:26.935778+0000","last_undegraded":"2023-12-04T05:37:26.935778+0000","last_fullsized":"2023-12-04T05:37:26.935778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936635+0000","last_change":"2023-12-04T05:37:25.002836+0000","last_active":"2023-12-04T05:37:26.936635+0000","last_peered":"2023-12-04T05:37:26.936635+0000","last_clean":"2023-12-04T05:37:26.936635+0000","last_became_active":"2023-12-04T05:37:25.002504+0000","last_became_peered":"2023-12-04T05:37:25.002504+0000","last_unstale":"2023-12-04T05:37:26.936635+0000","last_undegraded":"2023-12-04T05:37:26.936635+0000","last_fullsized":"2023-12-04T05:37:26.936635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937037+0000","last_change":"2023-12-04T05:37:25.001854+0000","last_active":"2023-12-04T05:37:26.937037+0000","last_peered":"2023-12-04T05:37:26.937037+0000","last_clean":"2023-12-04T05:37:26.937037+0000","last_became_active":"2023-12-04T05:37:25.001471+0000","last_became_peered":"2023-12-04T05:37:25.001471+0000","last_unstale":"2023-12-04T05:37:26.937037+0000","last_undegraded":"2023-12-04T05:37:26.937037+0000","last_fullsized":"2023-12-04T05:37:26.937037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935348+0000","last_change":"2023-12-04T05:37:24.991168+0000","last_active":"2023-12-04T05:37:26.935348+0000","last_peered":"2023-12-04T05:37:26.935348+0000","last_clean":"2023-12-04T05:37:26.935348+0000","last_became_active":"2023-12-04T05:37:24.990517+0000","last_became_peered":"2023-12-04T05:37:24.990517+0000","last_unstale":"2023-12-04T05:37:26.935348+0000","last_undegraded":"2023-12-04T05:37:26.935348+0000","last_fullsized":"2023-12-04T05:37:26.935348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:07.947991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435177+0000","last_change":"2023-12-04T05:37:24.987512+0000","last_active":"2023-12-04T05:37:26.435177+0000","last_peered":"2023-12-04T05:37:26.435177+0000","last_clean":"2023-12-04T05:37:26.435177+0000","last_became_active":"2023-12-04T05:37:24.987236+0000","last_became_peered":"2023-12-04T05:37:24.987236+0000","last_unstale":"2023-12-04T05:37:26.435177+0000","last_undegraded":"2023-12-04T05:37:26.435177+0000","last_fullsized":"2023-12-04T05:37:26.435177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936803+0000","last_change":"2023-12-04T05:37:24.998811+0000","last_active":"2023-12-04T05:37:26.936803+0000","last_peered":"2023-12-04T05:37:26.936803+0000","last_clean":"2023-12-04T05:37:26.936803+0000","last_became_active":"2023-12-04T05:37:24.998548+0000","last_became_peered":"2023-12-04T05:37:24.998548+0000","last_unstale":"2023-12-04T05:37:26.936803+0000","last_undegraded":"2023-12-04T05:37:26.936803+0000","last_fullsized":"2023-12-04T05:37:26.936803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936685+0000","last_change":"2023-12-04T05:37:25.002873+0000","last_active":"2023-12-04T05:37:26.936685+0000","last_peered":"2023-12-04T05:37:26.936685+0000","last_clean":"2023-12-04T05:37:26.936685+0000","last_became_active":"2023-12-04T05:37:25.002555+0000","last_became_peered":"2023-12-04T05:37:25.002555+0000","last_unstale":"2023-12-04T05:37:26.936685+0000","last_undegraded":"2023-12-04T05:37:26.936685+0000","last_fullsized":"2023-12-04T05:37:26.936685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936330+0000","last_change":"2023-12-04T05:37:25.002114+0000","last_active":"2023-12-04T05:37:26.936330+0000","last_peered":"2023-12-04T05:37:26.936330+0000","last_clean":"2023-12-04T05:37:26.936330+0000","last_became_active":"2023-12-04T05:37:24.999380+0000","last_became_peered":"2023-12-04T05:37:24.999380+0000","last_unstale":"2023-12-04T05:37:26.936330+0000","last_undegraded":"2023-12-04T05:37:26.936330+0000","last_fullsized":"2023-12-04T05:37:26.936330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435546+0000","last_change":"2023-12-04T05:37:24.992143+0000","last_active":"2023-12-04T05:37:26.435546+0000","last_peered":"2023-12-04T05:37:26.435546+0000","last_clean":"2023-12-04T05:37:26.435546+0000","last_became_active":"2023-12-04T05:37:24.991537+0000","last_became_peered":"2023-12-04T05:37:24.991537+0000","last_unstale":"2023-12-04T05:37:26.435546+0000","last_undegraded":"2023-12-04T05:37:26.435546+0000","last_fullsized":"2023-12-04T05:37:26.435546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:07.720393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435359+0000","last_change":"2023-12-04T05:37:24.996641+0000","last_active":"2023-12-04T05:37:26.435359+0000","last_peered":"2023-12-04T05:37:26.435359+0000","last_clean":"2023-12-04T05:37:26.435359+0000","last_became_active":"2023-12-04T05:37:24.993802+0000","last_became_peered":"2023-12-04T05:37:24.993802+0000","last_unstale":"2023-12-04T05:37:26.435359+0000","last_undegraded":"2023-12-04T05:37:26.435359+0000","last_fullsized":"2023-12-04T05:37:26.435359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:31.280029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935757+0000","last_change":"2023-12-04T05:37:24.997746+0000","last_active":"2023-12-04T05:37:26.935757+0000","last_peered":"2023-12-04T05:37:26.935757+0000","last_clean":"2023-12-04T05:37:26.935757+0000","last_became_active":"2023-12-04T05:37:24.997501+0000","last_became_peered":"2023-12-04T05:37:24.997501+0000","last_unstale":"2023-12-04T05:37:26.935757+0000","last_undegraded":"2023-12-04T05:37:26.935757+0000","last_fullsized":"2023-12-04T05:37:26.935757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:28:18.462079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977977+0000","last_change":"2023-12-04T05:37:24.990903+0000","last_active":"2023-12-04T05:37:25.977977+0000","last_peered":"2023-12-04T05:37:25.977977+0000","last_clean":"2023-12-04T05:37:25.977977+0000","last_became_active":"2023-12-04T05:37:24.990595+0000","last_became_peered":"2023-12-04T05:37:24.990595+0000","last_unstale":"2023-12-04T05:37:25.977977+0000","last_undegraded":"2023-12-04T05:37:25.977977+0000","last_fullsized":"2023-12-04T05:37:25.977977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978281+0000","last_change":"2023-12-04T05:37:24.990315+0000","last_active":"2023-12-04T05:37:25.978281+0000","last_peered":"2023-12-04T05:37:25.978281+0000","last_clean":"2023-12-04T05:37:25.978281+0000","last_became_active":"2023-12-04T05:37:24.990020+0000","last_became_peered":"2023-12-04T05:37:24.990020+0000","last_unstale":"2023-12-04T05:37:25.978281+0000","last_undegraded":"2023-12-04T05:37:25.978281+0000","last_fullsized":"2023-12-04T05:37:25.978281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976700+0000","last_change":"2023-12-04T05:37:25.004665+0000","last_active":"2023-12-04T05:37:25.976700+0000","last_peered":"2023-12-04T05:37:25.976700+0000","last_clean":"2023-12-04T05:37:25.976700+0000","last_became_active":"2023-12-04T05:37:25.004324+0000","last_became_peered":"2023-12-04T05:37:25.004324+0000","last_unstale":"2023-12-04T05:37:25.976700+0000","last_undegraded":"2023-12-04T05:37:25.976700+0000","last_fullsized":"2023-12-04T05:37:25.976700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936028+0000","last_change":"2023-12-04T05:37:24.993347+0000","last_active":"2023-12-04T05:37:26.936028+0000","last_peered":"2023-12-04T05:37:26.936028+0000","last_clean":"2023-12-04T05:37:26.936028+0000","last_became_active":"2023-12-04T05:37:24.993089+0000","last_became_peered":"2023-12-04T05:37:24.993089+0000","last_unstale":"2023-12-04T05:37:26.936028+0000","last_undegraded":"2023-12-04T05:37:26.936028+0000","last_fullsized":"2023-12-04T05:37:26.936028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936212+0000","last_change":"2023-12-04T05:37:24.995638+0000","last_active":"2023-12-04T05:37:26.936212+0000","last_peered":"2023-12-04T05:37:26.936212+0000","last_clean":"2023-12-04T05:37:26.936212+0000","last_became_active":"2023-12-04T05:37:24.995363+0000","last_became_peered":"2023-12-04T05:37:24.995363+0000","last_unstale":"2023-12-04T05:37:26.936212+0000","last_undegraded":"2023-12-04T05:37:26.936212+0000","last_fullsized":"2023-12-04T05:37:26.936212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435536+0000","last_change":"2023-12-04T05:37:24.998832+0000","last_active":"2023-12-04T05:37:26.435536+0000","last_peered":"2023-12-04T05:37:26.435536+0000","last_clean":"2023-12-04T05:37:26.435536+0000","last_became_active":"2023-12-04T05:37:24.998544+0000","last_became_peered":"2023-12-04T05:37:24.998544+0000","last_unstale":"2023-12-04T05:37:26.435536+0000","last_undegraded":"2023-12-04T05:37:26.435536+0000","last_fullsized":"2023-12-04T05:37:26.435536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:12.838061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936137+0000","last_change":"2023-12-04T05:37:24.994373+0000","last_active":"2023-12-04T05:37:26.936137+0000","last_peered":"2023-12-04T05:37:26.936137+0000","last_clean":"2023-12-04T05:37:26.936137+0000","last_became_active":"2023-12-04T05:37:24.994052+0000","last_became_peered":"2023-12-04T05:37:24.994052+0000","last_unstale":"2023-12-04T05:37:26.936137+0000","last_undegraded":"2023-12-04T05:37:26.936137+0000","last_fullsized":"2023-12-04T05:37:26.936137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937052+0000","last_change":"2023-12-04T05:37:24.993220+0000","last_active":"2023-12-04T05:37:26.937052+0000","last_peered":"2023-12-04T05:37:26.937052+0000","last_clean":"2023-12-04T05:37:26.937052+0000","last_became_active":"2023-12-04T05:37:24.992903+0000","last_became_peered":"2023-12-04T05:37:24.992903+0000","last_unstale":"2023-12-04T05:37:26.937052+0000","last_undegraded":"2023-12-04T05:37:26.937052+0000","last_fullsized":"2023-12-04T05:37:26.937052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978681+0000","last_change":"2023-12-04T05:37:24.985403+0000","last_active":"2023-12-04T05:37:25.978681+0000","last_peered":"2023-12-04T05:37:25.978681+0000","last_clean":"2023-12-04T05:37:25.978681+0000","last_became_active":"2023-12-04T05:37:24.985108+0000","last_became_peered":"2023-12-04T05:37:24.985108+0000","last_unstale":"2023-12-04T05:37:25.978681+0000","last_undegraded":"2023-12-04T05:37:25.978681+0000","last_fullsized":"2023-12-04T05:37:25.978681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936677+0000","last_change":"2023-12-04T05:37:25.001679+0000","last_active":"2023-12-04T05:37:26.936677+0000","last_peered":"2023-12-04T05:37:26.936677+0000","last_clean":"2023-12-04T05:37:26.936677+0000","last_became_active":"2023-12-04T05:37:25.001125+0000","last_became_peered":"2023-12-04T05:37:25.001125+0000","last_unstale":"2023-12-04T05:37:26.936677+0000","last_undegraded":"2023-12-04T05:37:26.936677+0000","last_fullsized":"2023-12-04T05:37:26.936677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978027+0000","last_change":"2023-12-04T05:37:24.991739+0000","last_active":"2023-12-04T05:37:25.978027+0000","last_peered":"2023-12-04T05:37:25.978027+0000","last_clean":"2023-12-04T05:37:25.978027+0000","last_became_active":"2023-12-04T05:37:24.991386+0000","last_became_peered":"2023-12-04T05:37:24.991386+0000","last_unstale":"2023-12-04T05:37:25.978027+0000","last_undegraded":"2023-12-04T05:37:25.978027+0000","last_fullsized":"2023-12-04T05:37:25.978027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:39.738739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936820+0000","last_change":"2023-12-04T05:37:24.999330+0000","last_active":"2023-12-04T05:37:26.936820+0000","last_peered":"2023-12-04T05:37:26.936820+0000","last_clean":"2023-12-04T05:37:26.936820+0000","last_became_active":"2023-12-04T05:37:24.998449+0000","last_became_peered":"2023-12-04T05:37:24.998449+0000","last_unstale":"2023-12-04T05:37:26.936820+0000","last_undegraded":"2023-12-04T05:37:26.936820+0000","last_fullsized":"2023-12-04T05:37:26.936820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977179+0000","last_change":"2023-12-04T05:37:24.999666+0000","last_active":"2023-12-04T05:37:25.977179+0000","last_peered":"2023-12-04T05:37:25.977179+0000","last_clean":"2023-12-04T05:37:25.977179+0000","last_became_active":"2023-12-04T05:37:24.999338+0000","last_became_peered":"2023-12-04T05:37:24.999338+0000","last_unstale":"2023-12-04T05:37:25.977179+0000","last_undegraded":"2023-12-04T05:37:25.977179+0000","last_fullsized":"2023-12-04T05:37:25.977179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978974+0000","last_change":"2023-12-04T05:37:24.359031+0000","last_active":"2023-12-04T05:37:25.978974+0000","last_peered":"2023-12-04T05:37:25.978974+0000","last_clean":"2023-12-04T05:37:25.978974+0000","last_became_active":"2023-12-04T05:37:24.358600+0000","last_became_peered":"2023-12-04T05:37:24.358600+0000","last_unstale":"2023-12-04T05:37:25.978974+0000","last_undegraded":"2023-12-04T05:37:25.978974+0000","last_fullsized":"2023-12-04T05:37:25.978974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978897+0000","last_change":"2023-12-04T05:37:24.989453+0000","last_active":"2023-12-04T05:37:25.978897+0000","last_peered":"2023-12-04T05:37:25.978897+0000","last_clean":"2023-12-04T05:37:25.978897+0000","last_became_active":"2023-12-04T05:37:24.988948+0000","last_became_peered":"2023-12-04T05:37:24.988948+0000","last_unstale":"2023-12-04T05:37:25.978897+0000","last_undegraded":"2023-12-04T05:37:25.978897+0000","last_fullsized":"2023-12-04T05:37:25.978897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:14.283024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977216+0000","last_change":"2023-12-04T05:37:24.367828+0000","last_active":"2023-12-04T05:37:25.977216+0000","last_peered":"2023-12-04T05:37:25.977216+0000","last_clean":"2023-12-04T05:37:25.977216+0000","last_became_active":"2023-12-04T05:37:24.367323+0000","last_became_peered":"2023-12-04T05:37:24.367323+0000","last_unstale":"2023-12-04T05:37:25.977216+0000","last_undegraded":"2023-12-04T05:37:25.977216+0000","last_fullsized":"2023-12-04T05:37:25.977216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978301+0000","last_change":"2023-12-04T05:37:24.991648+0000","last_active":"2023-12-04T05:37:25.978301+0000","last_peered":"2023-12-04T05:37:25.978301+0000","last_clean":"2023-12-04T05:37:25.978301+0000","last_became_active":"2023-12-04T05:37:24.991299+0000","last_became_peered":"2023-12-04T05:37:24.991299+0000","last_unstale":"2023-12-04T05:37:25.978301+0000","last_undegraded":"2023-12-04T05:37:25.978301+0000","last_fullsized":"2023-12-04T05:37:25.978301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435362+0000","last_change":"2023-12-04T05:37:24.362899+0000","last_active":"2023-12-04T05:37:26.435362+0000","last_peered":"2023-12-04T05:37:26.435362+0000","last_clean":"2023-12-04T05:37:26.435362+0000","last_became_active":"2023-12-04T05:37:24.362589+0000","last_became_peered":"2023-12-04T05:37:24.362589+0000","last_unstale":"2023-12-04T05:37:26.435362+0000","last_undegraded":"2023-12-04T05:37:26.435362+0000","last_fullsized":"2023-12-04T05:37:26.435362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:52:59.772803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936149+0000","last_change":"2023-12-04T05:37:24.990915+0000","last_active":"2023-12-04T05:37:26.936149+0000","last_peered":"2023-12-04T05:37:26.936149+0000","last_clean":"2023-12-04T05:37:26.936149+0000","last_became_active":"2023-12-04T05:37:24.990302+0000","last_became_peered":"2023-12-04T05:37:24.990302+0000","last_unstale":"2023-12-04T05:37:26.936149+0000","last_undegraded":"2023-12-04T05:37:26.936149+0000","last_fullsized":"2023-12-04T05:37:26.936149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935831+0000","last_change":"2023-12-04T05:37:24.353356+0000","last_active":"2023-12-04T05:37:26.935831+0000","last_peered":"2023-12-04T05:37:26.935831+0000","last_clean":"2023-12-04T05:37:26.935831+0000","last_became_active":"2023-12-04T05:37:24.353060+0000","last_became_peered":"2023-12-04T05:37:24.353060+0000","last_unstale":"2023-12-04T05:37:26.935831+0000","last_undegraded":"2023-12-04T05:37:26.935831+0000","last_fullsized":"2023-12-04T05:37:26.935831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:15.976925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936544+0000","last_change":"2023-12-04T05:37:25.001831+0000","last_active":"2023-12-04T05:37:26.936544+0000","last_peered":"2023-12-04T05:37:26.936544+0000","last_clean":"2023-12-04T05:37:26.936544+0000","last_became_active":"2023-12-04T05:37:25.001421+0000","last_became_peered":"2023-12-04T05:37:25.001421+0000","last_unstale":"2023-12-04T05:37:26.936544+0000","last_undegraded":"2023-12-04T05:37:26.936544+0000","last_fullsized":"2023-12-04T05:37:26.936544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978100+0000","last_change":"2023-12-04T05:37:24.361558+0000","last_active":"2023-12-04T05:37:25.978100+0000","last_peered":"2023-12-04T05:37:25.978100+0000","last_clean":"2023-12-04T05:37:25.978100+0000","last_became_active":"2023-12-04T05:37:24.361213+0000","last_became_peered":"2023-12-04T05:37:24.361213+0000","last_unstale":"2023-12-04T05:37:25.978100+0000","last_undegraded":"2023-12-04T05:37:25.978100+0000","last_fullsized":"2023-12-04T05:37:25.978100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936518+0000","last_change":"2023-12-04T05:37:24.998367+0000","last_active":"2023-12-04T05:37:26.936518+0000","last_peered":"2023-12-04T05:37:26.936518+0000","last_clean":"2023-12-04T05:37:26.936518+0000","last_became_active":"2023-12-04T05:37:24.997864+0000","last_became_peered":"2023-12-04T05:37:24.997864+0000","last_unstale":"2023-12-04T05:37:26.936518+0000","last_undegraded":"2023-12-04T05:37:26.936518+0000","last_fullsized":"2023-12-04T05:37:26.936518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978370+0000","last_change":"2023-12-04T05:37:24.362048+0000","last_active":"2023-12-04T05:37:25.978370+0000","last_peered":"2023-12-04T05:37:25.978370+0000","last_clean":"2023-12-04T05:37:25.978370+0000","last_became_active":"2023-12-04T05:37:24.361734+0000","last_became_peered":"2023-12-04T05:37:24.361734+0000","last_unstale":"2023-12-04T05:37:25.978370+0000","last_undegraded":"2023-12-04T05:37:25.978370+0000","last_fullsized":"2023-12-04T05:37:25.978370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977876+0000","last_change":"2023-12-04T05:37:24.981306+0000","last_active":"2023-12-04T05:37:25.977876+0000","last_peered":"2023-12-04T05:37:25.977876+0000","last_clean":"2023-12-04T05:37:25.977876+0000","last_became_active":"2023-12-04T05:37:24.980836+0000","last_became_peered":"2023-12-04T05:37:24.980836+0000","last_unstale":"2023-12-04T05:37:25.977876+0000","last_undegraded":"2023-12-04T05:37:25.977876+0000","last_fullsized":"2023-12-04T05:37:25.977876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435095+0000","last_change":"2023-12-04T05:37:24.360838+0000","last_active":"2023-12-04T05:37:26.435095+0000","last_peered":"2023-12-04T05:37:26.435095+0000","last_clean":"2023-12-04T05:37:26.435095+0000","last_became_active":"2023-12-04T05:37:24.360507+0000","last_became_peered":"2023-12-04T05:37:24.360507+0000","last_unstale":"2023-12-04T05:37:26.435095+0000","last_undegraded":"2023-12-04T05:37:26.435095+0000","last_fullsized":"2023-12-04T05:37:26.435095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935760+0000","last_change":"2023-12-04T05:37:24.996089+0000","last_active":"2023-12-04T05:37:26.935760+0000","last_peered":"2023-12-04T05:37:26.935760+0000","last_clean":"2023-12-04T05:37:26.935760+0000","last_became_active":"2023-12-04T05:37:24.995809+0000","last_became_peered":"2023-12-04T05:37:24.995809+0000","last_unstale":"2023-12-04T05:37:26.935760+0000","last_undegraded":"2023-12-04T05:37:26.935760+0000","last_fullsized":"2023-12-04T05:37:26.935760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977969+0000","last_change":"2023-12-04T05:37:24.354659+0000","last_active":"2023-12-04T05:37:25.977969+0000","last_peered":"2023-12-04T05:37:25.977969+0000","last_clean":"2023-12-04T05:37:25.977969+0000","last_became_active":"2023-12-04T05:37:24.354363+0000","last_became_peered":"2023-12-04T05:37:24.354363+0000","last_unstale":"2023-12-04T05:37:25.977969+0000","last_undegraded":"2023-12-04T05:37:25.977969+0000","last_fullsized":"2023-12-04T05:37:25.977969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937180+0000","last_change":"2023-12-04T05:37:24.999935+0000","last_active":"2023-12-04T05:37:26.937180+0000","last_peered":"2023-12-04T05:37:26.937180+0000","last_clean":"2023-12-04T05:37:26.937180+0000","last_became_active":"2023-12-04T05:37:24.999626+0000","last_became_peered":"2023-12-04T05:37:24.999626+0000","last_unstale":"2023-12-04T05:37:26.937180+0000","last_undegraded":"2023-12-04T05:37:26.937180+0000","last_fullsized":"2023-12-04T05:37:26.937180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435712+0000","last_change":"2023-12-04T05:37:24.367803+0000","last_active":"2023-12-04T05:37:26.435712+0000","last_peered":"2023-12-04T05:37:26.435712+0000","last_clean":"2023-12-04T05:37:26.435712+0000","last_became_active":"2023-12-04T05:37:24.367420+0000","last_became_peered":"2023-12-04T05:37:24.367420+0000","last_unstale":"2023-12-04T05:37:26.435712+0000","last_undegraded":"2023-12-04T05:37:26.435712+0000","last_fullsized":"2023-12-04T05:37:26.435712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:24.234900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435660+0000","last_change":"2023-12-04T05:37:24.996824+0000","last_active":"2023-12-04T05:37:26.435660+0000","last_peered":"2023-12-04T05:37:26.435660+0000","last_clean":"2023-12-04T05:37:26.435660+0000","last_became_active":"2023-12-04T05:37:24.996612+0000","last_became_peered":"2023-12-04T05:37:24.996612+0000","last_unstale":"2023-12-04T05:37:26.435660+0000","last_undegraded":"2023-12-04T05:37:26.435660+0000","last_fullsized":"2023-12-04T05:37:26.435660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:17.183378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977265+0000","last_change":"2023-12-04T05:37:24.364875+0000","last_active":"2023-12-04T05:37:25.977265+0000","last_peered":"2023-12-04T05:37:25.977265+0000","last_clean":"2023-12-04T05:37:25.977265+0000","last_became_active":"2023-12-04T05:37:24.364601+0000","last_became_peered":"2023-12-04T05:37:24.364601+0000","last_unstale":"2023-12-04T05:37:25.977265+0000","last_undegraded":"2023-12-04T05:37:25.977265+0000","last_fullsized":"2023-12-04T05:37:25.977265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435395+0000","last_change":"2023-12-04T05:37:25.006262+0000","last_active":"2023-12-04T05:37:26.435395+0000","last_peered":"2023-12-04T05:37:26.435395+0000","last_clean":"2023-12-04T05:37:26.435395+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:26.435395+0000","last_undegraded":"2023-12-04T05:37:26.435395+0000","last_fullsized":"2023-12-04T05:37:26.435395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:30:51.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937265+0000","last_change":"2023-12-04T05:37:24.360821+0000","last_active":"2023-12-04T05:37:26.937265+0000","last_peered":"2023-12-04T05:37:26.937265+0000","last_clean":"2023-12-04T05:37:26.937265+0000","last_became_active":"2023-12-04T05:37:24.360531+0000","last_became_peered":"2023-12-04T05:37:24.360531+0000","last_unstale":"2023-12-04T05:37:26.937265+0000","last_undegraded":"2023-12-04T05:37:26.937265+0000","last_fullsized":"2023-12-04T05:37:26.937265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937151+0000","last_change":"2023-12-04T05:37:24.997014+0000","last_active":"2023-12-04T05:37:26.937151+0000","last_peered":"2023-12-04T05:37:26.937151+0000","last_clean":"2023-12-04T05:37:26.937151+0000","last_became_active":"2023-12-04T05:37:24.996398+0000","last_became_peered":"2023-12-04T05:37:24.996398+0000","last_unstale":"2023-12-04T05:37:26.937151+0000","last_undegraded":"2023-12-04T05:37:26.937151+0000","last_fullsized":"2023-12-04T05:37:26.937151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435404+0000","last_change":"2023-12-04T05:37:24.355898+0000","last_active":"2023-12-04T05:37:26.435404+0000","last_peered":"2023-12-04T05:37:26.435404+0000","last_clean":"2023-12-04T05:37:26.435404+0000","last_became_active":"2023-12-04T05:37:24.355292+0000","last_became_peered":"2023-12-04T05:37:24.355292+0000","last_unstale":"2023-12-04T05:37:26.435404+0000","last_undegraded":"2023-12-04T05:37:26.435404+0000","last_fullsized":"2023-12-04T05:37:26.435404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:42.819254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935617+0000","last_change":"2023-12-04T05:37:24.995114+0000","last_active":"2023-12-04T05:37:26.935617+0000","last_peered":"2023-12-04T05:37:26.935617+0000","last_clean":"2023-12-04T05:37:26.935617+0000","last_became_active":"2023-12-04T05:37:24.994792+0000","last_became_peered":"2023-12-04T05:37:24.994792+0000","last_unstale":"2023-12-04T05:37:26.935617+0000","last_undegraded":"2023-12-04T05:37:26.935617+0000","last_fullsized":"2023-12-04T05:37:26.935617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978235+0000","last_change":"2023-12-04T05:37:24.354980+0000","last_active":"2023-12-04T05:37:25.978235+0000","last_peered":"2023-12-04T05:37:25.978235+0000","last_clean":"2023-12-04T05:37:25.978235+0000","last_became_active":"2023-12-04T05:37:24.354672+0000","last_became_peered":"2023-12-04T05:37:24.354672+0000","last_unstale":"2023-12-04T05:37:25.978235+0000","last_undegraded":"2023-12-04T05:37:25.978235+0000","last_fullsized":"2023-12-04T05:37:25.978235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435328+0000","last_change":"2023-12-04T05:37:24.990852+0000","last_active":"2023-12-04T05:37:26.435328+0000","last_peered":"2023-12-04T05:37:26.435328+0000","last_clean":"2023-12-04T05:37:26.435328+0000","last_became_active":"2023-12-04T05:37:24.990594+0000","last_became_peered":"2023-12-04T05:37:24.990594+0000","last_unstale":"2023-12-04T05:37:26.435328+0000","last_undegraded":"2023-12-04T05:37:26.435328+0000","last_fullsized":"2023-12-04T05:37:26.435328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935694+0000","last_change":"2023-12-04T05:37:24.355867+0000","last_active":"2023-12-04T05:37:26.935694+0000","last_peered":"2023-12-04T05:37:26.935694+0000","last_clean":"2023-12-04T05:37:26.935694+0000","last_became_active":"2023-12-04T05:37:24.354909+0000","last_became_peered":"2023-12-04T05:37:24.354909+0000","last_unstale":"2023-12-04T05:37:26.935694+0000","last_undegraded":"2023-12-04T05:37:26.935694+0000","last_fullsized":"2023-12-04T05:37:26.935694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936368+0000","last_change":"2023-12-04T05:37:25.001941+0000","last_active":"2023-12-04T05:37:26.936368+0000","last_peered":"2023-12-04T05:37:26.936368+0000","last_clean":"2023-12-04T05:37:26.936368+0000","last_became_active":"2023-12-04T05:37:24.998768+0000","last_became_peered":"2023-12-04T05:37:24.998768+0000","last_unstale":"2023-12-04T05:37:26.936368+0000","last_undegraded":"2023-12-04T05:37:26.936368+0000","last_fullsized":"2023-12-04T05:37:26.936368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435017+0000","last_change":"2023-12-04T05:37:24.365982+0000","last_active":"2023-12-04T05:37:26.435017+0000","last_peered":"2023-12-04T05:37:26.435017+0000","last_clean":"2023-12-04T05:37:26.435017+0000","last_became_active":"2023-12-04T05:37:24.365700+0000","last_became_peered":"2023-12-04T05:37:24.365700+0000","last_unstale":"2023-12-04T05:37:26.435017+0000","last_undegraded":"2023-12-04T05:37:26.435017+0000","last_fullsized":"2023-12-04T05:37:26.435017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978190+0000","last_change":"2023-12-04T05:37:24.987969+0000","last_active":"2023-12-04T05:37:25.978190+0000","last_peered":"2023-12-04T05:37:25.978190+0000","last_clean":"2023-12-04T05:37:25.978190+0000","last_became_active":"2023-12-04T05:37:24.986483+0000","last_became_peered":"2023-12-04T05:37:24.986483+0000","last_unstale":"2023-12-04T05:37:25.978190+0000","last_undegraded":"2023-12-04T05:37:25.978190+0000","last_fullsized":"2023-12-04T05:37:25.978190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:29.179535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435125+0000","last_change":"2023-12-04T05:37:24.370452+0000","last_active":"2023-12-04T05:37:26.435125+0000","last_peered":"2023-12-04T05:37:26.435125+0000","last_clean":"2023-12-04T05:37:26.435125+0000","last_became_active":"2023-12-04T05:37:24.369542+0000","last_became_peered":"2023-12-04T05:37:24.369542+0000","last_unstale":"2023-12-04T05:37:26.435125+0000","last_undegraded":"2023-12-04T05:37:26.435125+0000","last_fullsized":"2023-12-04T05:37:26.435125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:04.466402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978466+0000","last_change":"2023-12-04T05:37:24.991803+0000","last_active":"2023-12-04T05:37:25.978466+0000","last_peered":"2023-12-04T05:37:25.978466+0000","last_clean":"2023-12-04T05:37:25.978466+0000","last_became_active":"2023-12-04T05:37:24.991546+0000","last_became_peered":"2023-12-04T05:37:24.991546+0000","last_unstale":"2023-12-04T05:37:25.978466+0000","last_undegraded":"2023-12-04T05:37:25.978466+0000","last_fullsized":"2023-12-04T05:37:25.978466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936211+0000","last_change":"2023-12-04T05:37:24.364783+0000","last_active":"2023-12-04T05:37:26.936211+0000","last_peered":"2023-12-04T05:37:26.936211+0000","last_clean":"2023-12-04T05:37:26.936211+0000","last_became_active":"2023-12-04T05:37:24.364459+0000","last_became_peered":"2023-12-04T05:37:24.364459+0000","last_unstale":"2023-12-04T05:37:26.936211+0000","last_undegraded":"2023-12-04T05:37:26.936211+0000","last_fullsized":"2023-12-04T05:37:26.936211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:33.747521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937301+0000","last_change":"2023-12-04T05:37:24.995956+0000","last_active":"2023-12-04T05:37:26.937301+0000","last_peered":"2023-12-04T05:37:26.937301+0000","last_clean":"2023-12-04T05:37:26.937301+0000","last_became_active":"2023-12-04T05:37:24.995700+0000","last_became_peered":"2023-12-04T05:37:24.995700+0000","last_unstale":"2023-12-04T05:37:26.937301+0000","last_undegraded":"2023-12-04T05:37:26.937301+0000","last_fullsized":"2023-12-04T05:37:26.937301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978606+0000","last_change":"2023-12-04T05:37:24.354656+0000","last_active":"2023-12-04T05:37:25.978606+0000","last_peered":"2023-12-04T05:37:25.978606+0000","last_clean":"2023-12-04T05:37:25.978606+0000","last_became_active":"2023-12-04T05:37:24.354318+0000","last_became_peered":"2023-12-04T05:37:24.354318+0000","last_unstale":"2023-12-04T05:37:25.978606+0000","last_undegraded":"2023-12-04T05:37:25.978606+0000","last_fullsized":"2023-12-04T05:37:25.978606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:38.730683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935841+0000","last_change":"2023-12-04T05:37:24.990874+0000","last_active":"2023-12-04T05:37:26.935841+0000","last_peered":"2023-12-04T05:37:26.935841+0000","last_clean":"2023-12-04T05:37:26.935841+0000","last_became_active":"2023-12-04T05:37:24.990607+0000","last_became_peered":"2023-12-04T05:37:24.990607+0000","last_unstale":"2023-12-04T05:37:26.935841+0000","last_undegraded":"2023-12-04T05:37:26.935841+0000","last_fullsized":"2023-12-04T05:37:26.935841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978682+0000","last_change":"2023-12-04T05:37:24.363195+0000","last_active":"2023-12-04T05:37:25.978682+0000","last_peered":"2023-12-04T05:37:25.978682+0000","last_clean":"2023-12-04T05:37:25.978682+0000","last_became_active":"2023-12-04T05:37:24.362877+0000","last_became_peered":"2023-12-04T05:37:24.362877+0000","last_unstale":"2023-12-04T05:37:25.978682+0000","last_undegraded":"2023-12-04T05:37:25.978682+0000","last_fullsized":"2023-12-04T05:37:25.978682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935593+0000","last_change":"2023-12-04T05:37:25.005282+0000","last_active":"2023-12-04T05:37:26.935593+0000","last_peered":"2023-12-04T05:37:26.935593+0000","last_clean":"2023-12-04T05:37:26.935593+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:26.935593+0000","last_undegraded":"2023-12-04T05:37:26.935593+0000","last_fullsized":"2023-12-04T05:37:26.935593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:34.046063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978320+0000","last_change":"2023-12-04T05:37:24.364787+0000","last_active":"2023-12-04T05:37:25.978320+0000","last_peered":"2023-12-04T05:37:25.978320+0000","last_clean":"2023-12-04T05:37:25.978320+0000","last_became_active":"2023-12-04T05:37:24.364366+0000","last_became_peered":"2023-12-04T05:37:24.364366+0000","last_unstale":"2023-12-04T05:37:25.978320+0000","last_undegraded":"2023-12-04T05:37:25.978320+0000","last_fullsized":"2023-12-04T05:37:25.978320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935382+0000","last_change":"2023-12-04T05:37:24.992633+0000","last_active":"2023-12-04T05:37:26.935382+0000","last_peered":"2023-12-04T05:37:26.935382+0000","last_clean":"2023-12-04T05:37:26.935382+0000","last_became_active":"2023-12-04T05:37:24.992377+0000","last_became_peered":"2023-12-04T05:37:24.992377+0000","last_unstale":"2023-12-04T05:37:26.935382+0000","last_undegraded":"2023-12-04T05:37:26.935382+0000","last_fullsized":"2023-12-04T05:37:26.935382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:42.675557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976848+0000","last_change":"2023-12-04T05:37:24.355658+0000","last_active":"2023-12-04T05:37:25.976848+0000","last_peered":"2023-12-04T05:37:25.976848+0000","last_clean":"2023-12-04T05:37:25.976848+0000","last_became_active":"2023-12-04T05:37:24.353902+0000","last_became_peered":"2023-12-04T05:37:24.353902+0000","last_unstale":"2023-12-04T05:37:25.976848+0000","last_undegraded":"2023-12-04T05:37:25.976848+0000","last_fullsized":"2023-12-04T05:37:25.976848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935497+0000","last_change":"2023-12-04T05:37:24.991115+0000","last_active":"2023-12-04T05:37:26.935497+0000","last_peered":"2023-12-04T05:37:26.935497+0000","last_clean":"2023-12-04T05:37:26.935497+0000","last_became_active":"2023-12-04T05:37:24.990185+0000","last_became_peered":"2023-12-04T05:37:24.990185+0000","last_unstale":"2023-12-04T05:37:26.935497+0000","last_undegraded":"2023-12-04T05:37:26.935497+0000","last_fullsized":"2023-12-04T05:37:26.935497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:41:57.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978404+0000","last_change":"2023-12-04T05:37:24.368752+0000","last_active":"2023-12-04T05:37:25.978404+0000","last_peered":"2023-12-04T05:37:25.978404+0000","last_clean":"2023-12-04T05:37:25.978404+0000","last_became_active":"2023-12-04T05:37:24.368382+0000","last_became_peered":"2023-12-04T05:37:24.368382+0000","last_unstale":"2023-12-04T05:37:25.978404+0000","last_undegraded":"2023-12-04T05:37:25.978404+0000","last_fullsized":"2023-12-04T05:37:25.978404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935340+0000","last_change":"2023-12-04T05:37:24.989600+0000","last_active":"2023-12-04T05:37:26.935340+0000","last_peered":"2023-12-04T05:37:26.935340+0000","last_clean":"2023-12-04T05:37:26.935340+0000","last_became_active":"2023-12-04T05:37:24.989332+0000","last_became_peered":"2023-12-04T05:37:24.989332+0000","last_unstale":"2023-12-04T05:37:26.935340+0000","last_undegraded":"2023-12-04T05:37:26.935340+0000","last_fullsized":"2023-12-04T05:37:26.935340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:25:59.290418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978231+0000","last_change":"2023-12-04T05:37:24.364075+0000","last_active":"2023-12-04T05:37:25.978231+0000","last_peered":"2023-12-04T05:37:25.978231+0000","last_clean":"2023-12-04T05:37:25.978231+0000","last_became_active":"2023-12-04T05:37:24.363742+0000","last_became_peered":"2023-12-04T05:37:24.363742+0000","last_unstale":"2023-12-04T05:37:25.978231+0000","last_undegraded":"2023-12-04T05:37:25.978231+0000","last_fullsized":"2023-12-04T05:37:25.978231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936256+0000","last_change":"2023-12-04T05:37:25.001416+0000","last_active":"2023-12-04T05:37:26.936256+0000","last_peered":"2023-12-04T05:37:26.936256+0000","last_clean":"2023-12-04T05:37:26.936256+0000","last_became_active":"2023-12-04T05:37:25.001105+0000","last_became_peered":"2023-12-04T05:37:25.001105+0000","last_unstale":"2023-12-04T05:37:26.936256+0000","last_undegraded":"2023-12-04T05:37:26.936256+0000","last_fullsized":"2023-12-04T05:37:26.936256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936256+0000","last_change":"2023-12-04T05:37:24.365259+0000","last_active":"2023-12-04T05:37:26.936256+0000","last_peered":"2023-12-04T05:37:26.936256+0000","last_clean":"2023-12-04T05:37:26.936256+0000","last_became_active":"2023-12-04T05:37:24.364959+0000","last_became_peered":"2023-12-04T05:37:24.364959+0000","last_unstale":"2023-12-04T05:37:26.936256+0000","last_undegraded":"2023-12-04T05:37:26.936256+0000","last_fullsized":"2023-12-04T05:37:26.936256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935894+0000","last_change":"2023-12-04T05:37:24.993427+0000","last_active":"2023-12-04T05:37:26.935894+0000","last_peered":"2023-12-04T05:37:26.935894+0000","last_clean":"2023-12-04T05:37:26.935894+0000","last_became_active":"2023-12-04T05:37:24.993085+0000","last_became_peered":"2023-12-04T05:37:24.993085+0000","last_unstale":"2023-12-04T05:37:26.935894+0000","last_undegraded":"2023-12-04T05:37:26.935894+0000","last_fullsized":"2023-12-04T05:37:26.935894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:01:20.885419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936274+0000","last_change":"2023-12-04T05:37:24.363906+0000","last_active":"2023-12-04T05:37:26.936274+0000","last_peered":"2023-12-04T05:37:26.936274+0000","last_clean":"2023-12-04T05:37:26.936274+0000","last_became_active":"2023-12-04T05:37:24.363600+0000","last_became_peered":"2023-12-04T05:37:24.363600+0000","last_unstale":"2023-12-04T05:37:26.936274+0000","last_undegraded":"2023-12-04T05:37:26.936274+0000","last_fullsized":"2023-12-04T05:37:26.936274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:40.789742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.937311+0000","last_change":"2023-12-04T05:37:24.997150+0000","last_active":"2023-12-04T05:37:26.937311+0000","last_peered":"2023-12-04T05:37:26.937311+0000","last_clean":"2023-12-04T05:37:26.937311+0000","last_became_active":"2023-12-04T05:37:24.996748+0000","last_became_peered":"2023-12-04T05:37:24.996748+0000","last_unstale":"2023-12-04T05:37:26.937311+0000","last_undegraded":"2023-12-04T05:37:26.937311+0000","last_fullsized":"2023-12-04T05:37:26.937311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:27.491973+0000","last_change":"2023-12-04T05:37:24.366158+0000","last_active":"2023-12-04T05:37:27.491973+0000","last_peered":"2023-12-04T05:37:27.491973+0000","last_clean":"2023-12-04T05:37:27.491973+0000","last_became_active":"2023-12-04T05:37:24.365900+0000","last_became_peered":"2023-12-04T05:37:24.365900+0000","last_unstale":"2023-12-04T05:37:27.491973+0000","last_undegraded":"2023-12-04T05:37:27.491973+0000","last_fullsized":"2023-12-04T05:37:27.491973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.977113+0000","last_change":"2023-12-04T05:37:24.985398+0000","last_active":"2023-12-04T05:37:25.977113+0000","last_peered":"2023-12-04T05:37:25.977113+0000","last_clean":"2023-12-04T05:37:25.977113+0000","last_became_active":"2023-12-04T05:37:24.985152+0000","last_became_peered":"2023-12-04T05:37:24.985152+0000","last_unstale":"2023-12-04T05:37:25.977113+0000","last_undegraded":"2023-12-04T05:37:25.977113+0000","last_fullsized":"2023-12-04T05:37:25.977113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935962+0000","last_change":"2023-12-04T05:37:24.363919+0000","last_active":"2023-12-04T05:37:26.935962+0000","last_peered":"2023-12-04T05:37:26.935962+0000","last_clean":"2023-12-04T05:37:26.935962+0000","last_became_active":"2023-12-04T05:37:24.363592+0000","last_became_peered":"2023-12-04T05:37:24.363592+0000","last_unstale":"2023-12-04T05:37:26.935962+0000","last_undegraded":"2023-12-04T05:37:26.935962+0000","last_fullsized":"2023-12-04T05:37:26.935962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978321+0000","last_change":"2023-12-04T05:37:24.993989+0000","last_active":"2023-12-04T05:37:25.978321+0000","last_peered":"2023-12-04T05:37:25.978321+0000","last_clean":"2023-12-04T05:37:25.978321+0000","last_became_active":"2023-12-04T05:37:24.990547+0000","last_became_peered":"2023-12-04T05:37:24.990547+0000","last_unstale":"2023-12-04T05:37:25.978321+0000","last_undegraded":"2023-12-04T05:37:25.978321+0000","last_fullsized":"2023-12-04T05:37:25.978321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:18.892510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976949+0000","last_change":"2023-12-04T05:37:24.362595+0000","last_active":"2023-12-04T05:37:25.976949+0000","last_peered":"2023-12-04T05:37:25.976949+0000","last_clean":"2023-12-04T05:37:25.976949+0000","last_became_active":"2023-12-04T05:37:24.361717+0000","last_became_peered":"2023-12-04T05:37:24.361717+0000","last_unstale":"2023-12-04T05:37:25.976949+0000","last_undegraded":"2023-12-04T05:37:25.976949+0000","last_fullsized":"2023-12-04T05:37:25.976949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.976825+0000","last_change":"2023-12-04T05:37:24.985550+0000","last_active":"2023-12-04T05:37:25.976825+0000","last_peered":"2023-12-04T05:37:25.976825+0000","last_clean":"2023-12-04T05:37:25.976825+0000","last_became_active":"2023-12-04T05:37:24.984659+0000","last_became_peered":"2023-12-04T05:37:24.984659+0000","last_unstale":"2023-12-04T05:37:25.976825+0000","last_undegraded":"2023-12-04T05:37:25.976825+0000","last_fullsized":"2023-12-04T05:37:25.976825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.935776+0000","last_change":"2023-12-04T05:37:24.365186+0000","last_active":"2023-12-04T05:37:26.935776+0000","last_peered":"2023-12-04T05:37:26.935776+0000","last_clean":"2023-12-04T05:37:26.935776+0000","last_became_active":"2023-12-04T05:37:24.360434+0000","last_became_peered":"2023-12-04T05:37:24.360434+0000","last_unstale":"2023-12-04T05:37:26.935776+0000","last_undegraded":"2023-12-04T05:37:26.935776+0000","last_fullsized":"2023-12-04T05:37:26.935776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435041+0000","last_change":"2023-12-04T05:37:24.989352+0000","last_active":"2023-12-04T05:37:26.435041+0000","last_peered":"2023-12-04T05:37:26.435041+0000","last_clean":"2023-12-04T05:37:26.435041+0000","last_became_active":"2023-12-04T05:37:24.987078+0000","last_became_peered":"2023-12-04T05:37:24.987078+0000","last_unstale":"2023-12-04T05:37:26.435041+0000","last_undegraded":"2023-12-04T05:37:26.435041+0000","last_fullsized":"2023-12-04T05:37:26.435041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978627+0000","last_change":"2023-12-04T05:37:24.356767+0000","last_active":"2023-12-04T05:37:25.978627+0000","last_peered":"2023-12-04T05:37:25.978627+0000","last_clean":"2023-12-04T05:37:25.978627+0000","last_became_active":"2023-12-04T05:37:24.356474+0000","last_became_peered":"2023-12-04T05:37:24.356474+0000","last_unstale":"2023-12-04T05:37:25.978627+0000","last_undegraded":"2023-12-04T05:37:25.978627+0000","last_fullsized":"2023-12-04T05:37:25.978627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978127+0000","last_change":"2023-12-04T05:37:24.990350+0000","last_active":"2023-12-04T05:37:25.978127+0000","last_peered":"2023-12-04T05:37:25.978127+0000","last_clean":"2023-12-04T05:37:25.978127+0000","last_became_active":"2023-12-04T05:37:24.990101+0000","last_became_peered":"2023-12-04T05:37:24.990101+0000","last_unstale":"2023-12-04T05:37:25.978127+0000","last_undegraded":"2023-12-04T05:37:25.978127+0000","last_fullsized":"2023-12-04T05:37:25.978127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.435049+0000","last_change":"2023-12-04T05:37:24.365579+0000","last_active":"2023-12-04T05:37:26.435049+0000","last_peered":"2023-12-04T05:37:26.435049+0000","last_clean":"2023-12-04T05:37:26.435049+0000","last_became_active":"2023-12-04T05:37:24.364918+0000","last_became_peered":"2023-12-04T05:37:24.364918+0000","last_unstale":"2023-12-04T05:37:26.435049+0000","last_undegraded":"2023-12-04T05:37:26.435049+0000","last_fullsized":"2023-12-04T05:37:26.435049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:07.118802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:26.936395+0000","last_change":"2023-12-04T05:37:25.001807+0000","last_active":"2023-12-04T05:37:26.936395+0000","last_peered":"2023-12-04T05:37:26.936395+0000","last_clean":"2023-12-04T05:37:26.936395+0000","last_became_active":"2023-12-04T05:37:24.999364+0000","last_became_peered":"2023-12-04T05:37:24.999364+0000","last_unstale":"2023-12-04T05:37:26.936395+0000","last_undegraded":"2023-12-04T05:37:26.936395+0000","last_fullsized":"2023-12-04T05:37:26.936395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-04T05:37:25.978531+0000","last_change":"2023-12-04T05:37:24.361054+0000","last_active":"2023-12-04T05:37:25.978531+0000","last_peered":"2023-12-04T05:37:25.978531+0000","last_clean":"2023-12-04T05:37:25.978531+0000","last_became_active":"2023-12-04T05:37:24.360700+0000","last_became_peered":"2023-12-04T05:37:24.360700+0000","last_unstale":"2023-12-04T05:37:25.978531+0000","last_undegraded":"2023-12-04T05:37:25.978531+0000","last_fullsized":"2023-12-04T05:37:25.978531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-04T05:37:24.984931+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:24.984931+0000","last_peered":"2023-12-04T05:37:24.984931+0000","last_clean":"2023-12-04T05:37:24.984931+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:24.984931+0000","last_undegraded":"2023-12-04T05:37:24.984931+0000","last_fullsized":"2023-12-04T05:37:24.984931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.746},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.501}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.86199999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.77900000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79300000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.749}]},{"osd":5,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.90400000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.86399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.68700000000000006}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.72599999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.74299999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.89900000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.86799999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46000000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.438}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.626}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.44}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55700000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.79400000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.90700000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.98199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50700000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":724470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.36699999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.442}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.42599999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.495},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:34.281 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:37:34.282 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-04T05:37:34.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.454+0000 7fe5c909a640 1 Processor -- start 2023-12-04T05:37:34.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.454+0000 7fe5c909a640 1 -- start start 2023-12-04T05:37:34.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c909a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c909a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5c406c430 0x7fe5c40c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c909a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c4150bc0 con 0x7fe5c4154af0 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c909a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c4154fd0 con 0x7fe5c406c430 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c909a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4072160 con 0x7fe5c406c000 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c359e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe5c406c430 0x7fe5c40c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe5c4154af0 0x7fe5c40c1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50760/0 (socket says 172.21.15.97:50760) 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c259c640 1 -- 172.21.15.97:0/668356920 learned_addr learned my addr 172.21.15.97:0/668356920 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c2d9d640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c359e640 1 -- 172.21.15.97:0/668356920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 msgr2=0x7fe5c40700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c359e640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c40700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c359e640 1 -- 172.21.15.97:0/668356920 >> v1:172.21.15.97:6789/0 conn(0x7fe5c4154af0 legacy=0x7fe5c40c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c359e640 1 -- 172.21.15.97:0/668356920 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4072440 con 0x7fe5c406c430 2023-12-04T05:37:34.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.458+0000 7fe5c1d9b640 1 -- 172.21.15.97:0/668356920 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578530741 0 0) 0x7fe5c4150bc0 con 0x7fe5c4154af0 2023-12-04T05:37:34.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c359e640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c0870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009d90 tx=0x7fe5bc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cab2eb82264ac5d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c1d9b640 1 -- 172.21.15.97:0/668356920 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0a5890 con 0x7fe5c406c430 2023-12-04T05:37:34.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c1d9b640 1 -- 172.21.15.97:0/668356920 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0a59f0 con 0x7fe5c406c430 2023-12-04T05:37:34.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c1d9b640 1 -- 172.21.15.97:0/668356920 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0a5d80 con 0x7fe5c406c430 2023-12-04T05:37:34.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- 172.21.15.97:0/668356920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 msgr2=0x7fe5c40c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c0870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009d90 tx=0x7fe5bc01c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- 172.21.15.97:0/668356920 shutdown_connections 2023-12-04T05:37:34.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c0870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 --2- 172.21.15.97:0/668356920 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- 172.21.15.97:0/668356920 >> 172.21.15.97:0/668356920 conn(0x7fe5c40c5e70 msgr2=0x7fe5c40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:34.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- 172.21.15.97:0/668356920 shutdown_connections 2023-12-04T05:37:34.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- 172.21.15.97:0/668356920 wait complete. 2023-12-04T05:37:34.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 Processor -- start 2023-12-04T05:37:34.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.462+0000 7fe5c909a640 1 -- start start 2023-12-04T05:37:34.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c41eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 0x7fe5c414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41eefa0 con 0x7fe5c406c430 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40c42c0 con 0x7fe5c4154af0 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4153fe0 con 0x7fe5c406c000 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55272/0 (socket says 172.21.15.97:55272) 2023-12-04T05:37:34.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 -- 172.21.15.97:0/118134921 learned_addr learned my addr 172.21.15.97:0/118134921 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c2d9d640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c41eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c359e640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 0x7fe5c414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 -- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 msgr2=0x7fe5c41eea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c41eea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 -- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 msgr2=0x7fe5c414c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 0x7fe5c414c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 -- 172.21.15.97:0/118134921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009a70 con 0x7fe5c406c430 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c359e640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 0x7fe5c414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c259c640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c480 tx=0x7fe5b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80074e0 con 0x7fe5c406c430 2023-12-04T05:37:34.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8007660 con 0x7fe5c406c430 2023-12-04T05:37:34.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8004a30 con 0x7fe5c406c430 2023-12-04T05:37:34.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4153a20 con 0x7fe5c406c430 2023-12-04T05:37:34.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41eac80 con 0x7fe5c406c430 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c41eaae0 con 0x7fe5c406c430 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.466+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe5b8004b90 con 0x7fe5c406c430 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.470+0000 7fe5ab7fe640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 0x7fe5b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.470+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5b80835c0 con 0x7fe5c406c430 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.470+0000 7fe5c2d9d640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 0x7fe5b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.470+0000 7fe5c2d9d640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 0x7fe5b0068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400b9d0 tx=0x7fe5b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.474+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5c41eaae0 con 0x7fe5c406c430 2023-12-04T05:37:34.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.674+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe5c41eaae0 con 0x7fe5c406c430 2023-12-04T05:37:34.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5ab7fe640 1 -- 172.21.15.97:0/118134921 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe5c41eaae0 con 0x7fe5c406c430 2023-12-04T05:37:34.681 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-12-04T05:37:34.682 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg== 2023-12-04T05:37:34.682 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:37:34.682 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:37:34.682 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T05:37:34.682 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.0 2023-12-04T05:37:34.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 msgr2=0x7fe5b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 0x7fe5b0068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400b9d0 tx=0x7fe5b4008040 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 msgr2=0x7fe5c40c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c480 tx=0x7fe5b800c940 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 shutdown_connections 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe5b00668d0 0x7fe5b0068d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c4154af0 0x7fe5c414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe5c406c430 0x7fe5c40c3d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 --2- 172.21.15.97:0/118134921 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c406c000 0x7fe5c41eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 >> 172.21.15.97:0/118134921 conn(0x7fe5c40c5e70 msgr2=0x7fe5c4149550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 shutdown_connections 2023-12-04T05:37:34.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.678+0000 7fe5c909a640 1 -- 172.21.15.97:0/118134921 wait complete. 2023-12-04T05:37:34.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:34.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.834+0000 7f4369846640 1 Processor -- start 2023-12-04T05:37:34.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.834+0000 7f4369846640 1 -- start start 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4369846640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4364154d50 0x7f436406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4369846640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4369846640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436406c760 con 0x7f4364154260 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4369846640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640a8670 con 0x7f4364154d50 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4369846640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436406c550 con 0x7f43640a9470 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f435a7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4364154d50 0x7f436406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4362ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4364154260 0x7f4364154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50770/0 (socket says 172.21.15.97:50770) 2023-12-04T05:37:34.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f4362ffd640 1 -- 172.21.15.97:0/306669880 learned_addr learned my addr 172.21.15.97:0/306669880 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f43637fe640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f435a7fc640 1 -- 172.21.15.97:0/306669880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 msgr2=0x7f436406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f435a7fc640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f435a7fc640 1 -- 172.21.15.97:0/306669880 >> v1:172.21.15.97:6789/0 conn(0x7f4364154260 legacy=0x7f4364154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f435a7fc640 1 -- 172.21.15.97:0/306669880 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436406ca40 con 0x7f4364154d50 2023-12-04T05:37:34.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.838+0000 7f43627fc640 1 -- 172.21.15.97:0/306669880 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901178059 0 0) 0x7f436406c760 con 0x7f4364154260 2023-12-04T05:37:34.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f435a7fc640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f436406d800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097c0 tx=0x7f434c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6be2be7638cf76 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f43627fc640 1 -- 172.21.15.97:0/306669880 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0ab600 con 0x7f4364154d50 2023-12-04T05:37:34.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f43627fc640 1 -- 172.21.15.97:0/306669880 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c0a7050 con 0x7f4364154d50 2023-12-04T05:37:34.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f43627fc640 1 -- 172.21.15.97:0/306669880 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0ab980 con 0x7f4364154d50 2023-12-04T05:37:34.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- 172.21.15.97:0/306669880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 msgr2=0x7f436406d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f436406d800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097c0 tx=0x7f434c01c450 comp rx=0 tx=0).stop 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- 172.21.15.97:0/306669880 shutdown_connections 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- 172.21.15.97:0/306669880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f436406d800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- 172.21.15.97:0/306669880 >> 172.21.15.97:0/306669880 conn(0x7f43640c2970 msgr2=0x7f43640c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- 172.21.15.97:0/306669880 shutdown_connections 2023-12-04T05:37:34.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- 172.21.15.97:0/306669880 wait complete. 2023-12-04T05:37:34.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 Processor -- start 2023-12-04T05:37:34.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- start start 2023-12-04T05:37:34.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4364154260 0x7f4364147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4364145740 con 0x7f4364154d50 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4364146690 con 0x7f4364154260 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.842+0000 7f4369846640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436415d740 con 0x7f43640a9470 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55296/0 (socket says 172.21.15.97:55296) 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 -- 172.21.15.97:0/2364992097 learned_addr learned my addr 172.21.15.97:0/2364992097 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f435a7fc640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4364154260 0x7f4364147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4362ffd640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 -- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 msgr2=0x7f436415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 -- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4364154260 msgr2=0x7f4364147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4364154260 0x7f4364147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:34.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 -- 172.21.15.97:0/2364992097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009420 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4362ffd640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f43637fe640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d600 tx=0x7f435c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0125f0 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c012770 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436415dfa0 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c012b20 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4364145510 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436415e130 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f435c012c80 con 0x7f4364154d50 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.846+0000 7f4360ff9640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 0x7f4344068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:34.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.850+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f435c0848d0 con 0x7f4364154d50 2023-12-04T05:37:34.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.850+0000 7f4362ffd640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 0x7f4344068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:34.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.850+0000 7f4362ffd640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 0x7f4344068dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4354005fd0 tx=0x7f4354005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:34.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:34.850+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f435c051b00 con 0x7f4364154d50 2023-12-04T05:37:35.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.034+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4364068440 con 0x7f4364154d50 2023-12-04T05:37:35.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.034+0000 7f4360ff9640 1 -- 172.21.15.97:0/2364992097 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f435c055120 con 0x7f4364154d50 2023-12-04T05:37:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:35.039 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4888,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-04T05:37:35.039 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 17 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 msgr2=0x7f4344068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 0x7f4344068dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4354005fd0 tx=0x7f4354005b80 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 msgr2=0x7f43640c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d600 tx=0x7f435c00dac0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 shutdown_connections 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4344066900 0x7f4344068dc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4364154d50 0x7f43640c40c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4364154260 0x7f4364147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 --2- 172.21.15.97:0/2364992097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43640a9470 0x7f436415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 >> 172.21.15.97:0/2364992097 conn(0x7f43640c2970 msgr2=0x7f43640a9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 shutdown_connections 2023-12-04T05:37:35.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.038+0000 7f4369846640 1 -- 172.21.15.97:0/2364992097 wait complete. 2023-12-04T05:37:35.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T05:37:24.724414+0000', 'modified': '2023-12-04T05:37:27.727068+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4989': {'gid': 4989, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6836/525136181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 525136181}, {'type': 'v1', 'addr': '172.21.15.97:6836', 'nonce': 525136181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T05:37:35.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T05:37:35.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-04T05:37:35.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 Processor -- start 2023-12-04T05:37:35.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 -- start start 2023-12-04T05:37:35.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 0x7efd78152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78072410 0x7efd780c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780a54c0 con 0x7efd780c2a20 2023-12-04T05:37:35.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd78072c20 con 0x7efd78072410 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd7d2bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd781531f0 con 0x7efd7814fab0 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78072410 0x7efd780c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78072410 0x7efd780c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55310/0 (socket says 172.21.15.97:55310) 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 -- 172.21.15.97:0/450093629 learned_addr learned my addr 172.21.15.97:0/450093629 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 -- 172.21.15.97:0/450093629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 msgr2=0x7efd78152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd77fff640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 0x7efd78152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 0x7efd78152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 -- 172.21.15.97:0/450093629 >> v1:172.21.15.143:6789/0 conn(0x7efd780c2a20 legacy=0x7efd780c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd777fe640 1 -- 172.21.15.97:0/450093629 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780aa0c0 con 0x7efd78072410 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.602+0000 7efd77fff640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 0x7efd78152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd777fe640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78072410 0x7efd780c24e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03ea2f3ff80b881 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd76ffd640 1 -- 172.21.15.97:0/450093629 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0ab600 con 0x7efd78072410 2023-12-04T05:37:35.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd76ffd640 1 -- 172.21.15.97:0/450093629 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c0ab760 con 0x7efd78072410 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd76ffd640 1 -- 172.21.15.97:0/450093629 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0abaf0 con 0x7efd78072410 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 -- 172.21.15.97:0/450093629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78072410 msgr2=0x7efd780c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78072410 0x7efd780c24e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c01c440 comp rx=0 tx=0).stop 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 -- 172.21.15.97:0/450093629 shutdown_connections 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78072410 0x7efd780c24e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/450093629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd7814fab0 0x7efd78152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 -- 172.21.15.97:0/450093629 >> 172.21.15.97:0/450093629 conn(0x7efd7806ad80 msgr2=0x7efd780c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 -- 172.21.15.97:0/450093629 shutdown_connections 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.606+0000 7efd7d2bb640 1 -- 172.21.15.97:0/450093629 wait complete. 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 Processor -- start 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- start start 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 0x7efd781f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd780c2a20 0x7efd781500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781ed290 con 0x7efd7814fab0 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd78148ec0 con 0x7efd780c2a20 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd78151b60 con 0x7efd78072410 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55320/0 (socket says 172.21.15.97:55320) 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 -- 172.21.15.97:0/1676003926 learned_addr learned my addr 172.21.15.97:0/1676003926 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd777fe640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd780c2a20 0x7efd781500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd77fff640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 0x7efd781f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 -- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 msgr2=0x7efd781f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 0x7efd781f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 -- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd780c2a20 msgr2=0x7efd781500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd780c2a20 0x7efd781500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 -- 172.21.15.97:0/1676003926 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0094d0 con 0x7efd7814fab0 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd77fff640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 0x7efd781f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:35.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7caba640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c780 tx=0x7efd7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd74ff9640 1 -- 172.21.15.97:0/1676003926 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70004b70 con 0x7efd7814fab0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd74ff9640 1 -- 172.21.15.97:0/1676003926 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000ce90 con 0x7efd7814fab0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78151e40 con 0x7efd7814fab0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd74ff9640 1 -- 172.21.15.97:0/1676003926 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000a850 con 0x7efd7814fab0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.610+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780a6ea0 con 0x7efd7814fab0 2023-12-04T05:37:35.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd74ff9640 1 -- 172.21.15.97:0/1676003926 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd7000a9b0 con 0x7efd7814fab0 2023-12-04T05:37:35.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd74ff9640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 0x7efd64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd74ff9640 1 -- 172.21.15.97:0/1676003926 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd700845a0 con 0x7efd7814fab0 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd77fff640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 0x7efd64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 Processor -- start 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 -- start start 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd77fff640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 0x7efd64068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd6800a9b0 tx=0x7efd68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e093419fc0 0x55e09341a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 0x55e093464ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0932e3110 con 0x55e09341a8e0 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0932739a0 con 0x55e093419fc0 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e093270ed0 con 0x55e09341b200 2023-12-04T05:37:35.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55332/0 (socket says 172.21.15.97:55332) 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 -- 172.21.15.97:0/2431003128 learned_addr learned my addr 172.21.15.97:0/2431003128 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd77fff640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e093419fc0 0x55e09341a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd7caba640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 0x55e093464ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 -- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 msgr2=0x55e093464ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 0x55e093464ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 -- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e093419fc0 msgr2=0x55e09341a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e093419fc0 0x55e09341a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd777fe640 1 -- 172.21.15.97:0/2431003128 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e092f64890 con 0x55e09341a8e0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.614+0000 7efd7caba640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 0x55e093464ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd777fe640 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01cce0 tx=0x7efd6c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c042959c25d168cb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd5dffb640 1 -- 172.21.15.97:0/2431003128 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0aba90 con 0x55e09341a8e0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd5dffb640 1 -- 172.21.15.97:0/2431003128 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c0abbf0 con 0x55e09341a8e0 2023-12-04T05:37:35.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd5dffb640 1 -- 172.21.15.97:0/2431003128 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0be410 con 0x55e09341a8e0 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- 172.21.15.97:0/2431003128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 msgr2=0x55e09341acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01cce0 tx=0x7efd6c0a7000 comp rx=0 tx=0).stop 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- 172.21.15.97:0/2431003128 shutdown_connections 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e09341b200 0x55e093464ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09341acc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- 172.21.15.97:0/2431003128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e093419fc0 0x55e09341a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- 172.21.15.97:0/2431003128 >> 172.21.15.97:0/2431003128 conn(0x55e093458830 msgr2=0x55e09345ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- 172.21.15.97:0/2431003128 shutdown_connections 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- 172.21.15.97:0/2431003128 wait complete. 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- start start 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 Processor -- start 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093420e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e093421360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09326c7c0 con 0x55e09341b200 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e093224bf0 con 0x55e09341a8e0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e09322aa90 con 0x55e093419fc0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd81884000 10 client.0 _ll_register_callbacks cb 0x55e093407e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55336/0 (socket says 172.21.15.97:55336) 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 -- 172.21.15.97:0/3173798432 learned_addr learned my addr 172.21.15.97:0/3173798432 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd77fff640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093420e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd777fe640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e093421360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 -- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 msgr2=0x55e093420e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093420e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 -- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 msgr2=0x55e093421360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e093421360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.618+0000 7efd7caba640 1 -- 172.21.15.97:0/3173798432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780aa0c0 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd7caba640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd70055420 tx=0x7efd700595e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31918895cd2dd45 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70080070 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e09322e470 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd700538f0 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd70051ba0 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 10 client.5184 fetch_fsmap learned FSMap version 17 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e09322d190 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09322e470 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd70019070 con 0x55e09341b200 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 10 client.5184 fetch_fsmap finished waiting for FSMap version 17 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 10 client.5184 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T05:37:35.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 20 client.5184 populate_metadata read hostname 'smithi097' 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e09346de40 0x55e093470230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 4 client.5184 mds_command: new command op to 4989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 --> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e093231b50 con 0x55e09346de40 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd77fff640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e09346de40 0x55e093470230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd77fff640 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e09346de40 0x55e093470230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be032f6c0e330af6 server_cookie=d62ea41fc77cc76 in_seq=0 out_seq=0 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 10 client.5184 ms_handle_connect on v2:172.21.15.97:6834/525136181 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 1 -- 172.21.15.97:0/3173798432 <== mds.0 v2:172.21.15.97:6834/525136181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e093231b50 con 0x55e09346de40 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 10 client.5184 handle_command_reply: tid=0 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 client.5184 shutdown 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 msgr2=0x55e0934218a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd70055420 tx=0x7efd700595e0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 shutdown_connections 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e09346de40 0x55e093470230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e0934218a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e093421360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd56ffd640 0 client.5184 ms_handle_reset on v2:172.21.15.97:6834/525136181 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 --2- 172.21.15.97:0/3173798432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093420e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 >> 172.21.15.97:0/3173798432 conn(0x55e093458830 msgr2=0x55e09345ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 shutdown_connections 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 1 -- 172.21.15.97:0/3173798432 wait complete. 2023-12-04T05:37:35.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.622+0000 7efd81884000 20 client.5184 trim_cache size 0 max 16384 2023-12-04T05:37:35.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 Processor -- start 2023-12-04T05:37:35.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 -- start start 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e09346e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e09346e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e092f25940 con 0x55e09341b200 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e093266ac0 con 0x55e09341a8e0 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0932ad440 con 0x55e093419fc0 2023-12-04T05:37:35.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55352/0 (socket says 172.21.15.97:55352) 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 -- 172.21.15.97:0/1563810166 learned_addr learned my addr 172.21.15.97:0/1563810166 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd777fe640 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e09346e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd77fff640 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e09346e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 -- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 msgr2=0x55e09346e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e09346e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 -- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 msgr2=0x55e09346e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e09346e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 -- 172.21.15.97:0/1563810166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e093213490 con 0x55e09341b200 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.638+0000 7efd7caba640 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efd7005d260 tx=0x7efd70059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a77bec75026bf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd5e7fc640 1 -- 172.21.15.97:0/1563810166 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70080070 con 0x55e09341b200 2023-12-04T05:37:35.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd5e7fc640 1 -- 172.21.15.97:0/1563810166 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70082e90 con 0x55e09341b200 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd5e7fc640 1 -- 172.21.15.97:0/1563810166 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70055260 con 0x55e09341b200 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/1563810166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 msgr2=0x55e09346eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efd7005d260 tx=0x7efd70059000 comp rx=0 tx=0).stop 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/1563810166 shutdown_connections 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341b200 0x55e09346eca0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341a8e0 0x55e09346e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- 172.21.15.97:0/1563810166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e09346e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/1563810166 >> 172.21.15.97:0/1563810166 conn(0x55e093458830 msgr2=0x55e093419860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/1563810166 shutdown_connections 2023-12-04T05:37:35.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/1563810166 wait complete. 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- start start 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 Processor -- start 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093471550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341b200 0x55e093480220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09326b650 con 0x55e09341a8e0 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e09326f320 con 0x55e09341b200 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e093424510 con 0x55e093419fc0 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 10 client.0 _ll_register_callbacks cb 0x55e0932778e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:37:35.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55358/0 (socket says 172.21.15.97:55358) 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 -- 172.21.15.97:0/3766308119 learned_addr learned my addr 172.21.15.97:0/3766308119 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd7caba640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341b200 0x55e093480220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd77fff640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093471550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 -- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 msgr2=0x55e093471550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093471550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 -- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341b200 msgr2=0x55e093480220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341b200 0x55e093480220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 -- 172.21.15.97:0/3766308119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e09322d190 con 0x55e09341a8e0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd777fe640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01cce0 tx=0x7efd6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b52ba0fdb20a85d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c004240 con 0x55e09341a8e0 2023-12-04T05:37:35.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd6c0043a0 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.642+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e09341ef20 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6c003620 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 10 client.5190 fetch_fsmap learned FSMap version 17 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e092f64cc0 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e09341ef20 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd6c003780 con 0x55e09341a8e0 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 20 client.5190 populate_metadata read hostname 'smithi097' 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e093471a90 0x55e093480760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 4 client.5190 mds_command: new command op to 4989 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T05:37:35.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 --> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e09326b110 con 0x55e093471a90 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd77fff640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e093471a90 0x55e093480760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 10 client.5190 ms_handle_connect on v2:172.21.15.97:6834/525136181 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd77fff640 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e093471a90 0x55e093480760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd20bc2bebc3b7e8 server_cookie=3de4258d232b0630 in_seq=0 out_seq=0 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 1 -- 172.21.15.97:0/3766308119 <== mds.0 v2:172.21.15.97:6834/525136181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e09326b110 con 0x55e093471a90 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 10 client.5190 handle_command_reply: tid=0 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 client.5190 shutdown 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 msgr2=0x55e09347fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd6c01cce0 tx=0x7efd6c0046d0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 shutdown_connections 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:6834/525136181,v1:172.21.15.97:6836/525136181] conn(0x55e093471a90 0x55e093480760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e09341b200 0x55e093480220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e09341a8e0 0x55e09347fce0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 --2- 172.21.15.97:0/3766308119 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e093419fc0 0x55e093471550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd56ffd640 0 client.5190 ms_handle_reset on v2:172.21.15.97:6834/525136181 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 >> 172.21.15.97:0/3766308119 conn(0x55e093458830 msgr2=0x55e0934b7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 shutdown_connections 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 1 -- 172.21.15.97:0/3766308119 wait complete. 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd81884000 20 client.5190 trim_cache size 0 max 16384 2023-12-04T05:37:35.656 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "76f28696-8109-44bf-b432-6ecc5796b8c9", 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 4989, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 10.312004789, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 17, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 31, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 31, 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 18.163671794999999 2023-12-04T05:37:35.657 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:37:35.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 msgr2=0x7efd64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 0x7efd64068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd6800a9b0 tx=0x7efd68008040 comp rx=0 tx=0).stop 2023-12-04T05:37:35.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 msgr2=0x7efd780a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c780 tx=0x7efd7000cc40 comp rx=0 tx=0).stop 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 shutdown_connections 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd640668d0 0x7efd64068d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814fab0 0x7efd780a6960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd780c2a20 0x7efd781500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 --2- 172.21.15.97:0/1676003926 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78072410 0x7efd781f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 >> 172.21.15.97:0/1676003926 conn(0x7efd7806ad80 msgr2=0x7efd780663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 shutdown_connections 2023-12-04T05:37:35.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.646+0000 7efd7d2bb640 1 -- 172.21.15.97:0/1676003926 wait complete. 2023-12-04T05:37:35.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:37:35.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 Processor -- start 2023-12-04T05:37:35.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 -- start start 2023-12-04T05:37:35.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0168154f90 0x7f01680c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f016806cae0 0x7f01680c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016814ea30 con 0x7f016814e650 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680c6720 con 0x7f016806cae0 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f016d446640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680c49b0 con 0x7f0168154f90 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01677fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f016806cae0 0x7f01680c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f0166ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f016814e650 0x7f01680abb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50774/0 (socket says 172.21.15.97:50774) 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f0166ffd640 1 -- 172.21.15.97:0/3360593580 learned_addr learned my addr 172.21.15.97:0/3360593580 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01667fc640 1 --2- 172.21.15.97:0/3360593580 >> v2:172.21.15.143:3300/0 conn(0x7f0168154f90 0x7f01680c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01677fe640 1 -- 172.21.15.97:0/3360593580 >> v2:172.21.15.143:3300/0 conn(0x7f0168154f90 msgr2=0x7f01680c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01677fe640 1 --2- 172.21.15.97:0/3360593580 >> v2:172.21.15.143:3300/0 conn(0x7f0168154f90 0x7f01680c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01677fe640 1 -- 172.21.15.97:0/3360593580 >> v1:172.21.15.97:6789/0 conn(0x7f016814e650 legacy=0x7f01680abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f01677fe640 1 -- 172.21.15.97:0/3360593580 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680c4c50 con 0x7f016806cae0 2023-12-04T05:37:35.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.806+0000 7f0165ffb640 1 -- 172.21.15.97:0/3360593580 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729294498 0 0) 0x7f0158001120 con 0x7f016814e650 2023-12-04T05:37:35.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f01677fe640 1 --2- 172.21.15.97:0/3360593580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f016806cae0 0x7f01680c70f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f01680b0180 tx=0x7f016001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a49a5faa95297b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f0165ffb640 1 -- 172.21.15.97:0/3360593580 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600a57e0 con 0x7f016806cae0 2023-12-04T05:37:35.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f0165ffb640 1 -- 172.21.15.97:0/3360593580 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600a5940 con 0x7f016806cae0 2023-12-04T05:37:35.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f0165ffb640 1 -- 172.21.15.97:0/3360593580 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600a5cd0 con 0x7f016806cae0 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 -- 172.21.15.97:0/3360593580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f016806cae0 msgr2=0x7f01680c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 --2- 172.21.15.97:0/3360593580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f016806cae0 0x7f01680c70f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f01680b0180 tx=0x7f016001c7f0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 -- 172.21.15.97:0/3360593580 shutdown_connections 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 --2- 172.21.15.97:0/3360593580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f016806cae0 0x7f01680c70f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 --2- 172.21.15.97:0/3360593580 >> v2:172.21.15.143:3300/0 conn(0x7f0168154f90 0x7f01680c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 -- 172.21.15.97:0/3360593580 >> 172.21.15.97:0/3360593580 conn(0x7f0168073550 msgr2=0x7f0168073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 -- 172.21.15.97:0/3360593580 shutdown_connections 2023-12-04T05:37:35.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 -- 172.21.15.97:0/3360593580 wait complete. 2023-12-04T05:37:35.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.810+0000 7f016d446640 1 Processor -- start 2023-12-04T05:37:35.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- start start 2023-12-04T05:37:35.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f016806cae0 0x7f01681522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f016814e650 0x7f0168157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680c3800 con 0x7f0168154f90 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168154310 con 0x7f016814e650 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01681ec810 con 0x7f016806cae0 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55384/0 (socket says 172.21.15.97:55384) 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 -- 172.21.15.97:0/1107337511 learned_addr learned my addr 172.21.15.97:0/1107337511 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01667fc640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f016814e650 0x7f0168157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f0166ffd640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f016806cae0 0x7f01681522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 -- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f016806cae0 msgr2=0x7f01681522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f016806cae0 0x7f01681522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 -- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f016814e650 msgr2=0x7f0168157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:35.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f016814e650 0x7f0168157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:35.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 -- 172.21.15.97:0/1107337511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160009a70 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f01677fe640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f016001ccd0 tx=0x7f0160019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600ad440 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600ad5a0 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01680c3aa0 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600ad910 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01681ecad0 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.814+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01681eccc0 con 0x7f0168154f90 2023-12-04T05:37:35.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.818+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f01600ada70 con 0x7f0168154f90 2023-12-04T05:37:35.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.818+0000 7f014f7fe640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 0x7f0154068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:35.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.818+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f016011f550 con 0x7f0168154f90 2023-12-04T05:37:35.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.818+0000 7f0166ffd640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 0x7f0154068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:35.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.818+0000 7f0166ffd640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 0x7f0154068dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0158000f70 tx=0x7f0158007ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:35.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:35.822+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01600ec710 con 0x7f0168154f90 2023-12-04T05:37:36.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0168068440 con 0x7f0168154f90 2023-12-04T05:37:36.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f014f7fe640 1 -- 172.21.15.97:0/1107337511 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f01600bc060 con 0x7f0168154f90 2023-12-04T05:37:36.006 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 msgr2=0x7f0154068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 0x7f0154068dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0158000f70 tx=0x7f0158007ba0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 msgr2=0x7f016814cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f016001ccd0 tx=0x7f0160019590 comp rx=0 tx=0).stop 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 shutdown_connections 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0154066900 0x7f0154068dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0168154f90 0x7f016814cee0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f016814e650 0x7f0168157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 --2- 172.21.15.97:0/1107337511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f016806cae0 0x7f01681522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 >> 172.21.15.97:0/1107337511 conn(0x7f0168073550 msgr2=0x7f01680c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:36.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 shutdown_connections 2023-12-04T05:37:36.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.002+0000 7f016d446640 1 -- 172.21.15.97:0/1107337511 wait complete. 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:36.027 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:37:36.028 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:37:36.028 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:37:36.028 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:36.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.028 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.038 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42093sec preferred_lft 42093sec 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.039 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:37:36.040 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:36.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.041 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:37:36.099 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:37:36.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.101 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:37:36.154 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:36.155 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:37:36.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:37:36.156 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:37:36.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.247 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:37:36.256 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:37:36.257 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:36.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.257 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:37:36.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:36.321 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:36.380 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:36.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:36.380 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:36.432 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T05:37:36.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:36.521 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:36.521 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:36.534 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:36.534 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:36.534 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:37:36.535 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 0@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:37:36.535 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:37:36.539 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:37:36.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:36.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:36.560 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:37:36.625 INFO:teuthology.orchestra.run.smithi097.stdout:client4865 2023-12-04T05:37:36.626 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:36.626 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:36.676 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:37:36.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 Processor -- start 2023-12-04T05:37:36.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 -- start start 2023-12-04T05:37:36.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f68d814e970 0x7f68d806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:36.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d8152300 con 0x7f68d806ca50 2023-12-04T05:37:36.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d8071580 con 0x7f68d806be00 2023-12-04T05:37:36.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68de301640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d814ed50 con 0x7f68d814e970 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68dc89e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f68d806ca50 0x7f68d80c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50786/0 (socket says 172.21.15.97:50786) 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68dc89e640 1 -- 172.21.15.97:0/230404925 learned_addr learned my addr 172.21.15.97:0/230404925 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d7fff640 1 --2- 172.21.15.97:0/230404925 >> v2:172.21.15.143:3300/0 conn(0x7f68d814e970 0x7f68d806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d6ffd640 1 -- 172.21.15.97:0/230404925 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137939659 0 0) 0x7f68d00014a0 con 0x7f68d806ca50 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d6ffd640 1 -- 172.21.15.97:0/230404925 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c0003530 con 0x7f68d806ca50 2023-12-04T05:37:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d7fff640 1 -- 172.21.15.97:0/230404925 >> v1:172.21.15.143:6789/0 conn(0x7f68d806be00 legacy=0x7f68d8071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d7fff640 1 -- 172.21.15.97:0/230404925 >> v1:172.21.15.97:6789/0 conn(0x7f68d806ca50 legacy=0x7f68d80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.858+0000 7f68d7fff640 1 -- 172.21.15.97:0/230404925 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d8151d60 con 0x7f68d814e970 2023-12-04T05:37:36.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68d7fff640 1 --2- 172.21.15.97:0/230404925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d814e970 0x7f68d806e150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097c0 tx=0x7f68c801e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a47b886cc2ad5d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:36.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68d6ffd640 1 -- 172.21.15.97:0/230404925 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80aa430 con 0x7f68d814e970 2023-12-04T05:37:36.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68d6ffd640 1 -- 172.21.15.97:0/230404925 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c80aa590 con 0x7f68d814e970 2023-12-04T05:37:36.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68d6ffd640 1 -- 172.21.15.97:0/230404925 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80aa920 con 0x7f68d814e970 2023-12-04T05:37:36.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 -- 172.21.15.97:0/230404925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d814e970 msgr2=0x7f68d806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 --2- 172.21.15.97:0/230404925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d814e970 0x7f68d806e150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097c0 tx=0x7f68c801e600 comp rx=0 tx=0).stop 2023-12-04T05:37:36.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 -- 172.21.15.97:0/230404925 shutdown_connections 2023-12-04T05:37:36.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 --2- 172.21.15.97:0/230404925 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d814e970 0x7f68d806e150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 -- 172.21.15.97:0/230404925 >> 172.21.15.97:0/230404925 conn(0x7f68d80c2970 msgr2=0x7f68d80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:36.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 -- 172.21.15.97:0/230404925 shutdown_connections 2023-12-04T05:37:36.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.862+0000 7f68de301640 1 -- 172.21.15.97:0/230404925 wait complete. 2023-12-04T05:37:36.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 Processor -- start 2023-12-04T05:37:36.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- start start 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d806be00 0x7f68d80bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d806ca50 0x7f68d8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80ab620 con 0x7f68d814e970 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8144870 con 0x7f68d806be00 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c4ba0 con 0x7f68d806ca50 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55398/0 (socket says 172.21.15.97:55398) 2023-12-04T05:37:36.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 -- 172.21.15.97:0/1695437418 learned_addr learned my addr 172.21.15.97:0/1695437418 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68d7fff640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d806be00 0x7f68d80bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68d77fe640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d806ca50 0x7f68d8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 -- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d806ca50 msgr2=0x7f68d8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d806ca50 0x7f68d8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 -- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d806be00 msgr2=0x7f68d80bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d806be00 0x7f68d80bfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 -- 172.21.15.97:0/1695437418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009420 con 0x7f68d814e970 2023-12-04T05:37:36.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68dc89e640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f68d000cb40 tx=0x7f68d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000aca0 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000ae00 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0012620 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d80c4e80 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.866+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d80ab100 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d80ab2f0 con 0x7f68d814e970 2023-12-04T05:37:36.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f68d0007070 con 0x7f68d814e970 2023-12-04T05:37:36.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68d4ff9640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 0x7f68c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:36.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68d0084270 con 0x7f68d814e970 2023-12-04T05:37:36.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68d7fff640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 0x7f68c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:36.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.870+0000 7f68d7fff640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 0x7f68c4068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b1000 tx=0x7f68c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:36.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:36.874+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68d0051550 con 0x7f68d814e970 2023-12-04T05:37:37.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.054+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68d8152300 con 0x7f68d814e970 2023-12-04T05:37:37.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.054+0000 7f68d4ff9640 1 -- 172.21.15.97:0/1695437418 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68d0017060 con 0x7f68d814e970 2023-12-04T05:37:37.059 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:37:37.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 msgr2=0x7f68c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:37.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 0x7f68c4068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f68c80b1000 tx=0x7f68c8008040 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 msgr2=0x7f68d8141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f68d000cb40 tx=0x7f68d000a060 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 shutdown_connections 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68c40668d0 0x7f68c4068d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68d814e970 0x7f68d8141e40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d806ca50 0x7f68d8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 --2- 172.21.15.97:0/1695437418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d806be00 0x7f68d80bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 >> 172.21.15.97:0/1695437418 conn(0x7f68d80c2970 msgr2=0x7f68d815bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 shutdown_connections 2023-12-04T05:37:37.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.058+0000 7f68de301640 1 -- 172.21.15.97:0/1695437418 wait complete. 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:37:37.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:37.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.082 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.093 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:37:37.094 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:37.094 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.094 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:37:37.097 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:37.098 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.099 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:37:37.099 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.099 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42085sec preferred_lft 42085sec 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:37:37.101 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:37:37.102 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:37.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.104 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:37:37.165 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:37:37.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.167 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:37:37.223 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:37.224 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:37.226 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:37.226 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:37:37.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:37:37.226 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:37:37.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.325 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:37:37.335 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:37:37.336 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:37.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.337 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:37:37.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:37.405 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:37.460 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:37.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:37.460 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:37.512 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-04T05:37:37.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.512 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:37.607 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:37.607 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:37.620 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:37.620 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:37.620 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:37:37.620 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:37:37.620 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:37:37.624 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:37:37.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.624 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:37.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:37.692 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:37:37.747 INFO:teuthology.orchestra.run.smithi143.stdout:client4871 2023-12-04T05:37:37.747 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:37.747 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:37.800 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-04T05:37:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.934+0000 7efd7e0d6640 1 Processor -- start 2023-12-04T05:37:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.934+0000 7efd7e0d6640 1 -- start start 2023-12-04T05:37:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd7e0d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd7814f960 0x7efd781548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd7e0d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78154e10 0x7efd7815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd7e0d6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd78154640 con 0x7efd7814eb30 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd7e0d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780c0bd0 con 0x7efd78154e10 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd7e0d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7814ef10 con 0x7efd7814f960 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78154e10 0x7efd7815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd78154e10 0x7efd7815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55406/0 (socket says 172.21.15.97:55406) 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 -- 172.21.15.97:0/3238043566 learned_addr learned my addr 172.21.15.97:0/3238043566 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd6ffff640 1 --2- 172.21.15.97:0/3238043566 >> v2:172.21.15.143:3300/0 conn(0x7efd7814f960 0x7efd781548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 -- 172.21.15.97:0/3238043566 >> v2:172.21.15.143:3300/0 conn(0x7efd7814f960 msgr2=0x7efd781548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 --2- 172.21.15.97:0/3238043566 >> v2:172.21.15.143:3300/0 conn(0x7efd7814f960 0x7efd781548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 -- 172.21.15.97:0/3238043566 >> v1:172.21.15.143:6789/0 conn(0x7efd7814eb30 legacy=0x7efd7814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:37.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.938+0000 7efd77fff640 1 -- 172.21.15.97:0/3238043566 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd781535a0 con 0x7efd78154e10 2023-12-04T05:37:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd77fff640 1 --2- 172.21.15.97:0/3238043566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78154e10 0x7efd7815bc60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd7806e7f0 tx=0x7efd7001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e7a567dc9cc282 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd76ffd640 1 -- 172.21.15.97:0/3238043566 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700a5730 con 0x7efd78154e10 2023-12-04T05:37:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd76ffd640 1 -- 172.21.15.97:0/3238043566 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd700a5890 con 0x7efd78154e10 2023-12-04T05:37:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd76ffd640 1 -- 172.21.15.97:0/3238043566 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700a5c20 con 0x7efd78154e10 2023-12-04T05:37:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- 172.21.15.97:0/3238043566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78154e10 msgr2=0x7efd7815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/3238043566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78154e10 0x7efd7815bc60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd7806e7f0 tx=0x7efd7001c960 comp rx=0 tx=0).stop 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- 172.21.15.97:0/3238043566 shutdown_connections 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/3238043566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd78154e10 0x7efd7815bc60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/3238043566 >> v2:172.21.15.143:3300/0 conn(0x7efd7814f960 0x7efd781548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- 172.21.15.97:0/3238043566 >> 172.21.15.97:0/3238043566 conn(0x7efd780c5e70 msgr2=0x7efd780c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- 172.21.15.97:0/3238043566 shutdown_connections 2023-12-04T05:37:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- 172.21.15.97:0/3238043566 wait complete. 2023-12-04T05:37:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 Processor -- start 2023-12-04T05:37:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- start start 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78154e10 0x7efd78141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780c4e00 con 0x7efd7814f960 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780c3d50 con 0x7efd7814eb30 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd7e0d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd781edcf0 con 0x7efd78154e10 2023-12-04T05:37:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.942+0000 7efd777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:37344/0 (socket says 172.21.15.97:37344) 2023-12-04T05:37:37.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55414/0 (socket says 172.21.15.97:55414) 2023-12-04T05:37:37.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 -- 172.21.15.97:0/4180212328 learned_addr learned my addr 172.21.15.97:0/4180212328 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:37.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd77fff640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78154e10 0x7efd78141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 -- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78154e10 msgr2=0x7efd78141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78154e10 0x7efd78141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 -- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 msgr2=0x7efd781419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 -- 172.21.15.97:0/4180212328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009b30 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd6ffff640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd777fe640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c450 tx=0x7efd6800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68012830 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680129b0 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd780ab420 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68012d60 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780aafd0 con 0x7efd7814eb30 2023-12-04T05:37:37.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780c4f40 con 0x7efd7814eb30 2023-12-04T05:37:37.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.946+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd6801c460 con 0x7efd7814eb30 2023-12-04T05:37:37.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.950+0000 7efd74ff9640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:37.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.950+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd68084a60 con 0x7efd7814eb30 2023-12-04T05:37:37.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.950+0000 7efd6ffff640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:37.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.950+0000 7efd6ffff640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 0x7efd58068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd7814d080 tx=0x7efd60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:37.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:37.950+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd68051dc0 con 0x7efd7814eb30 2023-12-04T05:37:38.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.154+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7efd780c4f40 con 0x7efd7814eb30 2023-12-04T05:37:38.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.154+0000 7efd74ff9640 1 -- 172.21.15.97:0/4180212328 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7efd780c4f40 con 0x7efd7814eb30 2023-12-04T05:37:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 msgr2=0x7efd58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 0x7efd58068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd7814d080 tx=0x7efd60008040 comp rx=0 tx=0).stop 2023-12-04T05:37:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 msgr2=0x7efd780aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c450 tx=0x7efd6800c910 comp rx=0 tx=0).stop 2023-12-04T05:37:38.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 shutdown_connections 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd78154e10 0x7efd78141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd7814f960 0x7efd781419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 --2- 172.21.15.97:0/4180212328 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd7814eb30 0x7efd780aaa90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 >> 172.21.15.97:0/4180212328 conn(0x7efd780c5e70 msgr2=0x7efd780c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 shutdown_connections 2023-12-04T05:37:38.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.158+0000 7efd7e0d6640 1 -- 172.21.15.97:0/4180212328 wait complete. 2023-12-04T05:37:38.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.318+0000 7fcc2c5df640 1 Processor -- start 2023-12-04T05:37:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.318+0000 7fcc2c5df640 1 -- start start 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2c5df640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 0x7fcc240a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2c5df640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 0x7fcc241528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2c5df640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc240a9770 con 0x7fcc2414fbb0 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2c5df640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2414ff90 con 0x7fcc240a8460 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2c5df640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24071730 con 0x7fcc24152490 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2a37b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcc2414fbb0 0x7fcc240a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50794/0 (socket says 172.21.15.97:50794) 2023-12-04T05:37:38.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2a37b640 1 -- 172.21.15.97:0/1021251608 learned_addr learned my addr 172.21.15.97:0/1021251608 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:38.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2ab7c640 1 --2- 172.21.15.97:0/1021251608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 0x7fcc241528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc29b7a640 1 --2- 172.21.15.97:0/1021251608 >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 0x7fcc240a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707671783 0 0) 0x7fcc240a9770 con 0x7fcc2414fbb0 2023-12-04T05:37:38.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc10003530 con 0x7fcc2414fbb0 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2ab7c640 1 -- 172.21.15.97:0/1021251608 >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 msgr2=0x7fcc240a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2ab7c640 1 --2- 172.21.15.97:0/1021251608 >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 0x7fcc240a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2ab7c640 1 -- 172.21.15.97:0/1021251608 >> v1:172.21.15.97:6789/0 conn(0x7fcc2414fbb0 legacy=0x7fcc240a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313821930 0 0) 0x7fcc10003530 con 0x7fcc2414fbb0 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc2ab7c640 1 -- 172.21.15.97:0/1021251608 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24071a10 con 0x7fcc24152490 2023-12-04T05:37:38.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.322+0000 7fcc29b7a640 1 --2- 172.21.15.97:0/1021251608 >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 0x7fcc240a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2ab7c640 1 --2- 172.21.15.97:0/1021251608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 0x7fcc241528e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009d90 tx=0x7fcc1c01c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ed21a296c1f2dc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20001680 con 0x7fcc24152490 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c0a5520 con 0x7fcc24152490 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc29379640 1 -- 172.21.15.97:0/1021251608 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0a58b0 con 0x7fcc24152490 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1021251608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 msgr2=0x7fcc241528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1021251608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 0x7fcc241528e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009d90 tx=0x7fcc1c01c720 comp rx=0 tx=0).stop 2023-12-04T05:37:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1021251608 shutdown_connections 2023-12-04T05:37:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1021251608 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc24152490 0x7fcc241528e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1021251608 >> v2:172.21.15.143:3300/0 conn(0x7fcc240a8460 0x7fcc240a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1021251608 >> 172.21.15.97:0/1021251608 conn(0x7fcc240c2970 msgr2=0x7fcc240c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1021251608 shutdown_connections 2023-12-04T05:37:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1021251608 wait complete. 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 Processor -- start 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.326+0000 7fcc2c5df640 1 -- start start 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 0x7fcc2414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc24152490 0x7fcc240c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2414baa0 con 0x7fcc2414fbb0 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241edc60 con 0x7fcc24152490 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240c5a30 con 0x7fcc240a8460 2023-12-04T05:37:38.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55426/0 (socket says 172.21.15.97:55426) 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 -- 172.21.15.97:0/1704726492 learned_addr learned my addr 172.21.15.97:0/1704726492 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2a37b640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 0x7fcc2414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2ab7c640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc24152490 0x7fcc240c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 -- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 msgr2=0x7fcc2414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 0x7fcc2414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 -- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc24152490 msgr2=0x7fcc240c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc24152490 0x7fcc240c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 -- 172.21.15.97:0/1704726492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc14009420 con 0x7fcc2414fbb0 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2a37b640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 0x7fcc2414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:38.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc29b7a640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e980 tx=0x7fcc1400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400ca00 con 0x7fcc2414fbb0 2023-12-04T05:37:38.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400cb60 con 0x7fcc2414fbb0 2023-12-04T05:37:38.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14013470 con 0x7fcc2414fbb0 2023-12-04T05:37:38.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c009a70 con 0x7fcc2414fbb0 2023-12-04T05:37:38.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2414b450 con 0x7fcc2414fbb0 2023-12-04T05:37:38.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc24068440 con 0x7fcc2414fbb0 2023-12-04T05:37:38.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.330+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc140135d0 con 0x7fcc2414fbb0 2023-12-04T05:37:38.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.334+0000 7fcc1affd640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 0x7fcc08068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.334+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc14084ac0 con 0x7fcc2414fbb0 2023-12-04T05:37:38.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.334+0000 7fcc2a37b640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 0x7fcc08068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.334+0000 7fcc2a37b640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 0x7fcc08068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc200011f0 tx=0x7fcc20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.338+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc14051c60 con 0x7fcc2414fbb0 2023-12-04T05:37:38.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.486+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc2414bbe0 con 0x7fcc2414fbb0 2023-12-04T05:37:38.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.486+0000 7fcc1affd640 1 -- 172.21.15.97:0/1704726492 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16557 (secure 0 0 0) 0x7fcc2414bbe0 con 0x7fcc2414fbb0 2023-12-04T05:37:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:38.493 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":31,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:25.971926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 msgr2=0x7fcc08068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 0x7fcc08068dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc200011f0 tx=0x7fcc20009040 comp rx=0 tx=0).stop 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 msgr2=0x7fcc240c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e980 tx=0x7fcc1400ee40 comp rx=0 tx=0).stop 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 shutdown_connections 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc08066900 0x7fcc08068dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc24152490 0x7fcc240c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2414fbb0 0x7fcc240c4fb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 --2- 172.21.15.97:0/1704726492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc240a8460 0x7fcc2414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 >> 172.21.15.97:0/1704726492 conn(0x7fcc240c2970 msgr2=0x7fcc240c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 shutdown_connections 2023-12-04T05:37:38.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.490+0000 7fcc2c5df640 1 -- 172.21.15.97:0/1704726492 wait complete. 2023-12-04T05:37:38.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:37:22.374120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:37:23.709890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:38.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:38.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 Processor -- start 2023-12-04T05:37:38.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 -- start start 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb730157690 0x7fb7300aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 0x7fb7300c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb730157a70 con 0x7fb73006e360 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7300c6910 con 0x7fb730157690 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb7353f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7300c52e0 con 0x7fb7300c22b0 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72e7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb73006e360 0x7fb7300a9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50800/0 (socket says 172.21.15.97:50800) 2023-12-04T05:37:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72e7fc640 1 -- 172.21.15.97:0/3026399846 learned_addr learned my addr 172.21.15.97:0/3026399846 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:38.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72effd640 1 --2- 172.21.15.97:0/3026399846 >> v2:172.21.15.97:3300/0 conn(0x7fb730157690 0x7fb7300aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72f7fe640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 0x7fb7300c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72dffb640 1 -- 172.21.15.97:0/3026399846 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038921351 0 0) 0x7fb730157a70 con 0x7fb73006e360 2023-12-04T05:37:38.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72dffb640 1 -- 172.21.15.97:0/3026399846 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb718003530 con 0x7fb73006e360 2023-12-04T05:37:38.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72effd640 1 -- 172.21.15.97:0/3026399846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 msgr2=0x7fb7300c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:38.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72effd640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 0x7fb7300c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72effd640 1 -- 172.21.15.97:0/3026399846 >> v1:172.21.15.97:6789/0 conn(0x7fb73006e360 legacy=0x7fb7300a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72effd640 1 -- 172.21.15.97:0/3026399846 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300c55c0 con 0x7fb730157690 2023-12-04T05:37:38.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.650+0000 7fb72f7fe640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 0x7fb7300c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:38.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb72effd640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb7300aa590 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097c0 tx=0x7fb72001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cacdbd8bea246d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb72dffb640 1 -- 172.21.15.97:0/3026399846 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7200ad640 con 0x7fb730157690 2023-12-04T05:37:38.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb72dffb640 1 -- 172.21.15.97:0/3026399846 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7200ad7a0 con 0x7fb730157690 2023-12-04T05:37:38.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb72dffb640 1 -- 172.21.15.97:0/3026399846 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7200adb30 con 0x7fb730157690 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 -- 172.21.15.97:0/3026399846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 msgr2=0x7fb7300aa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb7300aa590 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097c0 tx=0x7fb72001c480 comp rx=0 tx=0).stop 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 -- 172.21.15.97:0/3026399846 shutdown_connections 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7300c22b0 0x7fb7300c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 --2- 172.21.15.97:0/3026399846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb7300aa590 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 -- 172.21.15.97:0/3026399846 >> 172.21.15.97:0/3026399846 conn(0x7fb730072760 msgr2=0x7fb73006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 -- 172.21.15.97:0/3026399846 shutdown_connections 2023-12-04T05:37:38.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.654+0000 7fb7353f8640 1 -- 172.21.15.97:0/3026399846 wait complete. 2023-12-04T05:37:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 Processor -- start 2023-12-04T05:37:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- start start 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7300c22b0 0x7fb7300c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73006d170 0x7fb73014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73014e110 con 0x7fb730157690 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73014f000 con 0x7fb7300c22b0 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73014de30 con 0x7fb73006d170 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55440/0 (socket says 172.21.15.97:55440) 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 -- 172.21.15.97:0/941868478 learned_addr learned my addr 172.21.15.97:0/941868478 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72f7fe640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73006d170 0x7fb73014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72effd640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7300c22b0 0x7fb7300c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 -- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73006d170 msgr2=0x7fb73014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73006d170 0x7fb73014d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 -- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7300c22b0 msgr2=0x7fb7300c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7300c22b0 0x7fb7300c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 -- 172.21.15.97:0/941868478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009a70 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb72e7fc640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c4d0 tx=0x7fb72400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724005cf0 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724005e50 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720009420 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240072d0 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.658+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73014db30 con 0x7fb730157690 2023-12-04T05:37:38.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7300ab050 con 0x7fb730157690 2023-12-04T05:37:38.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb724007430 con 0x7fb730157690 2023-12-04T05:37:38.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb7177fe640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb724083980 con 0x7fb730157690 2023-12-04T05:37:38.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb72effd640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.662+0000 7fb72effd640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 0x7fb71c068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7200af000 tx=0x7fb720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.670 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.666+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb724050d00 con 0x7fb730157690 2023-12-04T05:37:38.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb730068440 con 0x7fb730157690 2023-12-04T05:37:38.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7177fe640 1 -- 172.21.15.97:0/941868478 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7240170a0 con 0x7fb730157690 2023-12-04T05:37:38.822 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 msgr2=0x7fb71c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 0x7fb71c068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7200af000 tx=0x7fb720008040 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 msgr2=0x7fb73014d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c4d0 tx=0x7fb72400c8d0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 shutdown_connections 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb71c0668d0 0x7fb71c068d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb73006d170 0x7fb73014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb730157690 0x7fb73014d0b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 --2- 172.21.15.97:0/941868478 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7300c22b0 0x7fb7300c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 >> 172.21.15.97:0/941868478 conn(0x7fb730072760 msgr2=0x7fb73006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 shutdown_connections 2023-12-04T05:37:38.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.818+0000 7fb7353f8640 1 -- 172.21.15.97:0/941868478 wait complete. 2023-12-04T05:37:38.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.978+0000 7fb16139d640 1 Processor -- start 2023-12-04T05:37:38.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.978+0000 7fb16139d640 1 -- start start 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb16139d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 0x7fb15c0c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb16139d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb15c0c3b70 0x7fb15c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb16139d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c152170 con 0x7fb15c0c1b80 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb16139d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15c06dfe0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb16139d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c0c0ae0 con 0x7fb15c14ea10 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb1527fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb15c0c1b80 0x7fb15c0a4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50806/0 (socket says 172.21.15.97:50806) 2023-12-04T05:37:38.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb1527fc640 1 -- 172.21.15.97:0/191711840 learned_addr learned my addr 172.21.15.97:0/191711840 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15affd640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 0x7fb15c0c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15b7fe640 1 --2- 172.21.15.97:0/191711840 >> v2:172.21.15.143:3300/0 conn(0x7fb15c0c3b70 0x7fb15c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305092649 0 0) 0x7fb15c152170 con 0x7fb15c0c1b80 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb148003530 con 0x7fb15c0c1b80 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15b7fe640 1 -- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 msgr2=0x7fb15c0c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15b7fe640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 0x7fb15c0c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15b7fe640 1 -- 172.21.15.97:0/191711840 >> v1:172.21.15.97:6789/0 conn(0x7fb15c0c1b80 legacy=0x7fb15c0a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743106863 0 0) 0x7fb148003530 con 0x7fb15c0c1b80 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15b7fe640 1 -- 172.21.15.97:0/191711840 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c0c0dc0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.982+0000 7fb15affd640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 0x7fb15c0c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:38.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb15b7fe640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c0c3b70 0x7fb15c070b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097c0 tx=0x7fb15401eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1158b745696dde09 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144001680 con 0x7fb15c0c3b70 2023-12-04T05:37:38.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540a85d0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb15a7fc640 1 -- 172.21.15.97:0/191711840 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540a8960 con 0x7fb15c0c3b70 2023-12-04T05:37:38.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c0c3b70 msgr2=0x7fb15c070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c0c3b70 0x7fb15c070b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097c0 tx=0x7fb15401eb90 comp rx=0 tx=0).stop 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- 172.21.15.97:0/191711840 shutdown_connections 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c0c3b70 0x7fb15c070b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 --2- 172.21.15.97:0/191711840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c14ea10 0x7fb15c0c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- 172.21.15.97:0/191711840 >> 172.21.15.97:0/191711840 conn(0x7fb15c0a7800 msgr2=0x7fb15c0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- 172.21.15.97:0/191711840 shutdown_connections 2023-12-04T05:37:38.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- 172.21.15.97:0/191711840 wait complete. 2023-12-04T05:37:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 Processor -- start 2023-12-04T05:37:38.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 -- start start 2023-12-04T05:37:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.986+0000 7fb16139d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 0x7fb15c14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c14ea10 0x7fb15c0a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c147b30 con 0x7fb15c0c1b80 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c147ff0 con 0x7fb15c14ea10 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c1ed510 con 0x7fb15c0c3b70 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb15affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb15affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55456/0 (socket says 172.21.15.97:55456) 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb15affd640 1 -- 172.21.15.97:0/2786838558 learned_addr learned my addr 172.21.15.97:0/2786838558 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 0x7fb15c14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb15b7fe640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c14ea10 0x7fb15c0a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 -- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c14ea10 msgr2=0x7fb15c0a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c14ea10 0x7fb15c0a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 -- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 msgr2=0x7fb15c1ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 -- 172.21.15.97:0/2786838558 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009a70 con 0x7fb15c0c3b70 2023-12-04T05:37:38.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb15affd640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb1527fc640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 0x7fb15c14f080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb144001390 tx=0x7fb14400cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144005ae0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144005c60 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb154009420 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144007070 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c14f5c0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c04e890 con 0x7fb15c0c3b70 2023-12-04T05:37:38.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.990+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb1440071d0 con 0x7fb15c0c3b70 2023-12-04T05:37:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.994+0000 7fb153fff640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 0x7fb13c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.994+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb144083f10 con 0x7fb15c0c3b70 2023-12-04T05:37:38.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.994+0000 7fb15affd640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 0x7fb13c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:38.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.994+0000 7fb15affd640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 0x7fb13c068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb15c06df20 tx=0x7fb14c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:38.998+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb144051290 con 0x7fb15c0c3b70 2023-12-04T05:37:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb15c0c5600 con 0x7fb15c0c3b70 2023-12-04T05:37:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb153fff640 1 -- 172.21.15.97:0/2786838558 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1440548b0 con 0x7fb15c0c3b70 2023-12-04T05:37:39.150 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 msgr2=0x7fb13c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 0x7fb13c068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb15c06df20 tx=0x7fb14c00b040 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 msgr2=0x7fb15c14f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 0x7fb15c14f080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb144001390 tx=0x7fb14400cbe0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 shutdown_connections 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb13c0668d0 0x7fb13c068d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb15c14ea10 0x7fb15c0a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb15c0c3b70 0x7fb15c14f080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 --2- 172.21.15.97:0/2786838558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb15c0c1b80 0x7fb15c1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 >> 172.21.15.97:0/2786838558 conn(0x7fb15c0a7800 msgr2=0x7fb15c149440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 shutdown_connections 2023-12-04T05:37:39.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.146+0000 7fb16139d640 1 -- 172.21.15.97:0/2786838558 wait complete. 2023-12-04T05:37:39.171 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:39.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 Processor -- start 2023-12-04T05:37:39.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 -- start start 2023-12-04T05:37:39.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b1c0af430 0x7f9b1c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b1c0bd540 0x7f9b1c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0c56e0 con 0x7f9b1c06d230 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c155400 con 0x7f9b1c0af430 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b20964640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c7d70 con 0x7f9b1c0bd540 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1ad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b1c0af430 0x7f9b1c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b13fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9b1c06d230 0x7f9b1c06bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50812/0 (socket says 172.21.15.97:50812) 2023-12-04T05:37:39.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b13fff640 1 -- 172.21.15.97:0/1460766024 learned_addr learned my addr 172.21.15.97:0/1460766024 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1b59e640 1 --2- 172.21.15.97:0/1460766024 >> v2:172.21.15.143:3300/0 conn(0x7f9b1c0bd540 0x7f9b1c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1ad9d640 1 -- 172.21.15.97:0/1460766024 >> v2:172.21.15.143:3300/0 conn(0x7f9b1c0bd540 msgr2=0x7f9b1c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/1460766024 >> v2:172.21.15.143:3300/0 conn(0x7f9b1c0bd540 0x7f9b1c0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1ad9d640 1 -- 172.21.15.97:0/1460766024 >> v1:172.21.15.97:6789/0 conn(0x7f9b1c06d230 legacy=0x7f9b1c06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1ad9d640 1 -- 172.21.15.97:0/1460766024 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0c8050 con 0x7f9b1c0af430 2023-12-04T05:37:39.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.310+0000 7f9b1a59c640 1 -- 172.21.15.97:0/1460766024 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418698908 0 0) 0x7f9b04001120 con 0x7f9b1c06d230 2023-12-04T05:37:39.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/1460766024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0af430 0x7f9b1c0c8330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c155370 tx=0x7f9b0c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a072d8fb26437fa server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b1a59c640 1 -- 172.21.15.97:0/1460766024 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0ac400 con 0x7f9b1c0af430 2023-12-04T05:37:39.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b1a59c640 1 -- 172.21.15.97:0/1460766024 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c0a8050 con 0x7f9b1c0af430 2023-12-04T05:37:39.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b1a59c640 1 -- 172.21.15.97:0/1460766024 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0ac780 con 0x7f9b1c0af430 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 -- 172.21.15.97:0/1460766024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0af430 msgr2=0x7f9b1c0c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 --2- 172.21.15.97:0/1460766024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0af430 0x7f9b1c0c8330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c155370 tx=0x7f9b0c01c3a0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 -- 172.21.15.97:0/1460766024 shutdown_connections 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 --2- 172.21.15.97:0/1460766024 >> v2:172.21.15.143:3300/0 conn(0x7f9b1c0bd540 0x7f9b1c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 --2- 172.21.15.97:0/1460766024 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0af430 0x7f9b1c0c8330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 -- 172.21.15.97:0/1460766024 >> 172.21.15.97:0/1460766024 conn(0x7f9b1c073dd0 msgr2=0x7f9b1c0aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 -- 172.21.15.97:0/1460766024 shutdown_connections 2023-12-04T05:37:39.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.314+0000 7f9b20964640 1 -- 172.21.15.97:0/1460766024 wait complete. 2023-12-04T05:37:39.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 Processor -- start 2023-12-04T05:37:39.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- start start 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 0x7f9b1c1efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c0af430 0x7f9b1c1f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c14ba50 con 0x7f9b1c0bd540 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0c3fc0 con 0x7f9b1c0af430 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1f08c0 con 0x7f9b1c06d230 2023-12-04T05:37:39.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55470/0 (socket says 172.21.15.97:55470) 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 -- 172.21.15.97:0/4089708881 learned_addr learned my addr 172.21.15.97:0/4089708881 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 0x7f9b1c1efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b13fff640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c0af430 0x7f9b1c1f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 -- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 msgr2=0x7f9b1c1efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 0x7f9b1c1efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 -- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c0af430 msgr2=0x7f9b1c1f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c0af430 0x7f9b1c1f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 -- 172.21.15.97:0/4089708881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c009420 con 0x7f9b1c0bd540 2023-12-04T05:37:39.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 0x7f9b1c1efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b1b59e640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400ebe0 tx=0x7f9b1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400cd20 con 0x7f9b1c0bd540 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400f040 con 0x7f9b1c0bd540 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c0c33b0 con 0x7f9b1c0bd540 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400cea0 con 0x7f9b1c0bd540 2023-12-04T05:37:39.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.318+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0c3970 con 0x7f9b1c0bd540 2023-12-04T05:37:39.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0c0f40 con 0x7f9b1c0bd540 2023-12-04T05:37:39.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9b140146c0 con 0x7f9b1c0bd540 2023-12-04T05:37:39.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b137fe640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 0x7f9afc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b14085160 con 0x7f9b1c0bd540 2023-12-04T05:37:39.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 0x7f9afc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.322+0000 7f9b1ad9d640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 0x7f9afc068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0ae000 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.326+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b1c0c0f40 con 0x7f9b1c0bd540 2023-12-04T05:37:39.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.474+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b1c0c0f40 con 0x7f9b1c0bd540 2023-12-04T05:37:39.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.474+0000 7f9b137fe640 1 -- 172.21.15.97:0/4089708881 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b1c0c0f40 con 0x7f9b1c0bd540 2023-12-04T05:37:39.480 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:39.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 msgr2=0x7f9afc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 0x7f9afc068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0ae000 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 msgr2=0x7f9b1c14ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400ebe0 tx=0x7f9b1400c490 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 shutdown_connections 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9afc0668d0 0x7f9afc068d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b1c0bd540 0x7f9b1c14ac40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b1c0af430 0x7f9b1c1f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 --2- 172.21.15.97:0/4089708881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b1c06d230 0x7f9b1c1efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 >> 172.21.15.97:0/4089708881 conn(0x7f9b1c073dd0 msgr2=0x7f9b1c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 shutdown_connections 2023-12-04T05:37:39.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.478+0000 7f9b20964640 1 -- 172.21.15.97:0/4089708881 wait complete. 2023-12-04T05:37:39.500 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:37:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 Processor -- start 2023-12-04T05:37:39.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 -- start start 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd0e414fbb0 0x7fd0e40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e41530e0 con 0x7fd0e40a8460 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40a8d30 con 0x7fd0e414fbb0 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ebb96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e414ff90 con 0x7fd0e40a88e0 2023-12-04T05:37:39.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9131640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd0e40a8460 0x7fd0e4152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50818/0 (socket says 172.21.15.97:50818) 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9131640 1 -- 172.21.15.97:0/1558356668 learned_addr learned my addr 172.21.15.97:0/1558356668 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9932640 1 --2- 172.21.15.97:0/1558356668 >> v2:172.21.15.143:3300/0 conn(0x7fd0e414fbb0 0x7fd0e40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0ea133640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e8930640 1 -- 172.21.15.97:0/1558356668 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192484344 0 0) 0x7fd0e41530e0 con 0x7fd0e40a8460 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e8930640 1 -- 172.21.15.97:0/1558356668 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d0003530 con 0x7fd0e40a8460 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9932640 1 -- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 msgr2=0x7fd0e4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9932640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9932640 1 -- 172.21.15.97:0/1558356668 >> v1:172.21.15.97:6789/0 conn(0x7fd0e40a8460 legacy=0x7fd0e4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.634+0000 7fd0e9932640 1 -- 172.21.15.97:0/1558356668 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40a9770 con 0x7fd0e414fbb0 2023-12-04T05:37:39.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0e9932640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e40a8f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097c0 tx=0x7fd0e001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5433585a1d0ef4fb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0e8930640 1 -- 172.21.15.97:0/1558356668 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab600 con 0x7fd0e414fbb0 2023-12-04T05:37:39.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0e8930640 1 -- 172.21.15.97:0/1558356668 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e00a7050 con 0x7fd0e414fbb0 2023-12-04T05:37:39.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0e8930640 1 -- 172.21.15.97:0/1558356668 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab960 con 0x7fd0e414fbb0 2023-12-04T05:37:39.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 -- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 msgr2=0x7fd0e40a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e40a8f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00097c0 tx=0x7fd0e001c330 comp rx=0 tx=0).stop 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 -- 172.21.15.97:0/1558356668 shutdown_connections 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/1558356668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e40a8f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 -- 172.21.15.97:0/1558356668 >> 172.21.15.97:0/1558356668 conn(0x7fd0e40c2970 msgr2=0x7fd0e40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 -- 172.21.15.97:0/1558356668 shutdown_connections 2023-12-04T05:37:39.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.638+0000 7fd0ebb96640 1 -- 172.21.15.97:0/1558356668 wait complete. 2023-12-04T05:37:39.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 Processor -- start 2023-12-04T05:37:39.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- start start 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e41ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e41ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41f11e0 con 0x7fd0e40a8460 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41ece60 con 0x7fd0e414fbb0 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4150390 con 0x7fd0e40a88e0 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55476/0 (socket says 172.21.15.97:55476) 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 -- 172.21.15.97:0/4095809414 learned_addr learned my addr 172.21.15.97:0/4095809414 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 -- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 msgr2=0x7fd0e41ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e41ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 -- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 msgr2=0x7fd0e41ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e41ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 -- 172.21.15.97:0/4095809414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0009420 con 0x7fd0e40a8460 2023-12-04T05:37:39.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0e9932640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001c8a0 tx=0x7fd0e00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0003a30 con 0x7fd0e40a8460 2023-12-04T05:37:39.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0003b90 con 0x7fd0e40a8460 2023-12-04T05:37:39.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e41508e0 con 0x7fd0e40a8460 2023-12-04T05:37:39.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab400 con 0x7fd0e40a8460 2023-12-04T05:37:39.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4150ea0 con 0x7fd0e40a8460 2023-12-04T05:37:39.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.642+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4068440 con 0x7fd0e40a8460 2023-12-04T05:37:39.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.646+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd0e00b2040 con 0x7fd0e40a8460 2023-12-04T05:37:39.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.646+0000 7fd0da7fc640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.646+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e011e180 con 0x7fd0e40a8460 2023-12-04T05:37:39.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.646+0000 7fd0e9131640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.646+0000 7fd0e9131640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4007fd0 tx=0x7fd0d4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.650+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0e00eb450 con 0x7fd0e40a8460 2023-12-04T05:37:39.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.798+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0e40a9bf0 con 0x7fd0e40a8460 2023-12-04T05:37:39.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0da7fc640 1 -- 172.21.15.97:0/4095809414 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+207 (secure 0 0 0) 0x7fd0e00eea70 con 0x7fd0e40a8460 2023-12-04T05:37:39.804 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 4, 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_metadata" 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 5, 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_data" 2023-12-04T05:37:39.805 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:37:39.806 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:37:39.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 msgr2=0x7fd0c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4007fd0 tx=0x7fd0d4007900 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 msgr2=0x7fd0e415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001c8a0 tx=0x7fd0e00190d0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 shutdown_connections 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e414fbb0 0x7fd0e41ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e40a88e0 0x7fd0e41ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 --2- 172.21.15.97:0/4095809414 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e40a8460 0x7fd0e415c3c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 >> 172.21.15.97:0/4095809414 conn(0x7fd0e40c2970 msgr2=0x7fd0e414ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 shutdown_connections 2023-12-04T05:37:39.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.802+0000 7fd0ebb96640 1 -- 172.21.15.97:0/4095809414 wait complete. 2023-12-04T05:37:39.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-04T05:37:39.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-04T05:37:39.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.962+0000 7fabdfbc4640 1 Processor -- start 2023-12-04T05:37:39.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdfbc4640 1 -- start start 2023-12-04T05:37:39.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdfbc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 0x7fabd81600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdfbc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd806df40 con 0x7fabd80bfaf0 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdfbc4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd8158c50 con 0x7fabd8158870 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdfbc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80c2b30 con 0x7fabd806daf0 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdd15f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fabd80bfaf0 0x7fabd8157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50828/0 (socket says 172.21.15.97:50828) 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdd15f640 1 -- 172.21.15.97:0/536331688 learned_addr learned my addr 172.21.15.97:0/536331688 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:39.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabde161640 1 --2- 172.21.15.97:0/536331688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 0x7fabd81600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844593328 0 0) 0x7fabc8001120 con 0x7fabd80bfaf0 2023-12-04T05:37:39.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc4003530 con 0x7fabd80bfaf0 2023-12-04T05:37:39.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232684119 0 0) 0x7fabd8158c50 con 0x7fabd8158870 2023-12-04T05:37:39.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8001120 con 0x7fabd8158870 2023-12-04T05:37:39.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabde161640 1 -- 172.21.15.97:0/536331688 >> v1:172.21.15.143:6789/0 conn(0x7fabd8158870 legacy=0x7fabd806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabde161640 1 -- 172.21.15.97:0/536331688 >> v1:172.21.15.97:6789/0 conn(0x7fabd80bfaf0 legacy=0x7fabd8157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.966+0000 7fabde161640 1 -- 172.21.15.97:0/536331688 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80bfff0 con 0x7fabd806daf0 2023-12-04T05:37:39.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabde161640 1 --2- 172.21.15.97:0/536331688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 0x7fabd81600c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009dc0 tx=0x7fabd001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394631347978d4b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5970 con 0x7fabd806daf0 2023-12-04T05:37:39.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00a5ad0 con 0x7fabd806daf0 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdc95e640 1 -- 172.21.15.97:0/536331688 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5e60 con 0x7fabd806daf0 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 -- 172.21.15.97:0/536331688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 msgr2=0x7fabd81600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/536331688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 0x7fabd81600c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009dc0 tx=0x7fabd001c8b0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 -- 172.21.15.97:0/536331688 shutdown_connections 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/536331688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd806daf0 0x7fabd81600c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 -- 172.21.15.97:0/536331688 >> 172.21.15.97:0/536331688 conn(0x7fabd80c31c0 msgr2=0x7fabd80c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:39.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 -- 172.21.15.97:0/536331688 shutdown_connections 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 -- 172.21.15.97:0/536331688 wait complete. 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.970+0000 7fabdfbc4640 1 Processor -- start 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- start start 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd806daf0 0x7fabd80a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd80bfaf0 0x7fabd81f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80a9370 con 0x7fabd8158870 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80a6480 con 0x7fabd806daf0 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81f0b30 con 0x7fabd80bfaf0 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55480/0 (socket says 172.21.15.97:55480) 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 -- 172.21.15.97:0/2917555855 learned_addr learned my addr 172.21.15.97:0/2917555855 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:39.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdd960640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd806daf0 0x7fabd80a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdd15f640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd80bfaf0 0x7fabd81f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 -- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd80bfaf0 msgr2=0x7fabd81f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd80bfaf0 0x7fabd81f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 -- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd806daf0 msgr2=0x7fabd80a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd806daf0 0x7fabd80a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 -- 172.21.15.97:0/2917555855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009a70 con 0x7fabd8158870 2023-12-04T05:37:39.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabde161640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabd001a4e0 tx=0x7fabd0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00adca0 con 0x7fabd8158870 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00ade00 con 0x7fabd8158870 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd81f0e10 con 0x7fabd8158870 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00b9690 con 0x7fabd8158870 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd8151de0 con 0x7fabd8158870 2023-12-04T05:37:39.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.974+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8156cf0 con 0x7fabd8158870 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.978+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabd00b97f0 con 0x7fabd8158870 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.978+0000 7fabce7fc640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 0x7fabbc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.978+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd011f930 con 0x7fabd8158870 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.978+0000 7fabdd960640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 0x7fabbc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.978+0000 7fabdd960640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 0x7fabbc068dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabd40011f0 tx=0x7fabd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:39.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:39.982+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabd00ecdf0 con 0x7fabd8158870 2023-12-04T05:37:40.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.134+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fabd8068440 con 0x7fabd8158870 2023-12-04T05:37:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.978+0000 7fabce7fc640 1 -- 172.21.15.97:0/2917555855 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v32) v1 ==== 140+0+0 (secure 0 0 0) 0x7fabd0009450 con 0x7fabd8158870 2023-12-04T05:37:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' created 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.978+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 msgr2=0x7fabbc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.978+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 0x7fabbc068dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabd40011f0 tx=0x7fabd4009040 comp rx=0 tx=0).stop 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.978+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 msgr2=0x7fabd80aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.978+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabd001a4e0 tx=0x7fabd0019650 comp rx=0 tx=0).stop 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 shutdown_connections 2023-12-04T05:37:40.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabbc066900 0x7fabbc068dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd8158870 0x7fabd80aa180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd80bfaf0 0x7fabd81f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 --2- 172.21.15.97:0/2917555855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd806daf0 0x7fabd80a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 >> 172.21.15.97:0/2917555855 conn(0x7fabd80c31c0 msgr2=0x7fabd806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 shutdown_connections 2023-12-04T05:37:40.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:40.982+0000 7fabdfbc4640 1 -- 172.21.15.97:0/2917555855 wait complete. 2023-12-04T05:37:41.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:37:41.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 Processor -- start 2023-12-04T05:37:41.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 -- start start 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f514414f960 0x7f51441548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5144154e10 0x7f514415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5144154640 con 0x7f514414eb30 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440c0bd0 con 0x7f5144154e10 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5148832640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514414ef10 con 0x7f514414f960 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5142d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5144154e10 0x7f514415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5142d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5144154e10 0x7f514415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55486/0 (socket says 172.21.15.97:55486) 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.154+0000 7f5142d9d640 1 -- 172.21.15.97:0/897974532 learned_addr learned my addr 172.21.15.97:0/897974532 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:41.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f513bfff640 1 --2- 172.21.15.97:0/897974532 >> v2:172.21.15.143:3300/0 conn(0x7f514414f960 0x7f51441548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5142d9d640 1 -- 172.21.15.97:0/897974532 >> v2:172.21.15.143:3300/0 conn(0x7f514414f960 msgr2=0x7f51441548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:41.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5142d9d640 1 --2- 172.21.15.97:0/897974532 >> v2:172.21.15.143:3300/0 conn(0x7f514414f960 0x7f51441548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5142d9d640 1 -- 172.21.15.97:0/897974532 >> v1:172.21.15.143:6789/0 conn(0x7f514414eb30 legacy=0x7f514414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5142d9d640 1 -- 172.21.15.97:0/897974532 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51441535a0 con 0x7f5144154e10 2023-12-04T05:37:41.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5142d9d640 1 --2- 172.21.15.97:0/897974532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5144154e10 0x7f514415bc60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f514406e7f0 tx=0x7f513c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c3aa9fc104c8b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:41.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5141d9b640 1 -- 172.21.15.97:0/897974532 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a5770 con 0x7f5144154e10 2023-12-04T05:37:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5141d9b640 1 -- 172.21.15.97:0/897974532 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0a58d0 con 0x7f5144154e10 2023-12-04T05:37:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5141d9b640 1 -- 172.21.15.97:0/897974532 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a5c60 con 0x7f5144154e10 2023-12-04T05:37:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5148832640 1 -- 172.21.15.97:0/897974532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5144154e10 msgr2=0x7f514415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.158+0000 7f5148832640 1 --2- 172.21.15.97:0/897974532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5144154e10 0x7f514415bc60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f514406e7f0 tx=0x7f513c01c9a0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- 172.21.15.97:0/897974532 shutdown_connections 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 --2- 172.21.15.97:0/897974532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5144154e10 0x7f514415bc60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 --2- 172.21.15.97:0/897974532 >> v2:172.21.15.143:3300/0 conn(0x7f514414f960 0x7f51441548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- 172.21.15.97:0/897974532 >> 172.21.15.97:0/897974532 conn(0x7f51440c5e70 msgr2=0x7f51440c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- 172.21.15.97:0/897974532 shutdown_connections 2023-12-04T05:37:41.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- 172.21.15.97:0/897974532 wait complete. 2023-12-04T05:37:41.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 Processor -- start 2023-12-04T05:37:41.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- start start 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514414eb30 0x7f51441f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5144154e10 0x7f51441ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51441ed4a0 con 0x7f514414f960 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c5340 con 0x7f514414eb30 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5148832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440c4d80 con 0x7f5144154e10 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55496/0 (socket says 172.21.15.97:55496) 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 -- 172.21.15.97:0/1614746626 learned_addr learned my addr 172.21.15.97:0/1614746626 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f514259c640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514414eb30 0x7f51441f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f5142d9d640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5144154e10 0x7f51441ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 -- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5144154e10 msgr2=0x7f51441ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5144154e10 0x7f51441ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 -- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514414eb30 msgr2=0x7f51441f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514414eb30 0x7f51441f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 -- 172.21.15.97:0/1614746626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009b30 con 0x7f514414f960 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.162+0000 7f513bfff640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d800 tx=0x7f512c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00b6c0 con 0x7f514414f960 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00b820 con 0x7f514414f960 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00bb90 con 0x7f514414f960 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51440c5060 con 0x7f514414f960 2023-12-04T05:37:41.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144142ac0 con 0x7f514414f960 2023-12-04T05:37:41.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144068440 con 0x7f514414f960 2023-12-04T05:37:41.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f512c00bcf0 con 0x7f514414f960 2023-12-04T05:37:41.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.166+0000 7f513affd640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 0x7f5124068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:41.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.170+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f512c084980 con 0x7f514414f960 2023-12-04T05:37:41.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.170+0000 7f514259c640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 0x7f5124068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:41.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.170+0000 7f514259c640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 0x7f5124068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5134007fd0 tx=0x7f5134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:41.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.174+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f512c051b00 con 0x7f514414f960 2023-12-04T05:37:41.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.322+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f51440a8ac0 con 0x7f514414f960 2023-12-04T05:37:41.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f513affd640 1 -- 172.21.15.97:0/1614746626 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v33) v1 ==== 172+0+0 (secure 0 0 0) 0x7f512c055120 con 0x7f514414f960 2023-12-04T05:37:41.985 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' created 2023-12-04T05:37:41.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 msgr2=0x7f5124068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 0x7f5124068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5134007fd0 tx=0x7f5134009040 comp rx=0 tx=0).stop 2023-12-04T05:37:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 msgr2=0x7f5144142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d800 tx=0x7f512c00dcc0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 shutdown_connections 2023-12-04T05:37:41.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f51240668d0 0x7f5124068d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5144154e10 0x7f51441ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f514414f960 0x7f5144142580 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 --2- 172.21.15.97:0/1614746626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f514414eb30 0x7f51441f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 >> 172.21.15.97:0/1614746626 conn(0x7f51440c5e70 msgr2=0x7f5144144c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 shutdown_connections 2023-12-04T05:37:41.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:41.982+0000 7f5148832640 1 -- 172.21.15.97:0/1614746626 wait complete. 2023-12-04T05:37:42.033 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-04T05:37:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 Processor -- start 2023-12-04T05:37:42.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 -- start start 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4dc806e410 0x7f4dc8071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc8071380 con 0x7f4dc806c280 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc806cc20 con 0x7f4dc8156070 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcf6bb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc806cf00 con 0x7f4dc806e410 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dccc56640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4dc806e410 0x7f4dc8071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcdc58640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4dc806c280 0x7f4dc8163390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50836/0 (socket says 172.21.15.97:50836) 2023-12-04T05:37:42.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.170+0000 7f4dcdc58640 1 -- 172.21.15.97:0/4168543084 learned_addr learned my addr 172.21.15.97:0/4168543084 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dccc56640 1 -- 172.21.15.97:0/4168543084 >> v1:172.21.15.143:6789/0 conn(0x7f4dc8156070 legacy=0x7f4dc80c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dccc56640 1 -- 172.21.15.97:0/4168543084 >> v1:172.21.15.97:6789/0 conn(0x7f4dc806c280 legacy=0x7f4dc8163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dbffff640 1 -- 172.21.15.97:0/4168543084 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067045298 0 0) 0x7f4dc8071380 con 0x7f4dc806c280 2023-12-04T05:37:42.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dccc56640 1 -- 172.21.15.97:0/4168543084 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc815cbb0 con 0x7f4dc806e410 2023-12-04T05:37:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dccc56640 1 --2- 172.21.15.97:0/4168543084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc8071d60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4db80097c0 tx=0x7f4db801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b2c918a297ff44 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:42.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dbffff640 1 -- 172.21.15.97:0/4168543084 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80a6040 con 0x7f4dc806e410 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dbffff640 1 -- 172.21.15.97:0/4168543084 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db80aa600 con 0x7f4dc806e410 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.174+0000 7f4dbffff640 1 -- 172.21.15.97:0/4168543084 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80aa990 con 0x7f4dc806e410 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/4168543084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 msgr2=0x7f4dc8071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/4168543084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc8071d60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4db80097c0 tx=0x7f4db801cee0 comp rx=0 tx=0).stop 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/4168543084 shutdown_connections 2023-12-04T05:37:42.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/4168543084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc8071d60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/4168543084 >> 172.21.15.97:0/4168543084 conn(0x7f4dc80c5e70 msgr2=0x7f4dc80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/4168543084 shutdown_connections 2023-12-04T05:37:42.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/4168543084 wait complete. 2023-12-04T05:37:42.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 Processor -- start 2023-12-04T05:37:42.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- start start 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4dc806c280 0x7f4dc815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc8156070 0x7f4dc81f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc81f5900 con 0x7f4dc806e410 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc81f4d80 con 0x7f4dc8156070 2023-12-04T05:37:42.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcf6bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc81f5060 con 0x7f4dc806c280 2023-12-04T05:37:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55520/0 (socket says 172.21.15.97:55520) 2023-12-04T05:37:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 -- 172.21.15.97:0/1627876177 learned_addr learned my addr 172.21.15.97:0/1627876177 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcdc58640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc8156070 0x7f4dc81f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:42.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dcd457640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4dc806c280 0x7f4dc815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 -- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4dc806c280 msgr2=0x7f4dc815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4dc806c280 0x7f4dc815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 -- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc8156070 msgr2=0x7f4dc81f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc8156070 0x7f4dc81f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 -- 172.21.15.97:0/1627876177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009420 con 0x7f4dc806e410 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.178+0000 7f4dccc56640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4db8019090 tx=0x7f4db801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80b3800 con 0x7f4dc806e410 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db80b3960 con 0x7f4dc806e410 2023-12-04T05:37:42.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc81f5340 con 0x7f4dc806e410 2023-12-04T05:37:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80b3cd0 con 0x7f4dc806e410 2023-12-04T05:37:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80c5bc0 con 0x7f4dc806e410 2023-12-04T05:37:42.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8068440 con 0x7f4dc806e410 2023-12-04T05:37:42.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4db80c6430 con 0x7f4dc806e410 2023-12-04T05:37:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 0x7f4dac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.182+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4db811f500 con 0x7f4dc806e410 2023-12-04T05:37:42.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.186+0000 7f4dcd457640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 0x7f4dac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:42.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.186+0000 7f4dcd457640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 0x7f4dac068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4dc81503d0 tx=0x7f4dc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:42.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.186+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4db80ec570 con 0x7f4dc806e410 2023-12-04T05:37:42.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:42.370+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f4dc80705c0 con 0x7f4dc806e410 2023-12-04T05:37:43.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.018+0000 7f4dbdffb640 1 -- 172.21.15.97:0/1627876177 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f4db80efb90 con 0x7f4dc806e410 2023-12-04T05:37:43.026 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 6 and data pool 7 2023-12-04T05:37:43.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.026+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 msgr2=0x7f4dac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.026+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 0x7f4dac068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4dc81503d0 tx=0x7f4dc4009040 comp rx=0 tx=0).stop 2023-12-04T05:37:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.026+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 msgr2=0x7f4dc81f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.026+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4db8019090 tx=0x7f4db801acc0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 shutdown_connections 2023-12-04T05:37:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4dac0668d0 0x7f4dac068d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4dc8156070 0x7f4dc81f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4dc806e410 0x7f4dc81f1810 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 --2- 172.21.15.97:0/1627876177 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4dc806c280 0x7f4dc815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.038 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.030+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 >> 172.21.15.97:0/1627876177 conn(0x7f4dc80c5e70 msgr2=0x7f4dc80c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.042+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 shutdown_connections 2023-12-04T05:37:43.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.042+0000 7f4dcf6bb640 1 -- 172.21.15.97:0/1627876177 wait complete. 2023-12-04T05:37:43.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 Processor -- start 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 -- start start 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5dc4151cb0 0x7f5dc406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 0x7f5dc40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 0x7f5dc4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc41550f0 con 0x7f5dc4151cb0 2023-12-04T05:37:43.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40c52b0 con 0x7f5dc40c4740 2023-12-04T05:37:43.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dcb038640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40c5590 con 0x7f5dc40c4c50 2023-12-04T05:37:43.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5dc4151cb0 0x7f5dc406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5dc4151cb0 0x7f5dc406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55530/0 (socket says 172.21.15.97:55530) 2023-12-04T05:37:43.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 -- 172.21.15.97:0/43573752 learned_addr learned my addr 172.21.15.97:0/43573752 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca837640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 0x7f5dc4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dc9835640 1 --2- 172.21.15.97:0/43573752 >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 0x7f5dc40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 -- 172.21.15.97:0/43573752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 msgr2=0x7f5dc4157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 0x7f5dc4157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 -- 172.21.15.97:0/43573752 >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 msgr2=0x7f5dc40c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 --2- 172.21.15.97:0/43573752 >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 0x7f5dc40c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca036640 1 -- 172.21.15.97:0/43573752 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40c5870 con 0x7f5dc4151cb0 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dc9835640 1 --2- 172.21.15.97:0/43573752 >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 0x7f5dc40c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:43.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.210+0000 7f5dca837640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 0x7f5dc4157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dca036640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc4151cb0 0x7f5dc406aca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40caec0 tx=0x7f5dc001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c31f7acf84c98b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dc9034640 1 -- 172.21.15.97:0/43573752 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00ac620 con 0x7f5dc4151cb0 2023-12-04T05:37:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dc9034640 1 -- 172.21.15.97:0/43573752 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc00ac780 con 0x7f5dc4151cb0 2023-12-04T05:37:43.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dc9034640 1 -- 172.21.15.97:0/43573752 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00acb10 con 0x7f5dc4151cb0 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 -- 172.21.15.97:0/43573752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc4151cb0 msgr2=0x7f5dc406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc4151cb0 0x7f5dc406aca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40caec0 tx=0x7f5dc001c3e0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 -- 172.21.15.97:0/43573752 shutdown_connections 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc40c4c50 0x7f5dc4157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 --2- 172.21.15.97:0/43573752 >> v2:172.21.15.143:3300/0 conn(0x7f5dc40c4740 0x7f5dc40c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 --2- 172.21.15.97:0/43573752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc4151cb0 0x7f5dc406aca0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 -- 172.21.15.97:0/43573752 >> 172.21.15.97:0/43573752 conn(0x7f5dc40ab8b0 msgr2=0x7f5dc40abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 -- 172.21.15.97:0/43573752 shutdown_connections 2023-12-04T05:37:43.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.214+0000 7f5dcb038640 1 -- 172.21.15.97:0/43573752 wait complete. 2023-12-04T05:37:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 Processor -- start 2023-12-04T05:37:43.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 -- start start 2023-12-04T05:37:43.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5dc40c4740 0x7f5dc414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc4151cb0 0x7f5dc41444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4156120 con 0x7f5dc40c4c50 2023-12-04T05:37:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc41449f0 con 0x7f5dc40c4740 2023-12-04T05:37:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dcb038640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc41ed540 con 0x7f5dc4151cb0 2023-12-04T05:37:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55542/0 (socket says 172.21.15.97:55542) 2023-12-04T05:37:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 -- 172.21.15.97:0/828015026 learned_addr learned my addr 172.21.15.97:0/828015026 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dca036640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5dc40c4740 0x7f5dc414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dca837640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc4151cb0 0x7f5dc41444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 -- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc4151cb0 msgr2=0x7f5dc41444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc4151cb0 0x7f5dc41444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 -- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5dc40c4740 msgr2=0x7f5dc414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5dc40c4740 0x7f5dc414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 -- 172.21.15.97:0/828015026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00094d0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dc9835640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5db400c7c0 tx=0x7f5db400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db40077c0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4007920 con 0x7f5dc40c4c50 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.218+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4007cb0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc4144c30 con 0x7f5dc40c4c50 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc4156630 con 0x7f5dc40c4c50 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc41ed6b0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5db40113f0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dbaffd640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 0x7f5da8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5db4084780 con 0x7f5dc40c4c50 2023-12-04T05:37:43.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dca036640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 0x7f5da8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.222+0000 7f5dca036640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 0x7f5da8068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00ae000 tx=0x7f5dc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.226+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5dc41ed6b0 con 0x7f5dc40c4c50 2023-12-04T05:37:43.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.378+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dc41ed680 con 0x7f5dc40c4c50 2023-12-04T05:37:43.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.378+0000 7f5dbaffd640 1 -- 172.21.15.97:0/828015026 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20230 (secure 0 0 0) 0x7f5db4051700 con 0x7f5dc40c4c50 2023-12-04T05:37:43.384 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:43.384 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":34,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:42.375521+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:43.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 msgr2=0x7f5da8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 0x7f5da8068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00ae000 tx=0x7f5dc0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:43.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 msgr2=0x7f5dc4143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5db400c7c0 tx=0x7f5db400cc80 comp rx=0 tx=0).stop 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 shutdown_connections 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5da80668d0 0x7f5da8068d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5dc4151cb0 0x7f5dc41444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5dc40c4c50 0x7f5dc4143f70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 --2- 172.21.15.97:0/828015026 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5dc40c4740 0x7f5dc414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 >> 172.21.15.97:0/828015026 conn(0x7f5dc40ab8b0 msgr2=0x7f5dc414b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 shutdown_connections 2023-12-04T05:37:43.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.382+0000 7f5dcb038640 1 -- 172.21.15.97:0/828015026 wait complete. 2023-12-04T05:37:43.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:43.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 Processor -- start 2023-12-04T05:37:43.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 -- start start 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f47a00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00c9960 con 0x7f47a013dc20 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a013d920 con 0x7f47a013d1f0 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f47a4bb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0155120 con 0x7f47a00c48b0 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f47a013dc20 0x7f47a015efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50852/0 (socket says 172.21.15.97:50852) 2023-12-04T05:37:43.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479ed9d640 1 -- 172.21.15.97:0/385885647 learned_addr learned my addr 172.21.15.97:0/385885647 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f4795d9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f47a00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721061434 0 0) 0x7f47a00c9960 con 0x7f47a013dc20 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c003530 con 0x7f47a013dc20 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705543292 0 0) 0x7f47a013d920 con 0x7f47a013d1f0 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a00c9960 con 0x7f47a013d1f0 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4081036795 0 0) 0x7f478c003530 con 0x7f47a013dc20 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 msgr2=0x7f47a00c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f47a00c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 >> v1:172.21.15.143:6789/0 conn(0x7f47a013d1f0 legacy=0x7f47a00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0154a60 con 0x7f47a013dc20 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f4798001680 con 0x7f47a013dc20 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 >> v1:172.21.15.97:6789/0 conn(0x7f47a013dc20 legacy=0x7f47a015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f478c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478c0040a0 0x7f478c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c004d10 0x7f478c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0155120 con 0x7f478c0040a0 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00bba0 con 0x7f478c004d10 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.538+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00bd60 con 0x7f47a00c48b0 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479e59c640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f478c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478c0040a0 0x7f478c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479ed9d640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c004d10 0x7f478c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 -- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 msgr2=0x7f478c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f478c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 -- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c004d10 msgr2=0x7f478c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c004d10 0x7f478c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 -- 172.21.15.97:0/385885647 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c003530 con 0x7f478c0040a0 2023-12-04T05:37:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479e59c640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a00c48b0 0x7f478c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:43.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f4795d9b640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478c0040a0 0x7f478c0047d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4788009f90 tx=0x7f478801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fda3a4640fcc85 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880a5c00 con 0x7f478c0040a0 2023-12-04T05:37:43.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800f040 con 0x7f478c0040a0 2023-12-04T05:37:43.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.542+0000 7f479dd9b640 1 -- 172.21.15.97:0/385885647 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880ad440 con 0x7f478c0040a0 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- 172.21.15.97:0/385885647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478c0040a0 msgr2=0x7f478c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/385885647 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f478c0040a0 0x7f478c0047d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4788009f90 tx=0x7f478801cbf0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f479ed9d640 1 -- 172.21.15.97:0/385885647 reap_dead start 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- 172.21.15.97:0/385885647 shutdown_connections 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- 172.21.15.97:0/385885647 >> 172.21.15.97:0/385885647 conn(0x7f47a00ac160 msgr2=0x7f47a00c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- 172.21.15.97:0/385885647 shutdown_connections 2023-12-04T05:37:43.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- 172.21.15.97:0/385885647 wait complete. 2023-12-04T05:37:43.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 Processor -- start 2023-12-04T05:37:43.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- start start 2023-12-04T05:37:43.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c0040a0 0x7f47a0151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a01505b0 0x7f47a01331c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0133700 con 0x7f47a0152580 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01340b0 con 0x7f478c0040a0 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f47a4bb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01327f0 con 0x7f47a01505b0 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f4795d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f4795d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55554/0 (socket says 172.21.15.97:55554) 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f4795d9b640 1 -- 172.21.15.97:0/1881772364 learned_addr learned my addr 172.21.15.97:0/1881772364 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.546+0000 7f479e59c640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c0040a0 0x7f47a0151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f479ed9d640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a01505b0 0x7f47a01331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 -- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a01505b0 msgr2=0x7f47a01331c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a01505b0 0x7f47a01331c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 -- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c0040a0 msgr2=0x7f47a0151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c0040a0 0x7f47a0151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 -- 172.21.15.97:0/1881772364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00caed0 con 0x7f47a0152580 2023-12-04T05:37:43.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f4795d9b640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f478801ca20 tx=0x7f4788009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880ad800 con 0x7f47a0152580 2023-12-04T05:37:43.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47880ad980 con 0x7f47a0152580 2023-12-04T05:37:43.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0150a50 con 0x7f47a0152580 2023-12-04T05:37:43.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880add30 con 0x7f47a0152580 2023-12-04T05:37:43.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a01345e0 con 0x7f47a0152580 2023-12-04T05:37:43.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a0132960 con 0x7f47a0152580 2023-12-04T05:37:43.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47880b4040 con 0x7f47a0152580 2023-12-04T05:37:43.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 0x7f4780068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.550+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f478811ec40 con 0x7f47a0152580 2023-12-04T05:37:43.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.554+0000 7f479e59c640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 0x7f4780068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.554+0000 7f479e59c640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 0x7f4780068dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4790007fd0 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.554+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47880ebbd0 con 0x7f47a0152580 2023-12-04T05:37:43.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.706+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a0132960 con 0x7f47a0152580 2023-12-04T05:37:43.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.706+0000 7f47977fe640 1 -- 172.21.15.97:0/1881772364 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20230 (secure 0 0 0) 0x7f47880b2070 con 0x7f47a0152580 2023-12-04T05:37:43.712 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:43.712 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":34,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:42.375521+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 msgr2=0x7f4780068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 0x7f4780068dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4790007fd0 tx=0x7f4790009040 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 msgr2=0x7f47a0132c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f478801ca20 tx=0x7f4788009750 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 shutdown_connections 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4780066900 0x7f4780068dc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47a01505b0 0x7f47a01331c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47a0152580 0x7f47a0132c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 --2- 172.21.15.97:0/1881772364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f478c0040a0 0x7f47a0151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 >> 172.21.15.97:0/1881772364 conn(0x7f47a00ac160 msgr2=0x7f47a0135d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 shutdown_connections 2023-12-04T05:37:43.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.710+0000 7f47a4bb8640 1 -- 172.21.15.97:0/1881772364 wait complete. 2023-12-04T05:37:43.734 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-04T05:37:43.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 Processor -- start 2023-12-04T05:37:43.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 -- start start 2023-12-04T05:37:43.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd84414eb30 0x7fd84414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd844154fe0 0x7fd84415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd844154640 con 0x7fd84414f790 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440c0bd0 con 0x7fd84414eb30 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84c5b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84414ef10 con 0x7fd844154fe0 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd849b53640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd84414f790 0x7fd8441548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:50868/0 (socket says 172.21.15.97:50868) 2023-12-04T05:37:43.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd849b53640 1 -- 172.21.15.97:0/1138075675 learned_addr learned my addr 172.21.15.97:0/1138075675 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84a354640 1 --2- 172.21.15.97:0/1138075675 >> v2:172.21.15.143:3300/0 conn(0x7fd84414eb30 0x7fd84414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.870+0000 7fd84ab55640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd844154fe0 0x7fd84415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd849352640 1 -- 172.21.15.97:0/1138075675 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784899491 0 0) 0x7fd844154640 con 0x7fd84414f790 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd849352640 1 -- 172.21.15.97:0/1138075675 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd830003530 con 0x7fd84414f790 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd84a354640 1 -- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd844154fe0 msgr2=0x7fd84415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd84a354640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd844154fe0 0x7fd84415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd84a354640 1 -- 172.21.15.97:0/1138075675 >> v1:172.21.15.97:6789/0 conn(0x7fd84414f790 legacy=0x7fd8441548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd84a354640 1 -- 172.21.15.97:0/1138075675 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8441535a0 con 0x7fd84414eb30 2023-12-04T05:37:43.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd84a354640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414eb30 0x7fd84414f250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8400097c0 tx=0x7fd84001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d69bd3c3c671939 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd849352640 1 -- 172.21.15.97:0/1138075675 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400ab650 con 0x7fd84414eb30 2023-12-04T05:37:43.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd849352640 1 -- 172.21.15.97:0/1138075675 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400ab7b0 con 0x7fd84414eb30 2023-12-04T05:37:43.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.874+0000 7fd849352640 1 -- 172.21.15.97:0/1138075675 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400abb40 con 0x7fd84414eb30 2023-12-04T05:37:43.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414eb30 msgr2=0x7fd84414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414eb30 0x7fd84414f250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8400097c0 tx=0x7fd84001c450 comp rx=0 tx=0).stop 2023-12-04T05:37:43.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- 172.21.15.97:0/1138075675 shutdown_connections 2023-12-04T05:37:43.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd844154fe0 0x7fd84415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/1138075675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414eb30 0x7fd84414f250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- 172.21.15.97:0/1138075675 >> 172.21.15.97:0/1138075675 conn(0x7fd8440c5e70 msgr2=0x7fd8440c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- 172.21.15.97:0/1138075675 shutdown_connections 2023-12-04T05:37:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- 172.21.15.97:0/1138075675 wait complete. 2023-12-04T05:37:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 Processor -- start 2023-12-04T05:37:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- start start 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 0x7fd8440714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 0x7fd8440719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844148cf0 con 0x7fd844154fe0 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84413fb90 con 0x7fd84414f790 2023-12-04T05:37:43.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84c5b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844070c20 con 0x7fd84414eb30 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:55566/0 (socket says 172.21.15.97:55566) 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 -- 172.21.15.97:0/2704386311 learned_addr learned my addr 172.21.15.97:0/2704386311 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84a354640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 0x7fd8440714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 -- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 msgr2=0x7fd8440714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 0x7fd8440714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd849b53640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 0x7fd8440719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 -- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 msgr2=0x7fd8440719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 0x7fd8440719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84ab55640 1 -- 172.21.15.97:0/2704386311 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009420 con 0x7fd844154fe0 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd84a354640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 0x7fd8440714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.878+0000 7fd849b53640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 0x7fd8440719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd84ab55640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009d30 tx=0x7fd83c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c009ba0 con 0x7fd844154fe0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00f040 con 0x7fd844154fe0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84414fd20 con 0x7fd844154fe0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0146c0 con 0x7fd844154fe0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd844148910 con 0x7fd844154fe0 2023-12-04T05:37:43.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844068440 con 0x7fd844154fe0 2023-12-04T05:37:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd83c014820 con 0x7fd844154fe0 2023-12-04T05:37:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 0x7fd828068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd83c0852c0 con 0x7fd844154fe0 2023-12-04T05:37:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.882+0000 7fd84a354640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 0x7fd828068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.886+0000 7fd84a354640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 0x7fd828068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd8400af000 tx=0x7fd840008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:43.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:43.886+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd83c052110 con 0x7fd844154fe0 2023-12-04T05:37:44.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:44.074+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd8440a8ac0 con 0x7fd844154fe0 2023-12-04T05:37:44.313 INFO:tasks.ceph.mds.c.smithi097.stderr:2023-12-04T05:37:44.310+0000 7f2d2fd59640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:37:45.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.038+0000 7fd83affd640 1 -- 172.21.15.97:0/2704386311 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd83c055730 con 0x7fd844154fe0 2023-12-04T05:37:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 msgr2=0x7fd828068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 0x7fd828068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd8400af000 tx=0x7fd840008040 comp rx=0 tx=0).stop 2023-12-04T05:37:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 msgr2=0x7fd8440aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009d30 tx=0x7fd83c00c490 comp rx=0 tx=0).stop 2023-12-04T05:37:45.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 shutdown_connections 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd8280668d0 0x7fd828068d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd844154fe0 0x7fd8440aa2d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd84414f790 0x7fd8440719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 --2- 172.21.15.97:0/2704386311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd84414eb30 0x7fd8440714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 >> 172.21.15.97:0/2704386311 conn(0x7fd8440c5e70 msgr2=0x7fd84414a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 shutdown_connections 2023-12-04T05:37:45.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.042+0000 7fd84c5b8640 1 -- 172.21.15.97:0/2704386311 wait complete. 2023-12-04T05:37:45.067 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:37:45.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-04T05:37:45.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 Processor -- start 2023-12-04T05:37:45.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 -- start start 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49cc072800 0x7f49cc0c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc154880 con 0x7f49cc158800 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc06e160 con 0x7f49cc0c1fb0 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d2a5a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc158c90 con 0x7f49cc072800 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49cb7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f49cc072800 0x7f49cc0c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d0ff7640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f49cc158800 0x7f49cc06b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46316/0 (socket says 172.21.15.97:46316) 2023-12-04T05:37:45.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.206+0000 7f49d0ff7640 1 -- 172.21.15.97:0/3787844567 learned_addr learned my addr 172.21.15.97:0/3787844567 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:45.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49cb7fe640 1 -- 172.21.15.97:0/3787844567 >> v1:172.21.15.143:6789/0 conn(0x7f49cc0c1fb0 legacy=0x7f49cc155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49cb7fe640 1 -- 172.21.15.97:0/3787844567 >> v1:172.21.15.97:6789/0 conn(0x7f49cc158800 legacy=0x7f49cc06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49cb7fe640 1 -- 172.21.15.97:0/3787844567 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc06e440 con 0x7f49cc072800 2023-12-04T05:37:45.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49cb7fe640 1 --2- 172.21.15.97:0/3787844567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0c10c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f49c00097c0 tx=0x7f49c001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4390aa960f1d5d43 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:45.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49caffd640 1 -- 172.21.15.97:0/3787844567 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ab600 con 0x7f49cc072800 2023-12-04T05:37:45.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49caffd640 1 -- 172.21.15.97:0/3787844567 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c00a7050 con 0x7f49cc072800 2023-12-04T05:37:45.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49caffd640 1 -- 172.21.15.97:0/3787844567 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ab980 con 0x7f49cc072800 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3787844567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 msgr2=0x7f49cc0c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3787844567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0c10c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f49c00097c0 tx=0x7f49c001c2f0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3787844567 shutdown_connections 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3787844567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0c10c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.210+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3787844567 >> 172.21.15.97:0/3787844567 conn(0x7f49cc0c31c0 msgr2=0x7f49cc0c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:45.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3787844567 shutdown_connections 2023-12-04T05:37:45.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3787844567 wait complete. 2023-12-04T05:37:45.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 Processor -- start 2023-12-04T05:37:45.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- start start 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49cc0c1fb0 0x7f49cc0a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49cc158800 0x7f49cc14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0a92f0 con 0x7f49cc072800 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0ab510 con 0x7f49cc158800 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0aa2c0 con 0x7f49cc0c1fb0 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32904/0 (socket says 172.21.15.97:32904) 2023-12-04T05:37:45.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 -- 172.21.15.97:0/3066388786 learned_addr learned my addr 172.21.15.97:0/3066388786 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:45.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 -- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49cc0c1fb0 msgr2=0x7f49cc0a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49cc0c1fb0 0x7f49cc0a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 -- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49cc158800 msgr2=0x7f49cc14c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:45.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49cc158800 0x7f49cc14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:45.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 -- 172.21.15.97:0/3066388786 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0009420 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49cbfff640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c410 tx=0x7f49bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011790 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc011910 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc1eda90 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.214+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011cc0 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc0ab760 con 0x7f49cc072800 2023-12-04T05:37:45.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc0aa0b0 con 0x7f49cc072800 2023-12-04T05:37:45.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f49bc01c460 con 0x7f49cc072800 2023-12-04T05:37:45.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49c8ff9640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 0x7f49b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:45.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f49bc084770 con 0x7f49cc072800 2023-12-04T05:37:45.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49cb7fe640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 0x7f49b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:45.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.218+0000 7f49cb7fe640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 0x7f49b8068d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f49c00ad000 tx=0x7f49c0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:45.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.222+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49bc0515b0 con 0x7f49cc072800 2023-12-04T05:37:45.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:45.406+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49cc068440 con 0x7f49cc072800 2023-12-04T05:37:46.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.038+0000 7f49c8ff9640 1 -- 172.21.15.97:0/3066388786 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f49bc054bd0 con 0x7f49cc072800 2023-12-04T05:37:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 msgr2=0x7f49b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 0x7f49b8068d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f49c00ad000 tx=0x7f49c0004740 comp rx=0 tx=0).stop 2023-12-04T05:37:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 msgr2=0x7f49cc0a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c410 tx=0x7f49bc00c8d0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 shutdown_connections 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49b80668d0 0x7f49b8068d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49cc158800 0x7f49cc14c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49cc0c1fb0 0x7f49cc0a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 --2- 172.21.15.97:0/3066388786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49cc072800 0x7f49cc0a8870 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 >> 172.21.15.97:0/3066388786 conn(0x7f49cc0c31c0 msgr2=0x7f49cc0c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 shutdown_connections 2023-12-04T05:37:46.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.042+0000 7f49d2a5a640 1 -- 172.21.15.97:0/3066388786 wait complete. 2023-12-04T05:37:46.068 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-04T05:37:46.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:46.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 Processor -- start 2023-12-04T05:37:46.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 -- start start 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 0x7f9c3806b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c38154680 con 0x7f9c380c7d90 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c38154960 con 0x7f9c380af630 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3ca31640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380afa10 con 0x7f9c380c72b0 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3759e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9c380c7d90 0x7f9c3806b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46318/0 (socket says 172.21.15.97:46318) 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3759e640 1 -- 172.21.15.97:0/271598603 learned_addr learned my addr 172.21.15.97:0/271598603 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3659c640 1 --2- 172.21.15.97:0/271598603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 0x7f9c3806b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621276817 0 0) 0x7f9c38154680 con 0x7f9c380c7d90 2023-12-04T05:37:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c20003530 con 0x7f9c380c7d90 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951563323 0 0) 0x7f9c38154960 con 0x7f9c380af630 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c38154680 con 0x7f9c380af630 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460835392 0 0) 0x7f9c20003530 con 0x7f9c380c7d90 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3659c640 1 -- 172.21.15.97:0/271598603 >> v1:172.21.15.143:6789/0 conn(0x7f9c380af630 legacy=0x7f9c380c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3659c640 1 -- 172.21.15.97:0/271598603 >> v1:172.21.15.97:6789/0 conn(0x7f9c380c7d90 legacy=0x7f9c3806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.206+0000 7f9c3659c640 1 -- 172.21.15.97:0/271598603 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c38154c40 con 0x7f9c380c72b0 2023-12-04T05:37:46.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3659c640 1 --2- 172.21.15.97:0/271598603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 0x7f9c3806b2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097f0 tx=0x7f9c2c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4151180d648ccc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30001a00 con 0x7f9c380c72b0 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0a7050 con 0x7f9c380c72b0 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c35d9b640 1 -- 172.21.15.97:0/271598603 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0ab620 con 0x7f9c380c72b0 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 -- 172.21.15.97:0/271598603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 msgr2=0x7f9c3806b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/271598603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 0x7f9c3806b2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097f0 tx=0x7f9c2c01c350 comp rx=0 tx=0).stop 2023-12-04T05:37:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 -- 172.21.15.97:0/271598603 shutdown_connections 2023-12-04T05:37:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/271598603 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380c72b0 0x7f9c3806b2d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 -- 172.21.15.97:0/271598603 >> 172.21.15.97:0/271598603 conn(0x7f9c380aba40 msgr2=0x7f9c380abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 -- 172.21.15.97:0/271598603 shutdown_connections 2023-12-04T05:37:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.210+0000 7f9c3ca31640 1 -- 172.21.15.97:0/271598603 wait complete. 2023-12-04T05:37:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 Processor -- start 2023-12-04T05:37:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- start start 2023-12-04T05:37:46.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 0x7f9c38147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 0x7f9c381508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c381edc70 con 0x7f9c380c72b0 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c380c03b0 con 0x7f9c380c7d90 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c381ecd30 con 0x7f9c380af630 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32918/0 (socket says 172.21.15.97:32918) 2023-12-04T05:37:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 -- 172.21.15.97:0/2420403096 learned_addr learned my addr 172.21.15.97:0/2420403096 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c36d9d640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 0x7f9c38147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 -- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 msgr2=0x7f9c38147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3759e640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 0x7f9c381508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 0x7f9c38147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 -- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 msgr2=0x7f9c381508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 0x7f9c381508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 -- 172.21.15.97:0/2420403096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009420 con 0x7f9c380c72b0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c36d9d640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 0x7f9c38147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3759e640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 0x7f9c381508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3659c640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097f0 tx=0x7f9c2c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0abe70 con 0x7f9c380c72b0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c004020 con 0x7f9c380c72b0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c381ecff0 con 0x7f9c380c72b0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c004390 con 0x7f9c380c72b0 2023-12-04T05:37:46.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.214+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c381ed5b0 con 0x7f9c380c72b0 2023-12-04T05:37:46.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c381506f0 con 0x7f9c380c72b0 2023-12-04T05:37:46.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c2c0b2040 con 0x7f9c380c72b0 2023-12-04T05:37:46.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c1f7fe640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 0x7f9c24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9c2c11e450 con 0x7f9c380c72b0 2023-12-04T05:37:46.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c36d9d640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 0x7f9c24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.218+0000 7f9c36d9d640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 0x7f9c24068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c280011f0 tx=0x7f9c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.222+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c2c0eb320 con 0x7f9c380c72b0 2023-12-04T05:37:46.409 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c3804e890 con 0x7f9c380c72b0 2023-12-04T05:37:46.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c1f7fe640 1 -- 172.21.15.97:0/2420403096 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f9c2c0ee940 con 0x7f9c380c72b0 2023-12-04T05:37:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:46.410 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:37:46.410 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 22 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 msgr2=0x7f9c24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 0x7f9c24068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c280011f0 tx=0x7f9c28009040 comp rx=0 tx=0).stop 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 msgr2=0x7f9c3814cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c0097f0 tx=0x7f9c2c0190f0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 shutdown_connections 2023-12-04T05:37:46.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c240668d0 0x7f9c24068d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c380c7d90 0x7f9c381508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c380c72b0 0x7f9c3814cdc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 --2- 172.21.15.97:0/2420403096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c380af630 0x7f9c38147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 >> 172.21.15.97:0/2420403096 conn(0x7f9c380aba40 msgr2=0x7f9c380abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 shutdown_connections 2023-12-04T05:37:46.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.406+0000 7f9c3ca31640 1 -- 172.21.15.97:0/2420403096 wait complete. 2023-12-04T05:37:46.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:46.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 Processor -- start 2023-12-04T05:37:46.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 -- start start 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c155370 0x7f4b5c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c1547d0 con 0x7f4b5c151bf0 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c158b80 con 0x7f4b5c0c7ef0 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b6451d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c4aa0 con 0x7f4b5c155370 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b622b9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4b5c151bf0 0x7f4b5c0abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46332/0 (socket says 172.21.15.97:46332) 2023-12-04T05:37:46.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b622b9640 1 -- 172.21.15.97:0/3068151128 learned_addr learned my addr 172.21.15.97:0/3068151128 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c155370 0x7f4b5c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788899627 0 0) 0x7f4b5c1547d0 con 0x7f4b5c151bf0 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b48003530 con 0x7f4b5c151bf0 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952383421 0 0) 0x7f4b48003530 con 0x7f4b5c151bf0 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c155370 msgr2=0x7f4b5c15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c155370 0x7f4b5c15ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 >> v1:172.21.15.143:6789/0 conn(0x7f4b5c0c7ef0 legacy=0x7f4b5c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0c4d40 con 0x7f4b5c151bf0 2023-12-04T05:37:46.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f4b58001680 con 0x7f4b5c151bf0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 >> v1:172.21.15.97:6789/0 conn(0x7f4b5c151bf0 legacy=0x7f4b5c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b480039b0 0x7f4b48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b480047d0 0x7f4b48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c4aa0 con 0x7f4b48005190 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4800c060 con 0x7f4b480039b0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4800c220 con 0x7f4b480047d0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.566+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c155370 0x7f4b5c15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b61ab8640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b480047d0 0x7f4b48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b622b9640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b480039b0 0x7f4b48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 -- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b480047d0 msgr2=0x7f4b48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b480047d0 0x7f4b48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.574 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 -- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b480039b0 msgr2=0x7f4b48003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:46.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b480039b0 0x7f4b48003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 -- 172.21.15.97:0/3068151128 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48003530 con 0x7f4b48005190 2023-12-04T05:37:46.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b62aba640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b4800b990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0c85d0 tx=0x7f4b5401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bedbb1479918e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540a5cf0 con 0x7f4b48005190 2023-12-04T05:37:46.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400f040 con 0x7f4b48005190 2023-12-04T05:37:46.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b612b7640 1 -- 172.21.15.97:0/3068151128 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54003bc0 con 0x7f4b48005190 2023-12-04T05:37:46.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.570+0000 7f4b6451d640 1 -- 172.21.15.97:0/3068151128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 msgr2=0x7f4b4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 --2- 172.21.15.97:0/3068151128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b4800b990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0c85d0 tx=0x7f4b5401cca0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b62aba640 1 -- 172.21.15.97:0/3068151128 reap_dead start 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- 172.21.15.97:0/3068151128 shutdown_connections 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- 172.21.15.97:0/3068151128 >> 172.21.15.97:0/3068151128 conn(0x7f4b5c073550 msgr2=0x7f4b5c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- 172.21.15.97:0/3068151128 shutdown_connections 2023-12-04T05:37:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- 172.21.15.97:0/3068151128 wait complete. 2023-12-04T05:37:46.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 Processor -- start 2023-12-04T05:37:46.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- start start 2023-12-04T05:37:46.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b5c156180 0x7f4b5c0aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 0x7f4b5c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c158320 con 0x7f4b48005190 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1559d0 con 0x7f4b5c156180 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b6451d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c155c70 con 0x7f4b5c14b070 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32946/0 (socket says 172.21.15.97:32946) 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 -- 172.21.15.97:0/604333688 learned_addr learned my addr 172.21.15.97:0/604333688 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b61ab8640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b5c156180 0x7f4b5c0aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b62aba640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 0x7f4b5c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 -- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 msgr2=0x7f4b5c14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 0x7f4b5c14a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 -- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b5c156180 msgr2=0x7f4b5c0aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b5c156180 0x7f4b5c0aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 -- 172.21.15.97:0/604333688 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c1edc30 con 0x7f4b48005190 2023-12-04T05:37:46.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b62aba640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 0x7f4b5c14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.574+0000 7f4b622b9640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4b58007290 tx=0x7f4b58007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800f940 con 0x7f4b48005190 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5800fac0 con 0x7f4b48005190 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800fe70 con 0x7f4b48005190 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1587c0 con 0x7f4b48005190 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0abde0 con 0x7f4b48005190 2023-12-04T05:37:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c1eddc0 con 0x7f4b48005190 2023-12-04T05:37:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4b5801d460 con 0x7f4b48005190 2023-12-04T05:37:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 0x7f4b40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4b580849f0 con 0x7f4b48005190 2023-12-04T05:37:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.578+0000 7f4b61ab8640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 0x7f4b40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.582+0000 7f4b61ab8640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 0x7f4b40068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c001210 tx=0x7f4b4c0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.582+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b58051830 con 0x7f4b48005190 2023-12-04T05:37:46.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.734+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b5c155db0 con 0x7f4b48005190 2023-12-04T05:37:46.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b52ffd640 1 -- 172.21.15.97:0/604333688 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7f4b58054e50 con 0x7f4b48005190 2023-12-04T05:37:46.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:46.741 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 msgr2=0x7f4b40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 0x7f4b40068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c001210 tx=0x7f4b4c0011a0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 msgr2=0x7f4b5c0aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4b58007290 tx=0x7f4b58007750 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 shutdown_connections 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4b400668d0 0x7f4b40068d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b5c14b070 0x7f4b5c14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b5c156180 0x7f4b5c0aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 --2- 172.21.15.97:0/604333688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b48005190 0x7f4b5c0aa580 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 >> 172.21.15.97:0/604333688 conn(0x7f4b5c073550 msgr2=0x7f4b5c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 shutdown_connections 2023-12-04T05:37:46.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.738+0000 7f4b6451d640 1 -- 172.21.15.97:0/604333688 wait complete. 2023-12-04T05:37:46.765 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:37:46.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:46.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.898+0000 7f9fbc8fe640 1 Processor -- start 2023-12-04T05:37:46.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.898+0000 7f9fbc8fe640 1 -- start start 2023-12-04T05:37:46.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fbc8fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9fb8154d50 0x7f9fb806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fbc8fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9fb80a9470 0x7f9fb806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fbc8fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb806c760 con 0x7f9fb8154260 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fbc8fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80a8670 con 0x7f9fb80a9470 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fbc8fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb806c550 con 0x7f9fb8154d50 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9fb80a9470 0x7f9fb806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9fb80a9470 0x7f9fb806dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32956/0 (socket says 172.21.15.97:32956) 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 -- 172.21.15.97:0/4002899428 learned_addr learned my addr 172.21.15.97:0/4002899428 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fadd9b640 1 --2- 172.21.15.97:0/4002899428 >> v2:172.21.15.143:3300/0 conn(0x7f9fb8154d50 0x7f9fb806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 -- 172.21.15.97:0/4002899428 >> v2:172.21.15.143:3300/0 conn(0x7f9fb8154d50 msgr2=0x7f9fb806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:46.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 --2- 172.21.15.97:0/4002899428 >> v2:172.21.15.143:3300/0 conn(0x7f9fb8154d50 0x7f9fb806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 -- 172.21.15.97:0/4002899428 >> v1:172.21.15.143:6789/0 conn(0x7f9fb8154260 legacy=0x7f9fb8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 -- 172.21.15.97:0/4002899428 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb806ca40 con 0x7f9fb80a9470 2023-12-04T05:37:46.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb6d9d640 1 --2- 172.21.15.97:0/4002899428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb80a9470 0x7f9fb806dd40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8151a20 tx=0x7f9fb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be82a367eb7ce2f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb5d9b640 1 -- 172.21.15.97:0/4002899428 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a56d0 con 0x7f9fb80a9470 2023-12-04T05:37:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.902+0000 7f9fb5d9b640 1 -- 172.21.15.97:0/4002899428 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00a5830 con 0x7f9fb80a9470 2023-12-04T05:37:46.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fb5d9b640 1 -- 172.21.15.97:0/4002899428 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a5bc0 con 0x7f9fb80a9470 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/4002899428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb80a9470 msgr2=0x7f9fb806dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/4002899428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb80a9470 0x7f9fb806dd40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8151a20 tx=0x7f9fb001c9a0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/4002899428 shutdown_connections 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/4002899428 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb80a9470 0x7f9fb806dd40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/4002899428 >> v2:172.21.15.143:3300/0 conn(0x7f9fb8154d50 0x7f9fb806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/4002899428 >> 172.21.15.97:0/4002899428 conn(0x7f9fb80c2970 msgr2=0x7f9fb80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/4002899428 shutdown_connections 2023-12-04T05:37:46.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/4002899428 wait complete. 2023-12-04T05:37:46.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 Processor -- start 2023-12-04T05:37:46.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- start start 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fb80a9470 0x7f9fb81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fb8154d50 0x7f9fb80c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815e8e0 con 0x7f9fb8154260 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81517f0 con 0x7f9fb80a9470 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fbc8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb815dfb0 con 0x7f9fb8154d50 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fadd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fadd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32960/0 (socket says 172.21.15.97:32960) 2023-12-04T05:37:46.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fadd9b640 1 -- 172.21.15.97:0/1251407828 learned_addr learned my addr 172.21.15.97:0/1251407828 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fb659c640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fb80a9470 0x7f9fb81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.906+0000 7f9fb6d9d640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fb8154d50 0x7f9fb80c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 -- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fb8154d50 msgr2=0x7f9fb80c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fb8154d50 0x7f9fb80c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 -- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fb80a9470 msgr2=0x7f9fb81511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fb80a9470 0x7f9fb81511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 -- 172.21.15.97:0/1251407828 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009b30 con 0x7f9fb8154260 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fadd9b640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000e840 tx=0x7f9fa000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0009510 con 0x7f9fb8154260 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000ee90 con 0x7f9fb8154260 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb815e290 con 0x7f9fb8154260 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000cb60 con 0x7f9fb8154260 2023-12-04T05:37:46.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb815f450 con 0x7f9fb8154260 2023-12-04T05:37:46.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb815ea90 con 0x7f9fb8154260 2023-12-04T05:37:46.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.910+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9fa000ccc0 con 0x7f9fb8154260 2023-12-04T05:37:46.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.914+0000 7f9faf7fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 0x7f9f98068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:46.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.914+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9fa0084740 con 0x7f9fb8154260 2023-12-04T05:37:46.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.914+0000 7f9fb659c640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 0x7f9f98068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:46.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.914+0000 7f9fb659c640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 0x7f9f98068dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8007fd0 tx=0x7f9fa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:46.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:46.918+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fb815ea90 con 0x7f9fb8154260 2023-12-04T05:37:47.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.066+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fb815ea90 con 0x7f9f98066900 2023-12-04T05:37:47.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.078+0000 7f9faf7fe640 1 -- 172.21.15.97:0/1251407828 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527824 (secure 0 0 0) 0x7f9fb815ea90 con 0x7f9f98066900 2023-12-04T05:37:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:47.093 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:47.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 msgr2=0x7f9f98068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 0x7f9f98068dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8007fd0 tx=0x7f9fa8009040 comp rx=0 tx=0).stop 2023-12-04T05:37:47.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 msgr2=0x7f9fb8071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000e840 tx=0x7f9fa000ec40 comp rx=0 tx=0).stop 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 shutdown_connections 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9f98066900 0x7f9f98068dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fb8154d50 0x7f9fb80c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fb8154260 0x7f9fb8071050 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 --2- 172.21.15.97:0/1251407828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fb80a9470 0x7f9fb81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 >> 172.21.15.97:0/1251407828 conn(0x7f9fb80c2970 msgr2=0x7f9fb8154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 shutdown_connections 2023-12-04T05:37:47.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.086+0000 7f9fbc8fe640 1 -- 172.21.15.97:0/1251407828 wait complete. 2023-12-04T05:37:47.108 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-04T05:37:46.204420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220364,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754356,"statfs":{"total":773094113280,"available":772868460544,"internally_reserved":0,"allocated":4268032,"data_stored":2387132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222538"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054138+0000","last_change":"2023-12-04T05:37:43.042408+0000","last_active":"2023-12-04T05:37:43.054138+0000","last_peered":"2023-12-04T05:37:43.054138+0000","last_clean":"2023-12-04T05:37:43.054138+0000","last_became_active":"2023-12-04T05:37:43.041742+0000","last_became_peered":"2023-12-04T05:37:43.041742+0000","last_unstale":"2023-12-04T05:37:43.054138+0000","last_undegraded":"2023-12-04T05:37:43.054138+0000","last_fullsized":"2023-12-04T05:37:43.054138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:45.907701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996800+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:41.996800+0000","last_peered":"2023-12-04T05:37:41.996800+0000","last_clean":"2023-12-04T05:37:41.996800+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:41.996800+0000","last_undegraded":"2023-12-04T05:37:41.996800+0000","last_fullsized":"2023-12-04T05:37:41.996800+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.016751+0000","last_change":"2023-12-04T05:37:24.361054+0000","last_active":"2023-12-04T05:37:42.016751+0000","last_peered":"2023-12-04T05:37:42.016751+0000","last_clean":"2023-12-04T05:37:42.016751+0000","last_became_active":"2023-12-04T05:37:24.360700+0000","last_became_peered":"2023-12-04T05:37:24.360700+0000","last_unstale":"2023-12-04T05:37:42.016751+0000","last_undegraded":"2023-12-04T05:37:42.016751+0000","last_fullsized":"2023-12-04T05:37:42.016751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996538+0000","last_change":"2023-12-04T05:37:25.001807+0000","last_active":"2023-12-04T05:37:41.996538+0000","last_peered":"2023-12-04T05:37:41.996538+0000","last_clean":"2023-12-04T05:37:41.996538+0000","last_became_active":"2023-12-04T05:37:24.999364+0000","last_became_peered":"2023-12-04T05:37:24.999364+0000","last_unstale":"2023-12-04T05:37:41.996538+0000","last_undegraded":"2023-12-04T05:37:41.996538+0000","last_fullsized":"2023-12-04T05:37:41.996538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056484+0000","last_change":"2023-12-04T05:37:42.022650+0000","last_active":"2023-12-04T05:37:43.056484+0000","last_peered":"2023-12-04T05:37:43.056484+0000","last_clean":"2023-12-04T05:37:43.056484+0000","last_became_active":"2023-12-04T05:37:42.022186+0000","last_became_peered":"2023-12-04T05:37:42.022186+0000","last_unstale":"2023-12-04T05:37:43.056484+0000","last_undegraded":"2023-12-04T05:37:43.056484+0000","last_fullsized":"2023-12-04T05:37:43.056484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:19.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054287+0000","last_change":"2023-12-04T05:37:43.048636+0000","last_active":"2023-12-04T05:37:43.054287+0000","last_peered":"2023-12-04T05:37:43.054287+0000","last_clean":"2023-12-04T05:37:43.054287+0000","last_became_active":"2023-12-04T05:37:43.048286+0000","last_became_peered":"2023-12-04T05:37:43.048286+0000","last_unstale":"2023-12-04T05:37:43.054287+0000","last_undegraded":"2023-12-04T05:37:43.054287+0000","last_fullsized":"2023-12-04T05:37:43.054287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:20.154897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004420+0000","last_change":"2023-12-04T05:37:24.365579+0000","last_active":"2023-12-04T05:37:42.004420+0000","last_peered":"2023-12-04T05:37:42.004420+0000","last_clean":"2023-12-04T05:37:42.004420+0000","last_became_active":"2023-12-04T05:37:24.364918+0000","last_became_peered":"2023-12-04T05:37:24.364918+0000","last_unstale":"2023-12-04T05:37:42.004420+0000","last_undegraded":"2023-12-04T05:37:42.004420+0000","last_fullsized":"2023-12-04T05:37:42.004420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:07.118802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993232+0000","last_change":"2023-12-04T05:37:24.990350+0000","last_active":"2023-12-04T05:37:41.993232+0000","last_peered":"2023-12-04T05:37:41.993232+0000","last_clean":"2023-12-04T05:37:41.993232+0000","last_became_active":"2023-12-04T05:37:24.990101+0000","last_became_peered":"2023-12-04T05:37:24.990101+0000","last_unstale":"2023-12-04T05:37:41.993232+0000","last_undegraded":"2023-12-04T05:37:41.993232+0000","last_fullsized":"2023-12-04T05:37:41.993232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.017885+0000","last_change":"2023-12-04T05:37:42.022452+0000","last_active":"2023-12-04T05:37:43.017885+0000","last_peered":"2023-12-04T05:37:43.017885+0000","last_clean":"2023-12-04T05:37:43.017885+0000","last_became_active":"2023-12-04T05:37:42.021977+0000","last_became_peered":"2023-12-04T05:37:42.021977+0000","last_unstale":"2023-12-04T05:37:43.017885+0000","last_undegraded":"2023-12-04T05:37:43.017885+0000","last_fullsized":"2023-12-04T05:37:43.017885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:29.224659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052198+0000","last_change":"2023-12-04T05:37:43.039583+0000","last_active":"2023-12-04T05:37:43.052198+0000","last_peered":"2023-12-04T05:37:43.052198+0000","last_clean":"2023-12-04T05:37:43.052198+0000","last_became_active":"2023-12-04T05:37:43.039313+0000","last_became_peered":"2023-12-04T05:37:43.039313+0000","last_unstale":"2023-12-04T05:37:43.052198+0000","last_undegraded":"2023-12-04T05:37:43.052198+0000","last_fullsized":"2023-12-04T05:37:43.052198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:38:14.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993520+0000","last_change":"2023-12-04T05:37:24.356767+0000","last_active":"2023-12-04T05:37:41.993520+0000","last_peered":"2023-12-04T05:37:41.993520+0000","last_clean":"2023-12-04T05:37:41.993520+0000","last_became_active":"2023-12-04T05:37:24.356474+0000","last_became_peered":"2023-12-04T05:37:24.356474+0000","last_unstale":"2023-12-04T05:37:41.993520+0000","last_undegraded":"2023-12-04T05:37:41.993520+0000","last_fullsized":"2023-12-04T05:37:41.993520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004322+0000","last_change":"2023-12-04T05:37:24.989352+0000","last_active":"2023-12-04T05:37:42.004322+0000","last_peered":"2023-12-04T05:37:42.004322+0000","last_clean":"2023-12-04T05:37:42.004322+0000","last_became_active":"2023-12-04T05:37:24.987078+0000","last_became_peered":"2023-12-04T05:37:24.987078+0000","last_unstale":"2023-12-04T05:37:42.004322+0000","last_undegraded":"2023-12-04T05:37:42.004322+0000","last_fullsized":"2023-12-04T05:37:42.004322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034757+0000","last_change":"2023-12-04T05:37:42.015491+0000","last_active":"2023-12-04T05:37:43.034757+0000","last_peered":"2023-12-04T05:37:43.034757+0000","last_clean":"2023-12-04T05:37:43.034757+0000","last_became_active":"2023-12-04T05:37:42.014782+0000","last_became_peered":"2023-12-04T05:37:42.014782+0000","last_unstale":"2023-12-04T05:37:43.034757+0000","last_undegraded":"2023-12-04T05:37:43.034757+0000","last_fullsized":"2023-12-04T05:37:43.034757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:19:36.946960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.029522+0000","last_change":"2023-12-04T05:37:43.024483+0000","last_active":"2023-12-04T05:37:43.029522+0000","last_peered":"2023-12-04T05:37:43.029522+0000","last_clean":"2023-12-04T05:37:43.029522+0000","last_became_active":"2023-12-04T05:37:43.024100+0000","last_became_peered":"2023-12-04T05:37:43.024100+0000","last_unstale":"2023-12-04T05:37:43.029522+0000","last_undegraded":"2023-12-04T05:37:43.029522+0000","last_fullsized":"2023-12-04T05:37:43.029522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002987+0000","last_change":"2023-12-04T05:37:24.365186+0000","last_active":"2023-12-04T05:37:42.002987+0000","last_peered":"2023-12-04T05:37:42.002987+0000","last_clean":"2023-12-04T05:37:42.002987+0000","last_became_active":"2023-12-04T05:37:24.360434+0000","last_became_peered":"2023-12-04T05:37:24.360434+0000","last_unstale":"2023-12-04T05:37:42.002987+0000","last_undegraded":"2023-12-04T05:37:42.002987+0000","last_fullsized":"2023-12-04T05:37:42.002987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990580+0000","last_change":"2023-12-04T05:37:24.985550+0000","last_active":"2023-12-04T05:37:41.990580+0000","last_peered":"2023-12-04T05:37:41.990580+0000","last_clean":"2023-12-04T05:37:41.990580+0000","last_became_active":"2023-12-04T05:37:24.984659+0000","last_became_peered":"2023-12-04T05:37:24.984659+0000","last_unstale":"2023-12-04T05:37:41.990580+0000","last_undegraded":"2023-12-04T05:37:41.990580+0000","last_fullsized":"2023-12-04T05:37:41.990580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040856+0000","last_change":"2023-12-04T05:37:42.012100+0000","last_active":"2023-12-04T05:37:43.040856+0000","last_peered":"2023-12-04T05:37:43.040856+0000","last_clean":"2023-12-04T05:37:43.040856+0000","last_became_active":"2023-12-04T05:37:42.011773+0000","last_became_peered":"2023-12-04T05:37:42.011773+0000","last_unstale":"2023-12-04T05:37:43.040856+0000","last_undegraded":"2023-12-04T05:37:43.040856+0000","last_fullsized":"2023-12-04T05:37:43.040856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:38.831090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048955+0000","last_change":"2023-12-04T05:37:43.043735+0000","last_active":"2023-12-04T05:37:43.048955+0000","last_peered":"2023-12-04T05:37:43.048955+0000","last_clean":"2023-12-04T05:37:43.048955+0000","last_became_active":"2023-12-04T05:37:43.042794+0000","last_became_peered":"2023-12-04T05:37:43.042794+0000","last_unstale":"2023-12-04T05:37:43.048955+0000","last_undegraded":"2023-12-04T05:37:43.048955+0000","last_fullsized":"2023-12-04T05:37:43.048955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:39.837260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990971+0000","last_change":"2023-12-04T05:37:24.362595+0000","last_active":"2023-12-04T05:37:41.990971+0000","last_peered":"2023-12-04T05:37:41.990971+0000","last_clean":"2023-12-04T05:37:41.990971+0000","last_became_active":"2023-12-04T05:37:24.361717+0000","last_became_peered":"2023-12-04T05:37:24.361717+0000","last_unstale":"2023-12-04T05:37:41.990971+0000","last_undegraded":"2023-12-04T05:37:41.990971+0000","last_fullsized":"2023-12-04T05:37:41.990971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.011818+0000","last_change":"2023-12-04T05:37:24.993989+0000","last_active":"2023-12-04T05:37:42.011818+0000","last_peered":"2023-12-04T05:37:42.011818+0000","last_clean":"2023-12-04T05:37:42.011818+0000","last_became_active":"2023-12-04T05:37:24.990547+0000","last_became_peered":"2023-12-04T05:37:24.990547+0000","last_unstale":"2023-12-04T05:37:42.011818+0000","last_undegraded":"2023-12-04T05:37:42.011818+0000","last_fullsized":"2023-12-04T05:37:42.011818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:18.892510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034407+0000","last_change":"2023-12-04T05:37:42.009271+0000","last_active":"2023-12-04T05:37:43.034407+0000","last_peered":"2023-12-04T05:37:43.034407+0000","last_clean":"2023-12-04T05:37:43.034407+0000","last_became_active":"2023-12-04T05:37:42.008976+0000","last_became_peered":"2023-12-04T05:37:42.008976+0000","last_unstale":"2023-12-04T05:37:43.034407+0000","last_undegraded":"2023-12-04T05:37:43.034407+0000","last_fullsized":"2023-12-04T05:37:43.034407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:44.901531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056177+0000","last_change":"2023-12-04T05:37:43.051695+0000","last_active":"2023-12-04T05:37:43.056177+0000","last_peered":"2023-12-04T05:37:43.056177+0000","last_clean":"2023-12-04T05:37:43.056177+0000","last_became_active":"2023-12-04T05:37:43.051435+0000","last_became_peered":"2023-12-04T05:37:43.051435+0000","last_unstale":"2023-12-04T05:37:43.056177+0000","last_undegraded":"2023-12-04T05:37:43.056177+0000","last_fullsized":"2023-12-04T05:37:43.056177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:23.130464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005631+0000","last_change":"2023-12-04T05:37:24.363919+0000","last_active":"2023-12-04T05:37:42.005631+0000","last_peered":"2023-12-04T05:37:42.005631+0000","last_clean":"2023-12-04T05:37:42.005631+0000","last_became_active":"2023-12-04T05:37:24.363592+0000","last_became_peered":"2023-12-04T05:37:24.363592+0000","last_unstale":"2023-12-04T05:37:42.005631+0000","last_undegraded":"2023-12-04T05:37:42.005631+0000","last_fullsized":"2023-12-04T05:37:42.005631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990696+0000","last_change":"2023-12-04T05:37:24.985398+0000","last_active":"2023-12-04T05:37:41.990696+0000","last_peered":"2023-12-04T05:37:41.990696+0000","last_clean":"2023-12-04T05:37:41.990696+0000","last_became_active":"2023-12-04T05:37:24.985152+0000","last_became_peered":"2023-12-04T05:37:24.985152+0000","last_unstale":"2023-12-04T05:37:41.990696+0000","last_undegraded":"2023-12-04T05:37:41.990696+0000","last_fullsized":"2023-12-04T05:37:41.990696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.014337+0000","last_change":"2023-12-04T05:37:42.020510+0000","last_active":"2023-12-04T05:37:43.014337+0000","last_peered":"2023-12-04T05:37:43.014337+0000","last_clean":"2023-12-04T05:37:43.014337+0000","last_became_active":"2023-12-04T05:37:42.020307+0000","last_became_peered":"2023-12-04T05:37:42.020307+0000","last_unstale":"2023-12-04T05:37:43.014337+0000","last_undegraded":"2023-12-04T05:37:43.014337+0000","last_fullsized":"2023-12-04T05:37:43.014337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:26:09.999796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053104+0000","last_change":"2023-12-04T05:37:43.050422+0000","last_active":"2023-12-04T05:37:43.053104+0000","last_peered":"2023-12-04T05:37:43.053104+0000","last_clean":"2023-12-04T05:37:43.053104+0000","last_became_active":"2023-12-04T05:37:43.050087+0000","last_became_peered":"2023-12-04T05:37:43.050087+0000","last_unstale":"2023-12-04T05:37:43.053104+0000","last_undegraded":"2023-12-04T05:37:43.053104+0000","last_fullsized":"2023-12-04T05:37:43.053104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:56:33.810382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991311+0000","last_change":"2023-12-04T05:37:24.366158+0000","last_active":"2023-12-04T05:37:41.991311+0000","last_peered":"2023-12-04T05:37:41.991311+0000","last_clean":"2023-12-04T05:37:41.991311+0000","last_became_active":"2023-12-04T05:37:24.365900+0000","last_became_peered":"2023-12-04T05:37:24.365900+0000","last_unstale":"2023-12-04T05:37:41.991311+0000","last_undegraded":"2023-12-04T05:37:41.991311+0000","last_fullsized":"2023-12-04T05:37:41.991311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005576+0000","last_change":"2023-12-04T05:37:24.997150+0000","last_active":"2023-12-04T05:37:42.005576+0000","last_peered":"2023-12-04T05:37:42.005576+0000","last_clean":"2023-12-04T05:37:42.005576+0000","last_became_active":"2023-12-04T05:37:24.996748+0000","last_became_peered":"2023-12-04T05:37:24.996748+0000","last_unstale":"2023-12-04T05:37:42.005576+0000","last_undegraded":"2023-12-04T05:37:42.005576+0000","last_fullsized":"2023-12-04T05:37:42.005576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.035023+0000","last_change":"2023-12-04T05:37:42.014666+0000","last_active":"2023-12-04T05:37:43.035023+0000","last_peered":"2023-12-04T05:37:43.035023+0000","last_clean":"2023-12-04T05:37:43.035023+0000","last_became_active":"2023-12-04T05:37:42.014380+0000","last_became_peered":"2023-12-04T05:37:42.014380+0000","last_unstale":"2023-12-04T05:37:43.035023+0000","last_undegraded":"2023-12-04T05:37:43.035023+0000","last_fullsized":"2023-12-04T05:37:43.035023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:29.224659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.041947+0000","last_change":"2023-12-04T05:37:43.032271+0000","last_active":"2023-12-04T05:37:43.041947+0000","last_peered":"2023-12-04T05:37:43.041947+0000","last_clean":"2023-12-04T05:37:43.041947+0000","last_became_active":"2023-12-04T05:37:43.031977+0000","last_became_peered":"2023-12-04T05:37:43.031977+0000","last_unstale":"2023-12-04T05:37:43.041947+0000","last_undegraded":"2023-12-04T05:37:43.041947+0000","last_fullsized":"2023-12-04T05:37:43.041947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:07:12.958817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005019+0000","last_change":"2023-12-04T05:37:24.363906+0000","last_active":"2023-12-04T05:37:42.005019+0000","last_peered":"2023-12-04T05:37:42.005019+0000","last_clean":"2023-12-04T05:37:42.005019+0000","last_became_active":"2023-12-04T05:37:24.363600+0000","last_became_peered":"2023-12-04T05:37:24.363600+0000","last_unstale":"2023-12-04T05:37:42.005019+0000","last_undegraded":"2023-12-04T05:37:42.005019+0000","last_fullsized":"2023-12-04T05:37:42.005019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:40.789742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003166+0000","last_change":"2023-12-04T05:37:24.993427+0000","last_active":"2023-12-04T05:37:42.003166+0000","last_peered":"2023-12-04T05:37:42.003166+0000","last_clean":"2023-12-04T05:37:42.003166+0000","last_became_active":"2023-12-04T05:37:24.993085+0000","last_became_peered":"2023-12-04T05:37:24.993085+0000","last_unstale":"2023-12-04T05:37:42.003166+0000","last_undegraded":"2023-12-04T05:37:42.003166+0000","last_fullsized":"2023-12-04T05:37:42.003166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:01:20.885419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.036526+0000","last_change":"2023-12-04T05:37:42.020282+0000","last_active":"2023-12-04T05:37:43.036526+0000","last_peered":"2023-12-04T05:37:43.036526+0000","last_clean":"2023-12-04T05:37:43.036526+0000","last_became_active":"2023-12-04T05:37:42.019997+0000","last_became_peered":"2023-12-04T05:37:42.019997+0000","last_unstale":"2023-12-04T05:37:43.036526+0000","last_undegraded":"2023-12-04T05:37:43.036526+0000","last_fullsized":"2023-12-04T05:37:43.036526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:49.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056403+0000","last_change":"2023-12-04T05:37:43.043196+0000","last_active":"2023-12-04T05:37:43.056403+0000","last_peered":"2023-12-04T05:37:43.056403+0000","last_clean":"2023-12-04T05:37:43.056403+0000","last_became_active":"2023-12-04T05:37:43.043023+0000","last_became_peered":"2023-12-04T05:37:43.043023+0000","last_unstale":"2023-12-04T05:37:43.056403+0000","last_undegraded":"2023-12-04T05:37:43.056403+0000","last_fullsized":"2023-12-04T05:37:43.056403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004489+0000","last_change":"2023-12-04T05:37:24.365259+0000","last_active":"2023-12-04T05:37:42.004489+0000","last_peered":"2023-12-04T05:37:42.004489+0000","last_clean":"2023-12-04T05:37:42.004489+0000","last_became_active":"2023-12-04T05:37:24.364959+0000","last_became_peered":"2023-12-04T05:37:24.364959+0000","last_unstale":"2023-12-04T05:37:42.004489+0000","last_undegraded":"2023-12-04T05:37:42.004489+0000","last_fullsized":"2023-12-04T05:37:42.004489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996401+0000","last_change":"2023-12-04T05:37:25.001416+0000","last_active":"2023-12-04T05:37:41.996401+0000","last_peered":"2023-12-04T05:37:41.996401+0000","last_clean":"2023-12-04T05:37:41.996401+0000","last_became_active":"2023-12-04T05:37:25.001105+0000","last_became_peered":"2023-12-04T05:37:25.001105+0000","last_unstale":"2023-12-04T05:37:41.996401+0000","last_undegraded":"2023-12-04T05:37:41.996401+0000","last_fullsized":"2023-12-04T05:37:41.996401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.026669+0000","last_change":"2023-12-04T05:37:42.016036+0000","last_active":"2023-12-04T05:37:43.026669+0000","last_peered":"2023-12-04T05:37:43.026669+0000","last_clean":"2023-12-04T05:37:43.026669+0000","last_became_active":"2023-12-04T05:37:42.015754+0000","last_became_peered":"2023-12-04T05:37:42.015754+0000","last_unstale":"2023-12-04T05:37:43.026669+0000","last_undegraded":"2023-12-04T05:37:43.026669+0000","last_fullsized":"2023-12-04T05:37:43.026669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:39:25.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.044723+0000","last_change":"2023-12-04T05:37:43.037974+0000","last_active":"2023-12-04T05:37:43.044723+0000","last_peered":"2023-12-04T05:37:43.044723+0000","last_clean":"2023-12-04T05:37:43.044723+0000","last_became_active":"2023-12-04T05:37:43.037706+0000","last_became_peered":"2023-12-04T05:37:43.037706+0000","last_unstale":"2023-12-04T05:37:43.044723+0000","last_undegraded":"2023-12-04T05:37:43.044723+0000","last_fullsized":"2023-12-04T05:37:43.044723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:55:31.285725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993347+0000","last_change":"2023-12-04T05:37:24.364075+0000","last_active":"2023-12-04T05:37:41.993347+0000","last_peered":"2023-12-04T05:37:41.993347+0000","last_clean":"2023-12-04T05:37:41.993347+0000","last_became_active":"2023-12-04T05:37:24.363742+0000","last_became_peered":"2023-12-04T05:37:24.363742+0000","last_unstale":"2023-12-04T05:37:41.993347+0000","last_undegraded":"2023-12-04T05:37:41.993347+0000","last_fullsized":"2023-12-04T05:37:41.993347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004111+0000","last_change":"2023-12-04T05:37:24.989600+0000","last_active":"2023-12-04T05:37:42.004111+0000","last_peered":"2023-12-04T05:37:42.004111+0000","last_clean":"2023-12-04T05:37:42.004111+0000","last_became_active":"2023-12-04T05:37:24.989332+0000","last_became_peered":"2023-12-04T05:37:24.989332+0000","last_unstale":"2023-12-04T05:37:42.004111+0000","last_undegraded":"2023-12-04T05:37:42.004111+0000","last_fullsized":"2023-12-04T05:37:42.004111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:25:59.290418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046753+0000","last_change":"2023-12-04T05:37:42.014198+0000","last_active":"2023-12-04T05:37:43.046753+0000","last_peered":"2023-12-04T05:37:43.046753+0000","last_clean":"2023-12-04T05:37:43.046753+0000","last_became_active":"2023-12-04T05:37:42.013885+0000","last_became_peered":"2023-12-04T05:37:42.013885+0000","last_unstale":"2023-12-04T05:37:43.046753+0000","last_undegraded":"2023-12-04T05:37:43.046753+0000","last_fullsized":"2023-12-04T05:37:43.046753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:47:26.434154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058785+0000","last_change":"2023-12-04T05:37:43.051926+0000","last_active":"2023-12-04T05:37:43.058785+0000","last_peered":"2023-12-04T05:37:43.058785+0000","last_clean":"2023-12-04T05:37:43.058785+0000","last_became_active":"2023-12-04T05:37:43.051596+0000","last_became_peered":"2023-12-04T05:37:43.051596+0000","last_unstale":"2023-12-04T05:37:43.058785+0000","last_undegraded":"2023-12-04T05:37:43.058785+0000","last_fullsized":"2023-12-04T05:37:43.058785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:31:09.519131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.011908+0000","last_change":"2023-12-04T05:37:24.368752+0000","last_active":"2023-12-04T05:37:42.011908+0000","last_peered":"2023-12-04T05:37:42.011908+0000","last_clean":"2023-12-04T05:37:42.011908+0000","last_became_active":"2023-12-04T05:37:24.368382+0000","last_became_peered":"2023-12-04T05:37:24.368382+0000","last_unstale":"2023-12-04T05:37:42.011908+0000","last_undegraded":"2023-12-04T05:37:42.011908+0000","last_fullsized":"2023-12-04T05:37:42.011908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001212+0000","last_change":"2023-12-04T05:37:24.991115+0000","last_active":"2023-12-04T05:37:42.001212+0000","last_peered":"2023-12-04T05:37:42.001212+0000","last_clean":"2023-12-04T05:37:42.001212+0000","last_became_active":"2023-12-04T05:37:24.990185+0000","last_became_peered":"2023-12-04T05:37:24.990185+0000","last_unstale":"2023-12-04T05:37:42.001212+0000","last_undegraded":"2023-12-04T05:37:42.001212+0000","last_fullsized":"2023-12-04T05:37:42.001212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:41:57.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.031072+0000","last_change":"2023-12-04T05:37:42.013544+0000","last_active":"2023-12-04T05:37:43.031072+0000","last_peered":"2023-12-04T05:37:43.031072+0000","last_clean":"2023-12-04T05:37:43.031072+0000","last_became_active":"2023-12-04T05:37:42.012954+0000","last_became_peered":"2023-12-04T05:37:42.012954+0000","last_unstale":"2023-12-04T05:37:43.031072+0000","last_undegraded":"2023-12-04T05:37:43.031072+0000","last_fullsized":"2023-12-04T05:37:43.031072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048211+0000","last_change":"2023-12-04T05:37:43.034147+0000","last_active":"2023-12-04T05:37:43.048211+0000","last_peered":"2023-12-04T05:37:43.048211+0000","last_clean":"2023-12-04T05:37:43.048211+0000","last_became_active":"2023-12-04T05:37:43.033047+0000","last_became_peered":"2023-12-04T05:37:43.033047+0000","last_unstale":"2023-12-04T05:37:43.048211+0000","last_undegraded":"2023-12-04T05:37:43.048211+0000","last_fullsized":"2023-12-04T05:37:43.048211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:41.015271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990801+0000","last_change":"2023-12-04T05:37:24.355658+0000","last_active":"2023-12-04T05:37:41.990801+0000","last_peered":"2023-12-04T05:37:41.990801+0000","last_clean":"2023-12-04T05:37:41.990801+0000","last_became_active":"2023-12-04T05:37:24.353902+0000","last_became_peered":"2023-12-04T05:37:24.353902+0000","last_unstale":"2023-12-04T05:37:41.990801+0000","last_undegraded":"2023-12-04T05:37:41.990801+0000","last_fullsized":"2023-12-04T05:37:41.990801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998322+0000","last_change":"2023-12-04T05:37:24.992633+0000","last_active":"2023-12-04T05:37:41.998322+0000","last_peered":"2023-12-04T05:37:41.998322+0000","last_clean":"2023-12-04T05:37:41.998322+0000","last_became_active":"2023-12-04T05:37:24.992377+0000","last_became_peered":"2023-12-04T05:37:24.992377+0000","last_unstale":"2023-12-04T05:37:41.998322+0000","last_undegraded":"2023-12-04T05:37:41.998322+0000","last_fullsized":"2023-12-04T05:37:41.998322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:42.675557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040848+0000","last_change":"2023-12-04T05:37:42.000742+0000","last_active":"2023-12-04T05:37:43.040848+0000","last_peered":"2023-12-04T05:37:43.040848+0000","last_clean":"2023-12-04T05:37:43.040848+0000","last_became_active":"2023-12-04T05:37:42.000465+0000","last_became_peered":"2023-12-04T05:37:42.000465+0000","last_unstale":"2023-12-04T05:37:43.040848+0000","last_undegraded":"2023-12-04T05:37:43.040848+0000","last_fullsized":"2023-12-04T05:37:43.040848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:19.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053575+0000","last_change":"2023-12-04T05:37:43.045485+0000","last_active":"2023-12-04T05:37:43.053575+0000","last_peered":"2023-12-04T05:37:43.053575+0000","last_clean":"2023-12-04T05:37:43.053575+0000","last_became_active":"2023-12-04T05:37:43.045187+0000","last_became_peered":"2023-12-04T05:37:43.045187+0000","last_unstale":"2023-12-04T05:37:43.053575+0000","last_undegraded":"2023-12-04T05:37:43.053575+0000","last_fullsized":"2023-12-04T05:37:43.053575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993747+0000","last_change":"2023-12-04T05:37:24.364787+0000","last_active":"2023-12-04T05:37:41.993747+0000","last_peered":"2023-12-04T05:37:41.993747+0000","last_clean":"2023-12-04T05:37:41.993747+0000","last_became_active":"2023-12-04T05:37:24.364366+0000","last_became_peered":"2023-12-04T05:37:24.364366+0000","last_unstale":"2023-12-04T05:37:41.993747+0000","last_undegraded":"2023-12-04T05:37:41.993747+0000","last_fullsized":"2023-12-04T05:37:41.993747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998440+0000","last_change":"2023-12-04T05:37:25.005282+0000","last_active":"2023-12-04T05:37:41.998440+0000","last_peered":"2023-12-04T05:37:41.998440+0000","last_clean":"2023-12-04T05:37:41.998440+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:41.998440+0000","last_undegraded":"2023-12-04T05:37:41.998440+0000","last_fullsized":"2023-12-04T05:37:41.998440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:34.046063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056394+0000","last_change":"2023-12-04T05:37:42.014557+0000","last_active":"2023-12-04T05:37:43.056394+0000","last_peered":"2023-12-04T05:37:43.056394+0000","last_clean":"2023-12-04T05:37:43.056394+0000","last_became_active":"2023-12-04T05:37:42.013738+0000","last_became_peered":"2023-12-04T05:37:42.013738+0000","last_unstale":"2023-12-04T05:37:43.056394+0000","last_undegraded":"2023-12-04T05:37:43.056394+0000","last_fullsized":"2023-12-04T05:37:43.056394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:19.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050758+0000","last_change":"2023-12-04T05:37:43.032892+0000","last_active":"2023-12-04T05:37:43.050758+0000","last_peered":"2023-12-04T05:37:43.050758+0000","last_clean":"2023-12-04T05:37:43.050758+0000","last_became_active":"2023-12-04T05:37:43.032621+0000","last_became_peered":"2023-12-04T05:37:43.032621+0000","last_unstale":"2023-12-04T05:37:43.050758+0000","last_undegraded":"2023-12-04T05:37:43.050758+0000","last_fullsized":"2023-12-04T05:37:43.050758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:52.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997932+0000","last_change":"2023-12-04T05:37:24.363195+0000","last_active":"2023-12-04T05:37:41.997932+0000","last_peered":"2023-12-04T05:37:41.997932+0000","last_clean":"2023-12-04T05:37:41.997932+0000","last_became_active":"2023-12-04T05:37:24.362877+0000","last_became_peered":"2023-12-04T05:37:24.362877+0000","last_unstale":"2023-12-04T05:37:41.997932+0000","last_undegraded":"2023-12-04T05:37:41.997932+0000","last_fullsized":"2023-12-04T05:37:41.997932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003880+0000","last_change":"2023-12-04T05:37:24.990874+0000","last_active":"2023-12-04T05:37:42.003880+0000","last_peered":"2023-12-04T05:37:42.003880+0000","last_clean":"2023-12-04T05:37:42.003880+0000","last_became_active":"2023-12-04T05:37:24.990607+0000","last_became_peered":"2023-12-04T05:37:24.990607+0000","last_unstale":"2023-12-04T05:37:42.003880+0000","last_undegraded":"2023-12-04T05:37:42.003880+0000","last_fullsized":"2023-12-04T05:37:42.003880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054044+0000","last_change":"2023-12-04T05:37:42.014125+0000","last_active":"2023-12-04T05:37:43.054044+0000","last_peered":"2023-12-04T05:37:43.054044+0000","last_clean":"2023-12-04T05:37:43.054044+0000","last_became_active":"2023-12-04T05:37:42.013775+0000","last_became_peered":"2023-12-04T05:37:42.013775+0000","last_unstale":"2023-12-04T05:37:43.054044+0000","last_undegraded":"2023-12-04T05:37:43.054044+0000","last_fullsized":"2023-12-04T05:37:43.054044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:39.090830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050783+0000","last_change":"2023-12-04T05:37:43.048566+0000","last_active":"2023-12-04T05:37:43.050783+0000","last_peered":"2023-12-04T05:37:43.050783+0000","last_clean":"2023-12-04T05:37:43.050783+0000","last_became_active":"2023-12-04T05:37:43.048308+0000","last_became_peered":"2023-12-04T05:37:43.048308+0000","last_unstale":"2023-12-04T05:37:43.050783+0000","last_undegraded":"2023-12-04T05:37:43.050783+0000","last_fullsized":"2023-12-04T05:37:43.050783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:25.782864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997692+0000","last_change":"2023-12-04T05:37:24.354656+0000","last_active":"2023-12-04T05:37:41.997692+0000","last_peered":"2023-12-04T05:37:41.997692+0000","last_clean":"2023-12-04T05:37:41.997692+0000","last_became_active":"2023-12-04T05:37:24.354318+0000","last_became_peered":"2023-12-04T05:37:24.354318+0000","last_unstale":"2023-12-04T05:37:41.997692+0000","last_undegraded":"2023-12-04T05:37:41.997692+0000","last_fullsized":"2023-12-04T05:37:41.997692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:38.730683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005503+0000","last_change":"2023-12-04T05:37:24.995956+0000","last_active":"2023-12-04T05:37:42.005503+0000","last_peered":"2023-12-04T05:37:42.005503+0000","last_clean":"2023-12-04T05:37:42.005503+0000","last_became_active":"2023-12-04T05:37:24.995700+0000","last_became_peered":"2023-12-04T05:37:24.995700+0000","last_unstale":"2023-12-04T05:37:42.005503+0000","last_undegraded":"2023-12-04T05:37:42.005503+0000","last_fullsized":"2023-12-04T05:37:42.005503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.015123+0000","last_change":"2023-12-04T05:37:42.019719+0000","last_active":"2023-12-04T05:37:43.015123+0000","last_peered":"2023-12-04T05:37:43.015123+0000","last_clean":"2023-12-04T05:37:43.015123+0000","last_became_active":"2023-12-04T05:37:42.017987+0000","last_became_peered":"2023-12-04T05:37:42.017987+0000","last_unstale":"2023-12-04T05:37:43.015123+0000","last_undegraded":"2023-12-04T05:37:43.015123+0000","last_fullsized":"2023-12-04T05:37:43.015123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:39:36.463815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034247+0000","last_change":"2023-12-04T05:37:43.031394+0000","last_active":"2023-12-04T05:37:43.034247+0000","last_peered":"2023-12-04T05:37:43.034247+0000","last_clean":"2023-12-04T05:37:43.034247+0000","last_became_active":"2023-12-04T05:37:43.030895+0000","last_became_peered":"2023-12-04T05:37:43.030895+0000","last_unstale":"2023-12-04T05:37:43.034247+0000","last_undegraded":"2023-12-04T05:37:43.034247+0000","last_fullsized":"2023-12-04T05:37:43.034247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:42.898961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004920+0000","last_change":"2023-12-04T05:37:24.364783+0000","last_active":"2023-12-04T05:37:42.004920+0000","last_peered":"2023-12-04T05:37:42.004920+0000","last_clean":"2023-12-04T05:37:42.004920+0000","last_became_active":"2023-12-04T05:37:24.364459+0000","last_became_peered":"2023-12-04T05:37:24.364459+0000","last_unstale":"2023-12-04T05:37:42.004920+0000","last_undegraded":"2023-12-04T05:37:42.004920+0000","last_fullsized":"2023-12-04T05:37:42.004920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:33.747521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997997+0000","last_change":"2023-12-04T05:37:24.991803+0000","last_active":"2023-12-04T05:37:41.997997+0000","last_peered":"2023-12-04T05:37:41.997997+0000","last_clean":"2023-12-04T05:37:41.997997+0000","last_became_active":"2023-12-04T05:37:24.991546+0000","last_became_peered":"2023-12-04T05:37:24.991546+0000","last_unstale":"2023-12-04T05:37:41.997997+0000","last_undegraded":"2023-12-04T05:37:41.997997+0000","last_fullsized":"2023-12-04T05:37:41.997997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056047+0000","last_change":"2023-12-04T05:37:42.018191+0000","last_active":"2023-12-04T05:37:43.056047+0000","last_peered":"2023-12-04T05:37:43.056047+0000","last_clean":"2023-12-04T05:37:43.056047+0000","last_became_active":"2023-12-04T05:37:42.017772+0000","last_became_peered":"2023-12-04T05:37:42.017772+0000","last_unstale":"2023-12-04T05:37:43.056047+0000","last_undegraded":"2023-12-04T05:37:43.056047+0000","last_fullsized":"2023-12-04T05:37:43.056047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:56:32.804212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058611+0000","last_change":"2023-12-04T05:37:43.052118+0000","last_active":"2023-12-04T05:37:43.058611+0000","last_peered":"2023-12-04T05:37:43.058611+0000","last_clean":"2023-12-04T05:37:43.058611+0000","last_became_active":"2023-12-04T05:37:43.049327+0000","last_became_peered":"2023-12-04T05:37:43.049327+0000","last_unstale":"2023-12-04T05:37:43.058611+0000","last_undegraded":"2023-12-04T05:37:43.058611+0000","last_fullsized":"2023-12-04T05:37:43.058611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.755917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004515+0000","last_change":"2023-12-04T05:37:24.370452+0000","last_active":"2023-12-04T05:37:42.004515+0000","last_peered":"2023-12-04T05:37:42.004515+0000","last_clean":"2023-12-04T05:37:42.004515+0000","last_became_active":"2023-12-04T05:37:24.369542+0000","last_became_peered":"2023-12-04T05:37:24.369542+0000","last_unstale":"2023-12-04T05:37:42.004515+0000","last_undegraded":"2023-12-04T05:37:42.004515+0000","last_fullsized":"2023-12-04T05:37:42.004515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:04.466402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012611+0000","last_change":"2023-12-04T05:37:24.987969+0000","last_active":"2023-12-04T05:37:42.012611+0000","last_peered":"2023-12-04T05:37:42.012611+0000","last_clean":"2023-12-04T05:37:42.012611+0000","last_became_active":"2023-12-04T05:37:24.986483+0000","last_became_peered":"2023-12-04T05:37:24.986483+0000","last_unstale":"2023-12-04T05:37:42.012611+0000","last_undegraded":"2023-12-04T05:37:42.012611+0000","last_fullsized":"2023-12-04T05:37:42.012611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:29.179535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034713+0000","last_change":"2023-12-04T05:37:42.010207+0000","last_active":"2023-12-04T05:37:43.034713+0000","last_peered":"2023-12-04T05:37:43.034713+0000","last_clean":"2023-12-04T05:37:43.034713+0000","last_became_active":"2023-12-04T05:37:42.009870+0000","last_became_peered":"2023-12-04T05:37:42.009870+0000","last_unstale":"2023-12-04T05:37:43.034713+0000","last_undegraded":"2023-12-04T05:37:43.034713+0000","last_fullsized":"2023-12-04T05:37:43.034713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:27:27.055823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056178+0000","last_change":"2023-12-04T05:37:43.051549+0000","last_active":"2023-12-04T05:37:43.056178+0000","last_peered":"2023-12-04T05:37:43.056178+0000","last_clean":"2023-12-04T05:37:43.056178+0000","last_became_active":"2023-12-04T05:37:43.051246+0000","last_became_peered":"2023-12-04T05:37:43.051246+0000","last_unstale":"2023-12-04T05:37:43.056178+0000","last_undegraded":"2023-12-04T05:37:43.056178+0000","last_fullsized":"2023-12-04T05:37:43.056178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:06.015701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004928+0000","last_change":"2023-12-04T05:37:24.365982+0000","last_active":"2023-12-04T05:37:42.004928+0000","last_peered":"2023-12-04T05:37:42.004928+0000","last_clean":"2023-12-04T05:37:42.004928+0000","last_became_active":"2023-12-04T05:37:24.365700+0000","last_became_peered":"2023-12-04T05:37:24.365700+0000","last_unstale":"2023-12-04T05:37:42.004928+0000","last_undegraded":"2023-12-04T05:37:42.004928+0000","last_fullsized":"2023-12-04T05:37:42.004928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996164+0000","last_change":"2023-12-04T05:37:25.001941+0000","last_active":"2023-12-04T05:37:41.996164+0000","last_peered":"2023-12-04T05:37:41.996164+0000","last_clean":"2023-12-04T05:37:41.996164+0000","last_became_active":"2023-12-04T05:37:24.998768+0000","last_became_peered":"2023-12-04T05:37:24.998768+0000","last_unstale":"2023-12-04T05:37:41.996164+0000","last_undegraded":"2023-12-04T05:37:41.996164+0000","last_fullsized":"2023-12-04T05:37:41.996164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058578+0000","last_change":"2023-12-04T05:37:42.018403+0000","last_active":"2023-12-04T05:37:43.058578+0000","last_peered":"2023-12-04T05:37:43.058578+0000","last_clean":"2023-12-04T05:37:43.058578+0000","last_became_active":"2023-12-04T05:37:42.017103+0000","last_became_peered":"2023-12-04T05:37:42.017103+0000","last_unstale":"2023-12-04T05:37:43.058578+0000","last_undegraded":"2023-12-04T05:37:43.058578+0000","last_fullsized":"2023-12-04T05:37:43.058578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:01:15.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045547+0000","last_change":"2023-12-04T05:37:43.043123+0000","last_active":"2023-12-04T05:37:43.045547+0000","last_peered":"2023-12-04T05:37:43.045547+0000","last_clean":"2023-12-04T05:37:43.045547+0000","last_became_active":"2023-12-04T05:37:43.042631+0000","last_became_peered":"2023-12-04T05:37:43.042631+0000","last_unstale":"2023-12-04T05:37:43.045547+0000","last_undegraded":"2023-12-04T05:37:43.045547+0000","last_fullsized":"2023-12-04T05:37:43.045547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:39.837260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002898+0000","last_change":"2023-12-04T05:37:24.355867+0000","last_active":"2023-12-04T05:37:42.002898+0000","last_peered":"2023-12-04T05:37:42.002898+0000","last_clean":"2023-12-04T05:37:42.002898+0000","last_became_active":"2023-12-04T05:37:24.354909+0000","last_became_peered":"2023-12-04T05:37:24.354909+0000","last_unstale":"2023-12-04T05:37:42.002898+0000","last_undegraded":"2023-12-04T05:37:42.002898+0000","last_fullsized":"2023-12-04T05:37:42.002898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006798+0000","last_change":"2023-12-04T05:37:24.990852+0000","last_active":"2023-12-04T05:37:42.006798+0000","last_peered":"2023-12-04T05:37:42.006798+0000","last_clean":"2023-12-04T05:37:42.006798+0000","last_became_active":"2023-12-04T05:37:24.990594+0000","last_became_peered":"2023-12-04T05:37:24.990594+0000","last_unstale":"2023-12-04T05:37:42.006798+0000","last_undegraded":"2023-12-04T05:37:42.006798+0000","last_fullsized":"2023-12-04T05:37:42.006798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.066080+0000","last_change":"2023-12-04T05:37:42.016258+0000","last_active":"2023-12-04T05:37:43.066080+0000","last_peered":"2023-12-04T05:37:43.066080+0000","last_clean":"2023-12-04T05:37:43.066080+0000","last_became_active":"2023-12-04T05:37:42.015861+0000","last_became_peered":"2023-12-04T05:37:42.015861+0000","last_unstale":"2023-12-04T05:37:43.066080+0000","last_undegraded":"2023-12-04T05:37:43.066080+0000","last_fullsized":"2023-12-04T05:37:43.066080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040083+0000","last_change":"2023-12-04T05:37:43.033980+0000","last_active":"2023-12-04T05:37:43.040083+0000","last_peered":"2023-12-04T05:37:43.040083+0000","last_clean":"2023-12-04T05:37:43.040083+0000","last_became_active":"2023-12-04T05:37:43.033686+0000","last_became_peered":"2023-12-04T05:37:43.033686+0000","last_unstale":"2023-12-04T05:37:43.040083+0000","last_undegraded":"2023-12-04T05:37:43.040083+0000","last_fullsized":"2023-12-04T05:37:43.040083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:04.723719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993384+0000","last_change":"2023-12-04T05:37:24.354980+0000","last_active":"2023-12-04T05:37:41.993384+0000","last_peered":"2023-12-04T05:37:41.993384+0000","last_clean":"2023-12-04T05:37:41.993384+0000","last_became_active":"2023-12-04T05:37:24.354672+0000","last_became_peered":"2023-12-04T05:37:24.354672+0000","last_unstale":"2023-12-04T05:37:41.993384+0000","last_undegraded":"2023-12-04T05:37:41.993384+0000","last_fullsized":"2023-12-04T05:37:41.993384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002798+0000","last_change":"2023-12-04T05:37:24.995114+0000","last_active":"2023-12-04T05:37:42.002798+0000","last_peered":"2023-12-04T05:37:42.002798+0000","last_clean":"2023-12-04T05:37:42.002798+0000","last_became_active":"2023-12-04T05:37:24.994792+0000","last_became_peered":"2023-12-04T05:37:24.994792+0000","last_unstale":"2023-12-04T05:37:42.002798+0000","last_undegraded":"2023-12-04T05:37:42.002798+0000","last_fullsized":"2023-12-04T05:37:42.002798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.013869+0000","last_change":"2023-12-04T05:37:42.018389+0000","last_active":"2023-12-04T05:37:43.013869+0000","last_peered":"2023-12-04T05:37:43.013869+0000","last_clean":"2023-12-04T05:37:43.013869+0000","last_became_active":"2023-12-04T05:37:42.016913+0000","last_became_peered":"2023-12-04T05:37:42.016913+0000","last_unstale":"2023-12-04T05:37:43.013869+0000","last_undegraded":"2023-12-04T05:37:43.013869+0000","last_fullsized":"2023-12-04T05:37:43.013869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:16:37.948109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050338+0000","last_change":"2023-12-04T05:37:43.046990+0000","last_active":"2023-12-04T05:37:43.050338+0000","last_peered":"2023-12-04T05:37:43.050338+0000","last_clean":"2023-12-04T05:37:43.050338+0000","last_became_active":"2023-12-04T05:37:43.046733+0000","last_became_peered":"2023-12-04T05:37:43.046733+0000","last_unstale":"2023-12-04T05:37:43.050338+0000","last_undegraded":"2023-12-04T05:37:43.050338+0000","last_fullsized":"2023-12-04T05:37:43.050338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:04.723719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'9","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.009772+0000","last_change":"2023-12-04T05:37:24.355898+0000","last_active":"2023-12-04T05:37:42.009772+0000","last_peered":"2023-12-04T05:37:42.009772+0000","last_clean":"2023-12-04T05:37:42.009772+0000","last_became_active":"2023-12-04T05:37:24.355292+0000","last_became_peered":"2023-12-04T05:37:24.355292+0000","last_unstale":"2023-12-04T05:37:42.009772+0000","last_undegraded":"2023-12-04T05:37:42.009772+0000","last_fullsized":"2023-12-04T05:37:42.009772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:42.819254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005488+0000","last_change":"2023-12-04T05:37:24.997014+0000","last_active":"2023-12-04T05:37:42.005488+0000","last_peered":"2023-12-04T05:37:42.005488+0000","last_clean":"2023-12-04T05:37:42.005488+0000","last_became_active":"2023-12-04T05:37:24.996398+0000","last_became_peered":"2023-12-04T05:37:24.996398+0000","last_unstale":"2023-12-04T05:37:42.005488+0000","last_undegraded":"2023-12-04T05:37:42.005488+0000","last_fullsized":"2023-12-04T05:37:42.005488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048700+0000","last_change":"2023-12-04T05:37:42.000874+0000","last_active":"2023-12-04T05:37:43.048700+0000","last_peered":"2023-12-04T05:37:43.048700+0000","last_clean":"2023-12-04T05:37:43.048700+0000","last_became_active":"2023-12-04T05:37:42.000404+0000","last_became_peered":"2023-12-04T05:37:42.000404+0000","last_unstale":"2023-12-04T05:37:43.048700+0000","last_undegraded":"2023-12-04T05:37:43.048700+0000","last_fullsized":"2023-12-04T05:37:43.048700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:01.408364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055979+0000","last_change":"2023-12-04T05:37:43.051776+0000","last_active":"2023-12-04T05:37:43.055979+0000","last_peered":"2023-12-04T05:37:43.055979+0000","last_clean":"2023-12-04T05:37:43.055979+0000","last_became_active":"2023-12-04T05:37:43.051246+0000","last_became_peered":"2023-12-04T05:37:43.051246+0000","last_unstale":"2023-12-04T05:37:43.055979+0000","last_undegraded":"2023-12-04T05:37:43.055979+0000","last_fullsized":"2023-12-04T05:37:43.055979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005093+0000","last_change":"2023-12-04T05:37:24.360821+0000","last_active":"2023-12-04T05:37:42.005093+0000","last_peered":"2023-12-04T05:37:42.005093+0000","last_clean":"2023-12-04T05:37:42.005093+0000","last_became_active":"2023-12-04T05:37:24.360531+0000","last_became_peered":"2023-12-04T05:37:24.360531+0000","last_unstale":"2023-12-04T05:37:42.005093+0000","last_undegraded":"2023-12-04T05:37:42.005093+0000","last_fullsized":"2023-12-04T05:37:42.005093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.009733+0000","last_change":"2023-12-04T05:37:25.006262+0000","last_active":"2023-12-04T05:37:42.009733+0000","last_peered":"2023-12-04T05:37:42.009733+0000","last_clean":"2023-12-04T05:37:42.009733+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:42.009733+0000","last_undegraded":"2023-12-04T05:37:42.009733+0000","last_fullsized":"2023-12-04T05:37:42.009733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:30:51.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.018763+0000","last_change":"2023-12-04T05:37:42.007903+0000","last_active":"2023-12-04T05:37:43.018763+0000","last_peered":"2023-12-04T05:37:43.018763+0000","last_clean":"2023-12-04T05:37:43.018763+0000","last_became_active":"2023-12-04T05:37:42.007429+0000","last_became_peered":"2023-12-04T05:37:42.007429+0000","last_unstale":"2023-12-04T05:37:43.018763+0000","last_undegraded":"2023-12-04T05:37:43.018763+0000","last_fullsized":"2023-12-04T05:37:43.018763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050550+0000","last_change":"2023-12-04T05:37:43.048283+0000","last_active":"2023-12-04T05:37:43.050550+0000","last_peered":"2023-12-04T05:37:43.050550+0000","last_clean":"2023-12-04T05:37:43.050550+0000","last_became_active":"2023-12-04T05:37:43.048011+0000","last_became_peered":"2023-12-04T05:37:43.048011+0000","last_unstale":"2023-12-04T05:37:43.050550+0000","last_undegraded":"2023-12-04T05:37:43.050550+0000","last_fullsized":"2023-12-04T05:37:43.050550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:39:26.101801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991271+0000","last_change":"2023-12-04T05:37:24.364875+0000","last_active":"2023-12-04T05:37:41.991271+0000","last_peered":"2023-12-04T05:37:41.991271+0000","last_clean":"2023-12-04T05:37:41.991271+0000","last_became_active":"2023-12-04T05:37:24.364601+0000","last_became_peered":"2023-12-04T05:37:24.364601+0000","last_unstale":"2023-12-04T05:37:41.991271+0000","last_undegraded":"2023-12-04T05:37:41.991271+0000","last_fullsized":"2023-12-04T05:37:41.991271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.019748+0000","last_change":"2023-12-04T05:37:24.996824+0000","last_active":"2023-12-04T05:37:42.019748+0000","last_peered":"2023-12-04T05:37:42.019748+0000","last_clean":"2023-12-04T05:37:42.019748+0000","last_became_active":"2023-12-04T05:37:24.996612+0000","last_became_peered":"2023-12-04T05:37:24.996612+0000","last_unstale":"2023-12-04T05:37:42.019748+0000","last_undegraded":"2023-12-04T05:37:42.019748+0000","last_fullsized":"2023-12-04T05:37:42.019748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:17.183378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.062196+0000","last_change":"2023-12-04T05:37:42.009984+0000","last_active":"2023-12-04T05:37:43.062196+0000","last_peered":"2023-12-04T05:37:43.062196+0000","last_clean":"2023-12-04T05:37:43.062196+0000","last_became_active":"2023-12-04T05:37:42.009653+0000","last_became_peered":"2023-12-04T05:37:42.009653+0000","last_unstale":"2023-12-04T05:37:43.062196+0000","last_undegraded":"2023-12-04T05:37:43.062196+0000","last_fullsized":"2023-12-04T05:37:43.062196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:12:04.662207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053710+0000","last_change":"2023-12-04T05:37:43.043375+0000","last_active":"2023-12-04T05:37:43.053710+0000","last_peered":"2023-12-04T05:37:43.053710+0000","last_clean":"2023-12-04T05:37:43.053710+0000","last_became_active":"2023-12-04T05:37:43.042716+0000","last_became_peered":"2023-12-04T05:37:43.042716+0000","last_unstale":"2023-12-04T05:37:43.053710+0000","last_undegraded":"2023-12-04T05:37:43.053710+0000","last_fullsized":"2023-12-04T05:37:43.053710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:56.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.019835+0000","last_change":"2023-12-04T05:37:24.367803+0000","last_active":"2023-12-04T05:37:42.019835+0000","last_peered":"2023-12-04T05:37:42.019835+0000","last_clean":"2023-12-04T05:37:42.019835+0000","last_became_active":"2023-12-04T05:37:24.367420+0000","last_became_peered":"2023-12-04T05:37:24.367420+0000","last_unstale":"2023-12-04T05:37:42.019835+0000","last_undegraded":"2023-12-04T05:37:42.019835+0000","last_fullsized":"2023-12-04T05:37:42.019835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:24.234900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005188+0000","last_change":"2023-12-04T05:37:24.999935+0000","last_active":"2023-12-04T05:37:42.005188+0000","last_peered":"2023-12-04T05:37:42.005188+0000","last_clean":"2023-12-04T05:37:42.005188+0000","last_became_active":"2023-12-04T05:37:24.999626+0000","last_became_peered":"2023-12-04T05:37:24.999626+0000","last_unstale":"2023-12-04T05:37:42.005188+0000","last_undegraded":"2023-12-04T05:37:42.005188+0000","last_fullsized":"2023-12-04T05:37:42.005188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045691+0000","last_change":"2023-12-04T05:37:42.020167+0000","last_active":"2023-12-04T05:37:43.045691+0000","last_peered":"2023-12-04T05:37:43.045691+0000","last_clean":"2023-12-04T05:37:43.045691+0000","last_became_active":"2023-12-04T05:37:42.019924+0000","last_became_peered":"2023-12-04T05:37:42.019924+0000","last_unstale":"2023-12-04T05:37:43.045691+0000","last_undegraded":"2023-12-04T05:37:43.045691+0000","last_fullsized":"2023-12-04T05:37:43.045691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:19.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.060080+0000","last_change":"2023-12-04T05:37:43.055492+0000","last_active":"2023-12-04T05:37:43.060080+0000","last_peered":"2023-12-04T05:37:43.060080+0000","last_clean":"2023-12-04T05:37:43.060080+0000","last_became_active":"2023-12-04T05:37:43.055227+0000","last_became_peered":"2023-12-04T05:37:43.055227+0000","last_unstale":"2023-12-04T05:37:43.060080+0000","last_undegraded":"2023-12-04T05:37:43.060080+0000","last_fullsized":"2023-12-04T05:37:43.060080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:48.936035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.992788+0000","last_change":"2023-12-04T05:37:24.354659+0000","last_active":"2023-12-04T05:37:41.992788+0000","last_peered":"2023-12-04T05:37:41.992788+0000","last_clean":"2023-12-04T05:37:41.992788+0000","last_became_active":"2023-12-04T05:37:24.354363+0000","last_became_peered":"2023-12-04T05:37:24.354363+0000","last_unstale":"2023-12-04T05:37:41.992788+0000","last_undegraded":"2023-12-04T05:37:41.992788+0000","last_fullsized":"2023-12-04T05:37:41.992788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001621+0000","last_change":"2023-12-04T05:37:24.996089+0000","last_active":"2023-12-04T05:37:42.001621+0000","last_peered":"2023-12-04T05:37:42.001621+0000","last_clean":"2023-12-04T05:37:42.001621+0000","last_became_active":"2023-12-04T05:37:24.995809+0000","last_became_peered":"2023-12-04T05:37:24.995809+0000","last_unstale":"2023-12-04T05:37:42.001621+0000","last_undegraded":"2023-12-04T05:37:42.001621+0000","last_fullsized":"2023-12-04T05:37:42.001621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050781+0000","last_change":"2023-12-04T05:37:42.015732+0000","last_active":"2023-12-04T05:37:43.050781+0000","last_peered":"2023-12-04T05:37:43.050781+0000","last_clean":"2023-12-04T05:37:43.050781+0000","last_became_active":"2023-12-04T05:37:42.014482+0000","last_became_peered":"2023-12-04T05:37:42.014482+0000","last_unstale":"2023-12-04T05:37:43.050781+0000","last_undegraded":"2023-12-04T05:37:43.050781+0000","last_fullsized":"2023-12-04T05:37:43.050781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:44.901531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039662+0000","last_change":"2023-12-04T05:37:43.036113+0000","last_active":"2023-12-04T05:37:43.039662+0000","last_peered":"2023-12-04T05:37:43.039662+0000","last_clean":"2023-12-04T05:37:43.039662+0000","last_became_active":"2023-12-04T05:37:43.035852+0000","last_became_peered":"2023-12-04T05:37:43.035852+0000","last_unstale":"2023-12-04T05:37:43.039662+0000","last_undegraded":"2023-12-04T05:37:43.039662+0000","last_fullsized":"2023-12-04T05:37:43.039662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:07:12.958817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005033+0000","last_change":"2023-12-04T05:37:24.360838+0000","last_active":"2023-12-04T05:37:42.005033+0000","last_peered":"2023-12-04T05:37:42.005033+0000","last_clean":"2023-12-04T05:37:42.005033+0000","last_became_active":"2023-12-04T05:37:24.360507+0000","last_became_peered":"2023-12-04T05:37:24.360507+0000","last_unstale":"2023-12-04T05:37:42.005033+0000","last_undegraded":"2023-12-04T05:37:42.005033+0000","last_fullsized":"2023-12-04T05:37:42.005033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.992702+0000","last_change":"2023-12-04T05:37:24.981306+0000","last_active":"2023-12-04T05:37:41.992702+0000","last_peered":"2023-12-04T05:37:41.992702+0000","last_clean":"2023-12-04T05:37:41.992702+0000","last_became_active":"2023-12-04T05:37:24.980836+0000","last_became_peered":"2023-12-04T05:37:24.980836+0000","last_unstale":"2023-12-04T05:37:41.992702+0000","last_undegraded":"2023-12-04T05:37:41.992702+0000","last_fullsized":"2023-12-04T05:37:41.992702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046683+0000","last_change":"2023-12-04T05:37:42.014112+0000","last_active":"2023-12-04T05:37:43.046683+0000","last_peered":"2023-12-04T05:37:43.046683+0000","last_clean":"2023-12-04T05:37:43.046683+0000","last_became_active":"2023-12-04T05:37:42.013883+0000","last_became_peered":"2023-12-04T05:37:42.013883+0000","last_unstale":"2023-12-04T05:37:43.046683+0000","last_undegraded":"2023-12-04T05:37:43.046683+0000","last_fullsized":"2023-12-04T05:37:43.046683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:31.197406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.037052+0000","last_change":"2023-12-04T05:37:43.032937+0000","last_active":"2023-12-04T05:37:43.037052+0000","last_peered":"2023-12-04T05:37:43.037052+0000","last_clean":"2023-12-04T05:37:43.037052+0000","last_became_active":"2023-12-04T05:37:43.032655+0000","last_became_peered":"2023-12-04T05:37:43.032655+0000","last_unstale":"2023-12-04T05:37:43.037052+0000","last_undegraded":"2023-12-04T05:37:43.037052+0000","last_fullsized":"2023-12-04T05:37:43.037052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:54.799040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997026+0000","last_change":"2023-12-04T05:37:24.362048+0000","last_active":"2023-12-04T05:37:41.997026+0000","last_peered":"2023-12-04T05:37:41.997026+0000","last_clean":"2023-12-04T05:37:41.997026+0000","last_became_active":"2023-12-04T05:37:24.361734+0000","last_became_peered":"2023-12-04T05:37:24.361734+0000","last_unstale":"2023-12-04T05:37:41.997026+0000","last_undegraded":"2023-12-04T05:37:41.997026+0000","last_fullsized":"2023-12-04T05:37:41.997026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004515+0000","last_change":"2023-12-04T05:37:24.998367+0000","last_active":"2023-12-04T05:37:42.004515+0000","last_peered":"2023-12-04T05:37:42.004515+0000","last_clean":"2023-12-04T05:37:42.004515+0000","last_became_active":"2023-12-04T05:37:24.997864+0000","last_became_peered":"2023-12-04T05:37:24.997864+0000","last_unstale":"2023-12-04T05:37:42.004515+0000","last_undegraded":"2023-12-04T05:37:42.004515+0000","last_fullsized":"2023-12-04T05:37:42.004515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040659+0000","last_change":"2023-12-04T05:37:42.006654+0000","last_active":"2023-12-04T05:37:43.040659+0000","last_peered":"2023-12-04T05:37:43.040659+0000","last_clean":"2023-12-04T05:37:43.040659+0000","last_became_active":"2023-12-04T05:37:42.006345+0000","last_became_peered":"2023-12-04T05:37:42.006345+0000","last_unstale":"2023-12-04T05:37:43.040659+0000","last_undegraded":"2023-12-04T05:37:43.040659+0000","last_fullsized":"2023-12-04T05:37:43.040659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058099+0000","last_change":"2023-12-04T05:37:43.046540+0000","last_active":"2023-12-04T05:37:43.058099+0000","last_peered":"2023-12-04T05:37:43.058099+0000","last_clean":"2023-12-04T05:37:43.058099+0000","last_became_active":"2023-12-04T05:37:43.046237+0000","last_became_peered":"2023-12-04T05:37:43.046237+0000","last_unstale":"2023-12-04T05:37:43.058099+0000","last_undegraded":"2023-12-04T05:37:43.058099+0000","last_fullsized":"2023-12-04T05:37:43.058099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:36.448608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993276+0000","last_change":"2023-12-04T05:37:24.361558+0000","last_active":"2023-12-04T05:37:41.993276+0000","last_peered":"2023-12-04T05:37:41.993276+0000","last_clean":"2023-12-04T05:37:41.993276+0000","last_became_active":"2023-12-04T05:37:24.361213+0000","last_became_peered":"2023-12-04T05:37:24.361213+0000","last_unstale":"2023-12-04T05:37:41.993276+0000","last_undegraded":"2023-12-04T05:37:41.993276+0000","last_fullsized":"2023-12-04T05:37:41.993276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995515+0000","last_change":"2023-12-04T05:37:25.001831+0000","last_active":"2023-12-04T05:37:41.995515+0000","last_peered":"2023-12-04T05:37:41.995515+0000","last_clean":"2023-12-04T05:37:41.995515+0000","last_became_active":"2023-12-04T05:37:25.001421+0000","last_became_peered":"2023-12-04T05:37:25.001421+0000","last_unstale":"2023-12-04T05:37:41.995515+0000","last_undegraded":"2023-12-04T05:37:41.995515+0000","last_fullsized":"2023-12-04T05:37:41.995515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.025941+0000","last_change":"2023-12-04T05:37:42.013799+0000","last_active":"2023-12-04T05:37:43.025941+0000","last_peered":"2023-12-04T05:37:43.025941+0000","last_clean":"2023-12-04T05:37:43.025941+0000","last_became_active":"2023-12-04T05:37:42.013380+0000","last_became_peered":"2023-12-04T05:37:42.013380+0000","last_unstale":"2023-12-04T05:37:43.025941+0000","last_undegraded":"2023-12-04T05:37:43.025941+0000","last_fullsized":"2023-12-04T05:37:43.025941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:19:36.946960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.032124+0000","last_change":"2023-12-04T05:37:43.030056+0000","last_active":"2023-12-04T05:37:43.032124+0000","last_peered":"2023-12-04T05:37:43.032124+0000","last_clean":"2023-12-04T05:37:43.032124+0000","last_became_active":"2023-12-04T05:37:43.029617+0000","last_became_peered":"2023-12-04T05:37:43.029617+0000","last_unstale":"2023-12-04T05:37:43.032124+0000","last_undegraded":"2023-12-04T05:37:43.032124+0000","last_fullsized":"2023-12-04T05:37:43.032124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:01.483316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054309+0000","last_change":"2023-12-04T05:37:42.019312+0000","last_active":"2023-12-04T05:37:43.054309+0000","last_peered":"2023-12-04T05:37:43.054309+0000","last_clean":"2023-12-04T05:37:43.054309+0000","last_became_active":"2023-12-04T05:37:42.018806+0000","last_became_peered":"2023-12-04T05:37:42.018806+0000","last_unstale":"2023-12-04T05:37:43.054309+0000","last_undegraded":"2023-12-04T05:37:43.054309+0000","last_fullsized":"2023-12-04T05:37:43.054309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005839+0000","last_change":"2023-12-04T05:37:24.353356+0000","last_active":"2023-12-04T05:37:42.005839+0000","last_peered":"2023-12-04T05:37:42.005839+0000","last_clean":"2023-12-04T05:37:42.005839+0000","last_became_active":"2023-12-04T05:37:24.353060+0000","last_became_peered":"2023-12-04T05:37:24.353060+0000","last_unstale":"2023-12-04T05:37:42.005839+0000","last_undegraded":"2023-12-04T05:37:42.005839+0000","last_fullsized":"2023-12-04T05:37:42.005839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:15.976925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004851+0000","last_change":"2023-12-04T05:37:24.990915+0000","last_active":"2023-12-04T05:37:42.004851+0000","last_peered":"2023-12-04T05:37:42.004851+0000","last_clean":"2023-12-04T05:37:42.004851+0000","last_became_active":"2023-12-04T05:37:24.990302+0000","last_became_peered":"2023-12-04T05:37:24.990302+0000","last_unstale":"2023-12-04T05:37:42.004851+0000","last_undegraded":"2023-12-04T05:37:42.004851+0000","last_fullsized":"2023-12-04T05:37:42.004851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.047582+0000","last_change":"2023-12-04T05:37:43.041639+0000","last_active":"2023-12-04T05:37:43.047582+0000","last_peered":"2023-12-04T05:37:43.047582+0000","last_clean":"2023-12-04T05:37:43.047582+0000","last_became_active":"2023-12-04T05:37:43.041364+0000","last_became_peered":"2023-12-04T05:37:43.041364+0000","last_unstale":"2023-12-04T05:37:43.047582+0000","last_undegraded":"2023-12-04T05:37:43.047582+0000","last_fullsized":"2023-12-04T05:37:43.047582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052316+0000","last_change":"2023-12-04T05:37:42.019731+0000","last_active":"2023-12-04T05:37:43.052316+0000","last_peered":"2023-12-04T05:37:43.052316+0000","last_clean":"2023-12-04T05:37:43.052316+0000","last_became_active":"2023-12-04T05:37:42.018571+0000","last_became_peered":"2023-12-04T05:37:42.018571+0000","last_unstale":"2023-12-04T05:37:43.052316+0000","last_undegraded":"2023-12-04T05:37:43.052316+0000","last_fullsized":"2023-12-04T05:37:43.052316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:46:08.925815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.010887+0000","last_change":"2023-12-04T05:37:24.362899+0000","last_active":"2023-12-04T05:37:42.010887+0000","last_peered":"2023-12-04T05:37:42.010887+0000","last_clean":"2023-12-04T05:37:42.010887+0000","last_became_active":"2023-12-04T05:37:24.362589+0000","last_became_peered":"2023-12-04T05:37:24.362589+0000","last_unstale":"2023-12-04T05:37:42.010887+0000","last_undegraded":"2023-12-04T05:37:42.010887+0000","last_fullsized":"2023-12-04T05:37:42.010887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:52:59.772803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993655+0000","last_change":"2023-12-04T05:37:24.991648+0000","last_active":"2023-12-04T05:37:41.993655+0000","last_peered":"2023-12-04T05:37:41.993655+0000","last_clean":"2023-12-04T05:37:41.993655+0000","last_became_active":"2023-12-04T05:37:24.991299+0000","last_became_peered":"2023-12-04T05:37:24.991299+0000","last_unstale":"2023-12-04T05:37:41.993655+0000","last_undegraded":"2023-12-04T05:37:41.993655+0000","last_fullsized":"2023-12-04T05:37:41.993655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056339+0000","last_change":"2023-12-04T05:37:43.047542+0000","last_active":"2023-12-04T05:37:43.056339+0000","last_peered":"2023-12-04T05:37:43.056339+0000","last_clean":"2023-12-04T05:37:43.056339+0000","last_became_active":"2023-12-04T05:37:43.047290+0000","last_became_peered":"2023-12-04T05:37:43.047290+0000","last_unstale":"2023-12-04T05:37:43.056339+0000","last_undegraded":"2023-12-04T05:37:43.056339+0000","last_fullsized":"2023-12-04T05:37:43.056339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991212+0000","last_change":"2023-12-04T05:37:24.367828+0000","last_active":"2023-12-04T05:37:41.991212+0000","last_peered":"2023-12-04T05:37:41.991212+0000","last_clean":"2023-12-04T05:37:41.991212+0000","last_became_active":"2023-12-04T05:37:24.367323+0000","last_became_peered":"2023-12-04T05:37:24.367323+0000","last_unstale":"2023-12-04T05:37:41.991212+0000","last_undegraded":"2023-12-04T05:37:41.991212+0000","last_fullsized":"2023-12-04T05:37:41.991212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018347+0000","last_change":"2023-12-04T05:37:24.989453+0000","last_active":"2023-12-04T05:37:42.018347+0000","last_peered":"2023-12-04T05:37:42.018347+0000","last_clean":"2023-12-04T05:37:42.018347+0000","last_became_active":"2023-12-04T05:37:24.988948+0000","last_became_peered":"2023-12-04T05:37:24.988948+0000","last_unstale":"2023-12-04T05:37:42.018347+0000","last_undegraded":"2023-12-04T05:37:42.018347+0000","last_fullsized":"2023-12-04T05:37:42.018347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:14.283024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046611+0000","last_change":"2023-12-04T05:37:42.015838+0000","last_active":"2023-12-04T05:37:43.046611+0000","last_peered":"2023-12-04T05:37:43.046611+0000","last_clean":"2023-12-04T05:37:43.046611+0000","last_became_active":"2023-12-04T05:37:42.015553+0000","last_became_peered":"2023-12-04T05:37:42.015553+0000","last_unstale":"2023-12-04T05:37:43.046611+0000","last_undegraded":"2023-12-04T05:37:43.046611+0000","last_fullsized":"2023-12-04T05:37:43.046611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:01.408364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034024+0000","last_change":"2023-12-04T05:37:43.030828+0000","last_active":"2023-12-04T05:37:43.034024+0000","last_peered":"2023-12-04T05:37:43.034024+0000","last_clean":"2023-12-04T05:37:43.034024+0000","last_became_active":"2023-12-04T05:37:43.030457+0000","last_became_peered":"2023-12-04T05:37:43.030457+0000","last_unstale":"2023-12-04T05:37:43.034024+0000","last_undegraded":"2023-12-04T05:37:43.034024+0000","last_fullsized":"2023-12-04T05:37:43.034024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:29.406769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018453+0000","last_change":"2023-12-04T05:37:24.359031+0000","last_active":"2023-12-04T05:37:42.018453+0000","last_peered":"2023-12-04T05:37:42.018453+0000","last_clean":"2023-12-04T05:37:42.018453+0000","last_became_active":"2023-12-04T05:37:24.358600+0000","last_became_peered":"2023-12-04T05:37:24.358600+0000","last_unstale":"2023-12-04T05:37:42.018453+0000","last_undegraded":"2023-12-04T05:37:42.018453+0000","last_fullsized":"2023-12-04T05:37:42.018453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991183+0000","last_change":"2023-12-04T05:37:24.999666+0000","last_active":"2023-12-04T05:37:41.991183+0000","last_peered":"2023-12-04T05:37:41.991183+0000","last_clean":"2023-12-04T05:37:41.991183+0000","last_became_active":"2023-12-04T05:37:24.999338+0000","last_became_peered":"2023-12-04T05:37:24.999338+0000","last_unstale":"2023-12-04T05:37:41.991183+0000","last_undegraded":"2023-12-04T05:37:41.991183+0000","last_fullsized":"2023-12-04T05:37:41.991183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056296+0000","last_change":"2023-12-04T05:37:42.014807+0000","last_active":"2023-12-04T05:37:43.056296+0000","last_peered":"2023-12-04T05:37:43.056296+0000","last_clean":"2023-12-04T05:37:43.056296+0000","last_became_active":"2023-12-04T05:37:42.014523+0000","last_became_peered":"2023-12-04T05:37:42.014523+0000","last_unstale":"2023-12-04T05:37:43.056296+0000","last_undegraded":"2023-12-04T05:37:43.056296+0000","last_fullsized":"2023-12-04T05:37:43.056296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039769+0000","last_change":"2023-12-04T05:37:43.037334+0000","last_active":"2023-12-04T05:37:43.039769+0000","last_peered":"2023-12-04T05:37:43.039769+0000","last_clean":"2023-12-04T05:37:43.039769+0000","last_became_active":"2023-12-04T05:37:43.036736+0000","last_became_peered":"2023-12-04T05:37:43.036736+0000","last_unstale":"2023-12-04T05:37:43.039769+0000","last_undegraded":"2023-12-04T05:37:43.039769+0000","last_fullsized":"2023-12-04T05:37:43.039769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:36.242804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996047+0000","last_change":"2023-12-04T05:37:24.999330+0000","last_active":"2023-12-04T05:37:41.996047+0000","last_peered":"2023-12-04T05:37:41.996047+0000","last_clean":"2023-12-04T05:37:41.996047+0000","last_became_active":"2023-12-04T05:37:24.998449+0000","last_became_peered":"2023-12-04T05:37:24.998449+0000","last_unstale":"2023-12-04T05:37:41.996047+0000","last_undegraded":"2023-12-04T05:37:41.996047+0000","last_fullsized":"2023-12-04T05:37:41.996047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050687+0000","last_change":"2023-12-04T05:37:43.048258+0000","last_active":"2023-12-04T05:37:43.050687+0000","last_peered":"2023-12-04T05:37:43.050687+0000","last_clean":"2023-12-04T05:37:43.050687+0000","last_became_active":"2023-12-04T05:37:43.047968+0000","last_became_peered":"2023-12-04T05:37:43.047968+0000","last_unstale":"2023-12-04T05:37:43.050687+0000","last_undegraded":"2023-12-04T05:37:43.050687+0000","last_fullsized":"2023-12-04T05:37:43.050687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:18.436864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012495+0000","last_change":"2023-12-04T05:37:24.991739+0000","last_active":"2023-12-04T05:37:42.012495+0000","last_peered":"2023-12-04T05:37:42.012495+0000","last_clean":"2023-12-04T05:37:42.012495+0000","last_became_active":"2023-12-04T05:37:24.991386+0000","last_became_peered":"2023-12-04T05:37:24.991386+0000","last_unstale":"2023-12-04T05:37:42.012495+0000","last_undegraded":"2023-12-04T05:37:42.012495+0000","last_fullsized":"2023-12-04T05:37:42.012495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:39.738739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.049686+0000","last_change":"2023-12-04T05:37:43.041842+0000","last_active":"2023-12-04T05:37:43.049686+0000","last_peered":"2023-12-04T05:37:43.049686+0000","last_clean":"2023-12-04T05:37:43.049686+0000","last_became_active":"2023-12-04T05:37:43.041556+0000","last_became_peered":"2023-12-04T05:37:43.041556+0000","last_unstale":"2023-12-04T05:37:43.049686+0000","last_undegraded":"2023-12-04T05:37:43.049686+0000","last_fullsized":"2023-12-04T05:37:43.049686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:36.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995418+0000","last_change":"2023-12-04T05:37:25.001679+0000","last_active":"2023-12-04T05:37:41.995418+0000","last_peered":"2023-12-04T05:37:41.995418+0000","last_clean":"2023-12-04T05:37:41.995418+0000","last_became_active":"2023-12-04T05:37:25.001125+0000","last_became_peered":"2023-12-04T05:37:25.001125+0000","last_unstale":"2023-12-04T05:37:41.995418+0000","last_undegraded":"2023-12-04T05:37:41.995418+0000","last_fullsized":"2023-12-04T05:37:41.995418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039986+0000","last_change":"2023-12-04T05:37:43.032103+0000","last_active":"2023-12-04T05:37:43.039986+0000","last_peered":"2023-12-04T05:37:43.039986+0000","last_clean":"2023-12-04T05:37:43.039986+0000","last_became_active":"2023-12-04T05:37:43.031843+0000","last_became_peered":"2023-12-04T05:37:43.031843+0000","last_unstale":"2023-12-04T05:37:43.039986+0000","last_undegraded":"2023-12-04T05:37:43.039986+0000","last_fullsized":"2023-12-04T05:37:43.039986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:51:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991716+0000","last_change":"2023-12-04T05:37:24.985403+0000","last_active":"2023-12-04T05:37:41.991716+0000","last_peered":"2023-12-04T05:37:41.991716+0000","last_clean":"2023-12-04T05:37:41.991716+0000","last_became_active":"2023-12-04T05:37:24.985108+0000","last_became_peered":"2023-12-04T05:37:24.985108+0000","last_unstale":"2023-12-04T05:37:41.991716+0000","last_undegraded":"2023-12-04T05:37:41.991716+0000","last_fullsized":"2023-12-04T05:37:41.991716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050779+0000","last_change":"2023-12-04T05:37:43.042506+0000","last_active":"2023-12-04T05:37:43.050779+0000","last_peered":"2023-12-04T05:37:43.050779+0000","last_clean":"2023-12-04T05:37:43.050779+0000","last_became_active":"2023-12-04T05:37:43.040106+0000","last_became_peered":"2023-12-04T05:37:43.040106+0000","last_unstale":"2023-12-04T05:37:43.050779+0000","last_undegraded":"2023-12-04T05:37:43.050779+0000","last_fullsized":"2023-12-04T05:37:43.050779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:59.453804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005157+0000","last_change":"2023-12-04T05:37:24.993220+0000","last_active":"2023-12-04T05:37:42.005157+0000","last_peered":"2023-12-04T05:37:42.005157+0000","last_clean":"2023-12-04T05:37:42.005157+0000","last_became_active":"2023-12-04T05:37:24.992903+0000","last_became_peered":"2023-12-04T05:37:24.992903+0000","last_unstale":"2023-12-04T05:37:42.005157+0000","last_undegraded":"2023-12-04T05:37:42.005157+0000","last_fullsized":"2023-12-04T05:37:42.005157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.051629+0000","last_change":"2023-12-04T05:37:43.048237+0000","last_active":"2023-12-04T05:37:43.051629+0000","last_peered":"2023-12-04T05:37:43.051629+0000","last_clean":"2023-12-04T05:37:43.051629+0000","last_became_active":"2023-12-04T05:37:43.047939+0000","last_became_peered":"2023-12-04T05:37:43.047939+0000","last_unstale":"2023-12-04T05:37:43.051629+0000","last_undegraded":"2023-12-04T05:37:43.051629+0000","last_fullsized":"2023-12-04T05:37:43.051629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.755917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004749+0000","last_change":"2023-12-04T05:37:24.994373+0000","last_active":"2023-12-04T05:37:42.004749+0000","last_peered":"2023-12-04T05:37:42.004749+0000","last_clean":"2023-12-04T05:37:42.004749+0000","last_became_active":"2023-12-04T05:37:24.994052+0000","last_became_peered":"2023-12-04T05:37:24.994052+0000","last_unstale":"2023-12-04T05:37:42.004749+0000","last_undegraded":"2023-12-04T05:37:42.004749+0000","last_fullsized":"2023-12-04T05:37:42.004749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056583+0000","last_change":"2023-12-04T05:37:43.053488+0000","last_active":"2023-12-04T05:37:43.056583+0000","last_peered":"2023-12-04T05:37:43.056583+0000","last_clean":"2023-12-04T05:37:43.056583+0000","last_became_active":"2023-12-04T05:37:43.053259+0000","last_became_peered":"2023-12-04T05:37:43.053259+0000","last_unstale":"2023-12-04T05:37:43.056583+0000","last_undegraded":"2023-12-04T05:37:43.056583+0000","last_fullsized":"2023-12-04T05:37:43.056583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:44.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012970+0000","last_change":"2023-12-04T05:37:24.998832+0000","last_active":"2023-12-04T05:37:42.012970+0000","last_peered":"2023-12-04T05:37:42.012970+0000","last_clean":"2023-12-04T05:37:42.012970+0000","last_became_active":"2023-12-04T05:37:24.998544+0000","last_became_peered":"2023-12-04T05:37:24.998544+0000","last_unstale":"2023-12-04T05:37:42.012970+0000","last_undegraded":"2023-12-04T05:37:42.012970+0000","last_fullsized":"2023-12-04T05:37:42.012970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:12.838061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039624+0000","last_change":"2023-12-04T05:37:43.033372+0000","last_active":"2023-12-04T05:37:43.039624+0000","last_peered":"2023-12-04T05:37:43.039624+0000","last_clean":"2023-12-04T05:37:43.039624+0000","last_became_active":"2023-12-04T05:37:43.033048+0000","last_became_peered":"2023-12-04T05:37:43.033048+0000","last_unstale":"2023-12-04T05:37:43.039624+0000","last_undegraded":"2023-12-04T05:37:43.039624+0000","last_fullsized":"2023-12-04T05:37:43.039624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004769+0000","last_change":"2023-12-04T05:37:24.995638+0000","last_active":"2023-12-04T05:37:42.004769+0000","last_peered":"2023-12-04T05:37:42.004769+0000","last_clean":"2023-12-04T05:37:42.004769+0000","last_became_active":"2023-12-04T05:37:24.995363+0000","last_became_peered":"2023-12-04T05:37:24.995363+0000","last_unstale":"2023-12-04T05:37:42.004769+0000","last_undegraded":"2023-12-04T05:37:42.004769+0000","last_fullsized":"2023-12-04T05:37:42.004769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.051304+0000","last_change":"2023-12-04T05:37:43.034285+0000","last_active":"2023-12-04T05:37:43.051304+0000","last_peered":"2023-12-04T05:37:43.051304+0000","last_clean":"2023-12-04T05:37:43.051304+0000","last_became_active":"2023-12-04T05:37:43.033979+0000","last_became_peered":"2023-12-04T05:37:43.033979+0000","last_unstale":"2023-12-04T05:37:43.051304+0000","last_undegraded":"2023-12-04T05:37:43.051304+0000","last_fullsized":"2023-12-04T05:37:43.051304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:26.521827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004375+0000","last_change":"2023-12-04T05:37:24.993347+0000","last_active":"2023-12-04T05:37:42.004375+0000","last_peered":"2023-12-04T05:37:42.004375+0000","last_clean":"2023-12-04T05:37:42.004375+0000","last_became_active":"2023-12-04T05:37:24.993089+0000","last_became_peered":"2023-12-04T05:37:24.993089+0000","last_unstale":"2023-12-04T05:37:42.004375+0000","last_undegraded":"2023-12-04T05:37:42.004375+0000","last_fullsized":"2023-12-04T05:37:42.004375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.035280+0000","last_change":"2023-12-04T05:37:43.031670+0000","last_active":"2023-12-04T05:37:43.035280+0000","last_peered":"2023-12-04T05:37:43.035280+0000","last_clean":"2023-12-04T05:37:43.035280+0000","last_became_active":"2023-12-04T05:37:43.031313+0000","last_became_peered":"2023-12-04T05:37:43.031313+0000","last_unstale":"2023-12-04T05:37:43.035280+0000","last_undegraded":"2023-12-04T05:37:43.035280+0000","last_fullsized":"2023-12-04T05:37:43.035280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:47:34.395228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990392+0000","last_change":"2023-12-04T05:37:25.004665+0000","last_active":"2023-12-04T05:37:41.990392+0000","last_peered":"2023-12-04T05:37:41.990392+0000","last_clean":"2023-12-04T05:37:41.990392+0000","last_became_active":"2023-12-04T05:37:25.004324+0000","last_became_peered":"2023-12-04T05:37:25.004324+0000","last_unstale":"2023-12-04T05:37:41.990392+0000","last_undegraded":"2023-12-04T05:37:41.990392+0000","last_fullsized":"2023-12-04T05:37:41.990392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034465+0000","last_change":"2023-12-04T05:37:43.032000+0000","last_active":"2023-12-04T05:37:43.034465+0000","last_peered":"2023-12-04T05:37:43.034465+0000","last_clean":"2023-12-04T05:37:43.034465+0000","last_became_active":"2023-12-04T05:37:43.030614+0000","last_became_peered":"2023-12-04T05:37:43.030614+0000","last_unstale":"2023-12-04T05:37:43.034465+0000","last_undegraded":"2023-12-04T05:37:43.034465+0000","last_fullsized":"2023-12-04T05:37:43.034465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:26.521827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996966+0000","last_change":"2023-12-04T05:37:24.990315+0000","last_active":"2023-12-04T05:37:41.996966+0000","last_peered":"2023-12-04T05:37:41.996966+0000","last_clean":"2023-12-04T05:37:41.996966+0000","last_became_active":"2023-12-04T05:37:24.990020+0000","last_became_peered":"2023-12-04T05:37:24.990020+0000","last_unstale":"2023-12-04T05:37:41.996966+0000","last_undegraded":"2023-12-04T05:37:41.996966+0000","last_fullsized":"2023-12-04T05:37:41.996966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.043992+0000","last_change":"2023-12-04T05:37:43.041052+0000","last_active":"2023-12-04T05:37:43.043992+0000","last_peered":"2023-12-04T05:37:43.043992+0000","last_clean":"2023-12-04T05:37:43.043992+0000","last_became_active":"2023-12-04T05:37:43.040748+0000","last_became_peered":"2023-12-04T05:37:43.040748+0000","last_unstale":"2023-12-04T05:37:43.043992+0000","last_undegraded":"2023-12-04T05:37:43.043992+0000","last_fullsized":"2023-12-04T05:37:43.043992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:36.448608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991613+0000","last_change":"2023-12-04T05:37:24.990903+0000","last_active":"2023-12-04T05:37:41.991613+0000","last_peered":"2023-12-04T05:37:41.991613+0000","last_clean":"2023-12-04T05:37:41.991613+0000","last_became_active":"2023-12-04T05:37:24.990595+0000","last_became_peered":"2023-12-04T05:37:24.990595+0000","last_unstale":"2023-12-04T05:37:41.991613+0000","last_undegraded":"2023-12-04T05:37:41.991613+0000","last_fullsized":"2023-12-04T05:37:41.991613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055963+0000","last_change":"2023-12-04T05:37:43.051542+0000","last_active":"2023-12-04T05:37:43.055963+0000","last_peered":"2023-12-04T05:37:43.055963+0000","last_clean":"2023-12-04T05:37:43.055963+0000","last_became_active":"2023-12-04T05:37:43.050885+0000","last_became_peered":"2023-12-04T05:37:43.050885+0000","last_unstale":"2023-12-04T05:37:43.055963+0000","last_undegraded":"2023-12-04T05:37:43.055963+0000","last_fullsized":"2023-12-04T05:37:43.055963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:48.936035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005684+0000","last_change":"2023-12-04T05:37:24.997746+0000","last_active":"2023-12-04T05:37:42.005684+0000","last_peered":"2023-12-04T05:37:42.005684+0000","last_clean":"2023-12-04T05:37:42.005684+0000","last_became_active":"2023-12-04T05:37:24.997501+0000","last_became_peered":"2023-12-04T05:37:24.997501+0000","last_unstale":"2023-12-04T05:37:42.005684+0000","last_undegraded":"2023-12-04T05:37:42.005684+0000","last_fullsized":"2023-12-04T05:37:42.005684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:28:18.462079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.036466+0000","last_change":"2023-12-04T05:37:43.032146+0000","last_active":"2023-12-04T05:37:43.036466+0000","last_peered":"2023-12-04T05:37:43.036466+0000","last_clean":"2023-12-04T05:37:43.036466+0000","last_became_active":"2023-12-04T05:37:43.031852+0000","last_became_peered":"2023-12-04T05:37:43.031852+0000","last_unstale":"2023-12-04T05:37:43.036466+0000","last_undegraded":"2023-12-04T05:37:43.036466+0000","last_fullsized":"2023-12-04T05:37:43.036466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:31:09.519131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.010792+0000","last_change":"2023-12-04T05:37:24.996641+0000","last_active":"2023-12-04T05:37:42.010792+0000","last_peered":"2023-12-04T05:37:42.010792+0000","last_clean":"2023-12-04T05:37:42.010792+0000","last_became_active":"2023-12-04T05:37:24.993802+0000","last_became_peered":"2023-12-04T05:37:24.993802+0000","last_unstale":"2023-12-04T05:37:42.010792+0000","last_undegraded":"2023-12-04T05:37:42.010792+0000","last_fullsized":"2023-12-04T05:37:42.010792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:31.280029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056852+0000","last_change":"2023-12-04T05:37:43.053983+0000","last_active":"2023-12-04T05:37:43.056852+0000","last_peered":"2023-12-04T05:37:43.056852+0000","last_clean":"2023-12-04T05:37:43.056852+0000","last_became_active":"2023-12-04T05:37:43.053454+0000","last_became_peered":"2023-12-04T05:37:43.053454+0000","last_unstale":"2023-12-04T05:37:43.056852+0000","last_undegraded":"2023-12-04T05:37:43.056852+0000","last_fullsized":"2023-12-04T05:37:43.056852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:31.939030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012876+0000","last_change":"2023-12-04T05:37:24.992143+0000","last_active":"2023-12-04T05:37:42.012876+0000","last_peered":"2023-12-04T05:37:42.012876+0000","last_clean":"2023-12-04T05:37:42.012876+0000","last_became_active":"2023-12-04T05:37:24.991537+0000","last_became_peered":"2023-12-04T05:37:24.991537+0000","last_unstale":"2023-12-04T05:37:42.012876+0000","last_undegraded":"2023-12-04T05:37:42.012876+0000","last_fullsized":"2023-12-04T05:37:42.012876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:07.720393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.037548+0000","last_change":"2023-12-04T05:37:43.035233+0000","last_active":"2023-12-04T05:37:43.037548+0000","last_peered":"2023-12-04T05:37:43.037548+0000","last_clean":"2023-12-04T05:37:43.037548+0000","last_became_active":"2023-12-04T05:37:43.034961+0000","last_became_peered":"2023-12-04T05:37:43.034961+0000","last_unstale":"2023-12-04T05:37:43.037548+0000","last_undegraded":"2023-12-04T05:37:43.037548+0000","last_fullsized":"2023-12-04T05:37:43.037548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:24.949946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995357+0000","last_change":"2023-12-04T05:37:25.002114+0000","last_active":"2023-12-04T05:37:41.995357+0000","last_peered":"2023-12-04T05:37:41.995357+0000","last_clean":"2023-12-04T05:37:41.995357+0000","last_became_active":"2023-12-04T05:37:24.999380+0000","last_became_peered":"2023-12-04T05:37:24.999380+0000","last_unstale":"2023-12-04T05:37:41.995357+0000","last_undegraded":"2023-12-04T05:37:41.995357+0000","last_fullsized":"2023-12-04T05:37:41.995357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.060029+0000","last_change":"2023-12-04T05:37:43.054519+0000","last_active":"2023-12-04T05:37:43.060029+0000","last_peered":"2023-12-04T05:37:43.060029+0000","last_clean":"2023-12-04T05:37:43.060029+0000","last_became_active":"2023-12-04T05:37:43.051581+0000","last_became_peered":"2023-12-04T05:37:43.051581+0000","last_unstale":"2023-12-04T05:37:43.060029+0000","last_undegraded":"2023-12-04T05:37:43.060029+0000","last_fullsized":"2023-12-04T05:37:43.060029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:36.242804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996705+0000","last_change":"2023-12-04T05:37:25.002873+0000","last_active":"2023-12-04T05:37:41.996705+0000","last_peered":"2023-12-04T05:37:41.996705+0000","last_clean":"2023-12-04T05:37:41.996705+0000","last_became_active":"2023-12-04T05:37:25.002555+0000","last_became_peered":"2023-12-04T05:37:25.002555+0000","last_unstale":"2023-12-04T05:37:41.996705+0000","last_undegraded":"2023-12-04T05:37:41.996705+0000","last_fullsized":"2023-12-04T05:37:41.996705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055397+0000","last_change":"2023-12-04T05:37:43.049864+0000","last_active":"2023-12-04T05:37:43.055397+0000","last_peered":"2023-12-04T05:37:43.055397+0000","last_clean":"2023-12-04T05:37:43.055397+0000","last_became_active":"2023-12-04T05:37:43.048019+0000","last_became_peered":"2023-12-04T05:37:43.048019+0000","last_unstale":"2023-12-04T05:37:43.055397+0000","last_undegraded":"2023-12-04T05:37:43.055397+0000","last_fullsized":"2023-12-04T05:37:43.055397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:49.854356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004342+0000","last_change":"2023-12-04T05:37:24.998811+0000","last_active":"2023-12-04T05:37:42.004342+0000","last_peered":"2023-12-04T05:37:42.004342+0000","last_clean":"2023-12-04T05:37:42.004342+0000","last_became_active":"2023-12-04T05:37:24.998548+0000","last_became_peered":"2023-12-04T05:37:24.998548+0000","last_unstale":"2023-12-04T05:37:42.004342+0000","last_undegraded":"2023-12-04T05:37:42.004342+0000","last_fullsized":"2023-12-04T05:37:42.004342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056147+0000","last_change":"2023-12-04T05:37:43.051574+0000","last_active":"2023-12-04T05:37:43.056147+0000","last_peered":"2023-12-04T05:37:43.056147+0000","last_clean":"2023-12-04T05:37:43.056147+0000","last_became_active":"2023-12-04T05:37:43.051205+0000","last_became_peered":"2023-12-04T05:37:43.051205+0000","last_unstale":"2023-12-04T05:37:43.056147+0000","last_undegraded":"2023-12-04T05:37:43.056147+0000","last_fullsized":"2023-12-04T05:37:43.056147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:46:08.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006346+0000","last_change":"2023-12-04T05:37:24.987512+0000","last_active":"2023-12-04T05:37:42.006346+0000","last_peered":"2023-12-04T05:37:42.006346+0000","last_clean":"2023-12-04T05:37:42.006346+0000","last_became_active":"2023-12-04T05:37:24.987236+0000","last_became_peered":"2023-12-04T05:37:24.987236+0000","last_unstale":"2023-12-04T05:37:42.006346+0000","last_undegraded":"2023-12-04T05:37:42.006346+0000","last_fullsized":"2023-12-04T05:37:42.006346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.027004+0000","last_change":"2023-12-04T05:37:43.024694+0000","last_active":"2023-12-04T05:37:43.027004+0000","last_peered":"2023-12-04T05:37:43.027004+0000","last_clean":"2023-12-04T05:37:43.027004+0000","last_became_active":"2023-12-04T05:37:43.022066+0000","last_became_peered":"2023-12-04T05:37:43.022066+0000","last_unstale":"2023-12-04T05:37:43.027004+0000","last_undegraded":"2023-12-04T05:37:43.027004+0000","last_fullsized":"2023-12-04T05:37:43.027004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:50.136372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001118+0000","last_change":"2023-12-04T05:37:24.991168+0000","last_active":"2023-12-04T05:37:42.001118+0000","last_peered":"2023-12-04T05:37:42.001118+0000","last_clean":"2023-12-04T05:37:42.001118+0000","last_became_active":"2023-12-04T05:37:24.990517+0000","last_became_peered":"2023-12-04T05:37:24.990517+0000","last_unstale":"2023-12-04T05:37:42.001118+0000","last_undegraded":"2023-12-04T05:37:42.001118+0000","last_fullsized":"2023-12-04T05:37:42.001118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:07.947991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054182+0000","last_change":"2023-12-04T05:37:43.043707+0000","last_active":"2023-12-04T05:37:43.054182+0000","last_peered":"2023-12-04T05:37:43.054182+0000","last_clean":"2023-12-04T05:37:43.054182+0000","last_became_active":"2023-12-04T05:37:43.042891+0000","last_became_peered":"2023-12-04T05:37:43.042891+0000","last_unstale":"2023-12-04T05:37:43.054182+0000","last_undegraded":"2023-12-04T05:37:43.054182+0000","last_fullsized":"2023-12-04T05:37:43.054182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:30.230829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005081+0000","last_change":"2023-12-04T05:37:25.001854+0000","last_active":"2023-12-04T05:37:42.005081+0000","last_peered":"2023-12-04T05:37:42.005081+0000","last_clean":"2023-12-04T05:37:42.005081+0000","last_became_active":"2023-12-04T05:37:25.001471+0000","last_became_peered":"2023-12-04T05:37:25.001471+0000","last_unstale":"2023-12-04T05:37:42.005081+0000","last_undegraded":"2023-12-04T05:37:42.005081+0000","last_fullsized":"2023-12-04T05:37:42.005081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.059987+0000","last_change":"2023-12-04T05:37:43.053148+0000","last_active":"2023-12-04T05:37:43.059987+0000","last_peered":"2023-12-04T05:37:43.059987+0000","last_clean":"2023-12-04T05:37:43.059987+0000","last_became_active":"2023-12-04T05:37:43.052958+0000","last_became_peered":"2023-12-04T05:37:43.052958+0000","last_unstale":"2023-12-04T05:37:43.059987+0000","last_undegraded":"2023-12-04T05:37:43.059987+0000","last_fullsized":"2023-12-04T05:37:43.059987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996107+0000","last_change":"2023-12-04T05:37:25.002836+0000","last_active":"2023-12-04T05:37:41.996107+0000","last_peered":"2023-12-04T05:37:41.996107+0000","last_clean":"2023-12-04T05:37:41.996107+0000","last_became_active":"2023-12-04T05:37:25.002504+0000","last_became_peered":"2023-12-04T05:37:25.002504+0000","last_unstale":"2023-12-04T05:37:41.996107+0000","last_undegraded":"2023-12-04T05:37:41.996107+0000","last_fullsized":"2023-12-04T05:37:41.996107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058981+0000","last_change":"2023-12-04T05:37:43.054126+0000","last_active":"2023-12-04T05:37:43.058981+0000","last_peered":"2023-12-04T05:37:43.058981+0000","last_clean":"2023-12-04T05:37:43.058981+0000","last_became_active":"2023-12-04T05:37:43.053795+0000","last_became_peered":"2023-12-04T05:37:43.053795+0000","last_unstale":"2023-12-04T05:37:43.058981+0000","last_undegraded":"2023-12-04T05:37:43.058981+0000","last_fullsized":"2023-12-04T05:37:43.058981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:02.414534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005824+0000","last_change":"2023-12-04T05:37:24.994217+0000","last_active":"2023-12-04T05:37:42.005824+0000","last_peered":"2023-12-04T05:37:42.005824+0000","last_clean":"2023-12-04T05:37:42.005824+0000","last_became_active":"2023-12-04T05:37:24.993859+0000","last_became_peered":"2023-12-04T05:37:24.993859+0000","last_unstale":"2023-12-04T05:37:42.005824+0000","last_undegraded":"2023-12-04T05:37:42.005824+0000","last_fullsized":"2023-12-04T05:37:42.005824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058657+0000","last_change":"2023-12-04T05:37:43.052024+0000","last_active":"2023-12-04T05:37:43.058657+0000","last_peered":"2023-12-04T05:37:43.058657+0000","last_clean":"2023-12-04T05:37:43.058657+0000","last_became_active":"2023-12-04T05:37:43.051628+0000","last_became_peered":"2023-12-04T05:37:43.051628+0000","last_unstale":"2023-12-04T05:37:43.058657+0000","last_undegraded":"2023-12-04T05:37:43.058657+0000","last_fullsized":"2023-12-04T05:37:43.058657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:54.799040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998175+0000","last_change":"2023-12-04T05:37:24.990417+0000","last_active":"2023-12-04T05:37:41.998175+0000","last_peered":"2023-12-04T05:37:41.998175+0000","last_clean":"2023-12-04T05:37:41.998175+0000","last_became_active":"2023-12-04T05:37:24.989761+0000","last_became_peered":"2023-12-04T05:37:24.989761+0000","last_unstale":"2023-12-04T05:37:41.998175+0000","last_undegraded":"2023-12-04T05:37:41.998175+0000","last_fullsized":"2023-12-04T05:37:41.998175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052253+0000","last_change":"2023-12-04T05:37:43.039901+0000","last_active":"2023-12-04T05:37:43.052253+0000","last_peered":"2023-12-04T05:37:43.052253+0000","last_clean":"2023-12-04T05:37:43.052253+0000","last_became_active":"2023-12-04T05:37:43.039595+0000","last_became_peered":"2023-12-04T05:37:43.039595+0000","last_unstale":"2023-12-04T05:37:43.052253+0000","last_undegraded":"2023-12-04T05:37:43.052253+0000","last_fullsized":"2023-12-04T05:37:43.052253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:00.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995961+0000","last_change":"2023-12-04T05:37:24.999115+0000","last_active":"2023-12-04T05:37:41.995961+0000","last_peered":"2023-12-04T05:37:41.995961+0000","last_clean":"2023-12-04T05:37:41.995961+0000","last_became_active":"2023-12-04T05:37:24.997938+0000","last_became_peered":"2023-12-04T05:37:24.997938+0000","last_unstale":"2023-12-04T05:37:41.995961+0000","last_undegraded":"2023-12-04T05:37:41.995961+0000","last_fullsized":"2023-12-04T05:37:41.995961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045832+0000","last_change":"2023-12-04T05:37:43.043320+0000","last_active":"2023-12-04T05:37:43.045832+0000","last_peered":"2023-12-04T05:37:43.045832+0000","last_clean":"2023-12-04T05:37:43.045832+0000","last_became_active":"2023-12-04T05:37:43.042819+0000","last_became_peered":"2023-12-04T05:37:43.042819+0000","last_unstale":"2023-12-04T05:37:43.045832+0000","last_undegraded":"2023-12-04T05:37:43.045832+0000","last_fullsized":"2023-12-04T05:37:43.045832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:20.188748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996512+0000","last_change":"2023-12-04T05:37:25.001425+0000","last_active":"2023-12-04T05:37:41.996512+0000","last_peered":"2023-12-04T05:37:41.996512+0000","last_clean":"2023-12-04T05:37:41.996512+0000","last_became_active":"2023-12-04T05:37:25.001143+0000","last_became_peered":"2023-12-04T05:37:25.001143+0000","last_unstale":"2023-12-04T05:37:41.996512+0000","last_undegraded":"2023-12-04T05:37:41.996512+0000","last_fullsized":"2023-12-04T05:37:41.996512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058077+0000","last_change":"2023-12-04T05:37:43.046535+0000","last_active":"2023-12-04T05:37:43.058077+0000","last_peered":"2023-12-04T05:37:43.058077+0000","last_clean":"2023-12-04T05:37:43.058077+0000","last_became_active":"2023-12-04T05:37:43.046275+0000","last_became_peered":"2023-12-04T05:37:43.046275+0000","last_unstale":"2023-12-04T05:37:43.058077+0000","last_undegraded":"2023-12-04T05:37:43.058077+0000","last_fullsized":"2023-12-04T05:37:43.058077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:27.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006263+0000","last_change":"2023-12-04T05:37:24.997159+0000","last_active":"2023-12-04T05:37:42.006263+0000","last_peered":"2023-12-04T05:37:42.006263+0000","last_clean":"2023-12-04T05:37:42.006263+0000","last_became_active":"2023-12-04T05:37:24.996505+0000","last_became_peered":"2023-12-04T05:37:24.996505+0000","last_unstale":"2023-12-04T05:37:42.006263+0000","last_undegraded":"2023-12-04T05:37:42.006263+0000","last_fullsized":"2023-12-04T05:37:42.006263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045529+0000","last_change":"2023-12-04T05:37:43.042956+0000","last_active":"2023-12-04T05:37:43.045529+0000","last_peered":"2023-12-04T05:37:43.045529+0000","last_clean":"2023-12-04T05:37:43.045529+0000","last_became_active":"2023-12-04T05:37:43.042191+0000","last_became_peered":"2023-12-04T05:37:43.042191+0000","last_unstale":"2023-12-04T05:37:43.045529+0000","last_undegraded":"2023-12-04T05:37:43.045529+0000","last_fullsized":"2023-12-04T05:37:43.045529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:20.188748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001011+0000","last_change":"2023-12-04T05:37:24.991321+0000","last_active":"2023-12-04T05:37:42.001011+0000","last_peered":"2023-12-04T05:37:42.001011+0000","last_clean":"2023-12-04T05:37:42.001011+0000","last_became_active":"2023-12-04T05:37:24.990855+0000","last_became_peered":"2023-12-04T05:37:24.990855+0000","last_unstale":"2023-12-04T05:37:42.001011+0000","last_undegraded":"2023-12-04T05:37:42.001011+0000","last_fullsized":"2023-12-04T05:37:42.001011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:46:45.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.059001+0000","last_change":"2023-12-04T05:37:43.055016+0000","last_active":"2023-12-04T05:37:43.059001+0000","last_peered":"2023-12-04T05:37:43.059001+0000","last_clean":"2023-12-04T05:37:43.059001+0000","last_became_active":"2023-12-04T05:37:43.054798+0000","last_became_peered":"2023-12-04T05:37:43.054798+0000","last_unstale":"2023-12-04T05:37:43.059001+0000","last_undegraded":"2023-12-04T05:37:43.059001+0000","last_fullsized":"2023-12-04T05:37:43.059001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:27:28.061993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003844+0000","last_change":"2023-12-04T05:37:24.990710+0000","last_active":"2023-12-04T05:37:42.003844+0000","last_peered":"2023-12-04T05:37:42.003844+0000","last_clean":"2023-12-04T05:37:42.003844+0000","last_became_active":"2023-12-04T05:37:24.990190+0000","last_became_peered":"2023-12-04T05:37:24.990190+0000","last_unstale":"2023-12-04T05:37:42.003844+0000","last_undegraded":"2023-12-04T05:37:42.003844+0000","last_fullsized":"2023-12-04T05:37:42.003844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046153+0000","last_change":"2023-12-04T05:37:43.044902+0000","last_active":"2023-12-04T05:37:43.046153+0000","last_peered":"2023-12-04T05:37:43.046153+0000","last_clean":"2023-12-04T05:37:43.046153+0000","last_became_active":"2023-12-04T05:37:43.044654+0000","last_became_peered":"2023-12-04T05:37:43.044654+0000","last_unstale":"2023-12-04T05:37:43.046153+0000","last_undegraded":"2023-12-04T05:37:43.046153+0000","last_fullsized":"2023-12-04T05:37:43.046153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:00.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004955+0000","last_change":"2023-12-04T05:37:24.996407+0000","last_active":"2023-12-04T05:37:42.004955+0000","last_peered":"2023-12-04T05:37:42.004955+0000","last_clean":"2023-12-04T05:37:42.004955+0000","last_became_active":"2023-12-04T05:37:24.996150+0000","last_became_peered":"2023-12-04T05:37:24.996150+0000","last_unstale":"2023-12-04T05:37:42.004955+0000","last_undegraded":"2023-12-04T05:37:42.004955+0000","last_fullsized":"2023-12-04T05:37:42.004955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052725+0000","last_change":"2023-12-04T05:37:43.046155+0000","last_active":"2023-12-04T05:37:43.052725+0000","last_peered":"2023-12-04T05:37:43.052725+0000","last_clean":"2023-12-04T05:37:43.052725+0000","last_became_active":"2023-12-04T05:37:43.045849+0000","last_became_peered":"2023-12-04T05:37:43.045849+0000","last_unstale":"2023-12-04T05:37:43.052725+0000","last_undegraded":"2023-12-04T05:37:43.052725+0000","last_fullsized":"2023-12-04T05:37:43.052725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.013047+0000","last_change":"2023-12-04T05:37:24.992517+0000","last_active":"2023-12-04T05:37:42.013047+0000","last_peered":"2023-12-04T05:37:42.013047+0000","last_clean":"2023-12-04T05:37:42.013047+0000","last_became_active":"2023-12-04T05:37:24.991809+0000","last_became_peered":"2023-12-04T05:37:24.991809+0000","last_unstale":"2023-12-04T05:37:42.013047+0000","last_undegraded":"2023-12-04T05:37:42.013047+0000","last_fullsized":"2023-12-04T05:37:42.013047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:09.871491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.049264+0000","last_change":"2023-12-04T05:37:43.044648+0000","last_active":"2023-12-04T05:37:43.049264+0000","last_peered":"2023-12-04T05:37:43.049264+0000","last_clean":"2023-12-04T05:37:43.049264+0000","last_became_active":"2023-12-04T05:37:43.042019+0000","last_became_peered":"2023-12-04T05:37:43.042019+0000","last_unstale":"2023-12-04T05:37:43.049264+0000","last_undegraded":"2023-12-04T05:37:43.049264+0000","last_fullsized":"2023-12-04T05:37:43.049264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:27.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018427+0000","last_change":"2023-12-04T05:37:24.991447+0000","last_active":"2023-12-04T05:37:42.018427+0000","last_peered":"2023-12-04T05:37:42.018427+0000","last_clean":"2023-12-04T05:37:42.018427+0000","last_became_active":"2023-12-04T05:37:24.991120+0000","last_became_peered":"2023-12-04T05:37:24.991120+0000","last_unstale":"2023-12-04T05:37:42.018427+0000","last_undegraded":"2023-12-04T05:37:42.018427+0000","last_fullsized":"2023-12-04T05:37:42.018427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:23.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.74199999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71899999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75800000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.499}]},{"osd":2,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":156270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67600000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.66800000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.435}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.501},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.626}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.875}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.5}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.752}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":738263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.376},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.438}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.624},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:47.117 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:37:47.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 Processor -- start 2023-12-04T05:37:47.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 -- start start 2023-12-04T05:37:47.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 0x7f94bc151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94bc152090 0x7f94bc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc0c15a0 con 0x7f94bc152090 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc155220 con 0x7f94bc0c1030 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c2bc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0739b0 con 0x7f94bc06b860 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94bc152090 0x7f94bc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f94bc152090 0x7f94bc157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32968/0 (socket says 172.21.15.97:32968) 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 -- 172.21.15.97:0/1726999686 learned_addr learned my addr 172.21.15.97:0/1726999686 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94bbfff640 1 --2- 172.21.15.97:0/1726999686 >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 0x7f94bc151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c0960640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 -- 172.21.15.97:0/1726999686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 msgr2=0x7f94bc0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc0c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 -- 172.21.15.97:0/1726999686 >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 msgr2=0x7f94bc151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 --2- 172.21.15.97:0/1726999686 >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 0x7f94bc151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c1161640 1 -- 172.21.15.97:0/1726999686 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc155710 con 0x7f94bc152090 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94c0960640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:47.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.286+0000 7f94bbfff640 1 --2- 172.21.15.97:0/1726999686 >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 0x7f94bc151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c1161640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc157da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94bc06c070 tx=0x7f94b401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97757202e18a2ec server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94bb7fe640 1 -- 172.21.15.97:0/1726999686 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc158af0 con 0x7f94bc152090 2023-12-04T05:37:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94bb7fe640 1 -- 172.21.15.97:0/1726999686 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40a56d0 con 0x7f94bc152090 2023-12-04T05:37:47.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94bb7fe640 1 -- 172.21.15.97:0/1726999686 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40a5a60 con 0x7f94bc152090 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1726999686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 msgr2=0x7f94bc157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc157da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94bc06c070 tx=0x7f94b401c940 comp rx=0 tx=0).stop 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1726999686 shutdown_connections 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc157da0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1726999686 >> v2:172.21.15.143:3300/0 conn(0x7f94bc0c1030 0x7f94bc151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1726999686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc0c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1726999686 >> 172.21.15.97:0/1726999686 conn(0x7f94bc0c3130 msgr2=0x7f94bc0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1726999686 shutdown_connections 2023-12-04T05:37:47.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.290+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1726999686 wait complete. 2023-12-04T05:37:47.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 Processor -- start 2023-12-04T05:37:47.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 -- start start 2023-12-04T05:37:47.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94bc0c1030 0x7f94bc0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0c4340 con 0x7f94bc152090 2023-12-04T05:37:47.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc1f0b40 con 0x7f94bc0c1030 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc14a4e0 con 0x7f94bc06b860 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32972/0 (socket says 172.21.15.97:32972) 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 -- 172.21.15.97:0/1320053896 learned_addr learned my addr 172.21.15.97:0/1320053896 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c0960640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94bbfff640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94bc0c1030 0x7f94bc0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 -- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 msgr2=0x7f94bc143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 -- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94bc0c1030 msgr2=0x7f94bc0aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94bc0c1030 0x7f94bc0aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 -- 172.21.15.97:0/1320053896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009b30 con 0x7f94bc152090 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c1161640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f94b40af040 tx=0x7f94b40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b8640 con 0x7f94bc152090 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40b87c0 con 0x7f94bc152090 2023-12-04T05:37:47.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b8b70 con 0x7f94bc152090 2023-12-04T05:37:47.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.294+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc1effc0 con 0x7f94bc152090 2023-12-04T05:37:47.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc1f0580 con 0x7f94bc152090 2023-12-04T05:37:47.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc068440 con 0x7f94bc152090 2023-12-04T05:37:47.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f94b40b8cd0 con 0x7f94bc152090 2023-12-04T05:37:47.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94b97fa640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 0x7f94a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f94b411f380 con 0x7f94bc152090 2023-12-04T05:37:47.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94c0960640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 0x7f94a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.298+0000 7f94c0960640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 0x7f94a0068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94b00098d0 tx=0x7f94b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.302+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94b40ec280 con 0x7f94bc152090 2023-12-04T05:37:47.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.454+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94bc06be50 con 0x7f94a00668d0 2023-12-04T05:37:47.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.466+0000 7f94b97fa640 1 -- 172.21.15.97:0/1320053896 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527824 (secure 0 0 0) 0x7f94b00118e0 con 0x7f94a00668d0 2023-12-04T05:37:47.477 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:47.482 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 msgr2=0x7f94a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 0x7f94a0068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94b00098d0 tx=0x7f94b0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 msgr2=0x7f94bc1ecac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f94b40af040 tx=0x7f94b40196e0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 shutdown_connections 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f94a00668d0 0x7f94a0068d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f94bc152090 0x7f94bc1ecac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94bc0c1030 0x7f94bc0aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 --2- 172.21.15.97:0/1320053896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94bc06b860 0x7f94bc143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 >> 172.21.15.97:0/1320053896 conn(0x7f94bc0c3130 msgr2=0x7f94bc0c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:47.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 shutdown_connections 2023-12-04T05:37:47.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.474+0000 7f94c2bc4640 1 -- 172.21.15.97:0/1320053896 wait complete. 2023-12-04T05:37:47.497 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-04T05:37:46.204420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220364,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754356,"statfs":{"total":773094113280,"available":772868460544,"internally_reserved":0,"allocated":4268032,"data_stored":2387132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.222538"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054138+0000","last_change":"2023-12-04T05:37:43.042408+0000","last_active":"2023-12-04T05:37:43.054138+0000","last_peered":"2023-12-04T05:37:43.054138+0000","last_clean":"2023-12-04T05:37:43.054138+0000","last_became_active":"2023-12-04T05:37:43.041742+0000","last_became_peered":"2023-12-04T05:37:43.041742+0000","last_unstale":"2023-12-04T05:37:43.054138+0000","last_undegraded":"2023-12-04T05:37:43.054138+0000","last_fullsized":"2023-12-04T05:37:43.054138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:45.907701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996800+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:37:41.996800+0000","last_peered":"2023-12-04T05:37:41.996800+0000","last_clean":"2023-12-04T05:37:41.996800+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:37:41.996800+0000","last_undegraded":"2023-12-04T05:37:41.996800+0000","last_fullsized":"2023-12-04T05:37:41.996800+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.016751+0000","last_change":"2023-12-04T05:37:24.361054+0000","last_active":"2023-12-04T05:37:42.016751+0000","last_peered":"2023-12-04T05:37:42.016751+0000","last_clean":"2023-12-04T05:37:42.016751+0000","last_became_active":"2023-12-04T05:37:24.360700+0000","last_became_peered":"2023-12-04T05:37:24.360700+0000","last_unstale":"2023-12-04T05:37:42.016751+0000","last_undegraded":"2023-12-04T05:37:42.016751+0000","last_fullsized":"2023-12-04T05:37:42.016751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996538+0000","last_change":"2023-12-04T05:37:25.001807+0000","last_active":"2023-12-04T05:37:41.996538+0000","last_peered":"2023-12-04T05:37:41.996538+0000","last_clean":"2023-12-04T05:37:41.996538+0000","last_became_active":"2023-12-04T05:37:24.999364+0000","last_became_peered":"2023-12-04T05:37:24.999364+0000","last_unstale":"2023-12-04T05:37:41.996538+0000","last_undegraded":"2023-12-04T05:37:41.996538+0000","last_fullsized":"2023-12-04T05:37:41.996538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056484+0000","last_change":"2023-12-04T05:37:42.022650+0000","last_active":"2023-12-04T05:37:43.056484+0000","last_peered":"2023-12-04T05:37:43.056484+0000","last_clean":"2023-12-04T05:37:43.056484+0000","last_became_active":"2023-12-04T05:37:42.022186+0000","last_became_peered":"2023-12-04T05:37:42.022186+0000","last_unstale":"2023-12-04T05:37:43.056484+0000","last_undegraded":"2023-12-04T05:37:43.056484+0000","last_fullsized":"2023-12-04T05:37:43.056484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:19.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054287+0000","last_change":"2023-12-04T05:37:43.048636+0000","last_active":"2023-12-04T05:37:43.054287+0000","last_peered":"2023-12-04T05:37:43.054287+0000","last_clean":"2023-12-04T05:37:43.054287+0000","last_became_active":"2023-12-04T05:37:43.048286+0000","last_became_peered":"2023-12-04T05:37:43.048286+0000","last_unstale":"2023-12-04T05:37:43.054287+0000","last_undegraded":"2023-12-04T05:37:43.054287+0000","last_fullsized":"2023-12-04T05:37:43.054287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:20.154897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004420+0000","last_change":"2023-12-04T05:37:24.365579+0000","last_active":"2023-12-04T05:37:42.004420+0000","last_peered":"2023-12-04T05:37:42.004420+0000","last_clean":"2023-12-04T05:37:42.004420+0000","last_became_active":"2023-12-04T05:37:24.364918+0000","last_became_peered":"2023-12-04T05:37:24.364918+0000","last_unstale":"2023-12-04T05:37:42.004420+0000","last_undegraded":"2023-12-04T05:37:42.004420+0000","last_fullsized":"2023-12-04T05:37:42.004420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:07.118802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993232+0000","last_change":"2023-12-04T05:37:24.990350+0000","last_active":"2023-12-04T05:37:41.993232+0000","last_peered":"2023-12-04T05:37:41.993232+0000","last_clean":"2023-12-04T05:37:41.993232+0000","last_became_active":"2023-12-04T05:37:24.990101+0000","last_became_peered":"2023-12-04T05:37:24.990101+0000","last_unstale":"2023-12-04T05:37:41.993232+0000","last_undegraded":"2023-12-04T05:37:41.993232+0000","last_fullsized":"2023-12-04T05:37:41.993232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.017885+0000","last_change":"2023-12-04T05:37:42.022452+0000","last_active":"2023-12-04T05:37:43.017885+0000","last_peered":"2023-12-04T05:37:43.017885+0000","last_clean":"2023-12-04T05:37:43.017885+0000","last_became_active":"2023-12-04T05:37:42.021977+0000","last_became_peered":"2023-12-04T05:37:42.021977+0000","last_unstale":"2023-12-04T05:37:43.017885+0000","last_undegraded":"2023-12-04T05:37:43.017885+0000","last_fullsized":"2023-12-04T05:37:43.017885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:29.224659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052198+0000","last_change":"2023-12-04T05:37:43.039583+0000","last_active":"2023-12-04T05:37:43.052198+0000","last_peered":"2023-12-04T05:37:43.052198+0000","last_clean":"2023-12-04T05:37:43.052198+0000","last_became_active":"2023-12-04T05:37:43.039313+0000","last_became_peered":"2023-12-04T05:37:43.039313+0000","last_unstale":"2023-12-04T05:37:43.052198+0000","last_undegraded":"2023-12-04T05:37:43.052198+0000","last_fullsized":"2023-12-04T05:37:43.052198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:38:14.622374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993520+0000","last_change":"2023-12-04T05:37:24.356767+0000","last_active":"2023-12-04T05:37:41.993520+0000","last_peered":"2023-12-04T05:37:41.993520+0000","last_clean":"2023-12-04T05:37:41.993520+0000","last_became_active":"2023-12-04T05:37:24.356474+0000","last_became_peered":"2023-12-04T05:37:24.356474+0000","last_unstale":"2023-12-04T05:37:41.993520+0000","last_undegraded":"2023-12-04T05:37:41.993520+0000","last_fullsized":"2023-12-04T05:37:41.993520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004322+0000","last_change":"2023-12-04T05:37:24.989352+0000","last_active":"2023-12-04T05:37:42.004322+0000","last_peered":"2023-12-04T05:37:42.004322+0000","last_clean":"2023-12-04T05:37:42.004322+0000","last_became_active":"2023-12-04T05:37:24.987078+0000","last_became_peered":"2023-12-04T05:37:24.987078+0000","last_unstale":"2023-12-04T05:37:42.004322+0000","last_undegraded":"2023-12-04T05:37:42.004322+0000","last_fullsized":"2023-12-04T05:37:42.004322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034757+0000","last_change":"2023-12-04T05:37:42.015491+0000","last_active":"2023-12-04T05:37:43.034757+0000","last_peered":"2023-12-04T05:37:43.034757+0000","last_clean":"2023-12-04T05:37:43.034757+0000","last_became_active":"2023-12-04T05:37:42.014782+0000","last_became_peered":"2023-12-04T05:37:42.014782+0000","last_unstale":"2023-12-04T05:37:43.034757+0000","last_undegraded":"2023-12-04T05:37:43.034757+0000","last_fullsized":"2023-12-04T05:37:43.034757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:19:36.946960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.029522+0000","last_change":"2023-12-04T05:37:43.024483+0000","last_active":"2023-12-04T05:37:43.029522+0000","last_peered":"2023-12-04T05:37:43.029522+0000","last_clean":"2023-12-04T05:37:43.029522+0000","last_became_active":"2023-12-04T05:37:43.024100+0000","last_became_peered":"2023-12-04T05:37:43.024100+0000","last_unstale":"2023-12-04T05:37:43.029522+0000","last_undegraded":"2023-12-04T05:37:43.029522+0000","last_fullsized":"2023-12-04T05:37:43.029522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002987+0000","last_change":"2023-12-04T05:37:24.365186+0000","last_active":"2023-12-04T05:37:42.002987+0000","last_peered":"2023-12-04T05:37:42.002987+0000","last_clean":"2023-12-04T05:37:42.002987+0000","last_became_active":"2023-12-04T05:37:24.360434+0000","last_became_peered":"2023-12-04T05:37:24.360434+0000","last_unstale":"2023-12-04T05:37:42.002987+0000","last_undegraded":"2023-12-04T05:37:42.002987+0000","last_fullsized":"2023-12-04T05:37:42.002987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:13.274968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990580+0000","last_change":"2023-12-04T05:37:24.985550+0000","last_active":"2023-12-04T05:37:41.990580+0000","last_peered":"2023-12-04T05:37:41.990580+0000","last_clean":"2023-12-04T05:37:41.990580+0000","last_became_active":"2023-12-04T05:37:24.984659+0000","last_became_peered":"2023-12-04T05:37:24.984659+0000","last_unstale":"2023-12-04T05:37:41.990580+0000","last_undegraded":"2023-12-04T05:37:41.990580+0000","last_fullsized":"2023-12-04T05:37:41.990580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040856+0000","last_change":"2023-12-04T05:37:42.012100+0000","last_active":"2023-12-04T05:37:43.040856+0000","last_peered":"2023-12-04T05:37:43.040856+0000","last_clean":"2023-12-04T05:37:43.040856+0000","last_became_active":"2023-12-04T05:37:42.011773+0000","last_became_peered":"2023-12-04T05:37:42.011773+0000","last_unstale":"2023-12-04T05:37:43.040856+0000","last_undegraded":"2023-12-04T05:37:43.040856+0000","last_fullsized":"2023-12-04T05:37:43.040856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:38.831090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048955+0000","last_change":"2023-12-04T05:37:43.043735+0000","last_active":"2023-12-04T05:37:43.048955+0000","last_peered":"2023-12-04T05:37:43.048955+0000","last_clean":"2023-12-04T05:37:43.048955+0000","last_became_active":"2023-12-04T05:37:43.042794+0000","last_became_peered":"2023-12-04T05:37:43.042794+0000","last_unstale":"2023-12-04T05:37:43.048955+0000","last_undegraded":"2023-12-04T05:37:43.048955+0000","last_fullsized":"2023-12-04T05:37:43.048955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:39.837260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990971+0000","last_change":"2023-12-04T05:37:24.362595+0000","last_active":"2023-12-04T05:37:41.990971+0000","last_peered":"2023-12-04T05:37:41.990971+0000","last_clean":"2023-12-04T05:37:41.990971+0000","last_became_active":"2023-12-04T05:37:24.361717+0000","last_became_peered":"2023-12-04T05:37:24.361717+0000","last_unstale":"2023-12-04T05:37:41.990971+0000","last_undegraded":"2023-12-04T05:37:41.990971+0000","last_fullsized":"2023-12-04T05:37:41.990971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.011818+0000","last_change":"2023-12-04T05:37:24.993989+0000","last_active":"2023-12-04T05:37:42.011818+0000","last_peered":"2023-12-04T05:37:42.011818+0000","last_clean":"2023-12-04T05:37:42.011818+0000","last_became_active":"2023-12-04T05:37:24.990547+0000","last_became_peered":"2023-12-04T05:37:24.990547+0000","last_unstale":"2023-12-04T05:37:42.011818+0000","last_undegraded":"2023-12-04T05:37:42.011818+0000","last_fullsized":"2023-12-04T05:37:42.011818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:18.892510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034407+0000","last_change":"2023-12-04T05:37:42.009271+0000","last_active":"2023-12-04T05:37:43.034407+0000","last_peered":"2023-12-04T05:37:43.034407+0000","last_clean":"2023-12-04T05:37:43.034407+0000","last_became_active":"2023-12-04T05:37:42.008976+0000","last_became_peered":"2023-12-04T05:37:42.008976+0000","last_unstale":"2023-12-04T05:37:43.034407+0000","last_undegraded":"2023-12-04T05:37:43.034407+0000","last_fullsized":"2023-12-04T05:37:43.034407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:44.901531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056177+0000","last_change":"2023-12-04T05:37:43.051695+0000","last_active":"2023-12-04T05:37:43.056177+0000","last_peered":"2023-12-04T05:37:43.056177+0000","last_clean":"2023-12-04T05:37:43.056177+0000","last_became_active":"2023-12-04T05:37:43.051435+0000","last_became_peered":"2023-12-04T05:37:43.051435+0000","last_unstale":"2023-12-04T05:37:43.056177+0000","last_undegraded":"2023-12-04T05:37:43.056177+0000","last_fullsized":"2023-12-04T05:37:43.056177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:23.130464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005631+0000","last_change":"2023-12-04T05:37:24.363919+0000","last_active":"2023-12-04T05:37:42.005631+0000","last_peered":"2023-12-04T05:37:42.005631+0000","last_clean":"2023-12-04T05:37:42.005631+0000","last_became_active":"2023-12-04T05:37:24.363592+0000","last_became_peered":"2023-12-04T05:37:24.363592+0000","last_unstale":"2023-12-04T05:37:42.005631+0000","last_undegraded":"2023-12-04T05:37:42.005631+0000","last_fullsized":"2023-12-04T05:37:42.005631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990696+0000","last_change":"2023-12-04T05:37:24.985398+0000","last_active":"2023-12-04T05:37:41.990696+0000","last_peered":"2023-12-04T05:37:41.990696+0000","last_clean":"2023-12-04T05:37:41.990696+0000","last_became_active":"2023-12-04T05:37:24.985152+0000","last_became_peered":"2023-12-04T05:37:24.985152+0000","last_unstale":"2023-12-04T05:37:41.990696+0000","last_undegraded":"2023-12-04T05:37:41.990696+0000","last_fullsized":"2023-12-04T05:37:41.990696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.014337+0000","last_change":"2023-12-04T05:37:42.020510+0000","last_active":"2023-12-04T05:37:43.014337+0000","last_peered":"2023-12-04T05:37:43.014337+0000","last_clean":"2023-12-04T05:37:43.014337+0000","last_became_active":"2023-12-04T05:37:42.020307+0000","last_became_peered":"2023-12-04T05:37:42.020307+0000","last_unstale":"2023-12-04T05:37:43.014337+0000","last_undegraded":"2023-12-04T05:37:43.014337+0000","last_fullsized":"2023-12-04T05:37:43.014337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:26:09.999796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053104+0000","last_change":"2023-12-04T05:37:43.050422+0000","last_active":"2023-12-04T05:37:43.053104+0000","last_peered":"2023-12-04T05:37:43.053104+0000","last_clean":"2023-12-04T05:37:43.053104+0000","last_became_active":"2023-12-04T05:37:43.050087+0000","last_became_peered":"2023-12-04T05:37:43.050087+0000","last_unstale":"2023-12-04T05:37:43.053104+0000","last_undegraded":"2023-12-04T05:37:43.053104+0000","last_fullsized":"2023-12-04T05:37:43.053104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:56:33.810382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991311+0000","last_change":"2023-12-04T05:37:24.366158+0000","last_active":"2023-12-04T05:37:41.991311+0000","last_peered":"2023-12-04T05:37:41.991311+0000","last_clean":"2023-12-04T05:37:41.991311+0000","last_became_active":"2023-12-04T05:37:24.365900+0000","last_became_peered":"2023-12-04T05:37:24.365900+0000","last_unstale":"2023-12-04T05:37:41.991311+0000","last_undegraded":"2023-12-04T05:37:41.991311+0000","last_fullsized":"2023-12-04T05:37:41.991311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005576+0000","last_change":"2023-12-04T05:37:24.997150+0000","last_active":"2023-12-04T05:37:42.005576+0000","last_peered":"2023-12-04T05:37:42.005576+0000","last_clean":"2023-12-04T05:37:42.005576+0000","last_became_active":"2023-12-04T05:37:24.996748+0000","last_became_peered":"2023-12-04T05:37:24.996748+0000","last_unstale":"2023-12-04T05:37:42.005576+0000","last_undegraded":"2023-12-04T05:37:42.005576+0000","last_fullsized":"2023-12-04T05:37:42.005576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.035023+0000","last_change":"2023-12-04T05:37:42.014666+0000","last_active":"2023-12-04T05:37:43.035023+0000","last_peered":"2023-12-04T05:37:43.035023+0000","last_clean":"2023-12-04T05:37:43.035023+0000","last_became_active":"2023-12-04T05:37:42.014380+0000","last_became_peered":"2023-12-04T05:37:42.014380+0000","last_unstale":"2023-12-04T05:37:43.035023+0000","last_undegraded":"2023-12-04T05:37:43.035023+0000","last_fullsized":"2023-12-04T05:37:43.035023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:29.224659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.041947+0000","last_change":"2023-12-04T05:37:43.032271+0000","last_active":"2023-12-04T05:37:43.041947+0000","last_peered":"2023-12-04T05:37:43.041947+0000","last_clean":"2023-12-04T05:37:43.041947+0000","last_became_active":"2023-12-04T05:37:43.031977+0000","last_became_peered":"2023-12-04T05:37:43.031977+0000","last_unstale":"2023-12-04T05:37:43.041947+0000","last_undegraded":"2023-12-04T05:37:43.041947+0000","last_fullsized":"2023-12-04T05:37:43.041947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:07:12.958817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005019+0000","last_change":"2023-12-04T05:37:24.363906+0000","last_active":"2023-12-04T05:37:42.005019+0000","last_peered":"2023-12-04T05:37:42.005019+0000","last_clean":"2023-12-04T05:37:42.005019+0000","last_became_active":"2023-12-04T05:37:24.363600+0000","last_became_peered":"2023-12-04T05:37:24.363600+0000","last_unstale":"2023-12-04T05:37:42.005019+0000","last_undegraded":"2023-12-04T05:37:42.005019+0000","last_fullsized":"2023-12-04T05:37:42.005019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:40.789742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003166+0000","last_change":"2023-12-04T05:37:24.993427+0000","last_active":"2023-12-04T05:37:42.003166+0000","last_peered":"2023-12-04T05:37:42.003166+0000","last_clean":"2023-12-04T05:37:42.003166+0000","last_became_active":"2023-12-04T05:37:24.993085+0000","last_became_peered":"2023-12-04T05:37:24.993085+0000","last_unstale":"2023-12-04T05:37:42.003166+0000","last_undegraded":"2023-12-04T05:37:42.003166+0000","last_fullsized":"2023-12-04T05:37:42.003166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:01:20.885419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.036526+0000","last_change":"2023-12-04T05:37:42.020282+0000","last_active":"2023-12-04T05:37:43.036526+0000","last_peered":"2023-12-04T05:37:43.036526+0000","last_clean":"2023-12-04T05:37:43.036526+0000","last_became_active":"2023-12-04T05:37:42.019997+0000","last_became_peered":"2023-12-04T05:37:42.019997+0000","last_unstale":"2023-12-04T05:37:43.036526+0000","last_undegraded":"2023-12-04T05:37:43.036526+0000","last_fullsized":"2023-12-04T05:37:43.036526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:49.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056403+0000","last_change":"2023-12-04T05:37:43.043196+0000","last_active":"2023-12-04T05:37:43.056403+0000","last_peered":"2023-12-04T05:37:43.056403+0000","last_clean":"2023-12-04T05:37:43.056403+0000","last_became_active":"2023-12-04T05:37:43.043023+0000","last_became_peered":"2023-12-04T05:37:43.043023+0000","last_unstale":"2023-12-04T05:37:43.056403+0000","last_undegraded":"2023-12-04T05:37:43.056403+0000","last_fullsized":"2023-12-04T05:37:43.056403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004489+0000","last_change":"2023-12-04T05:37:24.365259+0000","last_active":"2023-12-04T05:37:42.004489+0000","last_peered":"2023-12-04T05:37:42.004489+0000","last_clean":"2023-12-04T05:37:42.004489+0000","last_became_active":"2023-12-04T05:37:24.364959+0000","last_became_peered":"2023-12-04T05:37:24.364959+0000","last_unstale":"2023-12-04T05:37:42.004489+0000","last_undegraded":"2023-12-04T05:37:42.004489+0000","last_fullsized":"2023-12-04T05:37:42.004489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996401+0000","last_change":"2023-12-04T05:37:25.001416+0000","last_active":"2023-12-04T05:37:41.996401+0000","last_peered":"2023-12-04T05:37:41.996401+0000","last_clean":"2023-12-04T05:37:41.996401+0000","last_became_active":"2023-12-04T05:37:25.001105+0000","last_became_peered":"2023-12-04T05:37:25.001105+0000","last_unstale":"2023-12-04T05:37:41.996401+0000","last_undegraded":"2023-12-04T05:37:41.996401+0000","last_fullsized":"2023-12-04T05:37:41.996401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.026669+0000","last_change":"2023-12-04T05:37:42.016036+0000","last_active":"2023-12-04T05:37:43.026669+0000","last_peered":"2023-12-04T05:37:43.026669+0000","last_clean":"2023-12-04T05:37:43.026669+0000","last_became_active":"2023-12-04T05:37:42.015754+0000","last_became_peered":"2023-12-04T05:37:42.015754+0000","last_unstale":"2023-12-04T05:37:43.026669+0000","last_undegraded":"2023-12-04T05:37:43.026669+0000","last_fullsized":"2023-12-04T05:37:43.026669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:39:25.095631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.044723+0000","last_change":"2023-12-04T05:37:43.037974+0000","last_active":"2023-12-04T05:37:43.044723+0000","last_peered":"2023-12-04T05:37:43.044723+0000","last_clean":"2023-12-04T05:37:43.044723+0000","last_became_active":"2023-12-04T05:37:43.037706+0000","last_became_peered":"2023-12-04T05:37:43.037706+0000","last_unstale":"2023-12-04T05:37:43.044723+0000","last_undegraded":"2023-12-04T05:37:43.044723+0000","last_fullsized":"2023-12-04T05:37:43.044723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:55:31.285725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993347+0000","last_change":"2023-12-04T05:37:24.364075+0000","last_active":"2023-12-04T05:37:41.993347+0000","last_peered":"2023-12-04T05:37:41.993347+0000","last_clean":"2023-12-04T05:37:41.993347+0000","last_became_active":"2023-12-04T05:37:24.363742+0000","last_became_peered":"2023-12-04T05:37:24.363742+0000","last_unstale":"2023-12-04T05:37:41.993347+0000","last_undegraded":"2023-12-04T05:37:41.993347+0000","last_fullsized":"2023-12-04T05:37:41.993347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004111+0000","last_change":"2023-12-04T05:37:24.989600+0000","last_active":"2023-12-04T05:37:42.004111+0000","last_peered":"2023-12-04T05:37:42.004111+0000","last_clean":"2023-12-04T05:37:42.004111+0000","last_became_active":"2023-12-04T05:37:24.989332+0000","last_became_peered":"2023-12-04T05:37:24.989332+0000","last_unstale":"2023-12-04T05:37:42.004111+0000","last_undegraded":"2023-12-04T05:37:42.004111+0000","last_fullsized":"2023-12-04T05:37:42.004111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:25:59.290418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046753+0000","last_change":"2023-12-04T05:37:42.014198+0000","last_active":"2023-12-04T05:37:43.046753+0000","last_peered":"2023-12-04T05:37:43.046753+0000","last_clean":"2023-12-04T05:37:43.046753+0000","last_became_active":"2023-12-04T05:37:42.013885+0000","last_became_peered":"2023-12-04T05:37:42.013885+0000","last_unstale":"2023-12-04T05:37:43.046753+0000","last_undegraded":"2023-12-04T05:37:43.046753+0000","last_fullsized":"2023-12-04T05:37:43.046753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:47:26.434154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058785+0000","last_change":"2023-12-04T05:37:43.051926+0000","last_active":"2023-12-04T05:37:43.058785+0000","last_peered":"2023-12-04T05:37:43.058785+0000","last_clean":"2023-12-04T05:37:43.058785+0000","last_became_active":"2023-12-04T05:37:43.051596+0000","last_became_peered":"2023-12-04T05:37:43.051596+0000","last_unstale":"2023-12-04T05:37:43.058785+0000","last_undegraded":"2023-12-04T05:37:43.058785+0000","last_fullsized":"2023-12-04T05:37:43.058785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:31:09.519131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.011908+0000","last_change":"2023-12-04T05:37:24.368752+0000","last_active":"2023-12-04T05:37:42.011908+0000","last_peered":"2023-12-04T05:37:42.011908+0000","last_clean":"2023-12-04T05:37:42.011908+0000","last_became_active":"2023-12-04T05:37:24.368382+0000","last_became_peered":"2023-12-04T05:37:24.368382+0000","last_unstale":"2023-12-04T05:37:42.011908+0000","last_undegraded":"2023-12-04T05:37:42.011908+0000","last_fullsized":"2023-12-04T05:37:42.011908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001212+0000","last_change":"2023-12-04T05:37:24.991115+0000","last_active":"2023-12-04T05:37:42.001212+0000","last_peered":"2023-12-04T05:37:42.001212+0000","last_clean":"2023-12-04T05:37:42.001212+0000","last_became_active":"2023-12-04T05:37:24.990185+0000","last_became_peered":"2023-12-04T05:37:24.990185+0000","last_unstale":"2023-12-04T05:37:42.001212+0000","last_undegraded":"2023-12-04T05:37:42.001212+0000","last_fullsized":"2023-12-04T05:37:42.001212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:41:57.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.031072+0000","last_change":"2023-12-04T05:37:42.013544+0000","last_active":"2023-12-04T05:37:43.031072+0000","last_peered":"2023-12-04T05:37:43.031072+0000","last_clean":"2023-12-04T05:37:43.031072+0000","last_became_active":"2023-12-04T05:37:42.012954+0000","last_became_peered":"2023-12-04T05:37:42.012954+0000","last_unstale":"2023-12-04T05:37:43.031072+0000","last_undegraded":"2023-12-04T05:37:43.031072+0000","last_fullsized":"2023-12-04T05:37:43.031072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048211+0000","last_change":"2023-12-04T05:37:43.034147+0000","last_active":"2023-12-04T05:37:43.048211+0000","last_peered":"2023-12-04T05:37:43.048211+0000","last_clean":"2023-12-04T05:37:43.048211+0000","last_became_active":"2023-12-04T05:37:43.033047+0000","last_became_peered":"2023-12-04T05:37:43.033047+0000","last_unstale":"2023-12-04T05:37:43.048211+0000","last_undegraded":"2023-12-04T05:37:43.048211+0000","last_fullsized":"2023-12-04T05:37:43.048211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:41.015271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990801+0000","last_change":"2023-12-04T05:37:24.355658+0000","last_active":"2023-12-04T05:37:41.990801+0000","last_peered":"2023-12-04T05:37:41.990801+0000","last_clean":"2023-12-04T05:37:41.990801+0000","last_became_active":"2023-12-04T05:37:24.353902+0000","last_became_peered":"2023-12-04T05:37:24.353902+0000","last_unstale":"2023-12-04T05:37:41.990801+0000","last_undegraded":"2023-12-04T05:37:41.990801+0000","last_fullsized":"2023-12-04T05:37:41.990801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:14.601761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998322+0000","last_change":"2023-12-04T05:37:24.992633+0000","last_active":"2023-12-04T05:37:41.998322+0000","last_peered":"2023-12-04T05:37:41.998322+0000","last_clean":"2023-12-04T05:37:41.998322+0000","last_became_active":"2023-12-04T05:37:24.992377+0000","last_became_peered":"2023-12-04T05:37:24.992377+0000","last_unstale":"2023-12-04T05:37:41.998322+0000","last_undegraded":"2023-12-04T05:37:41.998322+0000","last_fullsized":"2023-12-04T05:37:41.998322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:42.675557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040848+0000","last_change":"2023-12-04T05:37:42.000742+0000","last_active":"2023-12-04T05:37:43.040848+0000","last_peered":"2023-12-04T05:37:43.040848+0000","last_clean":"2023-12-04T05:37:43.040848+0000","last_became_active":"2023-12-04T05:37:42.000465+0000","last_became_peered":"2023-12-04T05:37:42.000465+0000","last_unstale":"2023-12-04T05:37:43.040848+0000","last_undegraded":"2023-12-04T05:37:43.040848+0000","last_fullsized":"2023-12-04T05:37:43.040848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:19.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053575+0000","last_change":"2023-12-04T05:37:43.045485+0000","last_active":"2023-12-04T05:37:43.053575+0000","last_peered":"2023-12-04T05:37:43.053575+0000","last_clean":"2023-12-04T05:37:43.053575+0000","last_became_active":"2023-12-04T05:37:43.045187+0000","last_became_peered":"2023-12-04T05:37:43.045187+0000","last_unstale":"2023-12-04T05:37:43.053575+0000","last_undegraded":"2023-12-04T05:37:43.053575+0000","last_fullsized":"2023-12-04T05:37:43.053575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993747+0000","last_change":"2023-12-04T05:37:24.364787+0000","last_active":"2023-12-04T05:37:41.993747+0000","last_peered":"2023-12-04T05:37:41.993747+0000","last_clean":"2023-12-04T05:37:41.993747+0000","last_became_active":"2023-12-04T05:37:24.364366+0000","last_became_peered":"2023-12-04T05:37:24.364366+0000","last_unstale":"2023-12-04T05:37:41.993747+0000","last_undegraded":"2023-12-04T05:37:41.993747+0000","last_fullsized":"2023-12-04T05:37:41.993747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:22.351209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998440+0000","last_change":"2023-12-04T05:37:25.005282+0000","last_active":"2023-12-04T05:37:41.998440+0000","last_peered":"2023-12-04T05:37:41.998440+0000","last_clean":"2023-12-04T05:37:41.998440+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:41.998440+0000","last_undegraded":"2023-12-04T05:37:41.998440+0000","last_fullsized":"2023-12-04T05:37:41.998440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:34.046063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056394+0000","last_change":"2023-12-04T05:37:42.014557+0000","last_active":"2023-12-04T05:37:43.056394+0000","last_peered":"2023-12-04T05:37:43.056394+0000","last_clean":"2023-12-04T05:37:43.056394+0000","last_became_active":"2023-12-04T05:37:42.013738+0000","last_became_peered":"2023-12-04T05:37:42.013738+0000","last_unstale":"2023-12-04T05:37:43.056394+0000","last_undegraded":"2023-12-04T05:37:43.056394+0000","last_fullsized":"2023-12-04T05:37:43.056394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:19.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050758+0000","last_change":"2023-12-04T05:37:43.032892+0000","last_active":"2023-12-04T05:37:43.050758+0000","last_peered":"2023-12-04T05:37:43.050758+0000","last_clean":"2023-12-04T05:37:43.050758+0000","last_became_active":"2023-12-04T05:37:43.032621+0000","last_became_peered":"2023-12-04T05:37:43.032621+0000","last_unstale":"2023-12-04T05:37:43.050758+0000","last_undegraded":"2023-12-04T05:37:43.050758+0000","last_fullsized":"2023-12-04T05:37:43.050758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:52.411582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997932+0000","last_change":"2023-12-04T05:37:24.363195+0000","last_active":"2023-12-04T05:37:41.997932+0000","last_peered":"2023-12-04T05:37:41.997932+0000","last_clean":"2023-12-04T05:37:41.997932+0000","last_became_active":"2023-12-04T05:37:24.362877+0000","last_became_peered":"2023-12-04T05:37:24.362877+0000","last_unstale":"2023-12-04T05:37:41.997932+0000","last_undegraded":"2023-12-04T05:37:41.997932+0000","last_fullsized":"2023-12-04T05:37:41.997932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003880+0000","last_change":"2023-12-04T05:37:24.990874+0000","last_active":"2023-12-04T05:37:42.003880+0000","last_peered":"2023-12-04T05:37:42.003880+0000","last_clean":"2023-12-04T05:37:42.003880+0000","last_became_active":"2023-12-04T05:37:24.990607+0000","last_became_peered":"2023-12-04T05:37:24.990607+0000","last_unstale":"2023-12-04T05:37:42.003880+0000","last_undegraded":"2023-12-04T05:37:42.003880+0000","last_fullsized":"2023-12-04T05:37:42.003880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054044+0000","last_change":"2023-12-04T05:37:42.014125+0000","last_active":"2023-12-04T05:37:43.054044+0000","last_peered":"2023-12-04T05:37:43.054044+0000","last_clean":"2023-12-04T05:37:43.054044+0000","last_became_active":"2023-12-04T05:37:42.013775+0000","last_became_peered":"2023-12-04T05:37:42.013775+0000","last_unstale":"2023-12-04T05:37:43.054044+0000","last_undegraded":"2023-12-04T05:37:43.054044+0000","last_fullsized":"2023-12-04T05:37:43.054044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:39.090830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050783+0000","last_change":"2023-12-04T05:37:43.048566+0000","last_active":"2023-12-04T05:37:43.050783+0000","last_peered":"2023-12-04T05:37:43.050783+0000","last_clean":"2023-12-04T05:37:43.050783+0000","last_became_active":"2023-12-04T05:37:43.048308+0000","last_became_peered":"2023-12-04T05:37:43.048308+0000","last_unstale":"2023-12-04T05:37:43.050783+0000","last_undegraded":"2023-12-04T05:37:43.050783+0000","last_fullsized":"2023-12-04T05:37:43.050783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:25.782864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997692+0000","last_change":"2023-12-04T05:37:24.354656+0000","last_active":"2023-12-04T05:37:41.997692+0000","last_peered":"2023-12-04T05:37:41.997692+0000","last_clean":"2023-12-04T05:37:41.997692+0000","last_became_active":"2023-12-04T05:37:24.354318+0000","last_became_peered":"2023-12-04T05:37:24.354318+0000","last_unstale":"2023-12-04T05:37:41.997692+0000","last_undegraded":"2023-12-04T05:37:41.997692+0000","last_fullsized":"2023-12-04T05:37:41.997692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:38.730683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005503+0000","last_change":"2023-12-04T05:37:24.995956+0000","last_active":"2023-12-04T05:37:42.005503+0000","last_peered":"2023-12-04T05:37:42.005503+0000","last_clean":"2023-12-04T05:37:42.005503+0000","last_became_active":"2023-12-04T05:37:24.995700+0000","last_became_peered":"2023-12-04T05:37:24.995700+0000","last_unstale":"2023-12-04T05:37:42.005503+0000","last_undegraded":"2023-12-04T05:37:42.005503+0000","last_fullsized":"2023-12-04T05:37:42.005503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.015123+0000","last_change":"2023-12-04T05:37:42.019719+0000","last_active":"2023-12-04T05:37:43.015123+0000","last_peered":"2023-12-04T05:37:43.015123+0000","last_clean":"2023-12-04T05:37:43.015123+0000","last_became_active":"2023-12-04T05:37:42.017987+0000","last_became_peered":"2023-12-04T05:37:42.017987+0000","last_unstale":"2023-12-04T05:37:43.015123+0000","last_undegraded":"2023-12-04T05:37:43.015123+0000","last_fullsized":"2023-12-04T05:37:43.015123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:39:36.463815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034247+0000","last_change":"2023-12-04T05:37:43.031394+0000","last_active":"2023-12-04T05:37:43.034247+0000","last_peered":"2023-12-04T05:37:43.034247+0000","last_clean":"2023-12-04T05:37:43.034247+0000","last_became_active":"2023-12-04T05:37:43.030895+0000","last_became_peered":"2023-12-04T05:37:43.030895+0000","last_unstale":"2023-12-04T05:37:43.034247+0000","last_undegraded":"2023-12-04T05:37:43.034247+0000","last_fullsized":"2023-12-04T05:37:43.034247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:42.898961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004920+0000","last_change":"2023-12-04T05:37:24.364783+0000","last_active":"2023-12-04T05:37:42.004920+0000","last_peered":"2023-12-04T05:37:42.004920+0000","last_clean":"2023-12-04T05:37:42.004920+0000","last_became_active":"2023-12-04T05:37:24.364459+0000","last_became_peered":"2023-12-04T05:37:24.364459+0000","last_unstale":"2023-12-04T05:37:42.004920+0000","last_undegraded":"2023-12-04T05:37:42.004920+0000","last_fullsized":"2023-12-04T05:37:42.004920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:33.747521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997997+0000","last_change":"2023-12-04T05:37:24.991803+0000","last_active":"2023-12-04T05:37:41.997997+0000","last_peered":"2023-12-04T05:37:41.997997+0000","last_clean":"2023-12-04T05:37:41.997997+0000","last_became_active":"2023-12-04T05:37:24.991546+0000","last_became_peered":"2023-12-04T05:37:24.991546+0000","last_unstale":"2023-12-04T05:37:41.997997+0000","last_undegraded":"2023-12-04T05:37:41.997997+0000","last_fullsized":"2023-12-04T05:37:41.997997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:07.293940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056047+0000","last_change":"2023-12-04T05:37:42.018191+0000","last_active":"2023-12-04T05:37:43.056047+0000","last_peered":"2023-12-04T05:37:43.056047+0000","last_clean":"2023-12-04T05:37:43.056047+0000","last_became_active":"2023-12-04T05:37:42.017772+0000","last_became_peered":"2023-12-04T05:37:42.017772+0000","last_unstale":"2023-12-04T05:37:43.056047+0000","last_undegraded":"2023-12-04T05:37:43.056047+0000","last_fullsized":"2023-12-04T05:37:43.056047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:56:32.804212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058611+0000","last_change":"2023-12-04T05:37:43.052118+0000","last_active":"2023-12-04T05:37:43.058611+0000","last_peered":"2023-12-04T05:37:43.058611+0000","last_clean":"2023-12-04T05:37:43.058611+0000","last_became_active":"2023-12-04T05:37:43.049327+0000","last_became_peered":"2023-12-04T05:37:43.049327+0000","last_unstale":"2023-12-04T05:37:43.058611+0000","last_undegraded":"2023-12-04T05:37:43.058611+0000","last_fullsized":"2023-12-04T05:37:43.058611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.755917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004515+0000","last_change":"2023-12-04T05:37:24.370452+0000","last_active":"2023-12-04T05:37:42.004515+0000","last_peered":"2023-12-04T05:37:42.004515+0000","last_clean":"2023-12-04T05:37:42.004515+0000","last_became_active":"2023-12-04T05:37:24.369542+0000","last_became_peered":"2023-12-04T05:37:24.369542+0000","last_unstale":"2023-12-04T05:37:42.004515+0000","last_undegraded":"2023-12-04T05:37:42.004515+0000","last_fullsized":"2023-12-04T05:37:42.004515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:04.466402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012611+0000","last_change":"2023-12-04T05:37:24.987969+0000","last_active":"2023-12-04T05:37:42.012611+0000","last_peered":"2023-12-04T05:37:42.012611+0000","last_clean":"2023-12-04T05:37:42.012611+0000","last_became_active":"2023-12-04T05:37:24.986483+0000","last_became_peered":"2023-12-04T05:37:24.986483+0000","last_unstale":"2023-12-04T05:37:42.012611+0000","last_undegraded":"2023-12-04T05:37:42.012611+0000","last_fullsized":"2023-12-04T05:37:42.012611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:29.179535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034713+0000","last_change":"2023-12-04T05:37:42.010207+0000","last_active":"2023-12-04T05:37:43.034713+0000","last_peered":"2023-12-04T05:37:43.034713+0000","last_clean":"2023-12-04T05:37:43.034713+0000","last_became_active":"2023-12-04T05:37:42.009870+0000","last_became_peered":"2023-12-04T05:37:42.009870+0000","last_unstale":"2023-12-04T05:37:43.034713+0000","last_undegraded":"2023-12-04T05:37:43.034713+0000","last_fullsized":"2023-12-04T05:37:43.034713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:27:27.055823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056178+0000","last_change":"2023-12-04T05:37:43.051549+0000","last_active":"2023-12-04T05:37:43.056178+0000","last_peered":"2023-12-04T05:37:43.056178+0000","last_clean":"2023-12-04T05:37:43.056178+0000","last_became_active":"2023-12-04T05:37:43.051246+0000","last_became_peered":"2023-12-04T05:37:43.051246+0000","last_unstale":"2023-12-04T05:37:43.056178+0000","last_undegraded":"2023-12-04T05:37:43.056178+0000","last_fullsized":"2023-12-04T05:37:43.056178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:06.015701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004928+0000","last_change":"2023-12-04T05:37:24.365982+0000","last_active":"2023-12-04T05:37:42.004928+0000","last_peered":"2023-12-04T05:37:42.004928+0000","last_clean":"2023-12-04T05:37:42.004928+0000","last_became_active":"2023-12-04T05:37:24.365700+0000","last_became_peered":"2023-12-04T05:37:24.365700+0000","last_unstale":"2023-12-04T05:37:42.004928+0000","last_undegraded":"2023-12-04T05:37:42.004928+0000","last_fullsized":"2023-12-04T05:37:42.004928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:47.351640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996164+0000","last_change":"2023-12-04T05:37:25.001941+0000","last_active":"2023-12-04T05:37:41.996164+0000","last_peered":"2023-12-04T05:37:41.996164+0000","last_clean":"2023-12-04T05:37:41.996164+0000","last_became_active":"2023-12-04T05:37:24.998768+0000","last_became_peered":"2023-12-04T05:37:24.998768+0000","last_unstale":"2023-12-04T05:37:41.996164+0000","last_undegraded":"2023-12-04T05:37:41.996164+0000","last_fullsized":"2023-12-04T05:37:41.996164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058578+0000","last_change":"2023-12-04T05:37:42.018403+0000","last_active":"2023-12-04T05:37:43.058578+0000","last_peered":"2023-12-04T05:37:43.058578+0000","last_clean":"2023-12-04T05:37:43.058578+0000","last_became_active":"2023-12-04T05:37:42.017103+0000","last_became_peered":"2023-12-04T05:37:42.017103+0000","last_unstale":"2023-12-04T05:37:43.058578+0000","last_undegraded":"2023-12-04T05:37:43.058578+0000","last_fullsized":"2023-12-04T05:37:43.058578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:01:15.738122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045547+0000","last_change":"2023-12-04T05:37:43.043123+0000","last_active":"2023-12-04T05:37:43.045547+0000","last_peered":"2023-12-04T05:37:43.045547+0000","last_clean":"2023-12-04T05:37:43.045547+0000","last_became_active":"2023-12-04T05:37:43.042631+0000","last_became_peered":"2023-12-04T05:37:43.042631+0000","last_unstale":"2023-12-04T05:37:43.045547+0000","last_undegraded":"2023-12-04T05:37:43.045547+0000","last_fullsized":"2023-12-04T05:37:43.045547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:41:39.837260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002898+0000","last_change":"2023-12-04T05:37:24.355867+0000","last_active":"2023-12-04T05:37:42.002898+0000","last_peered":"2023-12-04T05:37:42.002898+0000","last_clean":"2023-12-04T05:37:42.002898+0000","last_became_active":"2023-12-04T05:37:24.354909+0000","last_became_peered":"2023-12-04T05:37:24.354909+0000","last_unstale":"2023-12-04T05:37:42.002898+0000","last_undegraded":"2023-12-04T05:37:42.002898+0000","last_fullsized":"2023-12-04T05:37:42.002898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006798+0000","last_change":"2023-12-04T05:37:24.990852+0000","last_active":"2023-12-04T05:37:42.006798+0000","last_peered":"2023-12-04T05:37:42.006798+0000","last_clean":"2023-12-04T05:37:42.006798+0000","last_became_active":"2023-12-04T05:37:24.990594+0000","last_became_peered":"2023-12-04T05:37:24.990594+0000","last_unstale":"2023-12-04T05:37:42.006798+0000","last_undegraded":"2023-12-04T05:37:42.006798+0000","last_fullsized":"2023-12-04T05:37:42.006798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:18.586799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.066080+0000","last_change":"2023-12-04T05:37:42.016258+0000","last_active":"2023-12-04T05:37:43.066080+0000","last_peered":"2023-12-04T05:37:43.066080+0000","last_clean":"2023-12-04T05:37:43.066080+0000","last_became_active":"2023-12-04T05:37:42.015861+0000","last_became_peered":"2023-12-04T05:37:42.015861+0000","last_unstale":"2023-12-04T05:37:43.066080+0000","last_undegraded":"2023-12-04T05:37:43.066080+0000","last_fullsized":"2023-12-04T05:37:43.066080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040083+0000","last_change":"2023-12-04T05:37:43.033980+0000","last_active":"2023-12-04T05:37:43.040083+0000","last_peered":"2023-12-04T05:37:43.040083+0000","last_clean":"2023-12-04T05:37:43.040083+0000","last_became_active":"2023-12-04T05:37:43.033686+0000","last_became_peered":"2023-12-04T05:37:43.033686+0000","last_unstale":"2023-12-04T05:37:43.040083+0000","last_undegraded":"2023-12-04T05:37:43.040083+0000","last_fullsized":"2023-12-04T05:37:43.040083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:04.723719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993384+0000","last_change":"2023-12-04T05:37:24.354980+0000","last_active":"2023-12-04T05:37:41.993384+0000","last_peered":"2023-12-04T05:37:41.993384+0000","last_clean":"2023-12-04T05:37:41.993384+0000","last_became_active":"2023-12-04T05:37:24.354672+0000","last_became_peered":"2023-12-04T05:37:24.354672+0000","last_unstale":"2023-12-04T05:37:41.993384+0000","last_undegraded":"2023-12-04T05:37:41.993384+0000","last_fullsized":"2023-12-04T05:37:41.993384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.002798+0000","last_change":"2023-12-04T05:37:24.995114+0000","last_active":"2023-12-04T05:37:42.002798+0000","last_peered":"2023-12-04T05:37:42.002798+0000","last_clean":"2023-12-04T05:37:42.002798+0000","last_became_active":"2023-12-04T05:37:24.994792+0000","last_became_peered":"2023-12-04T05:37:24.994792+0000","last_unstale":"2023-12-04T05:37:42.002798+0000","last_undegraded":"2023-12-04T05:37:42.002798+0000","last_fullsized":"2023-12-04T05:37:42.002798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:32.198350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.013869+0000","last_change":"2023-12-04T05:37:42.018389+0000","last_active":"2023-12-04T05:37:43.013869+0000","last_peered":"2023-12-04T05:37:43.013869+0000","last_clean":"2023-12-04T05:37:43.013869+0000","last_became_active":"2023-12-04T05:37:42.016913+0000","last_became_peered":"2023-12-04T05:37:42.016913+0000","last_unstale":"2023-12-04T05:37:43.013869+0000","last_undegraded":"2023-12-04T05:37:43.013869+0000","last_fullsized":"2023-12-04T05:37:43.013869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:16:37.948109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050338+0000","last_change":"2023-12-04T05:37:43.046990+0000","last_active":"2023-12-04T05:37:43.050338+0000","last_peered":"2023-12-04T05:37:43.050338+0000","last_clean":"2023-12-04T05:37:43.050338+0000","last_became_active":"2023-12-04T05:37:43.046733+0000","last_became_peered":"2023-12-04T05:37:43.046733+0000","last_unstale":"2023-12-04T05:37:43.050338+0000","last_undegraded":"2023-12-04T05:37:43.050338+0000","last_fullsized":"2023-12-04T05:37:43.050338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:04.723719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'9","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.009772+0000","last_change":"2023-12-04T05:37:24.355898+0000","last_active":"2023-12-04T05:37:42.009772+0000","last_peered":"2023-12-04T05:37:42.009772+0000","last_clean":"2023-12-04T05:37:42.009772+0000","last_became_active":"2023-12-04T05:37:24.355292+0000","last_became_peered":"2023-12-04T05:37:24.355292+0000","last_unstale":"2023-12-04T05:37:42.009772+0000","last_undegraded":"2023-12-04T05:37:42.009772+0000","last_fullsized":"2023-12-04T05:37:42.009772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:42.819254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005488+0000","last_change":"2023-12-04T05:37:24.997014+0000","last_active":"2023-12-04T05:37:42.005488+0000","last_peered":"2023-12-04T05:37:42.005488+0000","last_clean":"2023-12-04T05:37:42.005488+0000","last_became_active":"2023-12-04T05:37:24.996398+0000","last_became_peered":"2023-12-04T05:37:24.996398+0000","last_unstale":"2023-12-04T05:37:42.005488+0000","last_undegraded":"2023-12-04T05:37:42.005488+0000","last_fullsized":"2023-12-04T05:37:42.005488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.048700+0000","last_change":"2023-12-04T05:37:42.000874+0000","last_active":"2023-12-04T05:37:43.048700+0000","last_peered":"2023-12-04T05:37:43.048700+0000","last_clean":"2023-12-04T05:37:43.048700+0000","last_became_active":"2023-12-04T05:37:42.000404+0000","last_became_peered":"2023-12-04T05:37:42.000404+0000","last_unstale":"2023-12-04T05:37:43.048700+0000","last_undegraded":"2023-12-04T05:37:43.048700+0000","last_fullsized":"2023-12-04T05:37:43.048700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:01.408364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055979+0000","last_change":"2023-12-04T05:37:43.051776+0000","last_active":"2023-12-04T05:37:43.055979+0000","last_peered":"2023-12-04T05:37:43.055979+0000","last_clean":"2023-12-04T05:37:43.055979+0000","last_became_active":"2023-12-04T05:37:43.051246+0000","last_became_peered":"2023-12-04T05:37:43.051246+0000","last_unstale":"2023-12-04T05:37:43.055979+0000","last_undegraded":"2023-12-04T05:37:43.055979+0000","last_fullsized":"2023-12-04T05:37:43.055979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:30.494066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005093+0000","last_change":"2023-12-04T05:37:24.360821+0000","last_active":"2023-12-04T05:37:42.005093+0000","last_peered":"2023-12-04T05:37:42.005093+0000","last_clean":"2023-12-04T05:37:42.005093+0000","last_became_active":"2023-12-04T05:37:24.360531+0000","last_became_peered":"2023-12-04T05:37:24.360531+0000","last_unstale":"2023-12-04T05:37:42.005093+0000","last_undegraded":"2023-12-04T05:37:42.005093+0000","last_fullsized":"2023-12-04T05:37:42.005093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.009733+0000","last_change":"2023-12-04T05:37:25.006262+0000","last_active":"2023-12-04T05:37:42.009733+0000","last_peered":"2023-12-04T05:37:42.009733+0000","last_clean":"2023-12-04T05:37:42.009733+0000","last_became_active":"2023-12-04T05:37:25.004990+0000","last_became_peered":"2023-12-04T05:37:25.004990+0000","last_unstale":"2023-12-04T05:37:42.009733+0000","last_undegraded":"2023-12-04T05:37:42.009733+0000","last_fullsized":"2023-12-04T05:37:42.009733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:30:51.863125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.018763+0000","last_change":"2023-12-04T05:37:42.007903+0000","last_active":"2023-12-04T05:37:43.018763+0000","last_peered":"2023-12-04T05:37:43.018763+0000","last_clean":"2023-12-04T05:37:43.018763+0000","last_became_active":"2023-12-04T05:37:42.007429+0000","last_became_peered":"2023-12-04T05:37:42.007429+0000","last_unstale":"2023-12-04T05:37:43.018763+0000","last_undegraded":"2023-12-04T05:37:43.018763+0000","last_fullsized":"2023-12-04T05:37:43.018763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050550+0000","last_change":"2023-12-04T05:37:43.048283+0000","last_active":"2023-12-04T05:37:43.050550+0000","last_peered":"2023-12-04T05:37:43.050550+0000","last_clean":"2023-12-04T05:37:43.050550+0000","last_became_active":"2023-12-04T05:37:43.048011+0000","last_became_peered":"2023-12-04T05:37:43.048011+0000","last_unstale":"2023-12-04T05:37:43.050550+0000","last_undegraded":"2023-12-04T05:37:43.050550+0000","last_fullsized":"2023-12-04T05:37:43.050550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:39:26.101801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991271+0000","last_change":"2023-12-04T05:37:24.364875+0000","last_active":"2023-12-04T05:37:41.991271+0000","last_peered":"2023-12-04T05:37:41.991271+0000","last_clean":"2023-12-04T05:37:41.991271+0000","last_became_active":"2023-12-04T05:37:24.364601+0000","last_became_peered":"2023-12-04T05:37:24.364601+0000","last_unstale":"2023-12-04T05:37:41.991271+0000","last_undegraded":"2023-12-04T05:37:41.991271+0000","last_fullsized":"2023-12-04T05:37:41.991271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:45:28.171479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.019748+0000","last_change":"2023-12-04T05:37:24.996824+0000","last_active":"2023-12-04T05:37:42.019748+0000","last_peered":"2023-12-04T05:37:42.019748+0000","last_clean":"2023-12-04T05:37:42.019748+0000","last_became_active":"2023-12-04T05:37:24.996612+0000","last_became_peered":"2023-12-04T05:37:24.996612+0000","last_unstale":"2023-12-04T05:37:42.019748+0000","last_undegraded":"2023-12-04T05:37:42.019748+0000","last_fullsized":"2023-12-04T05:37:42.019748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:17.183378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.062196+0000","last_change":"2023-12-04T05:37:42.009984+0000","last_active":"2023-12-04T05:37:43.062196+0000","last_peered":"2023-12-04T05:37:43.062196+0000","last_clean":"2023-12-04T05:37:43.062196+0000","last_became_active":"2023-12-04T05:37:42.009653+0000","last_became_peered":"2023-12-04T05:37:42.009653+0000","last_unstale":"2023-12-04T05:37:43.062196+0000","last_undegraded":"2023-12-04T05:37:43.062196+0000","last_fullsized":"2023-12-04T05:37:43.062196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:12:04.662207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.053710+0000","last_change":"2023-12-04T05:37:43.043375+0000","last_active":"2023-12-04T05:37:43.053710+0000","last_peered":"2023-12-04T05:37:43.053710+0000","last_clean":"2023-12-04T05:37:43.053710+0000","last_became_active":"2023-12-04T05:37:43.042716+0000","last_became_peered":"2023-12-04T05:37:43.042716+0000","last_unstale":"2023-12-04T05:37:43.053710+0000","last_undegraded":"2023-12-04T05:37:43.053710+0000","last_fullsized":"2023-12-04T05:37:43.053710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:38:56.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.019835+0000","last_change":"2023-12-04T05:37:24.367803+0000","last_active":"2023-12-04T05:37:42.019835+0000","last_peered":"2023-12-04T05:37:42.019835+0000","last_clean":"2023-12-04T05:37:42.019835+0000","last_became_active":"2023-12-04T05:37:24.367420+0000","last_became_peered":"2023-12-04T05:37:24.367420+0000","last_unstale":"2023-12-04T05:37:42.019835+0000","last_undegraded":"2023-12-04T05:37:42.019835+0000","last_fullsized":"2023-12-04T05:37:42.019835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:24.234900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005188+0000","last_change":"2023-12-04T05:37:24.999935+0000","last_active":"2023-12-04T05:37:42.005188+0000","last_peered":"2023-12-04T05:37:42.005188+0000","last_clean":"2023-12-04T05:37:42.005188+0000","last_became_active":"2023-12-04T05:37:24.999626+0000","last_became_peered":"2023-12-04T05:37:24.999626+0000","last_unstale":"2023-12-04T05:37:42.005188+0000","last_undegraded":"2023-12-04T05:37:42.005188+0000","last_fullsized":"2023-12-04T05:37:42.005188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045691+0000","last_change":"2023-12-04T05:37:42.020167+0000","last_active":"2023-12-04T05:37:43.045691+0000","last_peered":"2023-12-04T05:37:43.045691+0000","last_clean":"2023-12-04T05:37:43.045691+0000","last_became_active":"2023-12-04T05:37:42.019924+0000","last_became_peered":"2023-12-04T05:37:42.019924+0000","last_unstale":"2023-12-04T05:37:43.045691+0000","last_undegraded":"2023-12-04T05:37:43.045691+0000","last_fullsized":"2023-12-04T05:37:43.045691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:19.915796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.060080+0000","last_change":"2023-12-04T05:37:43.055492+0000","last_active":"2023-12-04T05:37:43.060080+0000","last_peered":"2023-12-04T05:37:43.060080+0000","last_clean":"2023-12-04T05:37:43.060080+0000","last_became_active":"2023-12-04T05:37:43.055227+0000","last_became_peered":"2023-12-04T05:37:43.055227+0000","last_unstale":"2023-12-04T05:37:43.060080+0000","last_undegraded":"2023-12-04T05:37:43.060080+0000","last_fullsized":"2023-12-04T05:37:43.060080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:48.936035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.992788+0000","last_change":"2023-12-04T05:37:24.354659+0000","last_active":"2023-12-04T05:37:41.992788+0000","last_peered":"2023-12-04T05:37:41.992788+0000","last_clean":"2023-12-04T05:37:41.992788+0000","last_became_active":"2023-12-04T05:37:24.354363+0000","last_became_peered":"2023-12-04T05:37:24.354363+0000","last_unstale":"2023-12-04T05:37:41.992788+0000","last_undegraded":"2023-12-04T05:37:41.992788+0000","last_fullsized":"2023-12-04T05:37:41.992788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:17.884455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001621+0000","last_change":"2023-12-04T05:37:24.996089+0000","last_active":"2023-12-04T05:37:42.001621+0000","last_peered":"2023-12-04T05:37:42.001621+0000","last_clean":"2023-12-04T05:37:42.001621+0000","last_became_active":"2023-12-04T05:37:24.995809+0000","last_became_peered":"2023-12-04T05:37:24.995809+0000","last_unstale":"2023-12-04T05:37:42.001621+0000","last_undegraded":"2023-12-04T05:37:42.001621+0000","last_fullsized":"2023-12-04T05:37:42.001621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050781+0000","last_change":"2023-12-04T05:37:42.015732+0000","last_active":"2023-12-04T05:37:43.050781+0000","last_peered":"2023-12-04T05:37:43.050781+0000","last_clean":"2023-12-04T05:37:43.050781+0000","last_became_active":"2023-12-04T05:37:42.014482+0000","last_became_peered":"2023-12-04T05:37:42.014482+0000","last_unstale":"2023-12-04T05:37:43.050781+0000","last_undegraded":"2023-12-04T05:37:43.050781+0000","last_fullsized":"2023-12-04T05:37:43.050781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:44.901531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039662+0000","last_change":"2023-12-04T05:37:43.036113+0000","last_active":"2023-12-04T05:37:43.039662+0000","last_peered":"2023-12-04T05:37:43.039662+0000","last_clean":"2023-12-04T05:37:43.039662+0000","last_became_active":"2023-12-04T05:37:43.035852+0000","last_became_peered":"2023-12-04T05:37:43.035852+0000","last_unstale":"2023-12-04T05:37:43.039662+0000","last_undegraded":"2023-12-04T05:37:43.039662+0000","last_fullsized":"2023-12-04T05:37:43.039662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:07:12.958817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005033+0000","last_change":"2023-12-04T05:37:24.360838+0000","last_active":"2023-12-04T05:37:42.005033+0000","last_peered":"2023-12-04T05:37:42.005033+0000","last_clean":"2023-12-04T05:37:42.005033+0000","last_became_active":"2023-12-04T05:37:24.360507+0000","last_became_peered":"2023-12-04T05:37:24.360507+0000","last_unstale":"2023-12-04T05:37:42.005033+0000","last_undegraded":"2023-12-04T05:37:42.005033+0000","last_fullsized":"2023-12-04T05:37:42.005033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:50.159358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.992702+0000","last_change":"2023-12-04T05:37:24.981306+0000","last_active":"2023-12-04T05:37:41.992702+0000","last_peered":"2023-12-04T05:37:41.992702+0000","last_clean":"2023-12-04T05:37:41.992702+0000","last_became_active":"2023-12-04T05:37:24.980836+0000","last_became_peered":"2023-12-04T05:37:24.980836+0000","last_unstale":"2023-12-04T05:37:41.992702+0000","last_undegraded":"2023-12-04T05:37:41.992702+0000","last_fullsized":"2023-12-04T05:37:41.992702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046683+0000","last_change":"2023-12-04T05:37:42.014112+0000","last_active":"2023-12-04T05:37:43.046683+0000","last_peered":"2023-12-04T05:37:43.046683+0000","last_clean":"2023-12-04T05:37:43.046683+0000","last_became_active":"2023-12-04T05:37:42.013883+0000","last_became_peered":"2023-12-04T05:37:42.013883+0000","last_unstale":"2023-12-04T05:37:43.046683+0000","last_undegraded":"2023-12-04T05:37:43.046683+0000","last_fullsized":"2023-12-04T05:37:43.046683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:31.197406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.037052+0000","last_change":"2023-12-04T05:37:43.032937+0000","last_active":"2023-12-04T05:37:43.037052+0000","last_peered":"2023-12-04T05:37:43.037052+0000","last_clean":"2023-12-04T05:37:43.037052+0000","last_became_active":"2023-12-04T05:37:43.032655+0000","last_became_peered":"2023-12-04T05:37:43.032655+0000","last_unstale":"2023-12-04T05:37:43.037052+0000","last_undegraded":"2023-12-04T05:37:43.037052+0000","last_fullsized":"2023-12-04T05:37:43.037052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:54.799040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.997026+0000","last_change":"2023-12-04T05:37:24.362048+0000","last_active":"2023-12-04T05:37:41.997026+0000","last_peered":"2023-12-04T05:37:41.997026+0000","last_clean":"2023-12-04T05:37:41.997026+0000","last_became_active":"2023-12-04T05:37:24.361734+0000","last_became_peered":"2023-12-04T05:37:24.361734+0000","last_unstale":"2023-12-04T05:37:41.997026+0000","last_undegraded":"2023-12-04T05:37:41.997026+0000","last_fullsized":"2023-12-04T05:37:41.997026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004515+0000","last_change":"2023-12-04T05:37:24.998367+0000","last_active":"2023-12-04T05:37:42.004515+0000","last_peered":"2023-12-04T05:37:42.004515+0000","last_clean":"2023-12-04T05:37:42.004515+0000","last_became_active":"2023-12-04T05:37:24.997864+0000","last_became_peered":"2023-12-04T05:37:24.997864+0000","last_unstale":"2023-12-04T05:37:42.004515+0000","last_undegraded":"2023-12-04T05:37:42.004515+0000","last_fullsized":"2023-12-04T05:37:42.004515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:43.827310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.040659+0000","last_change":"2023-12-04T05:37:42.006654+0000","last_active":"2023-12-04T05:37:43.040659+0000","last_peered":"2023-12-04T05:37:43.040659+0000","last_clean":"2023-12-04T05:37:43.040659+0000","last_became_active":"2023-12-04T05:37:42.006345+0000","last_became_peered":"2023-12-04T05:37:42.006345+0000","last_unstale":"2023-12-04T05:37:43.040659+0000","last_undegraded":"2023-12-04T05:37:43.040659+0000","last_fullsized":"2023-12-04T05:37:43.040659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058099+0000","last_change":"2023-12-04T05:37:43.046540+0000","last_active":"2023-12-04T05:37:43.058099+0000","last_peered":"2023-12-04T05:37:43.058099+0000","last_clean":"2023-12-04T05:37:43.058099+0000","last_became_active":"2023-12-04T05:37:43.046237+0000","last_became_peered":"2023-12-04T05:37:43.046237+0000","last_unstale":"2023-12-04T05:37:43.058099+0000","last_undegraded":"2023-12-04T05:37:43.058099+0000","last_fullsized":"2023-12-04T05:37:43.058099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:36.448608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993276+0000","last_change":"2023-12-04T05:37:24.361558+0000","last_active":"2023-12-04T05:37:41.993276+0000","last_peered":"2023-12-04T05:37:41.993276+0000","last_clean":"2023-12-04T05:37:41.993276+0000","last_became_active":"2023-12-04T05:37:24.361213+0000","last_became_peered":"2023-12-04T05:37:24.361213+0000","last_unstale":"2023-12-04T05:37:41.993276+0000","last_undegraded":"2023-12-04T05:37:41.993276+0000","last_fullsized":"2023-12-04T05:37:41.993276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:54:39.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995515+0000","last_change":"2023-12-04T05:37:25.001831+0000","last_active":"2023-12-04T05:37:41.995515+0000","last_peered":"2023-12-04T05:37:41.995515+0000","last_clean":"2023-12-04T05:37:41.995515+0000","last_became_active":"2023-12-04T05:37:25.001421+0000","last_became_peered":"2023-12-04T05:37:25.001421+0000","last_unstale":"2023-12-04T05:37:41.995515+0000","last_undegraded":"2023-12-04T05:37:41.995515+0000","last_fullsized":"2023-12-04T05:37:41.995515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.025941+0000","last_change":"2023-12-04T05:37:42.013799+0000","last_active":"2023-12-04T05:37:43.025941+0000","last_peered":"2023-12-04T05:37:43.025941+0000","last_clean":"2023-12-04T05:37:43.025941+0000","last_became_active":"2023-12-04T05:37:42.013380+0000","last_became_peered":"2023-12-04T05:37:42.013380+0000","last_unstale":"2023-12-04T05:37:43.025941+0000","last_undegraded":"2023-12-04T05:37:43.025941+0000","last_fullsized":"2023-12-04T05:37:43.025941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:19:36.946960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.032124+0000","last_change":"2023-12-04T05:37:43.030056+0000","last_active":"2023-12-04T05:37:43.032124+0000","last_peered":"2023-12-04T05:37:43.032124+0000","last_clean":"2023-12-04T05:37:43.032124+0000","last_became_active":"2023-12-04T05:37:43.029617+0000","last_became_peered":"2023-12-04T05:37:43.029617+0000","last_unstale":"2023-12-04T05:37:43.032124+0000","last_undegraded":"2023-12-04T05:37:43.032124+0000","last_fullsized":"2023-12-04T05:37:43.032124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:01.483316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054309+0000","last_change":"2023-12-04T05:37:42.019312+0000","last_active":"2023-12-04T05:37:43.054309+0000","last_peered":"2023-12-04T05:37:43.054309+0000","last_clean":"2023-12-04T05:37:43.054309+0000","last_became_active":"2023-12-04T05:37:42.018806+0000","last_became_peered":"2023-12-04T05:37:42.018806+0000","last_unstale":"2023-12-04T05:37:43.054309+0000","last_undegraded":"2023-12-04T05:37:43.054309+0000","last_fullsized":"2023-12-04T05:37:43.054309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:43.935691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005839+0000","last_change":"2023-12-04T05:37:24.353356+0000","last_active":"2023-12-04T05:37:42.005839+0000","last_peered":"2023-12-04T05:37:42.005839+0000","last_clean":"2023-12-04T05:37:42.005839+0000","last_became_active":"2023-12-04T05:37:24.353060+0000","last_became_peered":"2023-12-04T05:37:24.353060+0000","last_unstale":"2023-12-04T05:37:42.005839+0000","last_undegraded":"2023-12-04T05:37:42.005839+0000","last_fullsized":"2023-12-04T05:37:42.005839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:15.976925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004851+0000","last_change":"2023-12-04T05:37:24.990915+0000","last_active":"2023-12-04T05:37:42.004851+0000","last_peered":"2023-12-04T05:37:42.004851+0000","last_clean":"2023-12-04T05:37:42.004851+0000","last_became_active":"2023-12-04T05:37:24.990302+0000","last_became_peered":"2023-12-04T05:37:24.990302+0000","last_unstale":"2023-12-04T05:37:42.004851+0000","last_undegraded":"2023-12-04T05:37:42.004851+0000","last_fullsized":"2023-12-04T05:37:42.004851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:51.167414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.047582+0000","last_change":"2023-12-04T05:37:43.041639+0000","last_active":"2023-12-04T05:37:43.047582+0000","last_peered":"2023-12-04T05:37:43.047582+0000","last_clean":"2023-12-04T05:37:43.047582+0000","last_became_active":"2023-12-04T05:37:43.041364+0000","last_became_peered":"2023-12-04T05:37:43.041364+0000","last_unstale":"2023-12-04T05:37:43.047582+0000","last_undegraded":"2023-12-04T05:37:43.047582+0000","last_fullsized":"2023-12-04T05:37:43.047582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052316+0000","last_change":"2023-12-04T05:37:42.019731+0000","last_active":"2023-12-04T05:37:43.052316+0000","last_peered":"2023-12-04T05:37:43.052316+0000","last_clean":"2023-12-04T05:37:43.052316+0000","last_became_active":"2023-12-04T05:37:42.018571+0000","last_became_peered":"2023-12-04T05:37:42.018571+0000","last_unstale":"2023-12-04T05:37:43.052316+0000","last_undegraded":"2023-12-04T05:37:43.052316+0000","last_fullsized":"2023-12-04T05:37:43.052316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:46:08.925815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.010887+0000","last_change":"2023-12-04T05:37:24.362899+0000","last_active":"2023-12-04T05:37:42.010887+0000","last_peered":"2023-12-04T05:37:42.010887+0000","last_clean":"2023-12-04T05:37:42.010887+0000","last_became_active":"2023-12-04T05:37:24.362589+0000","last_became_peered":"2023-12-04T05:37:24.362589+0000","last_unstale":"2023-12-04T05:37:42.010887+0000","last_undegraded":"2023-12-04T05:37:42.010887+0000","last_fullsized":"2023-12-04T05:37:42.010887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:52:59.772803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.993655+0000","last_change":"2023-12-04T05:37:24.991648+0000","last_active":"2023-12-04T05:37:41.993655+0000","last_peered":"2023-12-04T05:37:41.993655+0000","last_clean":"2023-12-04T05:37:41.993655+0000","last_became_active":"2023-12-04T05:37:24.991299+0000","last_became_peered":"2023-12-04T05:37:24.991299+0000","last_unstale":"2023-12-04T05:37:41.993655+0000","last_undegraded":"2023-12-04T05:37:41.993655+0000","last_fullsized":"2023-12-04T05:37:41.993655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056339+0000","last_change":"2023-12-04T05:37:43.047542+0000","last_active":"2023-12-04T05:37:43.056339+0000","last_peered":"2023-12-04T05:37:43.056339+0000","last_clean":"2023-12-04T05:37:43.056339+0000","last_became_active":"2023-12-04T05:37:43.047290+0000","last_became_peered":"2023-12-04T05:37:43.047290+0000","last_unstale":"2023-12-04T05:37:43.056339+0000","last_undegraded":"2023-12-04T05:37:43.056339+0000","last_fullsized":"2023-12-04T05:37:43.056339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991212+0000","last_change":"2023-12-04T05:37:24.367828+0000","last_active":"2023-12-04T05:37:41.991212+0000","last_peered":"2023-12-04T05:37:41.991212+0000","last_clean":"2023-12-04T05:37:41.991212+0000","last_became_active":"2023-12-04T05:37:24.367323+0000","last_became_peered":"2023-12-04T05:37:24.367323+0000","last_unstale":"2023-12-04T05:37:41.991212+0000","last_undegraded":"2023-12-04T05:37:41.991212+0000","last_fullsized":"2023-12-04T05:37:41.991212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:35:04.875081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018347+0000","last_change":"2023-12-04T05:37:24.989453+0000","last_active":"2023-12-04T05:37:42.018347+0000","last_peered":"2023-12-04T05:37:42.018347+0000","last_clean":"2023-12-04T05:37:42.018347+0000","last_became_active":"2023-12-04T05:37:24.988948+0000","last_became_peered":"2023-12-04T05:37:24.988948+0000","last_unstale":"2023-12-04T05:37:42.018347+0000","last_undegraded":"2023-12-04T05:37:42.018347+0000","last_fullsized":"2023-12-04T05:37:42.018347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:14.283024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046611+0000","last_change":"2023-12-04T05:37:42.015838+0000","last_active":"2023-12-04T05:37:43.046611+0000","last_peered":"2023-12-04T05:37:43.046611+0000","last_clean":"2023-12-04T05:37:43.046611+0000","last_became_active":"2023-12-04T05:37:42.015553+0000","last_became_peered":"2023-12-04T05:37:42.015553+0000","last_unstale":"2023-12-04T05:37:43.046611+0000","last_undegraded":"2023-12-04T05:37:43.046611+0000","last_fullsized":"2023-12-04T05:37:43.046611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:01.408364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034024+0000","last_change":"2023-12-04T05:37:43.030828+0000","last_active":"2023-12-04T05:37:43.034024+0000","last_peered":"2023-12-04T05:37:43.034024+0000","last_clean":"2023-12-04T05:37:43.034024+0000","last_became_active":"2023-12-04T05:37:43.030457+0000","last_became_peered":"2023-12-04T05:37:43.030457+0000","last_unstale":"2023-12-04T05:37:43.034024+0000","last_undegraded":"2023-12-04T05:37:43.034024+0000","last_fullsized":"2023-12-04T05:37:43.034024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:29.406769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018453+0000","last_change":"2023-12-04T05:37:24.359031+0000","last_active":"2023-12-04T05:37:42.018453+0000","last_peered":"2023-12-04T05:37:42.018453+0000","last_clean":"2023-12-04T05:37:42.018453+0000","last_became_active":"2023-12-04T05:37:24.358600+0000","last_became_peered":"2023-12-04T05:37:24.358600+0000","last_unstale":"2023-12-04T05:37:42.018453+0000","last_undegraded":"2023-12-04T05:37:42.018453+0000","last_fullsized":"2023-12-04T05:37:42.018453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:23.317049+0000","last_clean_scrub_stamp":"2023-12-04T05:37:23.317049+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:27:30.628915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991183+0000","last_change":"2023-12-04T05:37:24.999666+0000","last_active":"2023-12-04T05:37:41.991183+0000","last_peered":"2023-12-04T05:37:41.991183+0000","last_clean":"2023-12-04T05:37:41.991183+0000","last_became_active":"2023-12-04T05:37:24.999338+0000","last_became_peered":"2023-12-04T05:37:24.999338+0000","last_unstale":"2023-12-04T05:37:41.991183+0000","last_undegraded":"2023-12-04T05:37:41.991183+0000","last_fullsized":"2023-12-04T05:37:41.991183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056296+0000","last_change":"2023-12-04T05:37:42.014807+0000","last_active":"2023-12-04T05:37:43.056296+0000","last_peered":"2023-12-04T05:37:43.056296+0000","last_clean":"2023-12-04T05:37:43.056296+0000","last_became_active":"2023-12-04T05:37:42.014523+0000","last_became_peered":"2023-12-04T05:37:42.014523+0000","last_unstale":"2023-12-04T05:37:43.056296+0000","last_undegraded":"2023-12-04T05:37:43.056296+0000","last_fullsized":"2023-12-04T05:37:43.056296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:40.974941+0000","last_clean_scrub_stamp":"2023-12-04T05:37:40.974941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:28.400598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039769+0000","last_change":"2023-12-04T05:37:43.037334+0000","last_active":"2023-12-04T05:37:43.039769+0000","last_peered":"2023-12-04T05:37:43.039769+0000","last_clean":"2023-12-04T05:37:43.039769+0000","last_became_active":"2023-12-04T05:37:43.036736+0000","last_became_peered":"2023-12-04T05:37:43.036736+0000","last_unstale":"2023-12-04T05:37:43.039769+0000","last_undegraded":"2023-12-04T05:37:43.039769+0000","last_fullsized":"2023-12-04T05:37:43.039769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:36.242804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996047+0000","last_change":"2023-12-04T05:37:24.999330+0000","last_active":"2023-12-04T05:37:41.996047+0000","last_peered":"2023-12-04T05:37:41.996047+0000","last_clean":"2023-12-04T05:37:41.996047+0000","last_became_active":"2023-12-04T05:37:24.998449+0000","last_became_peered":"2023-12-04T05:37:24.998449+0000","last_unstale":"2023-12-04T05:37:41.996047+0000","last_undegraded":"2023-12-04T05:37:41.996047+0000","last_fullsized":"2023-12-04T05:37:41.996047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050687+0000","last_change":"2023-12-04T05:37:43.048258+0000","last_active":"2023-12-04T05:37:43.050687+0000","last_peered":"2023-12-04T05:37:43.050687+0000","last_clean":"2023-12-04T05:37:43.050687+0000","last_became_active":"2023-12-04T05:37:43.047968+0000","last_became_peered":"2023-12-04T05:37:43.047968+0000","last_unstale":"2023-12-04T05:37:43.050687+0000","last_undegraded":"2023-12-04T05:37:43.050687+0000","last_fullsized":"2023-12-04T05:37:43.050687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:18.436864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012495+0000","last_change":"2023-12-04T05:37:24.991739+0000","last_active":"2023-12-04T05:37:42.012495+0000","last_peered":"2023-12-04T05:37:42.012495+0000","last_clean":"2023-12-04T05:37:42.012495+0000","last_became_active":"2023-12-04T05:37:24.991386+0000","last_became_peered":"2023-12-04T05:37:24.991386+0000","last_unstale":"2023-12-04T05:37:42.012495+0000","last_undegraded":"2023-12-04T05:37:42.012495+0000","last_fullsized":"2023-12-04T05:37:42.012495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:03:39.738739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.049686+0000","last_change":"2023-12-04T05:37:43.041842+0000","last_active":"2023-12-04T05:37:43.049686+0000","last_peered":"2023-12-04T05:37:43.049686+0000","last_clean":"2023-12-04T05:37:43.049686+0000","last_became_active":"2023-12-04T05:37:43.041556+0000","last_became_peered":"2023-12-04T05:37:43.041556+0000","last_unstale":"2023-12-04T05:37:43.049686+0000","last_undegraded":"2023-12-04T05:37:43.049686+0000","last_fullsized":"2023-12-04T05:37:43.049686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:36.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995418+0000","last_change":"2023-12-04T05:37:25.001679+0000","last_active":"2023-12-04T05:37:41.995418+0000","last_peered":"2023-12-04T05:37:41.995418+0000","last_clean":"2023-12-04T05:37:41.995418+0000","last_became_active":"2023-12-04T05:37:25.001125+0000","last_became_peered":"2023-12-04T05:37:25.001125+0000","last_unstale":"2023-12-04T05:37:41.995418+0000","last_undegraded":"2023-12-04T05:37:41.995418+0000","last_fullsized":"2023-12-04T05:37:41.995418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039986+0000","last_change":"2023-12-04T05:37:43.032103+0000","last_active":"2023-12-04T05:37:43.039986+0000","last_peered":"2023-12-04T05:37:43.039986+0000","last_clean":"2023-12-04T05:37:43.039986+0000","last_became_active":"2023-12-04T05:37:43.031843+0000","last_became_peered":"2023-12-04T05:37:43.031843+0000","last_unstale":"2023-12-04T05:37:43.039986+0000","last_undegraded":"2023-12-04T05:37:43.039986+0000","last_fullsized":"2023-12-04T05:37:43.039986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:51:41.179473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991716+0000","last_change":"2023-12-04T05:37:24.985403+0000","last_active":"2023-12-04T05:37:41.991716+0000","last_peered":"2023-12-04T05:37:41.991716+0000","last_clean":"2023-12-04T05:37:41.991716+0000","last_became_active":"2023-12-04T05:37:24.985108+0000","last_became_peered":"2023-12-04T05:37:24.985108+0000","last_unstale":"2023-12-04T05:37:41.991716+0000","last_undegraded":"2023-12-04T05:37:41.991716+0000","last_fullsized":"2023-12-04T05:37:41.991716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.050779+0000","last_change":"2023-12-04T05:37:43.042506+0000","last_active":"2023-12-04T05:37:43.050779+0000","last_peered":"2023-12-04T05:37:43.050779+0000","last_clean":"2023-12-04T05:37:43.050779+0000","last_became_active":"2023-12-04T05:37:43.040106+0000","last_became_peered":"2023-12-04T05:37:43.040106+0000","last_unstale":"2023-12-04T05:37:43.050779+0000","last_undegraded":"2023-12-04T05:37:43.050779+0000","last_fullsized":"2023-12-04T05:37:43.050779+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:59.453804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005157+0000","last_change":"2023-12-04T05:37:24.993220+0000","last_active":"2023-12-04T05:37:42.005157+0000","last_peered":"2023-12-04T05:37:42.005157+0000","last_clean":"2023-12-04T05:37:42.005157+0000","last_became_active":"2023-12-04T05:37:24.992903+0000","last_became_peered":"2023-12-04T05:37:24.992903+0000","last_unstale":"2023-12-04T05:37:42.005157+0000","last_undegraded":"2023-12-04T05:37:42.005157+0000","last_fullsized":"2023-12-04T05:37:42.005157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:18.792602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.051629+0000","last_change":"2023-12-04T05:37:43.048237+0000","last_active":"2023-12-04T05:37:43.051629+0000","last_peered":"2023-12-04T05:37:43.051629+0000","last_clean":"2023-12-04T05:37:43.051629+0000","last_became_active":"2023-12-04T05:37:43.047939+0000","last_became_peered":"2023-12-04T05:37:43.047939+0000","last_unstale":"2023-12-04T05:37:43.051629+0000","last_undegraded":"2023-12-04T05:37:43.051629+0000","last_fullsized":"2023-12-04T05:37:43.051629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.755917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004749+0000","last_change":"2023-12-04T05:37:24.994373+0000","last_active":"2023-12-04T05:37:42.004749+0000","last_peered":"2023-12-04T05:37:42.004749+0000","last_clean":"2023-12-04T05:37:42.004749+0000","last_became_active":"2023-12-04T05:37:24.994052+0000","last_became_peered":"2023-12-04T05:37:24.994052+0000","last_unstale":"2023-12-04T05:37:42.004749+0000","last_undegraded":"2023-12-04T05:37:42.004749+0000","last_fullsized":"2023-12-04T05:37:42.004749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056583+0000","last_change":"2023-12-04T05:37:43.053488+0000","last_active":"2023-12-04T05:37:43.056583+0000","last_peered":"2023-12-04T05:37:43.056583+0000","last_clean":"2023-12-04T05:37:43.056583+0000","last_became_active":"2023-12-04T05:37:43.053259+0000","last_became_peered":"2023-12-04T05:37:43.053259+0000","last_unstale":"2023-12-04T05:37:43.056583+0000","last_undegraded":"2023-12-04T05:37:43.056583+0000","last_fullsized":"2023-12-04T05:37:43.056583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:44.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012970+0000","last_change":"2023-12-04T05:37:24.998832+0000","last_active":"2023-12-04T05:37:42.012970+0000","last_peered":"2023-12-04T05:37:42.012970+0000","last_clean":"2023-12-04T05:37:42.012970+0000","last_became_active":"2023-12-04T05:37:24.998544+0000","last_became_peered":"2023-12-04T05:37:24.998544+0000","last_unstale":"2023-12-04T05:37:42.012970+0000","last_undegraded":"2023-12-04T05:37:42.012970+0000","last_fullsized":"2023-12-04T05:37:42.012970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:35:12.838061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.039624+0000","last_change":"2023-12-04T05:37:43.033372+0000","last_active":"2023-12-04T05:37:43.039624+0000","last_peered":"2023-12-04T05:37:43.039624+0000","last_clean":"2023-12-04T05:37:43.039624+0000","last_became_active":"2023-12-04T05:37:43.033048+0000","last_became_peered":"2023-12-04T05:37:43.033048+0000","last_unstale":"2023-12-04T05:37:43.039624+0000","last_undegraded":"2023-12-04T05:37:43.039624+0000","last_fullsized":"2023-12-04T05:37:43.039624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004769+0000","last_change":"2023-12-04T05:37:24.995638+0000","last_active":"2023-12-04T05:37:42.004769+0000","last_peered":"2023-12-04T05:37:42.004769+0000","last_clean":"2023-12-04T05:37:42.004769+0000","last_became_active":"2023-12-04T05:37:24.995363+0000","last_became_peered":"2023-12-04T05:37:24.995363+0000","last_unstale":"2023-12-04T05:37:42.004769+0000","last_undegraded":"2023-12-04T05:37:42.004769+0000","last_fullsized":"2023-12-04T05:37:42.004769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.051304+0000","last_change":"2023-12-04T05:37:43.034285+0000","last_active":"2023-12-04T05:37:43.051304+0000","last_peered":"2023-12-04T05:37:43.051304+0000","last_clean":"2023-12-04T05:37:43.051304+0000","last_became_active":"2023-12-04T05:37:43.033979+0000","last_became_peered":"2023-12-04T05:37:43.033979+0000","last_unstale":"2023-12-04T05:37:43.051304+0000","last_undegraded":"2023-12-04T05:37:43.051304+0000","last_fullsized":"2023-12-04T05:37:43.051304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:26.521827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004375+0000","last_change":"2023-12-04T05:37:24.993347+0000","last_active":"2023-12-04T05:37:42.004375+0000","last_peered":"2023-12-04T05:37:42.004375+0000","last_clean":"2023-12-04T05:37:42.004375+0000","last_became_active":"2023-12-04T05:37:24.993089+0000","last_became_peered":"2023-12-04T05:37:24.993089+0000","last_unstale":"2023-12-04T05:37:42.004375+0000","last_undegraded":"2023-12-04T05:37:42.004375+0000","last_fullsized":"2023-12-04T05:37:42.004375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:09:05.474458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.035280+0000","last_change":"2023-12-04T05:37:43.031670+0000","last_active":"2023-12-04T05:37:43.035280+0000","last_peered":"2023-12-04T05:37:43.035280+0000","last_clean":"2023-12-04T05:37:43.035280+0000","last_became_active":"2023-12-04T05:37:43.031313+0000","last_became_peered":"2023-12-04T05:37:43.031313+0000","last_unstale":"2023-12-04T05:37:43.035280+0000","last_undegraded":"2023-12-04T05:37:43.035280+0000","last_fullsized":"2023-12-04T05:37:43.035280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:47:34.395228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.990392+0000","last_change":"2023-12-04T05:37:25.004665+0000","last_active":"2023-12-04T05:37:41.990392+0000","last_peered":"2023-12-04T05:37:41.990392+0000","last_clean":"2023-12-04T05:37:41.990392+0000","last_became_active":"2023-12-04T05:37:25.004324+0000","last_became_peered":"2023-12-04T05:37:25.004324+0000","last_unstale":"2023-12-04T05:37:41.990392+0000","last_undegraded":"2023-12-04T05:37:41.990392+0000","last_fullsized":"2023-12-04T05:37:41.990392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:22:34.755577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.034465+0000","last_change":"2023-12-04T05:37:43.032000+0000","last_active":"2023-12-04T05:37:43.034465+0000","last_peered":"2023-12-04T05:37:43.034465+0000","last_clean":"2023-12-04T05:37:43.034465+0000","last_became_active":"2023-12-04T05:37:43.030614+0000","last_became_peered":"2023-12-04T05:37:43.030614+0000","last_unstale":"2023-12-04T05:37:43.034465+0000","last_undegraded":"2023-12-04T05:37:43.034465+0000","last_fullsized":"2023-12-04T05:37:43.034465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:26.521827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996966+0000","last_change":"2023-12-04T05:37:24.990315+0000","last_active":"2023-12-04T05:37:41.996966+0000","last_peered":"2023-12-04T05:37:41.996966+0000","last_clean":"2023-12-04T05:37:41.996966+0000","last_became_active":"2023-12-04T05:37:24.990020+0000","last_became_peered":"2023-12-04T05:37:24.990020+0000","last_unstale":"2023-12-04T05:37:41.996966+0000","last_undegraded":"2023-12-04T05:37:41.996966+0000","last_fullsized":"2023-12-04T05:37:41.996966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:11:48.012372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.043992+0000","last_change":"2023-12-04T05:37:43.041052+0000","last_active":"2023-12-04T05:37:43.043992+0000","last_peered":"2023-12-04T05:37:43.043992+0000","last_clean":"2023-12-04T05:37:43.043992+0000","last_became_active":"2023-12-04T05:37:43.040748+0000","last_became_peered":"2023-12-04T05:37:43.040748+0000","last_unstale":"2023-12-04T05:37:43.043992+0000","last_undegraded":"2023-12-04T05:37:43.043992+0000","last_fullsized":"2023-12-04T05:37:43.043992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:48:36.448608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.991613+0000","last_change":"2023-12-04T05:37:24.990903+0000","last_active":"2023-12-04T05:37:41.991613+0000","last_peered":"2023-12-04T05:37:41.991613+0000","last_clean":"2023-12-04T05:37:41.991613+0000","last_became_active":"2023-12-04T05:37:24.990595+0000","last_became_peered":"2023-12-04T05:37:24.990595+0000","last_unstale":"2023-12-04T05:37:41.991613+0000","last_undegraded":"2023-12-04T05:37:41.991613+0000","last_fullsized":"2023-12-04T05:37:41.991613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:07:41.797798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055963+0000","last_change":"2023-12-04T05:37:43.051542+0000","last_active":"2023-12-04T05:37:43.055963+0000","last_peered":"2023-12-04T05:37:43.055963+0000","last_clean":"2023-12-04T05:37:43.055963+0000","last_became_active":"2023-12-04T05:37:43.050885+0000","last_became_peered":"2023-12-04T05:37:43.050885+0000","last_unstale":"2023-12-04T05:37:43.055963+0000","last_undegraded":"2023-12-04T05:37:43.055963+0000","last_fullsized":"2023-12-04T05:37:43.055963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:48.936035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005684+0000","last_change":"2023-12-04T05:37:24.997746+0000","last_active":"2023-12-04T05:37:42.005684+0000","last_peered":"2023-12-04T05:37:42.005684+0000","last_clean":"2023-12-04T05:37:42.005684+0000","last_became_active":"2023-12-04T05:37:24.997501+0000","last_became_peered":"2023-12-04T05:37:24.997501+0000","last_unstale":"2023-12-04T05:37:42.005684+0000","last_undegraded":"2023-12-04T05:37:42.005684+0000","last_fullsized":"2023-12-04T05:37:42.005684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:28:18.462079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.036466+0000","last_change":"2023-12-04T05:37:43.032146+0000","last_active":"2023-12-04T05:37:43.036466+0000","last_peered":"2023-12-04T05:37:43.036466+0000","last_clean":"2023-12-04T05:37:43.036466+0000","last_became_active":"2023-12-04T05:37:43.031852+0000","last_became_peered":"2023-12-04T05:37:43.031852+0000","last_unstale":"2023-12-04T05:37:43.036466+0000","last_undegraded":"2023-12-04T05:37:43.036466+0000","last_fullsized":"2023-12-04T05:37:43.036466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:31:09.519131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.010792+0000","last_change":"2023-12-04T05:37:24.996641+0000","last_active":"2023-12-04T05:37:42.010792+0000","last_peered":"2023-12-04T05:37:42.010792+0000","last_clean":"2023-12-04T05:37:42.010792+0000","last_became_active":"2023-12-04T05:37:24.993802+0000","last_became_peered":"2023-12-04T05:37:24.993802+0000","last_unstale":"2023-12-04T05:37:42.010792+0000","last_undegraded":"2023-12-04T05:37:42.010792+0000","last_fullsized":"2023-12-04T05:37:42.010792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:37:31.280029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056852+0000","last_change":"2023-12-04T05:37:43.053983+0000","last_active":"2023-12-04T05:37:43.056852+0000","last_peered":"2023-12-04T05:37:43.056852+0000","last_clean":"2023-12-04T05:37:43.056852+0000","last_became_active":"2023-12-04T05:37:43.053454+0000","last_became_peered":"2023-12-04T05:37:43.053454+0000","last_unstale":"2023-12-04T05:37:43.056852+0000","last_undegraded":"2023-12-04T05:37:43.056852+0000","last_fullsized":"2023-12-04T05:37:43.056852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:31.939030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.012876+0000","last_change":"2023-12-04T05:37:24.992143+0000","last_active":"2023-12-04T05:37:42.012876+0000","last_peered":"2023-12-04T05:37:42.012876+0000","last_clean":"2023-12-04T05:37:42.012876+0000","last_became_active":"2023-12-04T05:37:24.991537+0000","last_became_peered":"2023-12-04T05:37:24.991537+0000","last_unstale":"2023-12-04T05:37:42.012876+0000","last_undegraded":"2023-12-04T05:37:42.012876+0000","last_fullsized":"2023-12-04T05:37:42.012876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:07.720393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.037548+0000","last_change":"2023-12-04T05:37:43.035233+0000","last_active":"2023-12-04T05:37:43.037548+0000","last_peered":"2023-12-04T05:37:43.037548+0000","last_clean":"2023-12-04T05:37:43.037548+0000","last_became_active":"2023-12-04T05:37:43.034961+0000","last_became_peered":"2023-12-04T05:37:43.034961+0000","last_unstale":"2023-12-04T05:37:43.037548+0000","last_undegraded":"2023-12-04T05:37:43.037548+0000","last_fullsized":"2023-12-04T05:37:43.037548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:24.949946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995357+0000","last_change":"2023-12-04T05:37:25.002114+0000","last_active":"2023-12-04T05:37:41.995357+0000","last_peered":"2023-12-04T05:37:41.995357+0000","last_clean":"2023-12-04T05:37:41.995357+0000","last_became_active":"2023-12-04T05:37:24.999380+0000","last_became_peered":"2023-12-04T05:37:24.999380+0000","last_unstale":"2023-12-04T05:37:41.995357+0000","last_undegraded":"2023-12-04T05:37:41.995357+0000","last_fullsized":"2023-12-04T05:37:41.995357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:08:08.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.060029+0000","last_change":"2023-12-04T05:37:43.054519+0000","last_active":"2023-12-04T05:37:43.060029+0000","last_peered":"2023-12-04T05:37:43.060029+0000","last_clean":"2023-12-04T05:37:43.060029+0000","last_became_active":"2023-12-04T05:37:43.051581+0000","last_became_peered":"2023-12-04T05:37:43.051581+0000","last_unstale":"2023-12-04T05:37:43.060029+0000","last_undegraded":"2023-12-04T05:37:43.060029+0000","last_fullsized":"2023-12-04T05:37:43.060029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:02:36.242804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996705+0000","last_change":"2023-12-04T05:37:25.002873+0000","last_active":"2023-12-04T05:37:41.996705+0000","last_peered":"2023-12-04T05:37:41.996705+0000","last_clean":"2023-12-04T05:37:41.996705+0000","last_became_active":"2023-12-04T05:37:25.002555+0000","last_became_peered":"2023-12-04T05:37:25.002555+0000","last_unstale":"2023-12-04T05:37:41.996705+0000","last_undegraded":"2023-12-04T05:37:41.996705+0000","last_fullsized":"2023-12-04T05:37:41.996705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:22.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.055397+0000","last_change":"2023-12-04T05:37:43.049864+0000","last_active":"2023-12-04T05:37:43.055397+0000","last_peered":"2023-12-04T05:37:43.055397+0000","last_clean":"2023-12-04T05:37:43.055397+0000","last_became_active":"2023-12-04T05:37:43.048019+0000","last_became_peered":"2023-12-04T05:37:43.048019+0000","last_unstale":"2023-12-04T05:37:43.055397+0000","last_undegraded":"2023-12-04T05:37:43.055397+0000","last_fullsized":"2023-12-04T05:37:43.055397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:30:49.854356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004342+0000","last_change":"2023-12-04T05:37:24.998811+0000","last_active":"2023-12-04T05:37:42.004342+0000","last_peered":"2023-12-04T05:37:42.004342+0000","last_clean":"2023-12-04T05:37:42.004342+0000","last_became_active":"2023-12-04T05:37:24.998548+0000","last_became_peered":"2023-12-04T05:37:24.998548+0000","last_unstale":"2023-12-04T05:37:42.004342+0000","last_undegraded":"2023-12-04T05:37:42.004342+0000","last_fullsized":"2023-12-04T05:37:42.004342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:53:00.780859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.056147+0000","last_change":"2023-12-04T05:37:43.051574+0000","last_active":"2023-12-04T05:37:43.056147+0000","last_peered":"2023-12-04T05:37:43.056147+0000","last_clean":"2023-12-04T05:37:43.056147+0000","last_became_active":"2023-12-04T05:37:43.051205+0000","last_became_peered":"2023-12-04T05:37:43.051205+0000","last_unstale":"2023-12-04T05:37:43.056147+0000","last_undegraded":"2023-12-04T05:37:43.056147+0000","last_fullsized":"2023-12-04T05:37:43.056147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:46:08.823420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006346+0000","last_change":"2023-12-04T05:37:24.987512+0000","last_active":"2023-12-04T05:37:42.006346+0000","last_peered":"2023-12-04T05:37:42.006346+0000","last_clean":"2023-12-04T05:37:42.006346+0000","last_became_active":"2023-12-04T05:37:24.987236+0000","last_became_peered":"2023-12-04T05:37:24.987236+0000","last_unstale":"2023-12-04T05:37:42.006346+0000","last_undegraded":"2023-12-04T05:37:42.006346+0000","last_fullsized":"2023-12-04T05:37:42.006346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.027004+0000","last_change":"2023-12-04T05:37:43.024694+0000","last_active":"2023-12-04T05:37:43.027004+0000","last_peered":"2023-12-04T05:37:43.027004+0000","last_clean":"2023-12-04T05:37:43.027004+0000","last_became_active":"2023-12-04T05:37:43.022066+0000","last_became_peered":"2023-12-04T05:37:43.022066+0000","last_unstale":"2023-12-04T05:37:43.027004+0000","last_undegraded":"2023-12-04T05:37:43.027004+0000","last_fullsized":"2023-12-04T05:37:43.027004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:23:50.136372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001118+0000","last_change":"2023-12-04T05:37:24.991168+0000","last_active":"2023-12-04T05:37:42.001118+0000","last_peered":"2023-12-04T05:37:42.001118+0000","last_clean":"2023-12-04T05:37:42.001118+0000","last_became_active":"2023-12-04T05:37:24.990517+0000","last_became_peered":"2023-12-04T05:37:24.990517+0000","last_unstale":"2023-12-04T05:37:42.001118+0000","last_undegraded":"2023-12-04T05:37:42.001118+0000","last_fullsized":"2023-12-04T05:37:42.001118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:05:07.947991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.054182+0000","last_change":"2023-12-04T05:37:43.043707+0000","last_active":"2023-12-04T05:37:43.054182+0000","last_peered":"2023-12-04T05:37:43.054182+0000","last_clean":"2023-12-04T05:37:43.054182+0000","last_became_active":"2023-12-04T05:37:43.042891+0000","last_became_peered":"2023-12-04T05:37:43.042891+0000","last_unstale":"2023-12-04T05:37:43.054182+0000","last_undegraded":"2023-12-04T05:37:43.054182+0000","last_fullsized":"2023-12-04T05:37:43.054182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:56:30.230829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005081+0000","last_change":"2023-12-04T05:37:25.001854+0000","last_active":"2023-12-04T05:37:42.005081+0000","last_peered":"2023-12-04T05:37:42.005081+0000","last_clean":"2023-12-04T05:37:42.005081+0000","last_became_active":"2023-12-04T05:37:25.001471+0000","last_became_peered":"2023-12-04T05:37:25.001471+0000","last_unstale":"2023-12-04T05:37:42.005081+0000","last_undegraded":"2023-12-04T05:37:42.005081+0000","last_fullsized":"2023-12-04T05:37:42.005081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.059987+0000","last_change":"2023-12-04T05:37:43.053148+0000","last_active":"2023-12-04T05:37:43.059987+0000","last_peered":"2023-12-04T05:37:43.059987+0000","last_clean":"2023-12-04T05:37:43.059987+0000","last_became_active":"2023-12-04T05:37:43.052958+0000","last_became_peered":"2023-12-04T05:37:43.052958+0000","last_unstale":"2023-12-04T05:37:43.059987+0000","last_undegraded":"2023-12-04T05:37:43.059987+0000","last_fullsized":"2023-12-04T05:37:43.059987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:48:25.376399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996107+0000","last_change":"2023-12-04T05:37:25.002836+0000","last_active":"2023-12-04T05:37:41.996107+0000","last_peered":"2023-12-04T05:37:41.996107+0000","last_clean":"2023-12-04T05:37:41.996107+0000","last_became_active":"2023-12-04T05:37:25.002504+0000","last_became_peered":"2023-12-04T05:37:25.002504+0000","last_unstale":"2023-12-04T05:37:41.996107+0000","last_undegraded":"2023-12-04T05:37:41.996107+0000","last_fullsized":"2023-12-04T05:37:41.996107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:26:25.242956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058981+0000","last_change":"2023-12-04T05:37:43.054126+0000","last_active":"2023-12-04T05:37:43.058981+0000","last_peered":"2023-12-04T05:37:43.058981+0000","last_clean":"2023-12-04T05:37:43.058981+0000","last_became_active":"2023-12-04T05:37:43.053795+0000","last_became_peered":"2023-12-04T05:37:43.053795+0000","last_unstale":"2023-12-04T05:37:43.058981+0000","last_undegraded":"2023-12-04T05:37:43.058981+0000","last_fullsized":"2023-12-04T05:37:43.058981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:05:02.414534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.005824+0000","last_change":"2023-12-04T05:37:24.994217+0000","last_active":"2023-12-04T05:37:42.005824+0000","last_peered":"2023-12-04T05:37:42.005824+0000","last_clean":"2023-12-04T05:37:42.005824+0000","last_became_active":"2023-12-04T05:37:24.993859+0000","last_became_peered":"2023-12-04T05:37:24.993859+0000","last_unstale":"2023-12-04T05:37:42.005824+0000","last_undegraded":"2023-12-04T05:37:42.005824+0000","last_fullsized":"2023-12-04T05:37:42.005824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:06:30.073514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058657+0000","last_change":"2023-12-04T05:37:43.052024+0000","last_active":"2023-12-04T05:37:43.058657+0000","last_peered":"2023-12-04T05:37:43.058657+0000","last_clean":"2023-12-04T05:37:43.058657+0000","last_became_active":"2023-12-04T05:37:43.051628+0000","last_became_peered":"2023-12-04T05:37:43.051628+0000","last_unstale":"2023-12-04T05:37:43.058657+0000","last_undegraded":"2023-12-04T05:37:43.058657+0000","last_fullsized":"2023-12-04T05:37:43.058657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:54.799040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.998175+0000","last_change":"2023-12-04T05:37:24.990417+0000","last_active":"2023-12-04T05:37:41.998175+0000","last_peered":"2023-12-04T05:37:41.998175+0000","last_clean":"2023-12-04T05:37:41.998175+0000","last_became_active":"2023-12-04T05:37:24.989761+0000","last_became_peered":"2023-12-04T05:37:24.989761+0000","last_unstale":"2023-12-04T05:37:41.998175+0000","last_undegraded":"2023-12-04T05:37:41.998175+0000","last_fullsized":"2023-12-04T05:37:41.998175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052253+0000","last_change":"2023-12-04T05:37:43.039901+0000","last_active":"2023-12-04T05:37:43.052253+0000","last_peered":"2023-12-04T05:37:43.052253+0000","last_clean":"2023-12-04T05:37:43.052253+0000","last_became_active":"2023-12-04T05:37:43.039595+0000","last_became_peered":"2023-12-04T05:37:43.039595+0000","last_unstale":"2023-12-04T05:37:43.052253+0000","last_undegraded":"2023-12-04T05:37:43.052253+0000","last_fullsized":"2023-12-04T05:37:43.052253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:00.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.995961+0000","last_change":"2023-12-04T05:37:24.999115+0000","last_active":"2023-12-04T05:37:41.995961+0000","last_peered":"2023-12-04T05:37:41.995961+0000","last_clean":"2023-12-04T05:37:41.995961+0000","last_became_active":"2023-12-04T05:37:24.997938+0000","last_became_peered":"2023-12-04T05:37:24.997938+0000","last_unstale":"2023-12-04T05:37:41.995961+0000","last_undegraded":"2023-12-04T05:37:41.995961+0000","last_fullsized":"2023-12-04T05:37:41.995961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:21:48.359696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045832+0000","last_change":"2023-12-04T05:37:43.043320+0000","last_active":"2023-12-04T05:37:43.045832+0000","last_peered":"2023-12-04T05:37:43.045832+0000","last_clean":"2023-12-04T05:37:43.045832+0000","last_became_active":"2023-12-04T05:37:43.042819+0000","last_became_peered":"2023-12-04T05:37:43.042819+0000","last_unstale":"2023-12-04T05:37:43.045832+0000","last_undegraded":"2023-12-04T05:37:43.045832+0000","last_fullsized":"2023-12-04T05:37:43.045832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:20.188748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:41.996512+0000","last_change":"2023-12-04T05:37:25.001425+0000","last_active":"2023-12-04T05:37:41.996512+0000","last_peered":"2023-12-04T05:37:41.996512+0000","last_clean":"2023-12-04T05:37:41.996512+0000","last_became_active":"2023-12-04T05:37:25.001143+0000","last_became_peered":"2023-12-04T05:37:25.001143+0000","last_unstale":"2023-12-04T05:37:41.996512+0000","last_undegraded":"2023-12-04T05:37:41.996512+0000","last_fullsized":"2023-12-04T05:37:41.996512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:08.865821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.058077+0000","last_change":"2023-12-04T05:37:43.046535+0000","last_active":"2023-12-04T05:37:43.058077+0000","last_peered":"2023-12-04T05:37:43.058077+0000","last_clean":"2023-12-04T05:37:43.058077+0000","last_became_active":"2023-12-04T05:37:43.046275+0000","last_became_peered":"2023-12-04T05:37:43.046275+0000","last_unstale":"2023-12-04T05:37:43.058077+0000","last_undegraded":"2023-12-04T05:37:43.058077+0000","last_fullsized":"2023-12-04T05:37:43.058077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:27.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.006263+0000","last_change":"2023-12-04T05:37:24.997159+0000","last_active":"2023-12-04T05:37:42.006263+0000","last_peered":"2023-12-04T05:37:42.006263+0000","last_clean":"2023-12-04T05:37:42.006263+0000","last_became_active":"2023-12-04T05:37:24.996505+0000","last_became_peered":"2023-12-04T05:37:24.996505+0000","last_unstale":"2023-12-04T05:37:42.006263+0000","last_undegraded":"2023-12-04T05:37:42.006263+0000","last_fullsized":"2023-12-04T05:37:42.006263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:55.302811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.045529+0000","last_change":"2023-12-04T05:37:43.042956+0000","last_active":"2023-12-04T05:37:43.045529+0000","last_peered":"2023-12-04T05:37:43.045529+0000","last_clean":"2023-12-04T05:37:43.045529+0000","last_became_active":"2023-12-04T05:37:43.042191+0000","last_became_peered":"2023-12-04T05:37:43.042191+0000","last_unstale":"2023-12-04T05:37:43.045529+0000","last_undegraded":"2023-12-04T05:37:43.045529+0000","last_fullsized":"2023-12-04T05:37:43.045529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:34:20.188748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.001011+0000","last_change":"2023-12-04T05:37:24.991321+0000","last_active":"2023-12-04T05:37:42.001011+0000","last_peered":"2023-12-04T05:37:42.001011+0000","last_clean":"2023-12-04T05:37:42.001011+0000","last_became_active":"2023-12-04T05:37:24.990855+0000","last_became_peered":"2023-12-04T05:37:24.990855+0000","last_unstale":"2023-12-04T05:37:42.001011+0000","last_undegraded":"2023-12-04T05:37:42.001011+0000","last_fullsized":"2023-12-04T05:37:42.001011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:46:45.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.059001+0000","last_change":"2023-12-04T05:37:43.055016+0000","last_active":"2023-12-04T05:37:43.059001+0000","last_peered":"2023-12-04T05:37:43.059001+0000","last_clean":"2023-12-04T05:37:43.059001+0000","last_became_active":"2023-12-04T05:37:43.054798+0000","last_became_peered":"2023-12-04T05:37:43.054798+0000","last_unstale":"2023-12-04T05:37:43.059001+0000","last_undegraded":"2023-12-04T05:37:43.059001+0000","last_fullsized":"2023-12-04T05:37:43.059001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:27:28.061993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.003844+0000","last_change":"2023-12-04T05:37:24.990710+0000","last_active":"2023-12-04T05:37:42.003844+0000","last_peered":"2023-12-04T05:37:42.003844+0000","last_clean":"2023-12-04T05:37:42.003844+0000","last_became_active":"2023-12-04T05:37:24.990190+0000","last_became_peered":"2023-12-04T05:37:24.990190+0000","last_unstale":"2023-12-04T05:37:42.003844+0000","last_undegraded":"2023-12-04T05:37:42.003844+0000","last_fullsized":"2023-12-04T05:37:42.003844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:15:22.440995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.046153+0000","last_change":"2023-12-04T05:37:43.044902+0000","last_active":"2023-12-04T05:37:43.046153+0000","last_peered":"2023-12-04T05:37:43.046153+0000","last_clean":"2023-12-04T05:37:43.046153+0000","last_became_active":"2023-12-04T05:37:43.044654+0000","last_became_peered":"2023-12-04T05:37:43.044654+0000","last_unstale":"2023-12-04T05:37:43.046153+0000","last_undegraded":"2023-12-04T05:37:43.046153+0000","last_fullsized":"2023-12-04T05:37:43.046153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:00.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.004955+0000","last_change":"2023-12-04T05:37:24.996407+0000","last_active":"2023-12-04T05:37:42.004955+0000","last_peered":"2023-12-04T05:37:42.004955+0000","last_clean":"2023-12-04T05:37:42.004955+0000","last_became_active":"2023-12-04T05:37:24.996150+0000","last_became_peered":"2023-12-04T05:37:24.996150+0000","last_unstale":"2023-12-04T05:37:42.004955+0000","last_undegraded":"2023-12-04T05:37:42.004955+0000","last_fullsized":"2023-12-04T05:37:42.004955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:37.143035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.052725+0000","last_change":"2023-12-04T05:37:43.046155+0000","last_active":"2023-12-04T05:37:43.052725+0000","last_peered":"2023-12-04T05:37:43.052725+0000","last_clean":"2023-12-04T05:37:43.052725+0000","last_became_active":"2023-12-04T05:37:43.045849+0000","last_became_peered":"2023-12-04T05:37:43.045849+0000","last_unstale":"2023-12-04T05:37:43.052725+0000","last_undegraded":"2023-12-04T05:37:43.052725+0000","last_fullsized":"2023-12-04T05:37:43.052725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:40:34.839383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.013047+0000","last_change":"2023-12-04T05:37:24.992517+0000","last_active":"2023-12-04T05:37:42.013047+0000","last_peered":"2023-12-04T05:37:42.013047+0000","last_clean":"2023-12-04T05:37:42.013047+0000","last_became_active":"2023-12-04T05:37:24.991809+0000","last_became_peered":"2023-12-04T05:37:24.991809+0000","last_unstale":"2023-12-04T05:37:42.013047+0000","last_undegraded":"2023-12-04T05:37:42.013047+0000","last_fullsized":"2023-12-04T05:37:42.013047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:09.871491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-04T05:37:43.049264+0000","last_change":"2023-12-04T05:37:43.044648+0000","last_active":"2023-12-04T05:37:43.049264+0000","last_peered":"2023-12-04T05:37:43.049264+0000","last_clean":"2023-12-04T05:37:43.049264+0000","last_became_active":"2023-12-04T05:37:43.042019+0000","last_became_peered":"2023-12-04T05:37:43.042019+0000","last_unstale":"2023-12-04T05:37:43.049264+0000","last_undegraded":"2023-12-04T05:37:43.049264+0000","last_fullsized":"2023-12-04T05:37:43.049264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:41.981111+0000","last_clean_scrub_stamp":"2023-12-04T05:37:41.981111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:50:27.527497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-04T05:37:42.018427+0000","last_change":"2023-12-04T05:37:24.991447+0000","last_active":"2023-12-04T05:37:42.018427+0000","last_peered":"2023-12-04T05:37:42.018427+0000","last_clean":"2023-12-04T05:37:42.018427+0000","last_became_active":"2023-12-04T05:37:24.991120+0000","last_became_peered":"2023-12-04T05:37:24.991120+0000","last_unstale":"2023-12-04T05:37:42.018427+0000","last_undegraded":"2023-12-04T05:37:42.018427+0000","last_fullsized":"2023-12-04T05:37:42.018427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:37:24.325105+0000","last_clean_scrub_stamp":"2023-12-04T05:37:24.325105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:10:23.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.74199999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71899999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.75800000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.504},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.499}]},{"osd":2,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":156270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59499999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67600000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.66800000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40400000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.435}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.501},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.626}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.73299999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.84299999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.875}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.45700000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.5}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.752}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":738263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.376},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.438}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.624},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.63400000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:37:47.506 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:37:47.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-04T05:37:47.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.678+0000 7f9954809640 1 Processor -- start 2023-12-04T05:37:47.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.678+0000 7f9954809640 1 -- start start 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9954809640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 0x7f99500c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9954809640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f99500a6b60 0x7f99500c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9954809640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500c2d70 con 0x7f99500c12f0 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9954809640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500c6c60 con 0x7f99500a6b60 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9954809640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c2040 con 0x7f99500706b0 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f99500c12f0 0x7f99500c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46344/0 (socket says 172.21.15.97:46344) 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994f7fe640 1 -- 172.21.15.97:0/3902980374 learned_addr learned my addr 172.21.15.97:0/3902980374 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:47.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994ffff640 1 --2- 172.21.15.97:0/3902980374 >> v2:172.21.15.97:3300/0 conn(0x7f99500a6b60 0x7f99500c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9947fff640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 0x7f99500c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994ffff640 1 -- 172.21.15.97:0/3902980374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 msgr2=0x7f99500c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:47.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994ffff640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 0x7f99500c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994ffff640 1 -- 172.21.15.97:0/3902980374 >> v1:172.21.15.97:6789/0 conn(0x7f99500c12f0 legacy=0x7f99500c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994ffff640 1 -- 172.21.15.97:0/3902980374 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500c2320 con 0x7f99500a6b60 2023-12-04T05:37:47.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f9947fff640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 0x7f99500c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:47.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.682+0000 7f994effd640 1 -- 172.21.15.97:0/3902980374 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628642020 0 0) 0x7f99500c2d70 con 0x7f99500c12f0 2023-12-04T05:37:47.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f994ffff640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99500c16d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9948009d90 tx=0x7f994801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd9397fe93ae51c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f994effd640 1 -- 172.21.15.97:0/3902980374 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480af600 con 0x7f99500a6b60 2023-12-04T05:37:47.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f994effd640 1 -- 172.21.15.97:0/3902980374 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99480ab050 con 0x7f99500a6b60 2023-12-04T05:37:47.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f994effd640 1 -- 172.21.15.97:0/3902980374 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480af980 con 0x7f99500a6b60 2023-12-04T05:37:47.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- 172.21.15.97:0/3902980374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 msgr2=0x7f99500c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99500c16d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9948009d90 tx=0x7f994801f130 comp rx=0 tx=0).stop 2023-12-04T05:37:47.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- 172.21.15.97:0/3902980374 shutdown_connections 2023-12-04T05:37:47.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99500c16d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 --2- 172.21.15.97:0/3902980374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500706b0 0x7f99500c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- 172.21.15.97:0/3902980374 >> 172.21.15.97:0/3902980374 conn(0x7f99500a9a10 msgr2=0x7f99500a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- 172.21.15.97:0/3902980374 shutdown_connections 2023-12-04T05:37:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- 172.21.15.97:0/3902980374 wait complete. 2023-12-04T05:37:47.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 Processor -- start 2023-12-04T05:37:47.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.686+0000 7f9954809640 1 -- start start 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99500706b0 0x7f9950151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500c12f0 0x7f99501edfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950150580 con 0x7f99500a6b60 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950152940 con 0x7f99500706b0 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500ad6d0 con 0x7f99500c12f0 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32984/0 (socket says 172.21.15.97:32984) 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 -- 172.21.15.97:0/1466906265 learned_addr learned my addr 172.21.15.97:0/1466906265 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:47.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994ffff640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500c12f0 0x7f99501edfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994f7fe640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99500706b0 0x7f9950151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 -- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500c12f0 msgr2=0x7f99501edfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500c12f0 0x7f99501edfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 -- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99500706b0 msgr2=0x7f9950151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99500706b0 0x7f9950151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 -- 172.21.15.97:0/1466906265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948009a70 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9947fff640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f993800c7f0 tx=0x7f993800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800cea0 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380079d0 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500adc00 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938007d80 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500ad920 con 0x7f99500a6b60 2023-12-04T05:37:47.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950066db0 con 0x7f99500a6b60 2023-12-04T05:37:47.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.690+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99380113f0 con 0x7f99500a6b60 2023-12-04T05:37:47.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.694+0000 7f994cff9640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 0x7f9930068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:47.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.694+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9938084720 con 0x7f99500a6b60 2023-12-04T05:37:47.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.694+0000 7f994f7fe640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 0x7f9930068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:47.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.694+0000 7f994f7fe640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 0x7f9930068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9940000f70 tx=0x7f9940007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:47.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.698+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9938051740 con 0x7f99500a6b60 2023-12-04T05:37:47.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.898+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f99500ae070 con 0x7f99500a6b60 2023-12-04T05:37:47.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.902+0000 7f994cff9640 1 -- 172.21.15.97:0/1466906265 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f99500ae070 con 0x7f99500a6b60 2023-12-04T05:37:47.907 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-12-04T05:37:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ== 2023-12-04T05:37:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:37:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:37:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-04T05:37:47.908 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.1 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 msgr2=0x7f9930068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 0x7f9930068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9940000f70 tx=0x7f9940007df0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 msgr2=0x7f99501eda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f993800c7f0 tx=0x7f993800ccb0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 shutdown_connections 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99300668d0 0x7f9930068d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99500c12f0 0x7f99501edfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99500a6b60 0x7f99501eda60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 --2- 172.21.15.97:0/1466906265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99500706b0 0x7f9950151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:47.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 >> 172.21.15.97:0/1466906265 conn(0x7f99500a9a10 msgr2=0x7f995006e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:47.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 shutdown_connections 2023-12-04T05:37:47.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:47.906+0000 7f9954809640 1 -- 172.21.15.97:0/1466906265 wait complete. 2023-12-04T05:37:47.929 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:47.929 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:47.938 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:47.939 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:47.989 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:48.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.122+0000 7f08ecafe640 1 Processor -- start 2023-12-04T05:37:48.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.122+0000 7f08ecafe640 1 -- start start 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ecafe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08e8151c60 0x7f08e806a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ecafe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806d280 0x7f08e815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ecafe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e81555f0 con 0x7f08e806ab30 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ecafe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e80acaa0 con 0x7f08e8151c60 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ecafe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e8152040 con 0x7f08e806d280 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ddd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f08e806ab30 0x7f08e806db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46346/0 (socket says 172.21.15.97:46346) 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08ddd9b640 1 -- 172.21.15.97:0/3961164837 learned_addr learned my addr 172.21.15.97:0/3961164837 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:48.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e659c640 1 --2- 172.21.15.97:0/3961164837 >> v2:172.21.15.97:3300/0 conn(0x7f08e8151c60 0x7f08e806a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e6d9d640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806d280 0x7f08e815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e659c640 1 -- 172.21.15.97:0/3961164837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806d280 msgr2=0x7f08e815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e659c640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806d280 0x7f08e815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e659c640 1 -- 172.21.15.97:0/3961164837 >> v1:172.21.15.97:6789/0 conn(0x7f08e806ab30 legacy=0x7f08e806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e659c640 1 -- 172.21.15.97:0/3961164837 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8155070 con 0x7f08e8151c60 2023-12-04T05:37:48.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.126+0000 7f08e5d9b640 1 -- 172.21.15.97:0/3961164837 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122371285 0 0) 0x7f08d0001120 con 0x7f08e806ab30 2023-12-04T05:37:48.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08e659c640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e8151c60 0x7f08e806a5f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009d90 tx=0x7f08d801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b066758c6bc7a23f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08e5d9b640 1 -- 172.21.15.97:0/3961164837 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5980 con 0x7f08e8151c60 2023-12-04T05:37:48.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08e5d9b640 1 -- 172.21.15.97:0/3961164837 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80a5ae0 con 0x7f08e8151c60 2023-12-04T05:37:48.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08e5d9b640 1 -- 172.21.15.97:0/3961164837 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80a5e70 con 0x7f08e8151c60 2023-12-04T05:37:48.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- 172.21.15.97:0/3961164837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e8151c60 msgr2=0x7f08e806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e8151c60 0x7f08e806a5f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009d90 tx=0x7f08d801c8c0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- 172.21.15.97:0/3961164837 shutdown_connections 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806d280 0x7f08e815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3961164837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e8151c60 0x7f08e806a5f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- 172.21.15.97:0/3961164837 >> 172.21.15.97:0/3961164837 conn(0x7f08e80c3910 msgr2=0x7f08e80c3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- 172.21.15.97:0/3961164837 shutdown_connections 2023-12-04T05:37:48.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- 172.21.15.97:0/3961164837 wait complete. 2023-12-04T05:37:48.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 Processor -- start 2023-12-04T05:37:48.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- start start 2023-12-04T05:37:48.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806ab30 0x7f08e814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e8151c60 0x7f08e81f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e80c5620 con 0x7f08e806d280 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e814a5c0 con 0x7f08e8151c60 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.130+0000 7f08ecafe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e8143c80 con 0x7f08e806ab30 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08e659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806ab30 0x7f08e814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:32990/0 (socket says 172.21.15.97:32990) 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 -- 172.21.15.97:0/3569558723 learned_addr learned my addr 172.21.15.97:0/3569558723 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08e6d9d640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e8151c60 0x7f08e81f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 -- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806ab30 msgr2=0x7f08e814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806ab30 0x7f08e814a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 -- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e8151c60 msgr2=0x7f08e81f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e8151c60 0x7f08e81f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 -- 172.21.15.97:0/3569558723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009a70 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ddd9b640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c780 tx=0x7f08d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00072d0 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0007450 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00047f0 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e8143f20 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e8145210 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8068440 con 0x7f08e806d280 2023-12-04T05:37:48.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.134+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f08d0004950 con 0x7f08e806d280 2023-12-04T05:37:48.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.138+0000 7f08df7fe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 0x7f08c8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.138+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f08d00837e0 con 0x7f08e806d280 2023-12-04T05:37:48.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.138+0000 7f08e659c640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 0x7f08c8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.138+0000 7f08e659c640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 0x7f08c8068dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08d80af000 tx=0x7f08d80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.142+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08d00506d0 con 0x7f08e806d280 2023-12-04T05:37:48.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.294+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e81555f0 con 0x7f08e806d280 2023-12-04T05:37:48.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08df7fe640 1 -- 172.21.15.97:0/3569558723 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7f08e81555f0 con 0x7f08e806d280 2023-12-04T05:37:48.301 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:48.301 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 msgr2=0x7f08c8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 0x7f08c8068dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08d80af000 tx=0x7f08d80a7070 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 msgr2=0x7f08e80c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c780 tx=0x7f08d000cc40 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 shutdown_connections 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08c8066900 0x7f08c8068dc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08e8151c60 0x7f08e81f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08e806d280 0x7f08e80c5a70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 --2- 172.21.15.97:0/3569558723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08e806ab30 0x7f08e814a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 >> 172.21.15.97:0/3569558723 conn(0x7f08e80c3910 msgr2=0x7f08e80c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 shutdown_connections 2023-12-04T05:37:48.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.298+0000 7f08ecafe640 1 -- 172.21.15.97:0/3569558723 wait complete. 2023-12-04T05:37:48.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:37:22.374120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:37:23.709890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:37:40.181523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:37:41.370503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:48.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:48.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 Processor -- start 2023-12-04T05:37:48.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 -- start start 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 0x7ff4901643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff490071380 con 0x7ff490156070 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49006cc20 con 0x7ff49006e410 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff497c09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49006cf00 con 0x7ff49006c280 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4959a5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff490156070 0x7ff4900c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46358/0 (socket says 172.21.15.97:46358) 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4959a5640 1 -- 172.21.15.97:0/1387104883 learned_addr learned my addr 172.21.15.97:0/1387104883 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4961a6640 1 --2- 172.21.15.97:0/1387104883 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 0x7ff4901643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059921601 0 0) 0x7ff490071380 con 0x7ff490156070 2023-12-04T05:37:48.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003530 con 0x7ff490156070 2023-12-04T05:37:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532222485 0 0) 0x7ff49006cc20 con 0x7ff49006e410 2023-12-04T05:37:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490071380 con 0x7ff49006e410 2023-12-04T05:37:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4961a6640 1 -- 172.21.15.97:0/1387104883 >> v1:172.21.15.143:6789/0 conn(0x7ff49006e410 legacy=0x7ff490071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4961a6640 1 -- 172.21.15.97:0/1387104883 >> v1:172.21.15.97:6789/0 conn(0x7ff490156070 legacy=0x7ff4900c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.462+0000 7ff4961a6640 1 -- 172.21.15.97:0/1387104883 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49015cbb0 con 0x7ff49006c280 2023-12-04T05:37:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff4961a6640 1 --2- 172.21.15.97:0/1387104883 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 0x7ff4901643a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff488009dc0 tx=0x7ff48801d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fffb7582abd5d994 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880a5a50 con 0x7ff49006c280 2023-12-04T05:37:48.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880a5bb0 con 0x7ff49006c280 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff4949a3640 1 -- 172.21.15.97:0/1387104883 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880ad440 con 0x7ff49006c280 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 -- 172.21.15.97:0/1387104883 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 msgr2=0x7ff4901643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 --2- 172.21.15.97:0/1387104883 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 0x7ff4901643a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff488009dc0 tx=0x7ff48801d3d0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 -- 172.21.15.97:0/1387104883 shutdown_connections 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 --2- 172.21.15.97:0/1387104883 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff49006c280 0x7ff4901643a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 -- 172.21.15.97:0/1387104883 >> 172.21.15.97:0/1387104883 conn(0x7ff4900c5e70 msgr2=0x7ff4900c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 -- 172.21.15.97:0/1387104883 shutdown_connections 2023-12-04T05:37:48.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.466+0000 7ff497c09640 1 -- 172.21.15.97:0/1387104883 wait complete. 2023-12-04T05:37:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 Processor -- start 2023-12-04T05:37:48.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- start start 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff49006c280 0x7ff49015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff490156070 0x7ff490158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900c0c50 con 0x7ff49006e410 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4901f4980 con 0x7ff49006c280 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4901f54c0 con 0x7ff490156070 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33004/0 (socket says 172.21.15.97:33004) 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 -- 172.21.15.97:0/3979295852 learned_addr learned my addr 172.21.15.97:0/3979295852 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4959a5640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff49006c280 0x7ff49015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4961a6640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff490156070 0x7ff490158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 -- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff490156070 msgr2=0x7ff490158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff490156070 0x7ff490158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 -- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff49006c280 msgr2=0x7ff49015ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff49006c280 0x7ff49015ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 -- 172.21.15.97:0/3979295852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009a70 con 0x7ff49006e410 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4951a4640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c500 tx=0x7ff48000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800052d0 con 0x7ff49006e410 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480005430 con 0x7ff49006e410 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480012870 con 0x7ff49006e410 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4901f4b90 con 0x7ff49006e410 2023-12-04T05:37:48.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.470+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4901f5150 con 0x7ff49006e410 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490068440 con 0x7ff49006e410 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff4800129d0 con 0x7ff49006e410 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff4867fc640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 0x7ff474068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff480084470 con 0x7ff49006e410 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff4959a5640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 0x7ff474068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.474+0000 7ff4959a5640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 0x7ff474068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0011f0 tx=0x7ff48c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.478+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4800512c0 con 0x7ff49006e410 2023-12-04T05:37:48.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4900ab470 con 0x7ff49006e410 2023-12-04T05:37:48.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff4867fc640 1 -- 172.21.15.97:0/3979295852 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4800548e0 con 0x7ff49006e410 2023-12-04T05:37:48.634 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:48.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 msgr2=0x7ff474068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 0x7ff474068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0011f0 tx=0x7ff48c009040 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 msgr2=0x7ff4900aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c500 tx=0x7ff48000c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 shutdown_connections 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff4740668d0 0x7ff474068d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff490156070 0x7ff490158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff49006e410 0x7ff4900aab50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 --2- 172.21.15.97:0/3979295852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff49006c280 0x7ff49015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 >> 172.21.15.97:0/3979295852 conn(0x7ff4900c5e70 msgr2=0x7ff4900c11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 shutdown_connections 2023-12-04T05:37:48.636 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.630+0000 7ff497c09640 1 -- 172.21.15.97:0/3979295852 wait complete. 2023-12-04T05:37:48.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:48.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.790+0000 7ffab5e79640 1 Processor -- start 2023-12-04T05:37:48.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.790+0000 7ffab5e79640 1 -- start start 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffab5e79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffab00c1360 0x7ffab00700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffab5e79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffab0154af0 0x7ffab014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffab5e79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab0150bc0 con 0x7ffab006c000 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffab5e79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab0154fd0 con 0x7ffab00c1360 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffab5e79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab0151a70 con 0x7ffab0154af0 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaa7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffab006c000 0x7ffab0151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46370/0 (socket says 172.21.15.97:46370) 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaa7fff640 1 -- 172.21.15.97:0/231998950 learned_addr learned my addr 172.21.15.97:0/231998950 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:48.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffab00c1360 0x7ffab00700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaffff640 1 --2- 172.21.15.97:0/231998950 >> v2:172.21.15.143:3300/0 conn(0x7ffab0154af0 0x7ffab014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaeffd640 1 -- 172.21.15.97:0/231998950 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574376174 0 0) 0x7ffab0150bc0 con 0x7ffab006c000 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaeffd640 1 -- 172.21.15.97:0/231998950 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9c003530 con 0x7ffab006c000 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaf7fe640 1 -- 172.21.15.97:0/231998950 >> v2:172.21.15.143:3300/0 conn(0x7ffab0154af0 msgr2=0x7ffab014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaf7fe640 1 --2- 172.21.15.97:0/231998950 >> v2:172.21.15.143:3300/0 conn(0x7ffab0154af0 0x7ffab014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaf7fe640 1 -- 172.21.15.97:0/231998950 >> v1:172.21.15.97:6789/0 conn(0x7ffab006c000 legacy=0x7ffab0151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.794+0000 7ffaaf7fe640 1 -- 172.21.15.97:0/231998950 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0072160 con 0x7ffab00c1360 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffaaf7fe640 1 --2- 172.21.15.97:0/231998950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab00700b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffab00a8460 tx=0x7ffaa001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139ec94e6ce9b1f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffaaeffd640 1 -- 172.21.15.97:0/231998950 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00ab600 con 0x7ffab00c1360 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffaaeffd640 1 -- 172.21.15.97:0/231998950 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa00a7050 con 0x7ffab00c1360 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffaaeffd640 1 -- 172.21.15.97:0/231998950 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00ab980 con 0x7ffab00c1360 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- 172.21.15.97:0/231998950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 msgr2=0x7ffab00700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 --2- 172.21.15.97:0/231998950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab00700b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffab00a8460 tx=0x7ffaa001c3d0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- 172.21.15.97:0/231998950 shutdown_connections 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 --2- 172.21.15.97:0/231998950 >> v2:172.21.15.143:3300/0 conn(0x7ffab0154af0 0x7ffab014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 --2- 172.21.15.97:0/231998950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab00700b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- 172.21.15.97:0/231998950 >> 172.21.15.97:0/231998950 conn(0x7ffab00c5e70 msgr2=0x7ffab00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- 172.21.15.97:0/231998950 shutdown_connections 2023-12-04T05:37:48.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- 172.21.15.97:0/231998950 wait complete. 2023-12-04T05:37:48.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 Processor -- start 2023-12-04T05:37:48.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.798+0000 7ffab5e79640 1 -- start start 2023-12-04T05:37:48.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab006c000 0x7ffab015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0154af0 0x7ffab014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01f12d0 con 0x7ffab00c1360 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01f1800 con 0x7ffab0154af0 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab015e470 con 0x7ffab006c000 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33014/0 (socket says 172.21.15.97:33014) 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 -- 172.21.15.97:0/1686171725 learned_addr learned my addr 172.21.15.97:0/1686171725 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaaf7fe640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab006c000 0x7ffab015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 -- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab006c000 msgr2=0x7ffab015e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab006c000 0x7ffab015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 -- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0154af0 msgr2=0x7ffab014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaaffff640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0154af0 0x7ffab014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0154af0 0x7ffab014ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 -- 172.21.15.97:0/1686171725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009420 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaa7fff640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c500 tx=0x7ffa9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98005cf0 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98005e50 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab01f1520 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980072f0 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab015e100 con 0x7ffab00c1360 2023-12-04T05:37:48.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab015ee40 con 0x7ffab00c1360 2023-12-04T05:37:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.802+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffa98007450 con 0x7ffab00c1360 2023-12-04T05:37:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.806+0000 7ffaacff9640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 0x7ffa90068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.806+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa98083d30 con 0x7ffab00c1360 2023-12-04T05:37:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.806+0000 7ffaaf7fe640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 0x7ffa90068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:48.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.806+0000 7ffaaf7fe640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 0x7ffa90068dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad000 tx=0x7ffaa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:48.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.810+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa98050cb0 con 0x7ffab00c1360 2023-12-04T05:37:48.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffab015dc60 con 0x7ffab00c1360 2023-12-04T05:37:48.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffaacff9640 1 -- 172.21.15.97:0/1686171725 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa980170a0 con 0x7ffab00c1360 2023-12-04T05:37:48.963 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 msgr2=0x7ffa90068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 0x7ffa90068dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad000 tx=0x7ffaa0008040 comp rx=0 tx=0).stop 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 msgr2=0x7ffab0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c500 tx=0x7ffa9800c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 shutdown_connections 2023-12-04T05:37:48.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa90066900 0x7ffa90068dc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffab0154af0 0x7ffab014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffab00c1360 0x7ffab0159aa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 --2- 172.21.15.97:0/1686171725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab006c000 0x7ffab015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.958+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 >> 172.21.15.97:0/1686171725 conn(0x7ffab00c5e70 msgr2=0x7ffab00663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.962+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 shutdown_connections 2023-12-04T05:37:48.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:48.962+0000 7ffab5e79640 1 -- 172.21.15.97:0/1686171725 wait complete. 2023-12-04T05:37:48.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:49.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 Processor -- start 2023-12-04T05:37:49.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 -- start start 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6340c1fb0 0x7fe6340c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe63406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe634154880 con 0x7fe634072800 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe634158c90 con 0x7fe6340c1fb0 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63909c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63406e160 con 0x7fe634158800 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6340c1fb0 0x7fe6340c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6340c1fb0 0x7fe6340c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33022/0 (socket says 172.21.15.97:33022) 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 -- 172.21.15.97:0/3066877991 learned_addr learned my addr 172.21.15.97:0/3066877991 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe63359e640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe63406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 -- 172.21.15.97:0/3066877991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 msgr2=0x7fe63406b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe63406b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 -- 172.21.15.97:0/3066877991 >> v1:172.21.15.143:6789/0 conn(0x7fe634072800 legacy=0x7fe634155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:49.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.126+0000 7fe632d9d640 1 -- 172.21.15.97:0/3066877991 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63406e440 con 0x7fe6340c1fb0 2023-12-04T05:37:49.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe632d9d640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6340c1fb0 0x7fe6340c10c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe624009870 tx=0x7fe62401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5774f33c207ec7c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63259c640 1 -- 172.21.15.97:0/3066877991 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240ab600 con 0x7fe6340c1fb0 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63259c640 1 -- 172.21.15.97:0/3066877991 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240a7050 con 0x7fe6340c1fb0 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63259c640 1 -- 172.21.15.97:0/3066877991 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240ab980 con 0x7fe6340c1fb0 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 -- 172.21.15.97:0/3066877991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6340c1fb0 msgr2=0x7fe6340c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6340c1fb0 0x7fe6340c10c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe624009870 tx=0x7fe62401c3b0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 -- 172.21.15.97:0/3066877991 shutdown_connections 2023-12-04T05:37:49.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe63406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 --2- 172.21.15.97:0/3066877991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6340c1fb0 0x7fe6340c10c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 -- 172.21.15.97:0/3066877991 >> 172.21.15.97:0/3066877991 conn(0x7fe6340c31c0 msgr2=0x7fe6340c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 -- 172.21.15.97:0/3066877991 shutdown_connections 2023-12-04T05:37:49.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.130+0000 7fe63909c640 1 -- 172.21.15.97:0/3066877991 wait complete. 2023-12-04T05:37:49.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 Processor -- start 2023-12-04T05:37:49.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 -- start start 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 0x7fe634148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe634147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ab980 con 0x7fe634072800 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340aa740 con 0x7fe6340c1fb0 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63909c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ab3c0 con 0x7fe634158800 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33038/0 (socket says 172.21.15.97:33038) 2023-12-04T05:37:49.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 -- 172.21.15.97:0/4222721648 learned_addr learned my addr 172.21.15.97:0/4222721648 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe62a59c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 0x7fe634148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe63359e640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe634147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 -- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 msgr2=0x7fe634147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe634147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 -- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 msgr2=0x7fe634148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 0x7fe634148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 -- 172.21.15.97:0/4222721648 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240094d0 con 0x7fe634072800 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe62a59c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 0x7fe634148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:49.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe632d9d640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae040 tx=0x7fe624019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.134+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240b4640 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240b47a0 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240b4b30 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340ab6a0 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63414ced0 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6340aa230 con 0x7fe634072800 2023-12-04T05:37:49.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe6240b2070 con 0x7fe634072800 2023-12-04T05:37:49.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62bfff640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 0x7fe614068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe62411e810 con 0x7fe634072800 2023-12-04T05:37:49.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62a59c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 0x7fe614068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.138+0000 7fe62a59c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 0x7fe614068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe634152390 tx=0x7fe61c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.142+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6340aa230 con 0x7fe634072800 2023-12-04T05:37:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.294+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6340aa230 con 0x7fe634072800 2023-12-04T05:37:49.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.294+0000 7fe62bfff640 1 -- 172.21.15.97:0/4222721648 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6340aa230 con 0x7fe634072800 2023-12-04T05:37:49.300 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 msgr2=0x7fe614068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 0x7fe614068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe634152390 tx=0x7fe61c008040 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 msgr2=0x7fe63414c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe6240ae040 tx=0x7fe624019150 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 shutdown_connections 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6140668d0 0x7fe614068d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe634158800 0x7fe634147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6340c1fb0 0x7fe634148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 --2- 172.21.15.97:0/4222721648 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe634072800 0x7fe63414c3e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 >> 172.21.15.97:0/4222721648 conn(0x7fe6340c31c0 msgr2=0x7fe6341526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 shutdown_connections 2023-12-04T05:37:49.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.298+0000 7fe63909c640 1 -- 172.21.15.97:0/4222721648 wait complete. 2023-12-04T05:37:49.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:37:49.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 Processor -- start 2023-12-04T05:37:49.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 -- start start 2023-12-04T05:37:49.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e6806c440 0x7f7e681524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680aa240 con 0x7f7e6806d210 2023-12-04T05:37:49.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680aa500 con 0x7f7e680c1e70 2023-12-04T05:37:49.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6e3f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6806c0c0 con 0x7f7e6806c440 2023-12-04T05:37:49.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6c995640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7e6806d210 0x7f7e6806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46372/0 (socket says 172.21.15.97:46372) 2023-12-04T05:37:49.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e6c995640 1 -- 172.21.15.97:0/1604517348 learned_addr learned my addr 172.21.15.97:0/1604517348 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:49.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e677fe640 1 --2- 172.21.15.97:0/1604517348 >> v2:172.21.15.143:3300/0 conn(0x7f7e6806c440 0x7f7e681524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245713067 0 0) 0x7f7e680aa240 con 0x7f7e6806d210 2023-12-04T05:37:49.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e50003530 con 0x7f7e6806d210 2023-12-04T05:37:49.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e677fe640 1 -- 172.21.15.97:0/1604517348 >> v1:172.21.15.143:6789/0 conn(0x7f7e680c1e70 legacy=0x7f7e680a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e677fe640 1 -- 172.21.15.97:0/1604517348 >> v1:172.21.15.97:6789/0 conn(0x7f7e6806d210 legacy=0x7f7e6806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829867448 0 0) 0x7f7e50003530 con 0x7f7e6806d210 2023-12-04T05:37:49.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.458+0000 7f7e677fe640 1 -- 172.21.15.97:0/1604517348 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680aa7e0 con 0x7f7e6806c440 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e677fe640 1 --2- 172.21.15.97:0/1604517348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806c440 0x7f7e681524e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097c0 tx=0x7f7e5c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fae5cbf29dce20bd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60001a00 con 0x7f7e6806c440 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0a7050 con 0x7f7e6806c440 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e66ffd640 1 -- 172.21.15.97:0/1604517348 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0ab620 con 0x7f7e6806c440 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/1604517348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806c440 msgr2=0x7f7e681524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/1604517348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806c440 0x7f7e681524e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097c0 tx=0x7f7e5c01c370 comp rx=0 tx=0).stop 2023-12-04T05:37:49.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/1604517348 shutdown_connections 2023-12-04T05:37:49.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/1604517348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806c440 0x7f7e681524e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/1604517348 >> 172.21.15.97:0/1604517348 conn(0x7f7e680c5e70 msgr2=0x7f7e680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/1604517348 shutdown_connections 2023-12-04T05:37:49.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.462+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/1604517348 wait complete. 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 Processor -- start 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- start start 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e6806c440 0x7f7e681eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 0x7f7e68155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681544d0 con 0x7f7e680c1e70 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68148a00 con 0x7f7e6806d210 2023-12-04T05:37:49.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681eb980 con 0x7f7e6806c440 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33054/0 (socket says 172.21.15.97:33054) 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 -- 172.21.15.97:0/363844551 learned_addr learned my addr 172.21.15.97:0/363844551 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e677fe640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 0x7f7e68155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e67fff640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e6806c440 0x7f7e681eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 -- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e6806c440 msgr2=0x7f7e681eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e6806c440 0x7f7e681eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 -- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 msgr2=0x7f7e68155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 0x7f7e68155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 -- 172.21.15.97:0/363844551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009420 con 0x7f7e680c1e70 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e677fe640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 0x7f7e68155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6c995640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e600018a0 tx=0x7f7e6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60012400 con 0x7f7e680c1e70 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60012560 con 0x7f7e680c1e70 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6814ce00 con 0x7f7e680c1e70 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60012910 con 0x7f7e680c1e70 2023-12-04T05:37:49.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.466+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6814d050 con 0x7f7e680c1e70 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e680c6dd0 con 0x7f7e680c1e70 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7e60012a70 con 0x7f7e680c1e70 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e64ff9640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 0x7f7e54068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7e60084ff0 con 0x7f7e680c1e70 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e67fff640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 0x7f7e54068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.470+0000 7f7e67fff640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 0x7f7e54068dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e68067680 tx=0x7f7e58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.474+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e60051ed0 con 0x7f7e680c1e70 2023-12-04T05:37:49.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.622+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e6806e710 con 0x7f7e680c1e70 2023-12-04T05:37:49.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.622+0000 7f7e64ff9640 1 -- 172.21.15.97:0/363844551 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7e600554f0 con 0x7f7e680c1e70 2023-12-04T05:37:49.628 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 msgr2=0x7f7e54068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 0x7f7e54068dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7e68067680 tx=0x7f7e58009040 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 msgr2=0x7f7e680c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e600018a0 tx=0x7f7e6000a430 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 shutdown_connections 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7e54066900 0x7f7e54068dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e680c1e70 0x7f7e680c09d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e6806d210 0x7f7e68155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 --2- 172.21.15.97:0/363844551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e6806c440 0x7f7e681eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 >> 172.21.15.97:0/363844551 conn(0x7f7e680c5e70 msgr2=0x7f7e680c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 shutdown_connections 2023-12-04T05:37:49.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.626+0000 7f7e6e3f8640 1 -- 172.21.15.97:0/363844551 wait complete. 2023-12-04T05:37:49.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:37:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.782+0000 7fd7e26c9640 1 Processor -- start 2023-12-04T05:37:49.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e26c9640 1 -- start start 2023-12-04T05:37:49.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e26c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd7dc1524e0 0x7fd7dc06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e26c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc0aa240 con 0x7fd7dc0c1e70 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e26c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc0aa500 con 0x7fd7dc06c440 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e26c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc06c0c0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7dbfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd7dc0c1e70 0x7fd7dc0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46386/0 (socket says 172.21.15.97:46386) 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7dbfff640 1 -- 172.21.15.97:0/425871202 learned_addr learned my addr 172.21.15.97:0/425871202 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:49.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e0c66640 1 --2- 172.21.15.97:0/425871202 >> v2:172.21.15.97:3300/0 conn(0x7fd7dc1524e0 0x7fd7dc06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7daffd640 1 -- 172.21.15.97:0/425871202 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538977305 0 0) 0x7fd7dc0aa240 con 0x7fd7dc0c1e70 2023-12-04T05:37:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7daffd640 1 -- 172.21.15.97:0/425871202 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c4003530 con 0x7fd7dc0c1e70 2023-12-04T05:37:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e0c66640 1 -- 172.21.15.97:0/425871202 >> v1:172.21.15.143:6789/0 conn(0x7fd7dc06c440 legacy=0x7fd7dc06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e0c66640 1 -- 172.21.15.97:0/425871202 >> v1:172.21.15.97:6789/0 conn(0x7fd7dc0c1e70 legacy=0x7fd7dc0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.786+0000 7fd7e0c66640 1 -- 172.21.15.97:0/425871202 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc0aa7e0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e0c66640 1 --2- 172.21.15.97:0/425871202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc06d920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d90 tx=0x7fd7d401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dd2760db1566ca server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7daffd640 1 -- 172.21.15.97:0/425871202 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40a5900 con 0x7fd7dc1524e0 2023-12-04T05:37:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7daffd640 1 -- 172.21.15.97:0/425871202 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d40a5a60 con 0x7fd7dc1524e0 2023-12-04T05:37:49.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7daffd640 1 -- 172.21.15.97:0/425871202 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40a5dd0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- 172.21.15.97:0/425871202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 msgr2=0x7fd7dc06d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/425871202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc06d920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009d90 tx=0x7fd7d401c950 comp rx=0 tx=0).stop 2023-12-04T05:37:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- 172.21.15.97:0/425871202 shutdown_connections 2023-12-04T05:37:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/425871202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc06d920 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- 172.21.15.97:0/425871202 >> 172.21.15.97:0/425871202 conn(0x7fd7dc0c5e70 msgr2=0x7fd7dc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- 172.21.15.97:0/425871202 shutdown_connections 2023-12-04T05:37:49.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- 172.21.15.97:0/425871202 wait complete. 2023-12-04T05:37:49.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 Processor -- start 2023-12-04T05:37:49.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.790+0000 7fd7e26c9640 1 -- start start 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 0x7fd7dc14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 0x7fd7dc0c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc14cba0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc14f3c0 con 0x7fd7dc06c440 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc14f6a0 con 0x7fd7dc0c1e70 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33076/0 (socket says 172.21.15.97:33076) 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 -- 172.21.15.97:0/4247565655 learned_addr learned my addr 172.21.15.97:0/4247565655 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7dbfff640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 0x7fd7dc14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7db7fe640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 0x7fd7dc0c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 -- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 msgr2=0x7fd7dc0c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 0x7fd7dc0c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 -- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 msgr2=0x7fd7dc14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 0x7fd7dc14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 -- 172.21.15.97:0/4247565655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4009a70 con 0x7fd7dc1524e0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7db7fe640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 0x7fd7dc0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7dbfff640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 0x7fd7dc14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e0c66640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4019560 tx=0x7fd7d40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40a5900 con 0x7fd7dc1524e0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d4003ba0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40ad650 con 0x7fd7dc1524e0 2023-12-04T05:37:49.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc14cdf0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc0c2dc0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.794+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc068440 con 0x7fd7dc1524e0 2023-12-04T05:37:49.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.798+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd7d40b4070 con 0x7fd7dc1524e0 2023-12-04T05:37:49.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.798+0000 7fd7d8ff9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 0x7fd7c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.798+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd7d411e9b0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.798+0000 7fd7dbfff640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 0x7fd7c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:49.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.798+0000 7fd7dbfff640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 0x7fd7c8068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0011f0 tx=0x7fd7cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:49.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.802+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7d40eb920 con 0x7fd7dc1524e0 2023-12-04T05:37:49.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd7dc06c220 con 0x7fd7dc1524e0 2023-12-04T05:37:49.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7d8ff9640 1 -- 172.21.15.97:0/4247565655 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd7d40b20a0 con 0x7fd7dc1524e0 2023-12-04T05:37:49.955 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:49.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 msgr2=0x7fd7c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 0x7fd7c8068d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0011f0 tx=0x7fd7cc009040 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 msgr2=0x7fd7dc140ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4019560 tx=0x7fd7d40196f0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 shutdown_connections 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7c80668d0 0x7fd7c8068d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd7dc1524e0 0x7fd7dc140ed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7dc0c1e70 0x7fd7dc0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.950+0000 7fd7e26c9640 1 --2- 172.21.15.97:0/4247565655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7dc06c440 0x7fd7dc14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.954+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 >> 172.21.15.97:0/4247565655 conn(0x7fd7dc0c5e70 msgr2=0x7fd7dc1468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.954+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 shutdown_connections 2023-12-04T05:37:49.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:49.954+0000 7fd7e26c9640 1 -- 172.21.15.97:0/4247565655 wait complete. 2023-12-04T05:37:49.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:37:50.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 Processor -- start 2023-12-04T05:37:50.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 -- start start 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb6014f960 0x7ffb601548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb60154e10 0x7ffb6015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb60154640 con 0x7ffb6014eb30 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600c0bd0 con 0x7ffb60154e10 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb65efe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6014ef10 con 0x7ffb6014f960 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb60154e10 0x7ffb6015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb60154e10 0x7ffb6015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33080/0 (socket says 172.21.15.97:33080) 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 -- 172.21.15.97:0/599867233 learned_addr learned my addr 172.21.15.97:0/599867233 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5effd640 1 --2- 172.21.15.97:0/599867233 >> v2:172.21.15.143:3300/0 conn(0x7ffb6014f960 0x7ffb601548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 -- 172.21.15.97:0/599867233 >> v2:172.21.15.143:3300/0 conn(0x7ffb6014f960 msgr2=0x7ffb601548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 --2- 172.21.15.97:0/599867233 >> v2:172.21.15.143:3300/0 conn(0x7ffb6014f960 0x7ffb601548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 -- 172.21.15.97:0/599867233 >> v1:172.21.15.143:6789/0 conn(0x7ffb6014eb30 legacy=0x7ffb6014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.114+0000 7ffb5ffff640 1 -- 172.21.15.97:0/599867233 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb601535a0 con 0x7ffb60154e10 2023-12-04T05:37:50.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb5ffff640 1 --2- 172.21.15.97:0/599867233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb60154e10 0x7ffb6015bc60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb6006e7f0 tx=0x7ffb5801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ce739188d478a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb5e7fc640 1 -- 172.21.15.97:0/599867233 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580a5770 con 0x7ffb60154e10 2023-12-04T05:37:50.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb5e7fc640 1 -- 172.21.15.97:0/599867233 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580a58d0 con 0x7ffb60154e10 2023-12-04T05:37:50.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb5e7fc640 1 -- 172.21.15.97:0/599867233 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580a5c60 con 0x7ffb60154e10 2023-12-04T05:37:50.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 -- 172.21.15.97:0/599867233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb60154e10 msgr2=0x7ffb6015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 --2- 172.21.15.97:0/599867233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb60154e10 0x7ffb6015bc60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb6006e7f0 tx=0x7ffb5801c9a0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 -- 172.21.15.97:0/599867233 shutdown_connections 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 --2- 172.21.15.97:0/599867233 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb60154e10 0x7ffb6015bc60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 --2- 172.21.15.97:0/599867233 >> v2:172.21.15.143:3300/0 conn(0x7ffb6014f960 0x7ffb601548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 -- 172.21.15.97:0/599867233 >> 172.21.15.97:0/599867233 conn(0x7ffb600c5e70 msgr2=0x7ffb600c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 -- 172.21.15.97:0/599867233 shutdown_connections 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.118+0000 7ffb65efe640 1 -- 172.21.15.97:0/599867233 wait complete. 2023-12-04T05:37:50.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 Processor -- start 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- start start 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb6014eb30 0x7ffb600bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb60154e10 0x7ffb6013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6013fbd0 con 0x7ffb6014f960 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601edf60 con 0x7ffb60154e10 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6013fe20 con 0x7ffb6014eb30 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33084/0 (socket says 172.21.15.97:33084) 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 -- 172.21.15.97:0/3165299762 learned_addr learned my addr 172.21.15.97:0/3165299762 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:50.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5ffff640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb60154e10 0x7ffb6013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5f7fe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb6014eb30 0x7ffb600bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 -- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb6014eb30 msgr2=0x7ffb600bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb6014eb30 0x7ffb600bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 -- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb60154e10 msgr2=0x7ffb6013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb60154e10 0x7ffb6013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 -- 172.21.15.97:0/3165299762 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58009b30 con 0x7ffb6014f960 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb5effd640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400e930 tx=0x7ffb5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54009690 con 0x7ffb6014f960 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400ca00 con 0x7ffb6014f960 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400cd70 con 0x7ffb6014f960 2023-12-04T05:37:50.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb60140100 con 0x7ffb6014f960 2023-12-04T05:37:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.122+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6006d6f0 con 0x7ffb6014f960 2023-12-04T05:37:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.126+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb60068440 con 0x7ffb6014f960 2023-12-04T05:37:50.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.126+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb54013470 con 0x7ffb6014f960 2023-12-04T05:37:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.126+0000 7ffb47fff640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.126+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffb54084940 con 0x7ffb6014f960 2023-12-04T05:37:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.126+0000 7ffb5f7fe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.130+0000 7ffb5f7fe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 0x7ffb4c068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000f70 tx=0x7ffb50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.130+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb54051990 con 0x7ffb6014f960 2023-12-04T05:37:50.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb600a8ac0 con 0x7ffb6014f960 2023-12-04T05:37:50.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb47fff640 1 -- 172.21.15.97:0/3165299762 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb54054fb0 con 0x7ffb6014f960 2023-12-04T05:37:50.302 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 msgr2=0x7ffb4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 0x7ffb4c068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000f70 tx=0x7ffb50009040 comp rx=0 tx=0).stop 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 msgr2=0x7ffb6013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400e930 tx=0x7ffb5400edf0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 shutdown_connections 2023-12-04T05:37:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb4c0668d0 0x7ffb4c068d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb60154e10 0x7ffb6013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb6014f960 0x7ffb6013e2e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 --2- 172.21.15.97:0/3165299762 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb6014eb30 0x7ffb600bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 >> 172.21.15.97:0/3165299762 conn(0x7ffb600c5e70 msgr2=0x7ffb60144ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 shutdown_connections 2023-12-04T05:37:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.298+0000 7ffb65efe640 1 -- 172.21.15.97:0/3165299762 wait complete. 2023-12-04T05:37:50.323 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:37:50.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.324 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:50.351 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:37:50.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.351 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:37:50.401 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:50.401 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:50.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:37:50.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:37:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.586+0000 7f75f218d640 1 Processor -- start 2023-12-04T05:37:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.586+0000 7f75f218d640 1 -- start start 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec151bf0 0x7f75ec0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75ec0c7ef0 0x7f75ec154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f75ec158630 0x7f75ec1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec1547d0 con 0x7f75ec158630 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec158b80 con 0x7f75ec0c7ef0 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75f218d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0c4aa0 con 0x7f75ec151bf0 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f75ec158630 0x7f75ec1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f75ec158630 0x7f75ec1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33096/0 (socket says 172.21.15.97:33096) 2023-12-04T05:37:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 -- 172.21.15.97:0/2143425815 learned_addr learned my addr 172.21.15.97:0/2143425815 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75eb7fe640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec151bf0 0x7f75ec0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75eaffd640 1 --2- 172.21.15.97:0/2143425815 >> v2:172.21.15.143:3300/0 conn(0x7f75ec0c7ef0 0x7f75ec154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 -- 172.21.15.97:0/2143425815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec151bf0 msgr2=0x7f75ec0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec151bf0 0x7f75ec0abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 -- 172.21.15.97:0/2143425815 >> v2:172.21.15.143:3300/0 conn(0x7f75ec0c7ef0 msgr2=0x7f75ec154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 --2- 172.21.15.97:0/2143425815 >> v2:172.21.15.143:3300/0 conn(0x7f75ec0c7ef0 0x7f75ec154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.590+0000 7f75ebfff640 1 -- 172.21.15.97:0/2143425815 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0c4d40 con 0x7f75ec158630 2023-12-04T05:37:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75ebfff640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec1551a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ac660 tx=0x7f75e401c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a0190a0517ae9f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75ea7fc640 1 -- 172.21.15.97:0/2143425815 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40a4ca0 con 0x7f75ec158630 2023-12-04T05:37:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75ea7fc640 1 -- 172.21.15.97:0/2143425815 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e40a4e00 con 0x7f75ec158630 2023-12-04T05:37:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75ea7fc640 1 -- 172.21.15.97:0/2143425815 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40ac610 con 0x7f75ec158630 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 -- 172.21.15.97:0/2143425815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 msgr2=0x7f75ec1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec1551a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ac660 tx=0x7f75e401c590 comp rx=0 tx=0).stop 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 -- 172.21.15.97:0/2143425815 shutdown_connections 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec1551a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 --2- 172.21.15.97:0/2143425815 >> v2:172.21.15.143:3300/0 conn(0x7f75ec0c7ef0 0x7f75ec154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 --2- 172.21.15.97:0/2143425815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec151bf0 0x7f75ec0abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 -- 172.21.15.97:0/2143425815 >> 172.21.15.97:0/2143425815 conn(0x7f75ec073550 msgr2=0x7f75ec073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 -- 172.21.15.97:0/2143425815 shutdown_connections 2023-12-04T05:37:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 -- 172.21.15.97:0/2143425815 wait complete. 2023-12-04T05:37:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.594+0000 7f75f218d640 1 Processor -- start 2023-12-04T05:37:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- start start 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec0c7ef0 0x7f75ec14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75ec151bf0 0x7f75ec148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0abee0 con 0x7f75ec158630 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0ab860 con 0x7f75ec151bf0 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec148ea0 con 0x7f75ec0c7ef0 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33108/0 (socket says 172.21.15.97:33108) 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 -- 172.21.15.97:0/137371836 learned_addr learned my addr 172.21.15.97:0/137371836 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75eb7fe640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec0c7ef0 0x7f75ec14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75eaffd640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75ec151bf0 0x7f75ec148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 -- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec0c7ef0 msgr2=0x7f75ec14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec0c7ef0 0x7f75ec14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 -- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75ec151bf0 msgr2=0x7f75ec148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75ec151bf0 0x7f75ec148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 -- 172.21.15.97:0/137371836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009b30 con 0x7f75ec158630 2023-12-04T05:37:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75ebfff640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f75e401ac40 tx=0x7f75e4019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40a4ca0 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4009510 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec1f2360 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4007cd0 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.598+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec14f100 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec068440 con 0x7f75ec158630 2023-12-04T05:37:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f75e40b7470 con 0x7f75ec158630 2023-12-04T05:37:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75d3fff640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 0x7f75d8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f75e411ecb0 con 0x7f75ec158630 2023-12-04T05:37:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75eb7fe640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 0x7f75d8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:50.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.602+0000 7f75eb7fe640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 0x7f75d8068dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009a40 tx=0x7f75dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.606+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75e40ebcf0 con 0x7f75ec158630 2023-12-04T05:37:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75ec06c970 con 0x7f75ec158630 2023-12-04T05:37:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75d3fff640 1 -- 172.21.15.97:0/137371836 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f75e40bb070 con 0x7f75ec158630 2023-12-04T05:37:50.793 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:37:50.793 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:37:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 msgr2=0x7f75d8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 0x7f75d8068dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009a40 tx=0x7f75dc009190 comp rx=0 tx=0).stop 2023-12-04T05:37:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 msgr2=0x7f75ec148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f75e401ac40 tx=0x7f75e4019650 comp rx=0 tx=0).stop 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 shutdown_connections 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f75d8066900 0x7f75d8068dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75ec158630 0x7f75ec148960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75ec151bf0 0x7f75ec148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 --2- 172.21.15.97:0/137371836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75ec0c7ef0 0x7f75ec14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 >> 172.21.15.97:0/137371836 conn(0x7f75ec073550 msgr2=0x7f75ec0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 shutdown_connections 2023-12-04T05:37:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:50.790+0000 7f75f218d640 1 -- 172.21.15.97:0/137371836 wait complete. 2023-12-04T05:37:50.814 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:37:50.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:37:50.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:37:50.815 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:50.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.815 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:37:50.825 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:37:50.825 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:37:50.825 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:37:50.825 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42071sec preferred_lft 42071sec 2023-12-04T05:37:50.826 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:37:50.827 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:37:50.828 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:50.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.828 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:37:50.891 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:37:50.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.893 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:37:50.946 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:50.947 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:37:50.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:37:50.948 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:37:51.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:51.040 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:37:51.050 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:37:51.051 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:51.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:51.051 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:37:51.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:51.117 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:51.172 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:37:51.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:51.173 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:51.229 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-04T05:37:51.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:51.229 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:51.321 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:51.321 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:51.334 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:51.335 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:51.335 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:37:51.335 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:37:51.335 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:37:51.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:37:51.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:51.339 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:51.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:51.363 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:37:51.422 INFO:teuthology.orchestra.run.smithi143.stdout:client5388 2023-12-04T05:37:51.423 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:51.423 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:51.477 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-04T05:37:51.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.614+0000 7f14a0972640 1 Processor -- start 2023-12-04T05:37:51.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.614+0000 7f14a0972640 1 -- start start 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f14a0972640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f149c0725b0 0x7f149c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f14a0972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 0x7f149c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f14a0972640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c0700b0 con 0x7f149c0aa830 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f14a0972640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c06c990 con 0x7f149c0725b0 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f14a0972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c06d830 con 0x7f149c1515e0 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f149c0725b0 0x7f149c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f149ad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 0x7f149c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f149a59c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f149c0aa830 0x7f149c0ab0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:51164/0 (socket says 172.21.15.97:51164) 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f149a59c640 1 -- 172.21.15.97:0/2534739682 learned_addr learned my addr 172.21.15.97:0/2534739682 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:51.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f149c0725b0 0x7f149c06cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:57094/0 (socket says 172.21.15.97:57094) 2023-12-04T05:37:51.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 -- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 msgr2=0x7f149c06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:51.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 0x7f149c06d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 -- 172.21.15.97:0/2534739682 >> v1:172.21.15.143:6789/0 conn(0x7f149c0aa830 legacy=0x7f149c0ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 -- 172.21.15.97:0/2534739682 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c06bff0 con 0x7f149c0725b0 2023-12-04T05:37:51.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f149ad9d640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 0x7f149c06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:51.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1499d9b640 1 -- 172.21.15.97:0/2534739682 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869976264 0 0) 0x7f149c0700b0 con 0x7f149c0aa830 2023-12-04T05:37:51.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.618+0000 7f1493fff640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c0725b0 0x7f149c06cdb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14840097c0 tx=0x7f148401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41394d1dad07ac87 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:51.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f1499d9b640 1 -- 172.21.15.97:0/2534739682 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ab600 con 0x7f149c0725b0 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f1499d9b640 1 -- 172.21.15.97:0/2534739682 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840a7050 con 0x7f149c0725b0 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f1499d9b640 1 -- 172.21.15.97:0/2534739682 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ab980 con 0x7f149c0725b0 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c0725b0 msgr2=0x7f149c06cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c0725b0 0x7f149c06cdb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14840097c0 tx=0x7f148401c3c0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- 172.21.15.97:0/2534739682 shutdown_connections 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c1515e0 0x7f149c06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- 172.21.15.97:0/2534739682 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c0725b0 0x7f149c06cdb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- 172.21.15.97:0/2534739682 >> 172.21.15.97:0/2534739682 conn(0x7f149c0c2a50 msgr2=0x7f149c0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- 172.21.15.97:0/2534739682 shutdown_connections 2023-12-04T05:37:51.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- 172.21.15.97:0/2534739682 wait complete. 2023-12-04T05:37:51.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 Processor -- start 2023-12-04T05:37:51.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- start start 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 0x7f149c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c1515e0 0x7f149c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c156190 con 0x7f149c0725b0 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c1503a0 con 0x7f149c1515e0 2023-12-04T05:37:51.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.622+0000 7f14a0972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c14edc0 con 0x7f149c0aa830 2023-12-04T05:37:51.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33112/0 (socket says 172.21.15.97:33112) 2023-12-04T05:37:51.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 -- 172.21.15.97:0/3788303392 learned_addr learned my addr 172.21.15.97:0/3788303392 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:51.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149ad9d640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c1515e0 0x7f149c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1493fff640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 0x7f149c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 -- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 msgr2=0x7f149c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 0x7f149c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 -- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c1515e0 msgr2=0x7f149c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c1515e0 0x7f149c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 -- 172.21.15.97:0/3788303392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009a70 con 0x7f149c0725b0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1493fff640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 0x7f149c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f149a59c640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f148c0011f0 tx=0x7f148c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0074e0 con 0x7f149c0725b0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c007640 con 0x7f149c0725b0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c004a10 con 0x7f149c0725b0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1484009420 con 0x7f149c0725b0 2023-12-04T05:37:51.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c14f380 con 0x7f149c0725b0 2023-12-04T05:37:51.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c068440 con 0x7f149c0725b0 2023-12-04T05:37:51.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f148c004b70 con 0x7f149c0725b0 2023-12-04T05:37:51.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.626+0000 7f1492ffd640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 0x7f147c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:51.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.630+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f148c083960 con 0x7f149c0725b0 2023-12-04T05:37:51.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.630+0000 7f1493fff640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 0x7f147c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:51.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.630+0000 7f1493fff640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 0x7f147c068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f149c074570 tx=0x7f1484008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:51.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.634+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f148c050980 con 0x7f149c0725b0 2023-12-04T05:37:51.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.810+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f149c0c21f0 con 0x7f149c0725b0 2023-12-04T05:37:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.814+0000 7f1492ffd640 1 -- 172.21.15.97:0/3788303392 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v15) v1 ==== 134+0+185 (secure 0 0 0) 0x7f148c018020 con 0x7f149c0725b0 2023-12-04T05:37:51.819 INFO:teuthology.orchestra.run.smithi097.stdout:[client.testuser] 2023-12-04T05:37:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w== 2023-12-04T05:37:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-04T05:37:51.819 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r fsname=cephfs" 2023-12-04T05:37:51.820 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T05:37:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 msgr2=0x7f147c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 0x7f147c068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f149c074570 tx=0x7f1484008040 comp rx=0 tx=0).stop 2023-12-04T05:37:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 msgr2=0x7f149c14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f148c0011f0 tx=0x7f148c00c9b0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 shutdown_connections 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f147c0668d0 0x7f147c068d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f149c1515e0 0x7f149c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f149c0aa830 0x7f149c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 --2- 172.21.15.97:0/3788303392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f149c0725b0 0x7f149c14fe60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 >> 172.21.15.97:0/3788303392 conn(0x7f149c0c2a50 msgr2=0x7f149c0c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 shutdown_connections 2023-12-04T05:37:51.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:51.818+0000 7f14a0972640 1 -- 172.21.15.97:0/3788303392 wait complete. 2023-12-04T05:37:51.841 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:37:51.850 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.CFjHrGyJ33 2023-12-04T05:37:51.851 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:51.851 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/tmp/tmp.CFjHrGyJ33 2023-12-04T05:37:51.900 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:51.900 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:51.956 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:51.956 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:52.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:52.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 Processor -- start 2023-12-04T05:37:52.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 -- start start 2023-12-04T05:37:52.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c1532f0 0x7f013c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f013c06d190 0x7f013c0a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0c4810 con 0x7f013c0a5200 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c06d610 con 0x7f013c06d190 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1536d0 con 0x7f013c1532f0 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013ad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f013c0a5200 0x7f013c153e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46396/0 (socket says 172.21.15.97:46396) 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013ad9d640 1 -- 172.21.15.97:0/1677961199 learned_addr learned my addr 172.21.15.97:0/1677961199 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f0139d9b640 1 --2- 172.21.15.97:0/1677961199 >> v2:172.21.15.143:3300/0 conn(0x7f013c06d190 0x7f013c0a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013a59c640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c1532f0 0x7f013c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013959a640 1 -- 172.21.15.97:0/1677961199 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973737981 0 0) 0x7f013c0c4810 con 0x7f013c0a5200 2023-12-04T05:37:52.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f013959a640 1 -- 172.21.15.97:0/1677961199 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0124003530 con 0x7f013c0a5200 2023-12-04T05:37:52.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f0139d9b640 1 -- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c1532f0 msgr2=0x7f013c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:52.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f0139d9b640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c1532f0 0x7f013c0c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f0139d9b640 1 -- 172.21.15.97:0/1677961199 >> v1:172.21.15.97:6789/0 conn(0x7f013c0a5200 legacy=0x7f013c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.190+0000 7f0139d9b640 1 -- 172.21.15.97:0/1677961199 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c06e300 con 0x7f013c06d190 2023-12-04T05:37:52.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f0139d9b640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c06d190 0x7f013c0a4cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01300097c0 tx=0x7f013001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fe61acdd853133 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013959a640 1 -- 172.21.15.97:0/1677961199 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300ac620 con 0x7f013c06d190 2023-12-04T05:37:52.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013959a640 1 -- 172.21.15.97:0/1677961199 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300ac780 con 0x7f013c06d190 2023-12-04T05:37:52.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013959a640 1 -- 172.21.15.97:0/1677961199 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300acb10 con 0x7f013c06d190 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 -- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c06d190 msgr2=0x7f013c0a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c06d190 0x7f013c0a4cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01300097c0 tx=0x7f013001c3c0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 -- 172.21.15.97:0/1677961199 shutdown_connections 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c06d190 0x7f013c0a4cc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 --2- 172.21.15.97:0/1677961199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c1532f0 0x7f013c0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 -- 172.21.15.97:0/1677961199 >> 172.21.15.97:0/1677961199 conn(0x7f013c0c5a50 msgr2=0x7f013c0c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 -- 172.21.15.97:0/1677961199 shutdown_connections 2023-12-04T05:37:52.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.194+0000 7f013b59e640 1 -- 172.21.15.97:0/1677961199 wait complete. 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 Processor -- start 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- start start 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c06d190 0x7f013c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c0a5200 0x7f013c1ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c1ecb80 con 0x7f013c1532f0 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c0aa660 con 0x7f013c0a5200 2023-12-04T05:37:52.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c070420 con 0x7f013c06d190 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33114/0 (socket says 172.21.15.97:33114) 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 -- 172.21.15.97:0/1814851424 learned_addr learned my addr 172.21.15.97:0/1814851424 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013a59c640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c06d190 0x7f013c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f0139d9b640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c0a5200 0x7f013c1ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 -- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c06d190 msgr2=0x7f013c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c06d190 0x7f013c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 -- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c0a5200 msgr2=0x7f013c1ed010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c0a5200 0x7f013c1ed010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 -- 172.21.15.97:0/1814851424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009420 con 0x7f013c1532f0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013ad9d640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f013400caa0 tx=0x7f013400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400ac00 con 0x7f013c1532f0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400ad60 con 0x7f013c1532f0 2023-12-04T05:37:52.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134012620 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c1f0d40 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.198+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0709c0 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c1eccf0 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0134007070 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f012affd640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 0x7f011c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0134084780 con 0x7f013c1532f0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f013a59c640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 0x7f011c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.202+0000 7f013a59c640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 0x7f011c068d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f012c009b60 tx=0x7f012c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.206+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0134051670 con 0x7f013c1532f0 2023-12-04T05:37:52.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.358+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f013c04e890 con 0x7f013c1532f0 2023-12-04T05:37:52.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.358+0000 7f012affd640 1 -- 172.21.15.97:0/1814851424 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7f0134054c90 con 0x7f013c1532f0 2023-12-04T05:37:52.363 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:52.363 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 msgr2=0x7f011c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 0x7f011c068d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f012c009b60 tx=0x7f012c009190 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 msgr2=0x7f013c1ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f013400caa0 tx=0x7f013400cf60 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 shutdown_connections 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f011c0668d0 0x7f011c068d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f013c1532f0 0x7f013c1ed550 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f013c0a5200 0x7f013c1ed010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 --2- 172.21.15.97:0/1814851424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f013c06d190 0x7f013c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 >> 172.21.15.97:0/1814851424 conn(0x7f013c0c5a50 msgr2=0x7f013c14faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 shutdown_connections 2023-12-04T05:37:52.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.362+0000 7f013b59e640 1 -- 172.21.15.97:0/1814851424 wait complete. 2023-12-04T05:37:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:37:22.374120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:37:23.709890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:37:40.181523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:37:41.370503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:52.384 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:52.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 Processor -- start 2023-12-04T05:37:52.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 -- start start 2023-12-04T05:37:52.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b3014eb30 0x7f5b3014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3014f790 0x7f5b301548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b30154640 con 0x7f5b30154e10 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b300c0bd0 con 0x7f5b3014eb30 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b34f80640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3014ef10 con 0x7f5b3014f790 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b2e59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5b3014eb30 0x7f5b3014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b2ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5b30154e10 0x7f5b30151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46412/0 (socket says 172.21.15.97:46412) 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b2ed9d640 1 -- 172.21.15.97:0/1044723406 learned_addr learned my addr 172.21.15.97:0/1044723406 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.522+0000 7f5b25d9b640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3014f790 0x7f5b301548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1044723406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3014f790 msgr2=0x7f5b301548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2e59c640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3014f790 0x7f5b301548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1044723406 >> v1:172.21.15.97:6789/0 conn(0x7f5b30154e10 legacy=0x7f5b30151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1044723406 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b301535a0 con 0x7f5b3014eb30 2023-12-04T05:37:52.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2dd9b640 1 -- 172.21.15.97:0/1044723406 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705251678 0 0) 0x7f5b30154640 con 0x7f5b30154e10 2023-12-04T05:37:52.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2e59c640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014f250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009d90 tx=0x7f5b2001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5254fd2bca200dc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2dd9b640 1 -- 172.21.15.97:0/1044723406 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200a58f0 con 0x7f5b3014eb30 2023-12-04T05:37:52.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2dd9b640 1 -- 172.21.15.97:0/1044723406 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200a5a50 con 0x7f5b3014eb30 2023-12-04T05:37:52.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.526+0000 7f5b2dd9b640 1 -- 172.21.15.97:0/1044723406 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200a5de0 con 0x7f5b3014eb30 2023-12-04T05:37:52.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- 172.21.15.97:0/1044723406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 msgr2=0x7f5b3014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014f250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009d90 tx=0x7f5b2001c920 comp rx=0 tx=0).stop 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- 172.21.15.97:0/1044723406 shutdown_connections 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b3014f790 0x7f5b301548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1044723406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014f250 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- 172.21.15.97:0/1044723406 >> 172.21.15.97:0/1044723406 conn(0x7f5b300c5e70 msgr2=0x7f5b300c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- 172.21.15.97:0/1044723406 shutdown_connections 2023-12-04T05:37:52.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- 172.21.15.97:0/1044723406 wait complete. 2023-12-04T05:37:52.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 Processor -- start 2023-12-04T05:37:52.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- start start 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3014f790 0x7f5b3013f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b30154e10 0x7f5b3013fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301ec640 con 0x7f5b3014eb30 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3006c080 con 0x7f5b3014f790 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b34f80640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3006c360 con 0x7f5b30154e10 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b2e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33144/0 (socket says 172.21.15.97:33144) 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1134959169 learned_addr learned my addr 172.21.15.97:0/1134959169 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:52.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b25d9b640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3014f790 0x7f5b3013f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.530+0000 7f5b2ed9d640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b30154e10 0x7f5b3013fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b30154e10 msgr2=0x7f5b3013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b30154e10 0x7f5b3013fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3014f790 msgr2=0x7f5b3013f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3014f790 0x7f5b3013f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 -- 172.21.15.97:0/1134959169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20009a70 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b2e59c640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5b2001a550 tx=0x7f5b200196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200ad850 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200ad9b0 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3006c640 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200add80 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3006cc00 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30068440 con 0x7f5b3014eb30 2023-12-04T05:37:52.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5b200b4050 con 0x7f5b3014eb30 2023-12-04T05:37:52.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 0x7f5b10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b2011f840 con 0x7f5b3014eb30 2023-12-04T05:37:52.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.534+0000 7f5b25d9b640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 0x7f5b10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.538+0000 7f5b25d9b640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 0x7f5b10068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b18007a60 tx=0x7f5b18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.538+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b200ec8e0 con 0x7f5b3014eb30 2023-12-04T05:37:52.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.690+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b300a8ac0 con 0x7f5b3014eb30 2023-12-04T05:37:52.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.690+0000 7f5b277fe640 1 -- 172.21.15.97:0/1134959169 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b200b2020 con 0x7f5b3014eb30 2023-12-04T05:37:52.695 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 msgr2=0x7f5b10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 0x7f5b10068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b18007a60 tx=0x7f5b18008040 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 msgr2=0x7f5b3014d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5b2001a550 tx=0x7f5b200196c0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 shutdown_connections 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5b100668d0 0x7f5b10068d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b30154e10 0x7f5b3013fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b3014f790 0x7f5b3013f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 --2- 172.21.15.97:0/1134959169 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b3014eb30 0x7f5b3014d5b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 >> 172.21.15.97:0/1134959169 conn(0x7f5b300c5e70 msgr2=0x7f5b300c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:52.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 shutdown_connections 2023-12-04T05:37:52.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.694+0000 7f5b34f80640 1 -- 172.21.15.97:0/1134959169 wait complete. 2023-12-04T05:37:52.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 Processor -- start 2023-12-04T05:37:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 -- start start 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f47dc0c1360 0x7f47dc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47dc06c000 0x7f47dc151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc150bc0 con 0x7f47dc1518a0 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc154fd0 con 0x7f47dc06c000 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e2fd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc072160 con 0x7f47dc0c1360 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47dc06c000 0x7f47dc151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f47dc06c000 0x7f47dc151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33160/0 (socket says 172.21.15.97:33160) 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 -- 172.21.15.97:0/3051344531 learned_addr learned my addr 172.21.15.97:0/3051344531 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47e0d6d640 1 --2- 172.21.15.97:0/3051344531 >> v2:172.21.15.143:3300/0 conn(0x7f47dc0c1360 0x7f47dc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 -- 172.21.15.97:0/3051344531 >> v2:172.21.15.143:3300/0 conn(0x7f47dc0c1360 msgr2=0x7f47dc0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 --2- 172.21.15.97:0/3051344531 >> v2:172.21.15.143:3300/0 conn(0x7f47dc0c1360 0x7f47dc0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d37fe640 1 -- 172.21.15.97:0/3051344531 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259810374 0 0) 0x7f47dc150bc0 con 0x7f47dc1518a0 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 -- 172.21.15.97:0/3051344531 >> v1:172.21.15.143:6789/0 conn(0x7f47dc1518a0 legacy=0x7f47dc14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.854+0000 7f47d3fff640 1 -- 172.21.15.97:0/3051344531 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc072440 con 0x7f47dc06c000 2023-12-04T05:37:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47d3fff640 1 --2- 172.21.15.97:0/3051344531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc151360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0c6aa0 tx=0x7f47cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9c1b7c113117ed server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47d37fe640 1 -- 172.21.15.97:0/3051344531 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0ab600 con 0x7f47dc06c000 2023-12-04T05:37:52.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47d37fe640 1 -- 172.21.15.97:0/3051344531 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc0a7050 con 0x7f47dc06c000 2023-12-04T05:37:52.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47d37fe640 1 -- 172.21.15.97:0/3051344531 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0ab980 con 0x7f47dc06c000 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 -- 172.21.15.97:0/3051344531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 msgr2=0x7f47dc151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/3051344531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc151360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0c6aa0 tx=0x7f47cc01c470 comp rx=0 tx=0).stop 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 -- 172.21.15.97:0/3051344531 shutdown_connections 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/3051344531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc151360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/3051344531 >> v2:172.21.15.143:3300/0 conn(0x7f47dc0c1360 0x7f47dc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 -- 172.21.15.97:0/3051344531 >> 172.21.15.97:0/3051344531 conn(0x7f47dc0c5e70 msgr2=0x7f47dc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:52.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 -- 172.21.15.97:0/3051344531 shutdown_connections 2023-12-04T05:37:52.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 -- 172.21.15.97:0/3051344531 wait complete. 2023-12-04T05:37:52.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.858+0000 7f47e2fd1640 1 Processor -- start 2023-12-04T05:37:52.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- start start 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47dc0c1360 0x7f47dc1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 0x7f47dc0c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0a8a20 con 0x7f47dc06c000 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc1f18b0 con 0x7f47dc152010 2023-12-04T05:37:52.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc154070 con 0x7f47dc0c1360 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33172/0 (socket says 172.21.15.97:33172) 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 -- 172.21.15.97:0/2448620394 learned_addr learned my addr 172.21.15.97:0/2448620394 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e156e640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 0x7f47dc0c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47d3fff640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47dc0c1360 0x7f47dc1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 -- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47dc0c1360 msgr2=0x7f47dc1f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47dc0c1360 0x7f47dc1f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 -- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 msgr2=0x7f47dc0c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 0x7f47dc0c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 -- 172.21.15.97:0/2448620394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0094d0 con 0x7f47dc06c000 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e156e640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 0x7f47dc0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e0d6d640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e930 tx=0x7f47d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8009690 con 0x7f47dc06c000 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800ca00 con 0x7f47dc06c000 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800cd70 con 0x7f47dc06c000 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc0a8c30 con 0x7f47dc06c000 2023-12-04T05:37:52.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc153d90 con 0x7f47dc06c000 2023-12-04T05:37:52.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.862+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc14d730 con 0x7f47dc06c000 2023-12-04T05:37:52.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.866+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47d8013470 con 0x7f47dc06c000 2023-12-04T05:37:52.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.866+0000 7f47d17fa640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 0x7f47c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:52.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.866+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f47d80849f0 con 0x7f47dc06c000 2023-12-04T05:37:52.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.866+0000 7f47d3fff640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 0x7f47c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:52.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.866+0000 7f47d3fff640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 0x7f47c8068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0ad000 tx=0x7f47cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:52.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:52.870+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47d8051990 con 0x7f47dc06c000 2023-12-04T05:37:53.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.018+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47dc068440 con 0x7f47dc06c000 2023-12-04T05:37:53.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47d17fa640 1 -- 172.21.15.97:0/2448620394 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47d8054fb0 con 0x7f47dc06c000 2023-12-04T05:37:53.025 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:53.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 msgr2=0x7f47c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 0x7f47c8068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0ad000 tx=0x7f47cc008040 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 msgr2=0x7f47dc0c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e930 tx=0x7f47d800edf0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 shutdown_connections 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47c80668d0 0x7f47c8068d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47dc152010 0x7f47dc0c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47dc0c1360 0x7f47dc1f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 --2- 172.21.15.97:0/2448620394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47dc06c000 0x7f47dc0c5890 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 >> 172.21.15.97:0/2448620394 conn(0x7f47dc0c5e70 msgr2=0x7f47dc0bff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 shutdown_connections 2023-12-04T05:37:53.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.022+0000 7f47e2fd1640 1 -- 172.21.15.97:0/2448620394 wait complete. 2023-12-04T05:37:53.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 Processor -- start 2023-12-04T05:37:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 -- start start 2023-12-04T05:37:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc8a014fc30 0x7fc8a00c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00aa6a0 con 0x7fc8a01523d0 2023-12-04T05:37:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00aa920 con 0x7fc8a014f850 2023-12-04T05:37:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc8a4bfd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a0072b30 con 0x7fc8a014fc30 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc8a014fc30 0x7fc8a00c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc8a01523d0 0x7fc8a00c24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46426/0 (socket says 172.21.15.97:46426) 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc8a014fc30 0x7fc8a00c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33174/0 (socket says 172.21.15.97:33174) 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89effd640 1 -- 172.21.15.97:0/3274685743 learned_addr learned my addr 172.21.15.97:0/3274685743 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89ffff640 1 -- 172.21.15.97:0/3274685743 >> v1:172.21.15.143:6789/0 conn(0x7fc8a014f850 legacy=0x7fc8a00a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89ffff640 1 -- 172.21.15.97:0/3274685743 >> v1:172.21.15.97:6789/0 conn(0x7fc8a01523d0 legacy=0x7fc8a00c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89ffff640 1 -- 172.21.15.97:0/3274685743 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00aac00 con 0x7fc8a014fc30 2023-12-04T05:37:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.186+0000 7fc89e7fc640 1 -- 172.21.15.97:0/3274685743 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993217023 0 0) 0x7fc8a00aa6a0 con 0x7fc8a01523d0 2023-12-04T05:37:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc89ffff640 1 --2- 172.21.15.97:0/3274685743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a014fc30 0x7fc8a00c41f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc898009d90 tx=0x7fc89801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78b4aabf57cf6e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc89e7fc640 1 -- 172.21.15.97:0/3274685743 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980a59a0 con 0x7fc8a014fc30 2023-12-04T05:37:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc89e7fc640 1 -- 172.21.15.97:0/3274685743 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8980a5b00 con 0x7fc8a014fc30 2023-12-04T05:37:53.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc89e7fc640 1 -- 172.21.15.97:0/3274685743 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980a5e90 con 0x7fc8a014fc30 2023-12-04T05:37:53.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3274685743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a014fc30 msgr2=0x7fc8a00c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3274685743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a014fc30 0x7fc8a00c41f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc898009d90 tx=0x7fc89801c8e0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3274685743 shutdown_connections 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3274685743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a014fc30 0x7fc8a00c41f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3274685743 >> 172.21.15.97:0/3274685743 conn(0x7fc8a006ad80 msgr2=0x7fc8a00c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3274685743 shutdown_connections 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3274685743 wait complete. 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.190+0000 7fc8a4bfd640 1 Processor -- start 2023-12-04T05:37:53.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- start start 2023-12-04T05:37:53.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a014f850 0x7fc8a0151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a014fc30 0x7fc8a00a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a014e2b0 con 0x7fc8a01523d0 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a014d4d0 con 0x7fc8a014f850 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a014f4d0 con 0x7fc8a014fc30 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33188/0 (socket says 172.21.15.97:33188) 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 -- 172.21.15.97:0/3068730224 learned_addr learned my addr 172.21.15.97:0/3068730224 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:53.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89effd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a014fc30 0x7fc8a00a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89f7fe640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a014f850 0x7fc8a0151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 -- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a014fc30 msgr2=0x7fc8a00a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a014fc30 0x7fc8a00a6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 -- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a014f850 msgr2=0x7fc8a0151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a014f850 0x7fc8a0151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 -- 172.21.15.97:0/3068730224 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009a70 con 0x7fc8a01523d0 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc89ffff640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc89801a510 tx=0x7fc898019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980ade40 con 0x7fc8a01523d0 2023-12-04T05:37:53.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8980b7410 con 0x7fc8a01523d0 2023-12-04T05:37:53.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a014d720 con 0x7fc8a01523d0 2023-12-04T05:37:53.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980b77a0 con 0x7fc8a01523d0 2023-12-04T05:37:53.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a006d3a0 con 0x7fc8a01523d0 2023-12-04T05:37:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.194+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a004e890 con 0x7fc8a01523d0 2023-12-04T05:37:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.198+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8980b4050 con 0x7fc8a01523d0 2023-12-04T05:37:53.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.198+0000 7fc887fff640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 0x7fc88c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.198+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc89811fb70 con 0x7fc8a01523d0 2023-12-04T05:37:53.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.198+0000 7fc89f7fe640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 0x7fc88c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.198+0000 7fc89f7fe640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 0x7fc88c068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc890007fd0 tx=0x7fc890009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.202+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8980ecd50 con 0x7fc8a01523d0 2023-12-04T05:37:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.354+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8a00c5260 con 0x7fc8a01523d0 2023-12-04T05:37:53.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.354+0000 7fc887fff640 1 -- 172.21.15.97:0/3068730224 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8980b2020 con 0x7fc8a01523d0 2023-12-04T05:37:53.360 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 msgr2=0x7fc88c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 0x7fc88c068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc890007fd0 tx=0x7fc890009040 comp rx=0 tx=0).stop 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 msgr2=0x7fc8a00a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc89801a510 tx=0x7fc898019680 comp rx=0 tx=0).stop 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 shutdown_connections 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc88c0668d0 0x7fc88c068d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8a01523d0 0x7fc8a00a71e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc8a014fc30 0x7fc8a00a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 --2- 172.21.15.97:0/3068730224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc8a014f850 0x7fc8a0151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 >> 172.21.15.97:0/3068730224 conn(0x7fc8a006ad80 msgr2=0x7fc8a00c18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 shutdown_connections 2023-12-04T05:37:53.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.358+0000 7fc8a4bfd640 1 -- 172.21.15.97:0/3068730224 wait complete. 2023-12-04T05:37:53.381 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:37:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 Processor -- start 2023-12-04T05:37:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 -- start start 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81a00c65b0 0x7f81a01548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f81a00c7f00 0x7f81a0154e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a01587f0 con 0x7f81a0151da0 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a00c5020 con 0x7f81a00c65b0 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a6c17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a0158600 con 0x7f81a00c7f00 2023-12-04T05:37:53.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81a00c65b0 0x7f81a01548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f81a00c65b0 0x7f81a01548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33196/0 (socket says 172.21.15.97:33196) 2023-12-04T05:37:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 -- 172.21.15.97:0/617666437 learned_addr learned my addr 172.21.15.97:0/617666437 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81a51b4640 1 --2- 172.21.15.97:0/617666437 >> v2:172.21.15.143:3300/0 conn(0x7f81a00c7f00 0x7f81a0154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 -- 172.21.15.97:0/617666437 >> v2:172.21.15.143:3300/0 conn(0x7f81a00c7f00 msgr2=0x7f81a0154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 --2- 172.21.15.97:0/617666437 >> v2:172.21.15.143:3300/0 conn(0x7f81a00c7f00 0x7f81a0154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 -- 172.21.15.97:0/617666437 >> v1:172.21.15.143:6789/0 conn(0x7f81a0151da0 legacy=0x7f81a00abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f8197fff640 1 -- 172.21.15.97:0/617666437 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00c4980 con 0x7f81a00c65b0 2023-12-04T05:37:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.518+0000 7f81977fe640 1 -- 172.21.15.97:0/617666437 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622705603 0 0) 0x7f81a01587f0 con 0x7f81a0151da0 2023-12-04T05:37:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f8197fff640 1 --2- 172.21.15.97:0/617666437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a01548e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f81a00c6a20 tx=0x7f819001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97fbb6c7bd77e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81977fe640 1 -- 172.21.15.97:0/617666437 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900ab600 con 0x7f81a00c65b0 2023-12-04T05:37:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81977fe640 1 -- 172.21.15.97:0/617666437 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81900a7050 con 0x7f81a00c65b0 2023-12-04T05:37:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81977fe640 1 -- 172.21.15.97:0/617666437 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900ab980 con 0x7f81a00c65b0 2023-12-04T05:37:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 -- 172.21.15.97:0/617666437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 msgr2=0x7f81a01548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 --2- 172.21.15.97:0/617666437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a01548e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f81a00c6a20 tx=0x7f819001c500 comp rx=0 tx=0).stop 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 -- 172.21.15.97:0/617666437 shutdown_connections 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 --2- 172.21.15.97:0/617666437 >> v2:172.21.15.143:3300/0 conn(0x7f81a00c7f00 0x7f81a0154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 --2- 172.21.15.97:0/617666437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a01548e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 -- 172.21.15.97:0/617666437 >> 172.21.15.97:0/617666437 conn(0x7f81a00ca000 msgr2=0x7f81a00ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 -- 172.21.15.97:0/617666437 shutdown_connections 2023-12-04T05:37:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.522+0000 7f81a6c17640 1 -- 172.21.15.97:0/617666437 wait complete. 2023-12-04T05:37:53.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 Processor -- start 2023-12-04T05:37:53.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- start start 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a00c7f00 0x7f81a00a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a0151da0 0x7f81a00aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01569d0 con 0x7f81a00c65b0 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00afd40 con 0x7f81a00c7f00 2023-12-04T05:37:53.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00abdf0 con 0x7f81a0151da0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33210/0 (socket says 172.21.15.97:33210) 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 -- 172.21.15.97:0/2825173667 learned_addr learned my addr 172.21.15.97:0/2825173667 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a51b4640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a0151da0 0x7f81a00aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f8197fff640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a00c7f00 0x7f81a00a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 -- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a0151da0 msgr2=0x7f81a00aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a0151da0 0x7f81a00aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 -- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a00c7f00 msgr2=0x7f81a00a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a00c7f00 0x7f81a00a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 -- 172.21.15.97:0/2825173667 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81900094d0 con 0x7f81a00c65b0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a49b3640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c500 tx=0x7f819c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c003600 con 0x7f81a00c65b0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c003760 con 0x7f81a00c65b0 2023-12-04T05:37:53.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a0156350 con 0x7f81a00c65b0 2023-12-04T05:37:53.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c003b10 con 0x7f81a00c65b0 2023-12-04T05:37:53.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.526+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a00ac090 con 0x7f81a00c65b0 2023-12-04T05:37:53.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0068440 con 0x7f81a00c65b0 2023-12-04T05:37:53.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f819c003c70 con 0x7f81a00c65b0 2023-12-04T05:37:53.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f81957fa640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 0x7f818c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f819c083d10 con 0x7f81a00c65b0 2023-12-04T05:37:53.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f8197fff640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 0x7f818c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.530+0000 7f8197fff640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 0x7f818c068dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81900ad000 tx=0x7f8190008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.534+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f819c089020 con 0x7f81a00c65b0 2023-12-04T05:37:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.682+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81a00c0940 con 0x7f81a00c65b0 2023-12-04T05:37:53.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.682+0000 7f81957fa640 1 -- 172.21.15.97:0/2825173667 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f819c017070 con 0x7f81a00c65b0 2023-12-04T05:37:53.688 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 msgr2=0x7f818c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 0x7f818c068dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81900ad000 tx=0x7f8190008040 comp rx=0 tx=0).stop 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 msgr2=0x7f81a0150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c500 tx=0x7f819c00c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 shutdown_connections 2023-12-04T05:37:53.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f818c066900 0x7f818c068dc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f81a0151da0 0x7f81a00aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f81a00c7f00 0x7f81a00a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 --2- 172.21.15.97:0/2825173667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f81a00c65b0 0x7f81a0150080 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 >> 172.21.15.97:0/2825173667 conn(0x7f81a00ca000 msgr2=0x7f81a006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 shutdown_connections 2023-12-04T05:37:53.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.686+0000 7f81a6c17640 1 -- 172.21.15.97:0/2825173667 wait complete. 2023-12-04T05:37:53.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:37:53.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 Processor -- start 2023-12-04T05:37:53.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 -- start start 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 0x7f16fc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16fc154fe0 0x7f16fc15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc154640 con 0x7f16fc14f790 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0c0bd0 con 0x7f16fc154fe0 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f17038ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc14ef10 con 0x7f16fc14eb30 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1700e85640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f16fc14f790 0x7f16fc1548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46428/0 (socket says 172.21.15.97:46428) 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1700e85640 1 -- 172.21.15.97:0/1950518247 learned_addr learned my addr 172.21.15.97:0/1950518247 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701e87640 1 --2- 172.21.15.97:0/1950518247 >> v2:172.21.15.143:3300/0 conn(0x7f16fc154fe0 0x7f16fc15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701686640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 0x7f16fc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f16f3fff640 1 -- 172.21.15.97:0/1950518247 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318470809 0 0) 0x7f16fc154640 con 0x7f16fc14f790 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f16f3fff640 1 -- 172.21.15.97:0/1950518247 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e8003530 con 0x7f16fc14f790 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701e87640 1 -- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 msgr2=0x7f16fc14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701e87640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 0x7f16fc14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701e87640 1 -- 172.21.15.97:0/1950518247 >> v1:172.21.15.97:6789/0 conn(0x7f16fc14f790 legacy=0x7f16fc1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701e87640 1 -- 172.21.15.97:0/1950518247 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc1535a0 con 0x7f16fc154fe0 2023-12-04T05:37:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.846+0000 7f1701686640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 0x7f16fc14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f1701e87640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc154fe0 0x7f16fc15bc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009d90 tx=0x7f16f401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f642dbf765eebc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f16f3fff640 1 -- 172.21.15.97:0/1950518247 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40a59e0 con 0x7f16fc154fe0 2023-12-04T05:37:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f16f3fff640 1 -- 172.21.15.97:0/1950518247 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f40a5b40 con 0x7f16fc154fe0 2023-12-04T05:37:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f16f3fff640 1 -- 172.21.15.97:0/1950518247 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40ad440 con 0x7f16fc154fe0 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 -- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc154fe0 msgr2=0x7f16fc15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc154fe0 0x7f16fc15bc60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009d90 tx=0x7f16f401c920 comp rx=0 tx=0).stop 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 -- 172.21.15.97:0/1950518247 shutdown_connections 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc154fe0 0x7f16fc15bc60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 --2- 172.21.15.97:0/1950518247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc14eb30 0x7f16fc14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 -- 172.21.15.97:0/1950518247 >> 172.21.15.97:0/1950518247 conn(0x7f16fc0c5e70 msgr2=0x7f16fc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 -- 172.21.15.97:0/1950518247 shutdown_connections 2023-12-04T05:37:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.850+0000 7f17038ea640 1 -- 172.21.15.97:0/1950518247 wait complete. 2023-12-04T05:37:53.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 Processor -- start 2023-12-04T05:37:53.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- start start 2023-12-04T05:37:53.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc14f790 0x7f16fc0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc154fe0 0x7f16fc0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0bc160 con 0x7f16fc14eb30 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0bcb30 con 0x7f16fc14f790 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0bb550 con 0x7f16fc154fe0 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33216/0 (socket says 172.21.15.97:33216) 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 -- 172.21.15.97:0/2014542534 learned_addr learned my addr 172.21.15.97:0/2014542534 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1700e85640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc14f790 0x7f16fc0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701e87640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc154fe0 0x7f16fc0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 -- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc154fe0 msgr2=0x7f16fc0c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc154fe0 0x7f16fc0c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 -- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc14f790 msgr2=0x7f16fc0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc14f790 0x7f16fc0c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 -- 172.21.15.97:0/2014542534 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009420 con 0x7f16fc14eb30 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f1701686640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f16f800ebe0 tx=0x7f16f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800eee0 con 0x7f16fc14eb30 2023-12-04T05:37:53.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800cc30 con 0x7f16fc14eb30 2023-12-04T05:37:53.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8013470 con 0x7f16fc14eb30 2023-12-04T05:37:53.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f4009a70 con 0x7f16fc14eb30 2023-12-04T05:37:53.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.854+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0bbb10 con 0x7f16fc14eb30 2023-12-04T05:37:53.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc068440 con 0x7f16fc14eb30 2023-12-04T05:37:53.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16f80135d0 con 0x7f16fc14eb30 2023-12-04T05:37:53.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f16f1ffb640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 0x7f16e0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:53.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16f8084a30 con 0x7f16fc14eb30 2023-12-04T05:37:53.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f1700e85640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 0x7f16e0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:53.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.858+0000 7f1700e85640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 0x7f16e0068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f16fc14d7e0 tx=0x7f16ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:53.862+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16f8051900 con 0x7f16fc14eb30 2023-12-04T05:37:54.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.010+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f16fc0670d0 con 0x7f16fc14eb30 2023-12-04T05:37:54.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.010+0000 7f16f1ffb640 1 -- 172.21.15.97:0/2014542534 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f16f8054f20 con 0x7f16fc14eb30 2023-12-04T05:37:54.015 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 msgr2=0x7f16e0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 0x7f16e0068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f16fc14d7e0 tx=0x7f16ec009040 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 msgr2=0x7f16fc0bc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f16f800ebe0 tx=0x7f16f800c520 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 shutdown_connections 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f16e0066900 0x7f16e0068dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16fc154fe0 0x7f16fc0c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16fc14f790 0x7f16fc0c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 --2- 172.21.15.97:0/2014542534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f16fc14eb30 0x7f16fc0bc5f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 >> 172.21.15.97:0/2014542534 conn(0x7f16fc0c5e70 msgr2=0x7f16fc14c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 shutdown_connections 2023-12-04T05:37:54.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.014+0000 7f17038ea640 1 -- 172.21.15.97:0/2014542534 wait complete. 2023-12-04T05:37:54.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:37:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 Processor -- start 2023-12-04T05:37:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 -- start start 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25a80c1360 0x7f25a80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 0x7f25a8151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a8150bc0 con 0x7f25a81518a0 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a8154fd0 con 0x7f25a80c1360 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25aed57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a8072160 con 0x7f25a806c000 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25acaf3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25a80c1360 0x7f25a80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25ad2f4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f25a81518a0 0x7f25a814dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35736/0 (socket says 172.21.15.97:35736) 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25ad2f4640 1 -- 172.21.15.97:0/1171617572 learned_addr learned my addr 172.21.15.97:0/1171617572 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f25acaf3640 1 --2- 172.21.15.97:0/1171617572 >> v2:172.21.15.97:3300/0 conn(0x7f25a80c1360 0x7f25a80700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57668/0 (socket says 172.21.15.97:57668) 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.170+0000 7f259ffff640 1 --2- 172.21.15.97:0/1171617572 >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 0x7f25a8151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25acaf3640 1 -- 172.21.15.97:0/1171617572 >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 msgr2=0x7f25a8151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25acaf3640 1 --2- 172.21.15.97:0/1171617572 >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 0x7f25a8151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25acaf3640 1 -- 172.21.15.97:0/1171617572 >> v1:172.21.15.97:6789/0 conn(0x7f25a81518a0 legacy=0x7f25a814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25acaf3640 1 -- 172.21.15.97:0/1171617572 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8072440 con 0x7f25a80c1360 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f259f7fe640 1 -- 172.21.15.97:0/1171617572 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715420530 0 0) 0x7f25a8150bc0 con 0x7f25a81518a0 2023-12-04T05:37:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f259ffff640 1 --2- 172.21.15.97:0/1171617572 >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 0x7f25a8151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25acaf3640 1 --2- 172.21.15.97:0/1171617572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c1360 0x7f25a80700b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f25a80abe70 tx=0x7f25a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4043ed7b5629df12 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f259f7fe640 1 -- 172.21.15.97:0/1171617572 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40ab600 con 0x7f25a80c1360 2023-12-04T05:37:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f259f7fe640 1 -- 172.21.15.97:0/1171617572 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40a7050 con 0x7f25a80c1360 2023-12-04T05:37:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f259f7fe640 1 -- 172.21.15.97:0/1171617572 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40ab980 con 0x7f25a80c1360 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 -- 172.21.15.97:0/1171617572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c1360 msgr2=0x7f25a80700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 --2- 172.21.15.97:0/1171617572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c1360 0x7f25a80700b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f25a80abe70 tx=0x7f25a401c3d0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 -- 172.21.15.97:0/1171617572 shutdown_connections 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 --2- 172.21.15.97:0/1171617572 >> v2:172.21.15.143:3300/0 conn(0x7f25a806c000 0x7f25a8151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 --2- 172.21.15.97:0/1171617572 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c1360 0x7f25a80700b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 -- 172.21.15.97:0/1171617572 >> 172.21.15.97:0/1171617572 conn(0x7f25a80c5e70 msgr2=0x7f25a80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 -- 172.21.15.97:0/1171617572 shutdown_connections 2023-12-04T05:37:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.174+0000 7f25aed57640 1 -- 172.21.15.97:0/1171617572 wait complete. 2023-12-04T05:37:54.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 Processor -- start 2023-12-04T05:37:54.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 -- start start 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25a806c000 0x7f25a814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25a80c1360 0x7f25a8150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80a8ff0 con 0x7f25a80c2900 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81ee440 con 0x7f25a80c1360 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8148170 con 0x7f25a806c000 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57672/0 (socket says 172.21.15.97:57672) 2023-12-04T05:37:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 -- 172.21.15.97:0/911326176 learned_addr learned my addr 172.21.15.97:0/911326176 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f259ffff640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25a80c1360 0x7f25a8150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25acaf3640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25a806c000 0x7f25a814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 -- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25a806c000 msgr2=0x7f25a814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25a806c000 0x7f25a814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 -- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25a80c1360 msgr2=0x7f25a8150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25a80c1360 0x7f25a8150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 -- 172.21.15.97:0/911326176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009420 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25ad2f4640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c780 tx=0x7f25a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000ce90 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a000a5e0 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000a970 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.178+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a80c3a90 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a80a8d10 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a81ee5f0 con 0x7f25a80c2900 2023-12-04T05:37:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25a000aad0 con 0x7f25a80c2900 2023-12-04T05:37:54.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f259d7fa640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 0x7f2594068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f25a0083b90 con 0x7f25a80c2900 2023-12-04T05:37:54.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f25acaf3640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 0x7f2594068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.182+0000 7f25acaf3640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 0x7f2594068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25a40ad000 tx=0x7f25a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.186+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25a81ee5f0 con 0x7f25a80c2900 2023-12-04T05:37:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25a81ee5f0 con 0x7f25a80c2900 2023-12-04T05:37:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f259d7fa640 1 -- 172.21.15.97:0/911326176 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25a81ee5f0 con 0x7f25a80c2900 2023-12-04T05:37:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:37:54.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 msgr2=0x7f2594068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 0x7f2594068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25a40ad000 tx=0x7f25a4008040 comp rx=0 tx=0).stop 2023-12-04T05:37:54.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 msgr2=0x7f25a814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c780 tx=0x7f25a000cc40 comp rx=0 tx=0).stop 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 shutdown_connections 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25940668d0 0x7f2594068d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25a80c2900 0x7f25a814f2e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25a80c1360 0x7f25a8150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 --2- 172.21.15.97:0/911326176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25a806c000 0x7f25a814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.350+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 >> 172.21.15.97:0/911326176 conn(0x7f25a80c5e70 msgr2=0x7f25a815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.354+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 shutdown_connections 2023-12-04T05:37:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.354+0000 7f25aed57640 1 -- 172.21.15.97:0/911326176 wait complete. 2023-12-04T05:37:54.375 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T05:37:54.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:54.376 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:54.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:37:54.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:54.403 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T05:37:54.459 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:54.460 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:54.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:37:54.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:37:54.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 Processor -- start 2023-12-04T05:37:54.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 -- start start 2023-12-04T05:37:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb70151bf0 0x7ffb700abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb7015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb701547d0 con 0x7ffb700c7ef0 2023-12-04T05:37:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb70158b80 con 0x7ffb70151bf0 2023-12-04T05:37:54.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb74f9d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700c4aa0 con 0x7ffb70155370 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb700c7ef0 0x7ffb70154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35744/0 (socket says 172.21.15.97:35744) 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 -- 172.21.15.97:0/3486718944 learned_addr learned my addr 172.21.15.97:0/3486718944 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6ed9d640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb7015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6e59c640 1 --2- 172.21.15.97:0/3486718944 >> v2:172.21.15.143:3300/0 conn(0x7ffb70151bf0 0x7ffb700abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302895119 0 0) 0x7ffb701547d0 con 0x7ffb700c7ef0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb58003530 con 0x7ffb700c7ef0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509843307 0 0) 0x7ffb58003530 con 0x7ffb700c7ef0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 msgr2=0x7ffb7015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb7015efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 >> v2:172.21.15.143:3300/0 conn(0x7ffb70151bf0 msgr2=0x7ffb700abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 --2- 172.21.15.97:0/3486718944 >> v2:172.21.15.143:3300/0 conn(0x7ffb70151bf0 0x7ffb700abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700c4d40 con 0x7ffb700c7ef0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7ffb64001680 con 0x7ffb700c7ef0 2023-12-04T05:37:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 >> v1:172.21.15.97:6789/0 conn(0x7ffb700c7ef0 legacy=0x7ffb70154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb58003980 0x7ffb58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb580047d0 0x7ffb58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70158b80 con 0x7ffb580047d0 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700c4aa0 con 0x7ffb58003980 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5800ba40 con 0x7ffb70155370 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb580047d0 0x7ffb58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6e59c640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb58003980 0x7ffb58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6ed9d640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 -- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 msgr2=0x7ffb58005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155370 0x7ffb58005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 -- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb58003980 msgr2=0x7ffb58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.686+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb58003980 0x7ffb58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6dd9b640 1 -- 172.21.15.97:0/3486718944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58003530 con 0x7ffb580047d0 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb580047d0 0x7ffb58004c50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c210 tx=0x7ffb6401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd3e28fc032b41e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64005ae0 con 0x7ffb580047d0 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb640a7070 con 0x7ffb580047d0 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6d59a640 1 -- 172.21.15.97:0/3486718944 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64005e60 con 0x7ffb580047d0 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3486718944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb580047d0 msgr2=0x7ffb58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3486718944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb580047d0 0x7ffb58004c50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c210 tx=0x7ffb6401c920 comp rx=0 tx=0).stop 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb6ed9d640 1 -- 172.21.15.97:0/3486718944 reap_dead start 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3486718944 shutdown_connections 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3486718944 >> 172.21.15.97:0/3486718944 conn(0x7ffb70073550 msgr2=0x7ffb70073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3486718944 shutdown_connections 2023-12-04T05:37:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.690+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3486718944 wait complete. 2023-12-04T05:37:54.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 Processor -- start 2023-12-04T05:37:54.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 -- start start 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb580047d0 0x7ffb701ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 0x7ffb700ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7015bd20 con 0x7ffb700aedc0 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701eeac0 con 0x7ffb70157920 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb74f9d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700c3dd0 con 0x7ffb580047d0 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57694/0 (socket says 172.21.15.97:57694) 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 -- 172.21.15.97:0/3807461605 learned_addr learned my addr 172.21.15.97:0/3807461605 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6e59c640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb580047d0 0x7ffb701ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 0x7ffb700ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 -- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb580047d0 msgr2=0x7ffb701ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb580047d0 0x7ffb701ee580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 -- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 msgr2=0x7ffb700ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 0x7ffb700ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 -- 172.21.15.97:0/3807461605 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700af240 con 0x7ffb700aedc0 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6dd9b640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 0x7ffb700ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:54.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb6ed9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb700c85d0 tx=0x7ffb6800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800e040 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800f040 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.694+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68015670 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700afc80 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700c3780 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb700c3f80 con 0x7ffb700aedc0 2023-12-04T05:37:54.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb680157d0 con 0x7ffb700aedc0 2023-12-04T05:37:54.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb5effd640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 0x7ffb50068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:54.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffb680850a0 con 0x7ffb700aedc0 2023-12-04T05:37:54.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb6e59c640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 0x7ffb50068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:54.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.698+0000 7ffb6e59c640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 0x7ffb50068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009b60 tx=0x7ffb60009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:54.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.702+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb700c3f80 con 0x7ffb700aedc0 2023-12-04T05:37:54.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb700c3f80 con 0x7ffb700aedc0 2023-12-04T05:37:54.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb5effd640 1 -- 172.21.15.97:0/3807461605 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7ffb700c3f80 con 0x7ffb700aedc0 2023-12-04T05:37:54.890 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:37:54.890 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 msgr2=0x7ffb50068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 0x7ffb50068dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009b60 tx=0x7ffb60009190 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 msgr2=0x7ffb700c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb700c85d0 tx=0x7ffb6800f580 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 shutdown_connections 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb50066900 0x7ffb50068dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb700aedc0 0x7ffb700c2210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb70157920 0x7ffb700ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 --2- 172.21.15.97:0/3807461605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb580047d0 0x7ffb701ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 >> 172.21.15.97:0/3807461605 conn(0x7ffb70073550 msgr2=0x7ffb700aadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:54.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 shutdown_connections 2023-12-04T05:37:54.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:54.886+0000 7ffb74f9d640 1 -- 172.21.15.97:0/3807461605 wait complete. 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:54.911 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:37:54.912 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:37:54.912 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.CFjHrGyJ33 2023-12-04T05:37:54.912 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:37:54.920 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.jWKE8KS4KV 2023-12-04T05:37:54.921 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /tmp/tmp.CFjHrGyJ33 /tmp/tmp.jWKE8KS4KV 2023-12-04T05:37:54.985 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.jWKE8KS4KV 2023-12-04T05:37:55.105 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.jWKE8KS4KV is 185B 2023-12-04T05:37:55.120 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.jWKE8KS4KV 2023-12-04T05:37:55.129 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T05:37:55.129 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:55.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.129 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:37:55.181 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42074sec preferred_lft 42074sec 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.182 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:37:55.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.184 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:37:55.243 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:37:55.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.245 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:37:55.299 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:37:55.299 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:37:55.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.300 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:37:55.301 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:37:55.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:37:55.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:37:55.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:37:55.301 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:37:55.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.391 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:37:55.400 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:37:55.400 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:55.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:37:55.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:55.465 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:55.516 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:37:55.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:37:55.517 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:37:55.568 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:55.568 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/tmp/tmp.CFjHrGyJ33 of=/dev/stdout 2023-12-04T05:37:55.620 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-04T05:37:55.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:55.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:55.714 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:55.714 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:55.714 INFO:teuthology.orchestra.run.smithi097.stdout:keyring.get_secret failed 2023-12-04T05:37:55.724 INFO:teuthology.orchestra.run.smithi097.stderr:mount.ceph: kernel BUG! 2023-12-04T05:37:55.724 INFO:teuthology.orchestra.run.smithi097.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-04T05:37:55.724 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:37:55.725 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:37:55.725 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:37:55.725 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: testuser@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:37:55.725 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:37:55.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-04T05:37:55.728 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-04T05:37:55.729 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:37:55.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:37:55.819 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:37:55.871 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:37:55.871 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:37:55.872 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:55.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:37:55.881 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:55.882 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:55.891 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:37:55.891 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:37:55.945 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:56.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 Processor -- start 2023-12-04T05:37:56.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 -- start start 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f05e40c1880 0x7f05e40c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f05e4155060 0x7f05e4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e406caf0 con 0x7f05e40c1880 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e41554f0 con 0x7f05e4155060 2023-12-04T05:37:56.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e8c32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e414b440 con 0x7f05e406be00 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f05e40c1880 0x7f05e40c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f05e40c1880 0x7f05e40c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57700/0 (socket says 172.21.15.97:57700) 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e259c640 1 -- 172.21.15.97:0/2946575575 learned_addr learned my addr 172.21.15.97:0/2946575575 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05dbfff640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.078+0000 7f05e2d9d640 1 --2- 172.21.15.97:0/2946575575 >> v2:172.21.15.143:3300/0 conn(0x7f05e4155060 0x7f05e4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 -- 172.21.15.97:0/2946575575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 msgr2=0x7f05e4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e4154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 -- 172.21.15.97:0/2946575575 >> v2:172.21.15.143:3300/0 conn(0x7f05e4155060 msgr2=0x7f05e4157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 --2- 172.21.15.97:0/2946575575 >> v2:172.21.15.143:3300/0 conn(0x7f05e4155060 0x7f05e4157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 -- 172.21.15.97:0/2946575575 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4154670 con 0x7f05e40c1880 2023-12-04T05:37:56.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e259c640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40c1880 0x7f05e40c1c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab5d0 tx=0x7f05d401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4672af248cc79ce9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e1d9b640 1 -- 172.21.15.97:0/2946575575 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40aa640 con 0x7f05e40c1880 2023-12-04T05:37:56.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e1d9b640 1 -- 172.21.15.97:0/2946575575 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40aa7a0 con 0x7f05e40c1880 2023-12-04T05:37:56.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.082+0000 7f05e1d9b640 1 -- 172.21.15.97:0/2946575575 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40aab30 con 0x7f05e40c1880 2023-12-04T05:37:56.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- 172.21.15.97:0/2946575575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40c1880 msgr2=0x7f05e40c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40c1880 0x7f05e40c1c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f05e40ab5d0 tx=0x7f05d401c500 comp rx=0 tx=0).stop 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- 172.21.15.97:0/2946575575 shutdown_connections 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e4154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- 172.21.15.97:0/2946575575 >> v2:172.21.15.143:3300/0 conn(0x7f05e4155060 0x7f05e4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- 172.21.15.97:0/2946575575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e40c1880 0x7f05e40c1c60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- 172.21.15.97:0/2946575575 >> 172.21.15.97:0/2946575575 conn(0x7f05e40c2970 msgr2=0x7f05e40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- 172.21.15.97:0/2946575575 shutdown_connections 2023-12-04T05:37:56.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- 172.21.15.97:0/2946575575 wait complete. 2023-12-04T05:37:56.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 Processor -- start 2023-12-04T05:37:56.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- start start 2023-12-04T05:37:56.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e41f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e40c1880 0x7f05e41f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40c47c0 con 0x7f05e4155060 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415dec0 con 0x7f05e40c1880 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e8c32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415e1a0 con 0x7f05e406be00 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57704/0 (socket says 172.21.15.97:57704) 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 -- 172.21.15.97:0/3072304015 learned_addr learned my addr 172.21.15.97:0/3072304015 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e259c640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e41f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05dbfff640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e40c1880 0x7f05e41f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 -- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 msgr2=0x7f05e41f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e41f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 -- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e40c1880 msgr2=0x7f05e41f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e40c1880 0x7f05e41f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.086+0000 7f05e2d9d640 1 -- 172.21.15.97:0/3072304015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40094d0 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05e2d9d640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05dc007e60 tx=0x7f05dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc014420 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0145a0 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e4159050 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc014950 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e41f10d0 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4158eb0 con 0x7f05e4155060 2023-12-04T05:37:56.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f05dc014ab0 con 0x7f05e4155060 2023-12-04T05:37:56.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 0x7f05c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f05dc084f30 con 0x7f05e4155060 2023-12-04T05:37:56.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.090+0000 7f05e259c640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 0x7f05c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.094+0000 7f05e259c640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 0x7f05c4068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05d40ae000 tx=0x7f05d40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.094+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05e4158eb0 con 0x7f05e4155060 2023-12-04T05:37:56.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.246+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05e4158eb0 con 0x7f05e4155060 2023-12-04T05:37:56.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05daffd640 1 -- 172.21.15.97:0/3072304015 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7f05e4158eb0 con 0x7f05e4155060 2023-12-04T05:37:56.253 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:56.253 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 msgr2=0x7f05c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 0x7f05c4068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05d40ae000 tx=0x7f05d40b5040 comp rx=0 tx=0).stop 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 msgr2=0x7f05e40a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05dc007e60 tx=0x7f05dc00e4b0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 shutdown_connections 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f05c40668d0 0x7f05c4068d90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05e4155060 0x7f05e40a9540 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05e40c1880 0x7f05e41f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 --2- 172.21.15.97:0/3072304015 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05e406be00 0x7f05e41f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 >> 172.21.15.97:0/3072304015 conn(0x7f05e40c2970 msgr2=0x7f05e4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 shutdown_connections 2023-12-04T05:37:56.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.250+0000 7f05e8c32640 1 -- 172.21.15.97:0/3072304015 wait complete. 2023-12-04T05:37:56.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:37:22.374120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:37:23.709890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:37:40.181523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:37:41.370503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:56.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:56.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 Processor -- start 2023-12-04T05:37:56.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 -- start start 2023-12-04T05:37:56.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1fa0156070 0x7f1fa00c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1fa006e410 0x7f1fa0071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa00c0db0 0x7f1fa0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa0071380 con 0x7f1fa006e410 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa006cc20 con 0x7f1fa0156070 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.414+0000 7f1fa772a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa006cf00 con 0x7f1fa00c0db0 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1fa006e410 0x7f1fa0071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1fa006e410 0x7f1fa0071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57716/0 (socket says 172.21.15.97:57716) 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1684871297 learned_addr learned my addr 172.21.15.97:0/1684871297 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa5cc7640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa00c0db0 0x7f1fa0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa54c6640 1 --2- 172.21.15.97:0/1684871297 >> v2:172.21.15.143:3300/0 conn(0x7f1fa0156070 0x7f1fa00c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1684871297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa00c0db0 msgr2=0x7f1fa0158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa00c0db0 0x7f1fa0158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1684871297 >> v2:172.21.15.143:3300/0 conn(0x7f1fa0156070 msgr2=0x7f1fa00c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1684871297 >> v2:172.21.15.143:3300/0 conn(0x7f1fa0156070 0x7f1fa00c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1684871297 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa015cbb0 con 0x7f1fa006e410 2023-12-04T05:37:56.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa006e410 0x7f1fa0071d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1fa006e870 tx=0x7f1f9001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee481ffbc93a348 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1f97fff640 1 -- 172.21.15.97:0/1684871297 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900ab650 con 0x7f1fa006e410 2023-12-04T05:37:56.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1f97fff640 1 -- 172.21.15.97:0/1684871297 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f900ab7b0 con 0x7f1fa006e410 2023-12-04T05:37:56.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.418+0000 7f1f97fff640 1 -- 172.21.15.97:0/1684871297 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900abb40 con 0x7f1fa006e410 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- 172.21.15.97:0/1684871297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa006e410 msgr2=0x7f1fa0071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa006e410 0x7f1fa0071d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1fa006e870 tx=0x7f1f9001c500 comp rx=0 tx=0).stop 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- 172.21.15.97:0/1684871297 shutdown_connections 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa00c0db0 0x7f1fa0158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1684871297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa006e410 0x7f1fa0071d60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1684871297 >> v2:172.21.15.143:3300/0 conn(0x7f1fa0156070 0x7f1fa00c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- 172.21.15.97:0/1684871297 >> 172.21.15.97:0/1684871297 conn(0x7f1fa00c5e70 msgr2=0x7f1fa00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- 172.21.15.97:0/1684871297 shutdown_connections 2023-12-04T05:37:56.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- 172.21.15.97:0/1684871297 wait complete. 2023-12-04T05:37:56.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 Processor -- start 2023-12-04T05:37:56.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- start start 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fa006e410 0x7f1fa01629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa0156070 0x7f1fa014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa014c4c0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa014c710 con 0x7f1fa006e410 2023-12-04T05:37:56.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa772a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa01f49b0 con 0x7f1fa0156070 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57732/0 (socket says 172.21.15.97:57732) 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1392372594 learned_addr learned my addr 172.21.15.97:0/1392372594 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa54c6640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fa006e410 0x7f1fa01629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa5cc7640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa0156070 0x7f1fa014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa0156070 msgr2=0x7f1fa014bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa0156070 0x7f1fa014bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fa006e410 msgr2=0x7f1fa01629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fa006e410 0x7f1fa01629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.422+0000 7f1fa4cc5640 1 -- 172.21.15.97:0/1392372594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900094d0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1fa4cc5640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f9001abb0 tx=0x7f1f900192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900be5f0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f900be750 con 0x7f1fa00c0db0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900beac0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa01f4c90 con 0x7f1fa00c0db0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa01f5250 con 0x7f1fa00c0db0 2023-12-04T05:37:56.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa0068440 con 0x7f1fa00c0db0 2023-12-04T05:37:56.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1f900b43f0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.426+0000 7f1f95ffb640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 0x7f1f84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.430+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1f9011f6c0 con 0x7f1fa00c0db0 2023-12-04T05:37:56.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.430+0000 7f1fa54c6640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 0x7f1f84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.430+0000 7f1fa54c6640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 0x7f1f84068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fa01f24d0 tx=0x7f1f9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.434+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f900ec640 con 0x7f1fa00c0db0 2023-12-04T05:37:56.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.582+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fa01f5440 con 0x7f1fa00c0db0 2023-12-04T05:37:56.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.582+0000 7f1f95ffb640 1 -- 172.21.15.97:0/1392372594 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f900efc60 con 0x7f1fa00c0db0 2023-12-04T05:37:56.588 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 msgr2=0x7f1f84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 0x7f1f84068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1fa01f24d0 tx=0x7f1f9c009190 comp rx=0 tx=0).stop 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 msgr2=0x7f1fa014ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f9001abb0 tx=0x7f1f900192a0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 shutdown_connections 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1f840668d0 0x7f1f84068d90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fa0156070 0x7f1fa014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1fa00c0db0 0x7f1fa014ba40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 --2- 172.21.15.97:0/1392372594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fa006e410 0x7f1fa01629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 >> 172.21.15.97:0/1392372594 conn(0x7f1fa00c5e70 msgr2=0x7f1fa0155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 shutdown_connections 2023-12-04T05:37:56.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.586+0000 7f1fa772a640 1 -- 172.21.15.97:0/1392372594 wait complete. 2023-12-04T05:37:56.609 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:56.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 Processor -- start 2023-12-04T05:37:56.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 -- start start 2023-12-04T05:37:56.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f48100c1e70 0x7f48101524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481006d210 0x7f481006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48100aa240 con 0x7f481006c440 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481006c0c0 con 0x7f48100c1e70 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f4815d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48100aa500 con 0x7f481006d210 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f481006c440 0x7f48100a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35754/0 (socket says 172.21.15.97:35754) 2023-12-04T05:37:56.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480effd640 1 -- 172.21.15.97:0/3844239181 learned_addr learned my addr 172.21.15.97:0/3844239181 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:56.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480f7fe640 1 --2- 172.21.15.97:0/3844239181 >> v2:172.21.15.143:3300/0 conn(0x7f48100c1e70 0x7f48101524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480ffff640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481006d210 0x7f481006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416208495 0 0) 0x7f48100aa240 con 0x7f481006c440 2023-12-04T05:37:56.753 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f8003530 con 0x7f481006c440 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1895543847 0 0) 0x7f47f8003530 con 0x7f481006c440 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481006d210 msgr2=0x7f481006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481006d210 0x7f481006d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 >> v2:172.21.15.143:3300/0 conn(0x7f48100c1e70 msgr2=0x7f48101524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 --2- 172.21.15.97:0/3844239181 >> v2:172.21.15.143:3300/0 conn(0x7f48100c1e70 0x7f48101524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100aa7e0 con 0x7f481006c440 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f4804001680 con 0x7f481006c440 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 >> v1:172.21.15.97:6789/0 conn(0x7f481006c440 legacy=0x7f48100a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8003980 0x7f47f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f80047d0 0x7f47f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47f8005190 0x7f47f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481006c0c0 con 0x7f47f8005190 2023-12-04T05:37:56.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48100aa500 con 0x7f47f8003980 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800bed0 con 0x7f47f80047d0 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480ffff640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f481006d210 0x7f481006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480f7fe640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8003980 0x7f47f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480effd640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f80047d0 0x7f47f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.746+0000 7f480ffff640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47f8005190 0x7f47f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 -- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f80047d0 msgr2=0x7f47f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f80047d0 0x7f47f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 -- 172.21.15.97:0/3844239181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47f8005190 msgr2=0x7f47f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:56.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47f8005190 0x7f47f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 -- 172.21.15.97:0/3844239181 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8003530 con 0x7f47f8003980 2023-12-04T05:37:56.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480effd640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f80047d0 0x7f47f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:56.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480ffff640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47f8005190 0x7f47f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:56.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480f7fe640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8003980 0x7f47f8003da0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4800009b10 tx=0x7f480001ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47394c58e8d7c00 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48000a5680 con 0x7f47f8003980 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48000a57e0 con 0x7f47f8003980 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480e7fc640 1 -- 172.21.15.97:0/3844239181 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48000a5b90 con 0x7f47f8003980 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f4815d1d640 1 -- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8003980 msgr2=0x7f47f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f4815d1d640 1 --2- 172.21.15.97:0/3844239181 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47f8003980 0x7f47f8003da0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4800009b10 tx=0x7f480001ca90 comp rx=0 tx=0).stop 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f480ffff640 1 -- 172.21.15.97:0/3844239181 reap_dead start 2023-12-04T05:37:56.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f4815d1d640 1 -- 172.21.15.97:0/3844239181 shutdown_connections 2023-12-04T05:37:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.750+0000 7f4815d1d640 1 -- 172.21.15.97:0/3844239181 >> 172.21.15.97:0/3844239181 conn(0x7f48100c5e70 msgr2=0x7f48100c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- 172.21.15.97:0/3844239181 shutdown_connections 2023-12-04T05:37:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- 172.21.15.97:0/3844239181 wait complete. 2023-12-04T05:37:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 Processor -- start 2023-12-04T05:37:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- start start 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f8003980 0x7f481014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48101eb7e0 0x7f48101edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481014e050 con 0x7f48101eb360 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48101e7b60 con 0x7f48101eb7e0 2023-12-04T05:37:56.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f4815d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48101ee140 con 0x7f47f8003980 2023-12-04T05:37:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57754/0 (socket says 172.21.15.97:57754) 2023-12-04T05:37:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 -- 172.21.15.97:0/4052326970 learned_addr learned my addr 172.21.15.97:0/4052326970 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480f7fe640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f8003980 0x7f481014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480ffff640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48101eb7e0 0x7f48101edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 -- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f8003980 msgr2=0x7f481014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f8003980 0x7f481014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 -- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48101eb7e0 msgr2=0x7f48101edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48101eb7e0 0x7f48101edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 -- 172.21.15.97:0/4052326970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481014d9d0 con 0x7f48101eb360 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f480effd640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f48040072f0 tx=0x7f48040077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.754+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400fa00 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400fb60 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810153e20 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400fed0 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481014dc70 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48100678c0 con 0x7f48101eb360 2023-12-04T05:37:56.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f480401d460 con 0x7f48101eb360 2023-12-04T05:37:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f47f7fff640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 0x7f47fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4804084920 con 0x7f48101eb360 2023-12-04T05:37:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f480f7fe640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 0x7f47fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:56.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.758+0000 7f480f7fe640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 0x7f47fc068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48000af000 tx=0x7f48000046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:56.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.762+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48040553d0 con 0x7f48101eb360 2023-12-04T05:37:56.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.910+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4810071990 con 0x7f48101eb360 2023-12-04T05:37:56.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f47f7fff640 1 -- 172.21.15.97:0/4052326970 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4804054f60 con 0x7f48101eb360 2023-12-04T05:37:56.917 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 msgr2=0x7f47fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 0x7f47fc068d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f48000af000 tx=0x7f48000046d0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 msgr2=0x7f48101ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f48040072f0 tx=0x7f48040077b0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 shutdown_connections 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f47fc0668d0 0x7f47fc068d90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f48101eb7e0 0x7f48101edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f48101eb360 0x7f48101ed6c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 --2- 172.21.15.97:0/4052326970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47f8003980 0x7f481014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 >> 172.21.15.97:0/4052326970 conn(0x7f48100c5e70 msgr2=0x7f481006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 shutdown_connections 2023-12-04T05:37:56.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:56.914+0000 7f4815d1d640 1 -- 172.21.15.97:0/4052326970 wait complete. 2023-12-04T05:37:56.937 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:57.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 Processor -- start 2023-12-04T05:37:57.082 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 -- start start 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd806c440 0x7fbfd81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbfd806d210 0x7fbfd806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd80aa240 con 0x7fbfd80c1e70 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd806c0c0 con 0x7fbfd806c440 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfe0365640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd80aa500 con 0x7fbfd806d210 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfdd900640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd806c440 0x7fbfd81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfdd900640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbfd806c440 0x7fbfd81524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57770/0 (socket says 172.21.15.97:57770) 2023-12-04T05:37:57.084 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfdd900640 1 -- 172.21.15.97:0/2279916067 learned_addr learned my addr 172.21.15.97:0/2279916067 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.078+0000 7fbfde902640 1 --2- 172.21.15.97:0/2279916067 >> v2:172.21.15.143:3300/0 conn(0x7fbfd806d210 0x7fbfd806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd900640 1 -- 172.21.15.97:0/2279916067 >> v2:172.21.15.143:3300/0 conn(0x7fbfd806d210 msgr2=0x7fbfd806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd900640 1 --2- 172.21.15.97:0/2279916067 >> v2:172.21.15.143:3300/0 conn(0x7fbfd806d210 0x7fbfd806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd900640 1 -- 172.21.15.97:0/2279916067 >> v1:172.21.15.143:6789/0 conn(0x7fbfd80c1e70 legacy=0x7fbfd80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd900640 1 -- 172.21.15.97:0/2279916067 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80aa7e0 con 0x7fbfd806c440 2023-12-04T05:37:57.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd900640 1 --2- 172.21.15.97:0/2279916067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81524e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8150020 tx=0x7fbfc801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13d0fb17ab22765 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd0ff640 1 -- 172.21.15.97:0/2279916067 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80ac640 con 0x7fbfd806c440 2023-12-04T05:37:57.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd0ff640 1 -- 172.21.15.97:0/2279916067 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc80ac7a0 con 0x7fbfd806c440 2023-12-04T05:37:57.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfdd0ff640 1 -- 172.21.15.97:0/2279916067 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80acb30 con 0x7fbfd806c440 2023-12-04T05:37:57.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfe0365640 1 -- 172.21.15.97:0/2279916067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 msgr2=0x7fbfd81524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.082+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2279916067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81524e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8150020 tx=0x7fbfc801c4d0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- 172.21.15.97:0/2279916067 shutdown_connections 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2279916067 >> v2:172.21.15.143:3300/0 conn(0x7fbfd806d210 0x7fbfd806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2279916067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81524e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- 172.21.15.97:0/2279916067 >> 172.21.15.97:0/2279916067 conn(0x7fbfd80c5e70 msgr2=0x7fbfd80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- 172.21.15.97:0/2279916067 shutdown_connections 2023-12-04T05:37:57.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- 172.21.15.97:0/2279916067 wait complete. 2023-12-04T05:37:57.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 Processor -- start 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- start start 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd806d210 0x7fbfd8145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd80c1e70 0x7fbfd814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81454f0 con 0x7fbfd806c440 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8144f30 con 0x7fbfd806d210 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8145210 con 0x7fbfd80c1e70 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57784/0 (socket says 172.21.15.97:57784) 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 -- 172.21.15.97:0/2252899613 learned_addr learned my addr 172.21.15.97:0/2252899613 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfdd900640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd806d210 0x7fbfd8145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde902640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd80c1e70 0x7fbfd814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 -- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd80c1e70 msgr2=0x7fbfd814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd80c1e70 0x7fbfd814cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 -- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd806d210 msgr2=0x7fbfd8145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd806d210 0x7fbfd8145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 -- 172.21.15.97:0/2252899613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80094d0 con 0x7fbfd806c440 2023-12-04T05:37:57.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfde101640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4005220 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd4005380 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd81ecee0 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.086+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4007270 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd8146450 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd8068440 con 0x7fbfd806c440 2023-12-04T05:37:57.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbfd40073d0 con 0x7fbfd806c440 2023-12-04T05:37:57.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfceffd640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 0x7fbfbc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbfd4083f00 con 0x7fbfd806c440 2023-12-04T05:37:57.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfdd900640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 0x7fbfbc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.090+0000 7fbfdd900640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 0x7fbfbc068dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80ae000 tx=0x7fbfc80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.094+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfd4050ea0 con 0x7fbfd806c440 2023-12-04T05:37:57.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.242+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfd806c220 con 0x7fbfd806c440 2023-12-04T05:37:57.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.242+0000 7fbfceffd640 1 -- 172.21.15.97:0/2252899613 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfd40544c0 con 0x7fbfd806c440 2023-12-04T05:37:57.248 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 msgr2=0x7fbfbc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 0x7fbfbc068dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80ae000 tx=0x7fbfc80a7000 comp rx=0 tx=0).stop 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 msgr2=0x7fbfd81435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400c500 tx=0x7fbfd400c9c0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 shutdown_connections 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbfbc066900 0x7fbfbc068dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbfd80c1e70 0x7fbfd814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbfd806d210 0x7fbfd8145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.250 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 --2- 172.21.15.97:0/2252899613 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbfd806c440 0x7fbfd81435f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 >> 172.21.15.97:0/2252899613 conn(0x7fbfd80c5e70 msgr2=0x7fbfd80bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 shutdown_connections 2023-12-04T05:37:57.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.246+0000 7fbfe0365640 1 -- 172.21.15.97:0/2252899613 wait complete. 2023-12-04T05:37:57.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:37:57.410 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 Processor -- start 2023-12-04T05:37:57.411 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 -- start start 2023-12-04T05:37:57.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e780c4cc0 0x7f0e78153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.412 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78154320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e780c0960 con 0x7f0e78071ea0 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7806cde0 con 0x7f0e780c4cc0 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7f51e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7806c820 con 0x7f0e780c11c0 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7e51c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e780c4cc0 0x7f0e78153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7e51c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e780c4cc0 0x7f0e78153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57790/0 (socket says 172.21.15.97:57790) 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.406+0000 7f0e7e51c640 1 -- 172.21.15.97:0/4201828511 learned_addr learned my addr 172.21.15.97:0/4201828511 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7ed1d640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7e51c640 1 -- 172.21.15.97:0/4201828511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 msgr2=0x7f0e78154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7e51c640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7e51c640 1 -- 172.21.15.97:0/4201828511 >> v1:172.21.15.143:6789/0 conn(0x7f0e78071ea0 legacy=0x7f0e780c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7e51c640 1 -- 172.21.15.97:0/4201828511 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7806cb00 con 0x7f0e780c4cc0 2023-12-04T05:37:57.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7e51c640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e780c4cc0 0x7f0e78153de0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009870 tx=0x7f0e7401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c56b015ad6824 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7d51a640 1 -- 172.21.15.97:0/4201828511 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740ab600 con 0x7f0e780c4cc0 2023-12-04T05:37:57.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7d51a640 1 -- 172.21.15.97:0/4201828511 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740a7050 con 0x7f0e780c4cc0 2023-12-04T05:37:57.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.410+0000 7f0e7d51a640 1 -- 172.21.15.97:0/4201828511 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740ab980 con 0x7f0e780c4cc0 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- 172.21.15.97:0/4201828511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e780c4cc0 msgr2=0x7f0e78153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e780c4cc0 0x7f0e78153de0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009870 tx=0x7f0e7401c420 comp rx=0 tx=0).stop 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- 172.21.15.97:0/4201828511 shutdown_connections 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/4201828511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e780c4cc0 0x7f0e78153de0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- 172.21.15.97:0/4201828511 >> 172.21.15.97:0/4201828511 conn(0x7f0e7806ad80 msgr2=0x7f0e780c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- 172.21.15.97:0/4201828511 shutdown_connections 2023-12-04T05:37:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- 172.21.15.97:0/4201828511 wait complete. 2023-12-04T05:37:57.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 Processor -- start 2023-12-04T05:37:57.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- start start 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e780c4cc0 0x7f0e780a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781498d0 con 0x7f0e78071ea0 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7814ad80 con 0x7f0e780c4cc0 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7f51e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780a6dc0 con 0x7f0e780c11c0 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57796/0 (socket says 172.21.15.97:57796) 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 -- 172.21.15.97:0/1659460614 learned_addr learned my addr 172.21.15.97:0/1659460614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7ed1d640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e780c4cc0 0x7f0e780a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7dd1b640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 -- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 msgr2=0x7f0e78151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 -- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e780c4cc0 msgr2=0x7f0e780a7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e780c4cc0 0x7f0e780a7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 -- 172.21.15.97:0/1659460614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e740094d0 con 0x7f0e78071ea0 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7dd1b640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:57.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.414+0000 7f0e7e51c640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e7401a050 tx=0x7f0e7401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740b6420 con 0x7f0e78071ea0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740b6580 con 0x7f0e78071ea0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e740b6930 con 0x7f0e78071ea0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e780a6a90 con 0x7f0e78071ea0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e78152480 con 0x7f0e78071ea0 2023-12-04T05:37:57.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7806d3a0 con 0x7f0e78071ea0 2023-12-04T05:37:57.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e740b2040 con 0x7f0e78071ea0 2023-12-04T05:37:57.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 0x7f0e5c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e7411e970 con 0x7f0e78071ea0 2023-12-04T05:37:57.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.418+0000 7f0e7dd1b640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 0x7f0e5c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.422+0000 7f0e7dd1b640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 0x7f0e5c068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e780a81e0 tx=0x7f0e68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.422+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e740eb900 con 0x7f0e78071ea0 2023-12-04T05:37:57.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e78153260 con 0x7f0e78071ea0 2023-12-04T05:37:57.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e6effd640 1 -- 172.21.15.97:0/1659460614 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0e740ba020 con 0x7f0e78071ea0 2023-12-04T05:37:57.578 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:57.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 msgr2=0x7f0e5c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 0x7f0e5c068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e780a81e0 tx=0x7f0e68009040 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 msgr2=0x7f0e78149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0e7401a050 tx=0x7f0e7401ac60 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 shutdown_connections 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e5c0668d0 0x7f0e5c068d90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e780c4cc0 0x7f0e780a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e780c11c0 0x7f0e78151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 --2- 172.21.15.97:0/1659460614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e78071ea0 0x7f0e78149a40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 >> 172.21.15.97:0/1659460614 conn(0x7f0e7806ad80 msgr2=0x7f0e78151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 shutdown_connections 2023-12-04T05:37:57.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.574+0000 7f0e7f51e640 1 -- 172.21.15.97:0/1659460614 wait complete. 2023-12-04T05:37:57.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:37:57.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 Processor -- start 2023-12-04T05:37:57.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 -- start start 2023-12-04T05:37:57.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a200af8b0 0x7f5a200c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a2006cb20 0x7f5a200c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a20157c70 con 0x7f5a200c4e30 2023-12-04T05:37:57.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a20152170 con 0x7f5a2006cb20 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a25854640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a20157f50 con 0x7f5a200af8b0 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a2006cb20 0x7f5a200c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a2006cb20 0x7f5a200c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57802/0 (socket says 172.21.15.97:57802) 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 -- 172.21.15.97:0/416490126 learned_addr learned my addr 172.21.15.97:0/416490126 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a1effd640 1 --2- 172.21.15.97:0/416490126 >> v2:172.21.15.143:3300/0 conn(0x7f5a200af8b0 0x7f5a200c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 -- 172.21.15.97:0/416490126 >> v2:172.21.15.143:3300/0 conn(0x7f5a200af8b0 msgr2=0x7f5a200c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 --2- 172.21.15.97:0/416490126 >> v2:172.21.15.143:3300/0 conn(0x7f5a200af8b0 0x7f5a200c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 -- 172.21.15.97:0/416490126 >> v1:172.21.15.143:6789/0 conn(0x7f5a200c4e30 legacy=0x7f5a20154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.734+0000 7f5a167fc640 1 -- 172.21.15.97:0/416490126 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20158230 con 0x7f5a2006cb20 2023-12-04T05:37:57.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a167fc640 1 --2- 172.21.15.97:0/416490126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a2006cb20 0x7f5a200c48f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a200c7a00 tx=0x7f5a0801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d8bae9f64f2426 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a1e7fc640 1 -- 172.21.15.97:0/416490126 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080a57d0 con 0x7f5a2006cb20 2023-12-04T05:37:57.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a1e7fc640 1 -- 172.21.15.97:0/416490126 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080a5930 con 0x7f5a2006cb20 2023-12-04T05:37:57.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a1e7fc640 1 -- 172.21.15.97:0/416490126 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080a5cc0 con 0x7f5a2006cb20 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 -- 172.21.15.97:0/416490126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a2006cb20 msgr2=0x7f5a200c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 --2- 172.21.15.97:0/416490126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a2006cb20 0x7f5a200c48f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a200c7a00 tx=0x7f5a0801c910 comp rx=0 tx=0).stop 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 -- 172.21.15.97:0/416490126 shutdown_connections 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 --2- 172.21.15.97:0/416490126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a2006cb20 0x7f5a200c48f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 --2- 172.21.15.97:0/416490126 >> v2:172.21.15.143:3300/0 conn(0x7f5a200af8b0 0x7f5a200c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 -- 172.21.15.97:0/416490126 >> 172.21.15.97:0/416490126 conn(0x7f5a20073720 msgr2=0x7f5a20073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 -- 172.21.15.97:0/416490126 shutdown_connections 2023-12-04T05:37:57.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.738+0000 7f5a25854640 1 -- 172.21.15.97:0/416490126 wait complete. 2023-12-04T05:37:57.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 Processor -- start 2023-12-04T05:37:57.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- start start 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2006cb20 0x7f5a201f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a200af8b0 0x7f5a200aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200bf650 con 0x7f5a200c4e30 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a201f1320 con 0x7f5a200af8b0 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a201ed650 con 0x7f5a2006cb20 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57804/0 (socket says 172.21.15.97:57804) 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 -- 172.21.15.97:0/52421788 learned_addr learned my addr 172.21.15.97:0/52421788 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a167fc640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a200af8b0 0x7f5a200aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1effd640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2006cb20 0x7f5a201f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 -- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2006cb20 msgr2=0x7f5a201f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2006cb20 0x7f5a201f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 -- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a200af8b0 msgr2=0x7f5a200aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a200af8b0 0x7f5a200aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 -- 172.21.15.97:0/52421788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009b30 con 0x7f5a200c4e30 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1f7fe640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c430 tx=0x7f5a1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18005220 con 0x7f5a200c4e30 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18005380 con 0x7f5a200c4e30 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18007270 con 0x7f5a200c4e30 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a200c0e10 con 0x7f5a200c4e30 2023-12-04T05:37:57.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.742+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a201ed000 con 0x7f5a200c4e30 2023-12-04T05:37:57.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20068010 con 0x7f5a200c4e30 2023-12-04T05:37:57.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5a180073d0 con 0x7f5a200c4e30 2023-12-04T05:37:57.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a1cff9640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 0x7f5a00068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:57.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a18083a80 con 0x7f5a200c4e30 2023-12-04T05:37:57.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a1effd640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 0x7f5a00068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:57.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.746+0000 7f5a1effd640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 0x7f5a00068dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009ac0 tx=0x7f5a10009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:57.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.750+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a18050a00 con 0x7f5a200c4e30 2023-12-04T05:37:57.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5a201ece60 con 0x7f5a200c4e30 2023-12-04T05:37:57.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a1cff9640 1 -- 172.21.15.97:0/52421788 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5a201ece60 con 0x7f5a200c4e30 2023-12-04T05:37:57.905 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:37:57.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 msgr2=0x7f5a00068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 0x7f5a00068dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009ac0 tx=0x7f5a10009190 comp rx=0 tx=0).stop 2023-12-04T05:37:57.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 msgr2=0x7f5a200c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:57.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800c430 tx=0x7f5a1800c8f0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 shutdown_connections 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a00066900 0x7f5a00068dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a200c4e30 0x7f5a200c2840 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a200af8b0 0x7f5a200aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 --2- 172.21.15.97:0/52421788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2006cb20 0x7f5a201f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 >> 172.21.15.97:0/52421788 conn(0x7f5a20073720 msgr2=0x7f5a20073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 shutdown_connections 2023-12-04T05:37:57.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:57.902+0000 7f5a25854640 1 -- 172.21.15.97:0/52421788 wait complete. 2023-12-04T05:37:57.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:37:58.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.062+0000 7f3caeec8640 1 Processor -- start 2023-12-04T05:37:58.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.062+0000 7f3caeec8640 1 -- start start 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.062+0000 7f3caeec8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3ca80c67d0 0x7f3ca8155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.062+0000 7f3caeec8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca81586c0 0x7f3ca80c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.062+0000 7f3caeec8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80c8620 con 0x7f3ca80c6bb0 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3caeec8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80c5680 con 0x7f3ca80c67d0 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3caeec8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80c4cb0 con 0x7f3ca81586c0 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3ca80c67d0 0x7f3ca8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cad6c5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3ca80c6bb0 0x7f3ca80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35760/0 (socket says 172.21.15.97:35760) 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3ca80c67d0 0x7f3ca8155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57816/0 (socket says 172.21.15.97:57816) 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cad6c5640 1 -- 172.21.15.97:0/125110225 learned_addr learned my addr 172.21.15.97:0/125110225 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cae6c7640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca81586c0 0x7f3ca80c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 -- 172.21.15.97:0/125110225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca81586c0 msgr2=0x7f3ca80c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca81586c0 0x7f3ca80c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 -- 172.21.15.97:0/125110225 >> v1:172.21.15.97:6789/0 conn(0x7f3ca80c6bb0 legacy=0x7f3ca80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 -- 172.21.15.97:0/125110225 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80c6ff0 con 0x7f3ca80c67d0 2023-12-04T05:37:58.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cacec4640 1 -- 172.21.15.97:0/125110225 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52224556 0 0) 0x7f3ca80c8620 con 0x7f3ca80c6bb0 2023-12-04T05:37:58.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cadec6640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca80c67d0 0x7f3ca8155200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40097f0 tx=0x7f3ca401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c12bfa3357d74ce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cacec4640 1 -- 172.21.15.97:0/125110225 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40ab600 con 0x7f3ca80c67d0 2023-12-04T05:37:58.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cacec4640 1 -- 172.21.15.97:0/125110225 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca40a7050 con 0x7f3ca80c67d0 2023-12-04T05:37:58.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.066+0000 7f3cacec4640 1 -- 172.21.15.97:0/125110225 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40ab980 con 0x7f3ca80c67d0 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- 172.21.15.97:0/125110225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca80c67d0 msgr2=0x7f3ca8155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca80c67d0 0x7f3ca8155200 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40097f0 tx=0x7f3ca401c480 comp rx=0 tx=0).stop 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- 172.21.15.97:0/125110225 shutdown_connections 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca81586c0 0x7f3ca80c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- 172.21.15.97:0/125110225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca80c67d0 0x7f3ca8155200 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- 172.21.15.97:0/125110225 >> 172.21.15.97:0/125110225 conn(0x7f3ca80ab980 msgr2=0x7f3ca80abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- 172.21.15.97:0/125110225 shutdown_connections 2023-12-04T05:37:58.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- 172.21.15.97:0/125110225 wait complete. 2023-12-04T05:37:58.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 Processor -- start 2023-12-04T05:37:58.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- start start 2023-12-04T05:37:58.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ca80c67d0 0x7f3ca81454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 0x7f3ca80bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80bc940 con 0x7f3ca81586c0 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80ab800 con 0x7f3ca80c67d0 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3caeec8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca814aa00 con 0x7f3ca80c6bb0 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57822/0 (socket says 172.21.15.97:57822) 2023-12-04T05:37:58.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 -- 172.21.15.97:0/676381933 learned_addr learned my addr 172.21.15.97:0/676381933 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cadec6640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ca80c67d0 0x7f3ca81454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cad6c5640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 0x7f3ca80bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 -- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 msgr2=0x7f3ca80bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 0x7f3ca80bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 -- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ca80c67d0 msgr2=0x7f3ca81454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.070+0000 7f3cae6c7640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ca80c67d0 0x7f3ca81454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3cae6c7640 1 -- 172.21.15.97:0/676381933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009420 con 0x7f3ca81586c0 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3cad6c5640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 0x7f3ca80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:58.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3cae6c7640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009d20 tx=0x7f3ca000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0009b10 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000f040 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca814aca0 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00146c0 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca814b260 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca804e890 con 0x7f3ca81586c0 2023-12-04T05:37:58.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ca0014820 con 0x7f3ca81586c0 2023-12-04T05:37:58.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 0x7f3c8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ca00851f0 con 0x7f3ca81586c0 2023-12-04T05:37:58.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.074+0000 7f3cadec6640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 0x7f3c8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.078+0000 7f3cadec6640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 0x7f3c8c068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ad000 tx=0x7f3ca40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.078+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ca0052160 con 0x7f3ca81586c0 2023-12-04T05:37:58.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ca80c7520 con 0x7f3ca81586c0 2023-12-04T05:37:58.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3c9e7fc640 1 -- 172.21.15.97:0/676381933 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ca0055780 con 0x7f3ca81586c0 2023-12-04T05:37:58.246 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:37:58.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 msgr2=0x7f3c8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 0x7f3c8c068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ad000 tx=0x7f3ca40a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:58.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 msgr2=0x7f3ca80bc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009d20 tx=0x7f3ca000c490 comp rx=0 tx=0).stop 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 shutdown_connections 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.242+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c8c0668d0 0x7f3c8c068d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ca81586c0 0x7f3ca80bc400 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ca80c6bb0 0x7f3ca80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 --2- 172.21.15.97:0/676381933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ca80c67d0 0x7f3ca81454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 >> 172.21.15.97:0/676381933 conn(0x7f3ca80ab980 msgr2=0x7f3ca80abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 shutdown_connections 2023-12-04T05:37:58.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.246+0000 7f3caeec8640 1 -- 172.21.15.97:0/676381933 wait complete. 2023-12-04T05:37:58.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:37:58.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:58.268 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:37:58.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:37:58.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:37:58.301 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:37:58.358 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:37:58.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 Processor -- start 2023-12-04T05:37:58.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 -- start start 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f587814fbb0 0x7f58780a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 0x7f58780a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 0x7f58781528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587814ff90 con 0x7f587814fbb0 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780a9770 con 0x7f58780a8460 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f587e217640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5878071730 con 0x7f5878152490 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f587814fbb0 0x7f58780a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f587814fbb0 0x7f58780a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57834/0 (socket says 172.21.15.97:57834) 2023-12-04T05:37:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 -- 172.21.15.97:0/4213520797 learned_addr learned my addr 172.21.15.97:0/4213520797 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f586ffff640 1 --2- 172.21.15.97:0/4213520797 >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 0x7f58780a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f5877fff640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 0x7f58781528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 -- 172.21.15.97:0/4213520797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 msgr2=0x7f58781528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 0x7f58781528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 -- 172.21.15.97:0/4213520797 >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 msgr2=0x7f58780a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 --2- 172.21.15.97:0/4213520797 >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 0x7f58780a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f58777fe640 1 -- 172.21.15.97:0/4213520797 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878071a10 con 0x7f587814fbb0 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f586ffff640 1 --2- 172.21.15.97:0/4213520797 >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 0x7f58780a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:58.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.494+0000 7f5877fff640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 0x7f58781528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f58777fe640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587814fbb0 0x7f58780a8f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f587806e6e0 tx=0x7f586801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb041b71a95b0c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f5876ffd640 1 -- 172.21.15.97:0/4213520797 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680ab600 con 0x7f587814fbb0 2023-12-04T05:37:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f5876ffd640 1 -- 172.21.15.97:0/4213520797 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680a7050 con 0x7f587814fbb0 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f5876ffd640 1 -- 172.21.15.97:0/4213520797 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680ab980 con 0x7f587814fbb0 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 -- 172.21.15.97:0/4213520797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587814fbb0 msgr2=0x7f58780a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587814fbb0 0x7f58780a8f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f587806e6e0 tx=0x7f586801c3b0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 -- 172.21.15.97:0/4213520797 shutdown_connections 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5878152490 0x7f58781528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 --2- 172.21.15.97:0/4213520797 >> v2:172.21.15.143:3300/0 conn(0x7f58780a8460 0x7f58780a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 --2- 172.21.15.97:0/4213520797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f587814fbb0 0x7f58780a8f20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 -- 172.21.15.97:0/4213520797 >> 172.21.15.97:0/4213520797 conn(0x7f58780c2970 msgr2=0x7f58780c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 -- 172.21.15.97:0/4213520797 shutdown_connections 2023-12-04T05:37:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.498+0000 7f587e217640 1 -- 172.21.15.97:0/4213520797 wait complete. 2023-12-04T05:37:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 Processor -- start 2023-12-04T05:37:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- start start 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58780a8460 0x7f58780c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f587814fbb0 0x7f58781ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5878150790 con 0x7f5878152490 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c3b00 con 0x7f58780a8460 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58781f0ef0 con 0x7f587814fbb0 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57836/0 (socket says 172.21.15.97:57836) 2023-12-04T05:37:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 -- 172.21.15.97:0/173945427 learned_addr learned my addr 172.21.15.97:0/173945427 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f58777fe640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58780a8460 0x7f58780c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f586ffff640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f587814fbb0 0x7f58781ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 -- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f587814fbb0 msgr2=0x7f58781ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f587814fbb0 0x7f58781ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 -- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58780a8460 msgr2=0x7f58780c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58780a8460 0x7f58780c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 -- 172.21.15.97:0/173945427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680094d0 con 0x7f5878152490 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5877fff640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5870007df0 tx=0x7f587000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700039a0 con 0x7f5878152490 2023-12-04T05:37:58.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000f040 con 0x7f5878152490 2023-12-04T05:37:58.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870003d40 con 0x7f5878152490 2023-12-04T05:37:58.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58780c3da0 con 0x7f5878152490 2023-12-04T05:37:58.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.502+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58780c5c00 con 0x7f5878152490 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58780c3f30 con 0x7f5878152490 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5870004030 con 0x7f5878152490 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f5874ff9640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 0x7f5858068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5870084a90 con 0x7f5878152490 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f58777fe640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 0x7f5858068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.506+0000 7f58777fe640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 0x7f5858068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58680ad000 tx=0x7f58680a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.510+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5870051960 con 0x7f5878152490 2023-12-04T05:37:58.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.694+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5878068440 con 0x7f5878152490 2023-12-04T05:37:58.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.694+0000 7f5874ff9640 1 -- 172.21.15.97:0/173945427 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f5870054f80 con 0x7f5878152490 2023-12-04T05:37:58.699 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:58.700 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:37:58.700 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 22 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 msgr2=0x7f5858068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 0x7f5858068d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58680ad000 tx=0x7f58680a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 msgr2=0x7f5878145250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5870007df0 tx=0x7f587000d4a0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 shutdown_connections 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58580668d0 0x7f5858068d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878152490 0x7f5878145250 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f587814fbb0 0x7f58781ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 --2- 172.21.15.97:0/173945427 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58780a8460 0x7f58780c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 >> 172.21.15.97:0/173945427 conn(0x7f58780c2970 msgr2=0x7f5878070500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:58.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 shutdown_connections 2023-12-04T05:37:58.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.698+0000 7f587e217640 1 -- 172.21.15.97:0/173945427 wait complete. 2023-12-04T05:37:58.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:37:58.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.854+0000 7fd95d86b640 1 Processor -- start 2023-12-04T05:37:58.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.854+0000 7fd95d86b640 1 -- start start 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd95d86b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd958154260 0x7fd958154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd95d86b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd958154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd95d86b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95806c760 con 0x7fd9580a9470 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd95d86b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580a8670 con 0x7fd958154260 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd95d86b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95806c550 con 0x7fd95806df10 2023-12-04T05:37:58.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd94e7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd9580a9470 0x7fd95806d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35774/0 (socket says 172.21.15.97:35774) 2023-12-04T05:37:58.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd94e7fc640 1 -- 172.21.15.97:0/388987002 learned_addr learned my addr 172.21.15.97:0/388987002 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:58.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 --2- 172.21.15.97:0/388987002 >> v2:172.21.15.143:3300/0 conn(0x7fd958154260 0x7fd958154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166167533 0 0) 0x7fd95806c760 con 0x7fd9580a9470 2023-12-04T05:37:58.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9577fe640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd958154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd944003530 con 0x7fd9580a9470 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614309081 0 0) 0x7fd944003530 con 0x7fd9580a9470 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 msgr2=0x7fd958154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd958154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 >> v2:172.21.15.143:3300/0 conn(0x7fd958154260 msgr2=0x7fd958154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 --2- 172.21.15.97:0/388987002 >> v2:172.21.15.143:3300/0 conn(0x7fd958154260 0x7fd958154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95806ca40 con 0x7fd9580a9470 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fd9400016a0 con 0x7fd9580a9470 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 >> v1:172.21.15.97:6789/0 conn(0x7fd9580a9470 legacy=0x7fd95806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd944003980 0x7fd944003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd9440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944004d10 0x7fd944005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580a8670 con 0x7fd944003980 2023-12-04T05:37:58.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95806c550 con 0x7fd944004d10 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94400b990 con 0x7fd95806df10 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd944003980 0x7fd944003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd9577fe640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944004d10 0x7fd944005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd94e7fc640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd9440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 -- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 msgr2=0x7fd9440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95806df10 0x7fd9440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 -- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944004d10 msgr2=0x7fd944005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944004d10 0x7fd944005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.858+0000 7fd956ffd640 1 -- 172.21.15.97:0/388987002 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944003530 con 0x7fd944003980 2023-12-04T05:37:58.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd956ffd640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd944003980 0x7fd944003da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd948009fc0 tx=0x7fd94801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b509b1b24d5d13 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480a5c60 con 0x7fd944003980 2023-12-04T05:37:58.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800f040 con 0x7fd944003980 2023-12-04T05:37:58.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd9567fc640 1 -- 172.21.15.97:0/388987002 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480ad440 con 0x7fd944003980 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 -- 172.21.15.97:0/388987002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd944003980 msgr2=0x7fd944003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 --2- 172.21.15.97:0/388987002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd944003980 0x7fd944003da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd948009fc0 tx=0x7fd94801cc70 comp rx=0 tx=0).stop 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd9577fe640 1 -- 172.21.15.97:0/388987002 reap_dead start 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 -- 172.21.15.97:0/388987002 shutdown_connections 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 -- 172.21.15.97:0/388987002 >> 172.21.15.97:0/388987002 conn(0x7fd9580c2970 msgr2=0x7fd9580c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 -- 172.21.15.97:0/388987002 shutdown_connections 2023-12-04T05:37:58.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.862+0000 7fd95d86b640 1 -- 172.21.15.97:0/388987002 wait complete. 2023-12-04T05:37:58.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 Processor -- start 2023-12-04T05:37:58.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- start start 2023-12-04T05:37:58.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944003980 0x7fd9581ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 0x7fd9581ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95813e070 con 0x7fd95813d6b0 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95814acd0 con 0x7fd944003980 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9581452f0 con 0x7fd958148850 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57854/0 (socket says 172.21.15.97:57854) 2023-12-04T05:37:58.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 -- 172.21.15.97:0/949742054 learned_addr learned my addr 172.21.15.97:0/949742054 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:58.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd956ffd640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944003980 0x7fd9581ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd94e7fc640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 0x7fd9581ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 -- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 msgr2=0x7fd9581ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 0x7fd9581ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 -- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944003980 msgr2=0x7fd9581ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944003980 0x7fd9581ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 -- 172.21.15.97:0/949742054 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958147ca0 con 0x7fd95813d6b0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd94e7fc640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 0x7fd9581ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd9577fe640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c6e90 tx=0x7fd950011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950004030 con 0x7fd95813d6b0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950004190 con 0x7fd95813d6b0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9581eecf0 con 0x7fd95813d6b0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000f770 con 0x7fd95813d6b0 2023-12-04T05:37:58.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95814b250 con 0x7fd95813d6b0 2023-12-04T05:37:58.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.866+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd958068440 con 0x7fd95813d6b0 2023-12-04T05:37:58.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.870+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd95000f8d0 con 0x7fd95813d6b0 2023-12-04T05:37:58.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.870+0000 7fd954ff9640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 0x7fd938068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:58.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.870+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd950084bc0 con 0x7fd95813d6b0 2023-12-04T05:37:58.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.870+0000 7fd956ffd640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 0x7fd938068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:58.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.870+0000 7fd956ffd640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 0x7fd938068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9480af000 tx=0x7fd948004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:58.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:58.874+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd950051b10 con 0x7fd95813d6b0 2023-12-04T05:37:59.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.026+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9581482a0 con 0x7fd95813d6b0 2023-12-04T05:37:59.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.026+0000 7fd954ff9640 1 -- 172.21.15.97:0/949742054 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7fd950019090 con 0x7fd95813d6b0 2023-12-04T05:37:59.031 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:37:59.031 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:37:59.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 msgr2=0x7fd938068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 0x7fd938068d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9480af000 tx=0x7fd948004ac0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 msgr2=0x7fd95813db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd9580c6e90 tx=0x7fd950011cf0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 shutdown_connections 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd9380668d0 0x7fd938068d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd95813d6b0 0x7fd95813db30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd958148850 0x7fd9581ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 --2- 172.21.15.97:0/949742054 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd944003980 0x7fd9581ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 >> 172.21.15.97:0/949742054 conn(0x7fd9580c2970 msgr2=0x7fd958066510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 shutdown_connections 2023-12-04T05:37:59.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.030+0000 7fd95d86b640 1 -- 172.21.15.97:0/949742054 wait complete. 2023-12-04T05:37:59.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:37:22.374120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:37:23.709890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:37:40.181523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:37:41.370503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:37:59.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:37:59.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 Processor -- start 2023-12-04T05:37:59.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 -- start start 2023-12-04T05:37:59.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d48151f10 0x7f1d480c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 0x7f1d4815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480ca780 con 0x7f1d480c7f00 2023-12-04T05:37:59.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d48158cc0 con 0x7f1d48151f10 2023-12-04T05:37:59.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d4d5d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480c5700 con 0x7f1d480cac10 2023-12-04T05:37:59.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 0x7f1d4815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d46ffd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d48151f10 0x7f1d480c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d467fc640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1d480c7f00 0x7f1d48154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52832/0 (socket says 172.21.15.97:52832) 2023-12-04T05:37:59.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d467fc640 1 -- 172.21.15.97:0/49809151 learned_addr learned my addr 172.21.15.97:0/49809151 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:59.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d477fe640 1 -- 172.21.15.97:0/49809151 >> v2:172.21.15.143:3300/0 conn(0x7f1d48151f10 msgr2=0x7f1d480c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:59.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d477fe640 1 --2- 172.21.15.97:0/49809151 >> v2:172.21.15.143:3300/0 conn(0x7f1d48151f10 0x7f1d480c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d45ffb640 1 -- 172.21.15.97:0/49809151 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275101391 0 0) 0x7f1d480ca780 con 0x7f1d480c7f00 2023-12-04T05:37:59.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d477fe640 1 -- 172.21.15.97:0/49809151 >> v1:172.21.15.143:6789/0 conn(0x7f1d480c7f00 legacy=0x7f1d48154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.194+0000 7f1d477fe640 1 -- 172.21.15.97:0/49809151 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48158720 con 0x7f1d480cac10 2023-12-04T05:37:59.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d477fe640 1 --2- 172.21.15.97:0/49809151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 0x7f1d4815f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99bc672b59437e50 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d45ffb640 1 -- 172.21.15.97:0/49809151 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400a58c0 con 0x7f1d480cac10 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d45ffb640 1 -- 172.21.15.97:0/49809151 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d400a5a20 con 0x7f1d480cac10 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d45ffb640 1 -- 172.21.15.97:0/49809151 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d400a5db0 con 0x7f1d480cac10 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/49809151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 msgr2=0x7f1d4815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/49809151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 0x7f1d4815f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009d90 tx=0x7f1d4001c800 comp rx=0 tx=0).stop 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/49809151 shutdown_connections 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/49809151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d480cac10 0x7f1d4815f0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/49809151 >> v2:172.21.15.143:3300/0 conn(0x7f1d48151f10 0x7f1d480c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/49809151 >> 172.21.15.97:0/49809151 conn(0x7f1d48073950 msgr2=0x7f1d48073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/49809151 shutdown_connections 2023-12-04T05:37:59.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.198+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/49809151 wait complete. 2023-12-04T05:37:59.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 Processor -- start 2023-12-04T05:37:59.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- start start 2023-12-04T05:37:59.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d480cac10 0x7f1d48146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d48151f10 0x7f1d48146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48146ba0 con 0x7f1d480c7f00 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480bd3e0 con 0x7f1d480cac10 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d481f05b0 con 0x7f1d48151f10 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57858/0 (socket says 172.21.15.97:57858) 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 -- 172.21.15.97:0/1694725737 learned_addr learned my addr 172.21.15.97:0/1694725737 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:59.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d467fc640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d480cac10 0x7f1d48146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d477fe640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d48151f10 0x7f1d48146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 -- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d48151f10 msgr2=0x7f1d48146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d48151f10 0x7f1d48146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 -- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d480cac10 msgr2=0x7f1d48146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d480cac10 0x7f1d48146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 -- 172.21.15.97:0/1694725737 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40009a70 con 0x7f1d480c7f00 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d46ffd640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e870 tx=0x7f1d3800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38009510 con 0x7f1d480c7f00 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d481f0870 con 0x7f1d480c7f00 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800eec0 con 0x7f1d480c7f00 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800cb40 con 0x7f1d480c7f00 2023-12-04T05:37:59.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d481f0e30 con 0x7f1d480c7f00 2023-12-04T05:37:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.202+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d48068440 con 0x7f1d480c7f00 2023-12-04T05:37:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.206+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d3800cca0 con 0x7f1d480c7f00 2023-12-04T05:37:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.206+0000 7f1d2f7fe640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 0x7f1d34068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.206+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1d38084800 con 0x7f1d480c7f00 2023-12-04T05:37:59.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.206+0000 7f1d467fc640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 0x7f1d34068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.206+0000 7f1d467fc640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 0x7f1d34068dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d481524a0 tx=0x7f1d3c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.210+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d380517a0 con 0x7f1d480c7f00 2023-12-04T05:37:59.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d480c43c0 con 0x7f1d480c7f00 2023-12-04T05:37:59.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d2f7fe640 1 -- 172.21.15.97:0/1694725737 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d38054dc0 con 0x7f1d480c7f00 2023-12-04T05:37:59.369 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 msgr2=0x7f1d34068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 0x7f1d34068dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d481524a0 tx=0x7f1d3c007d60 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 msgr2=0x7f1d48155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800e870 tx=0x7f1d3800ec70 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 shutdown_connections 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d34066900 0x7f1d34068dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d48151f10 0x7f1d48146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d480cac10 0x7f1d48146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 --2- 172.21.15.97:0/1694725737 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d480c7f00 0x7f1d48155e20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 >> 172.21.15.97:0/1694725737 conn(0x7f1d48073950 msgr2=0x7f1d480c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 shutdown_connections 2023-12-04T05:37:59.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.366+0000 7f1d4d5d1640 1 -- 172.21.15.97:0/1694725737 wait complete. 2023-12-04T05:37:59.390 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:37:59.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 Processor -- start 2023-12-04T05:37:59.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 -- start start 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7febfc06c440 0x7febfc1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7febfc06d210 0x7febfc06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0aa240 con 0x7febfc0c1e70 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc06c0c0 con 0x7febfc06c440 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7fec00f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc0aa500 con 0x7febfc06d210 2023-12-04T05:37:59.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7febfa59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7febfc0c1e70 0x7febfc0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35786/0 (socket says 172.21.15.97:35786) 2023-12-04T05:37:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.526+0000 7febfa59c640 1 -- 172.21.15.97:0/941504362 learned_addr learned my addr 172.21.15.97:0/941504362 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 --2- 172.21.15.97:0/941504362 >> v2:172.21.15.97:3300/0 conn(0x7febfc06c440 0x7febfc1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febfad9d640 1 --2- 172.21.15.97:0/941504362 >> v2:172.21.15.143:3300/0 conn(0x7febfc06d210 0x7febfc06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf9d9b640 1 -- 172.21.15.97:0/941504362 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015877818 0 0) 0x7febfc0aa240 con 0x7febfc0c1e70 2023-12-04T05:37:59.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf9d9b640 1 -- 172.21.15.97:0/941504362 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe8003530 con 0x7febfc0c1e70 2023-12-04T05:37:59.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 -- 172.21.15.97:0/941504362 >> v2:172.21.15.143:3300/0 conn(0x7febfc06d210 msgr2=0x7febfc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:59.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 --2- 172.21.15.97:0/941504362 >> v2:172.21.15.143:3300/0 conn(0x7febfc06d210 0x7febfc06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 -- 172.21.15.97:0/941504362 >> v1:172.21.15.97:6789/0 conn(0x7febfc0c1e70 legacy=0x7febfc0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 -- 172.21.15.97:0/941504362 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0aa7e0 con 0x7febfc06c440 2023-12-04T05:37:59.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf3fff640 1 --2- 172.21.15.97:0/941504362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1524e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7febfc150020 tx=0x7febe401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94190e2c2181002c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf9d9b640 1 -- 172.21.15.97:0/941504362 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40ab600 con 0x7febfc06c440 2023-12-04T05:37:59.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf9d9b640 1 -- 172.21.15.97:0/941504362 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe40a7050 con 0x7febfc06c440 2023-12-04T05:37:59.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.530+0000 7febf9d9b640 1 -- 172.21.15.97:0/941504362 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40ab980 con 0x7febfc06c440 2023-12-04T05:37:59.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- 172.21.15.97:0/941504362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 msgr2=0x7febfc1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- 172.21.15.97:0/941504362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1524e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7febfc150020 tx=0x7febe401c430 comp rx=0 tx=0).stop 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- 172.21.15.97:0/941504362 shutdown_connections 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- 172.21.15.97:0/941504362 >> v2:172.21.15.143:3300/0 conn(0x7febfc06d210 0x7febfc06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- 172.21.15.97:0/941504362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1524e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- 172.21.15.97:0/941504362 >> 172.21.15.97:0/941504362 conn(0x7febfc0c5e70 msgr2=0x7febfc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- 172.21.15.97:0/941504362 shutdown_connections 2023-12-04T05:37:59.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- 172.21.15.97:0/941504362 wait complete. 2023-12-04T05:37:59.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 Processor -- start 2023-12-04T05:37:59.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- start start 2023-12-04T05:37:59.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febfc06d210 0x7febfc1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febfc0c1e70 0x7febfc1ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14faa0 con 0x7febfc06c440 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14cba0 con 0x7febfc06d210 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7fec00f2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14cdf0 con 0x7febfc0c1e70 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57876/0 (socket says 172.21.15.97:57876) 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 -- 172.21.15.97:0/2236462230 learned_addr learned my addr 172.21.15.97:0/2236462230 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febf3fff640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febfc06d210 0x7febfc1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfad9d640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febfc0c1e70 0x7febfc1ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 -- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febfc0c1e70 msgr2=0x7febfc1ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febfc0c1e70 0x7febfc1ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 -- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febfc06d210 msgr2=0x7febfc1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febfc06d210 0x7febfc1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 -- 172.21.15.97:0/2236462230 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4009420 con 0x7febfc06c440 2023-12-04T05:37:59.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.534+0000 7febfa59c640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7febec00c4d0 tx=0x7febec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec005cf0 con 0x7febfc06c440 2023-12-04T05:37:59.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec005e50 con 0x7febfc06c440 2023-12-04T05:37:59.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc14d0d0 con 0x7febfc06c440 2023-12-04T05:37:59.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec007270 con 0x7febfc06c440 2023-12-04T05:37:59.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc1509f0 con 0x7febfc06c440 2023-12-04T05:37:59.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc14d310 con 0x7febfc06c440 2023-12-04T05:37:59.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7febec0073d0 con 0x7febfc06c440 2023-12-04T05:37:59.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 0x7febdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7febec083d00 con 0x7febfc06c440 2023-12-04T05:37:59.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf3fff640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 0x7febdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.538+0000 7febf3fff640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 0x7febdc068d90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7febfc072510 tx=0x7febe40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.542+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7febfc14d310 con 0x7febfc06c440 2023-12-04T05:37:59.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febfc14d310 con 0x7febfc06c440 2023-12-04T05:37:59.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7febf2ffd640 1 -- 172.21.15.97:0/2236462230 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7febfc14d310 con 0x7febfc06c440 2023-12-04T05:37:59.697 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:37:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 msgr2=0x7febdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 0x7febdc068d90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7febfc072510 tx=0x7febe40a6000 comp rx=0 tx=0).stop 2023-12-04T05:37:59.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 msgr2=0x7febfc1ee290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7febec00c4d0 tx=0x7febec00c990 comp rx=0 tx=0).stop 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 shutdown_connections 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7febdc0668d0 0x7febdc068d90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febfc0c1e70 0x7febfc1ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febfc06d210 0x7febfc1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 --2- 172.21.15.97:0/2236462230 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7febfc06c440 0x7febfc1ee290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 >> 172.21.15.97:0/2236462230 conn(0x7febfc0c5e70 msgr2=0x7febfc1517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 shutdown_connections 2023-12-04T05:37:59.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.694+0000 7fec00f2a640 1 -- 172.21.15.97:0/2236462230 wait complete. 2023-12-04T05:37:59.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:37:59.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.854+0000 7fd57352a640 1 Processor -- start 2023-12-04T05:37:59.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.854+0000 7fd57352a640 1 -- start start 2023-12-04T05:37:59.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.854+0000 7fd57352a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd56c14eb30 0x7fd56c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.854+0000 7fd57352a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 0x7fd56c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.854+0000 7fd57352a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c154640 con 0x7fd56c154e10 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd57352a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0c0bd0 con 0x7fd56c14eb30 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd57352a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c14ef10 con 0x7fd56c14f790 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd56c14eb30 0x7fd56c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd571ac7640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd56c154e10 0x7fd56c151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35798/0 (socket says 172.21.15.97:35798) 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd571ac7640 1 -- 172.21.15.97:0/421794180 learned_addr learned my addr 172.21.15.97:0/421794180 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:37:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd570ac5640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 0x7fd56c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd563fff640 1 -- 172.21.15.97:0/421794180 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614683430 0 0) 0x7fd56c154640 con 0x7fd56c154e10 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd563fff640 1 -- 172.21.15.97:0/421794180 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd558005740 con 0x7fd56c154e10 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 -- 172.21.15.97:0/421794180 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 msgr2=0x7fd56c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 0x7fd56c1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 -- 172.21.15.97:0/421794180 >> v1:172.21.15.97:6789/0 conn(0x7fd56c154e10 legacy=0x7fd56c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 -- 172.21.15.97:0/421794180 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c1535a0 con 0x7fd56c14eb30 2023-12-04T05:37:59.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd570ac5640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 0x7fd56c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd5712c6640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c14f250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd5680097c0 tx=0x7fd56801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9e64fa5f760eed server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd563fff640 1 -- 172.21.15.97:0/421794180 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680ad660 con 0x7fd56c14eb30 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd563fff640 1 -- 172.21.15.97:0/421794180 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5680ad7c0 con 0x7fd56c14eb30 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.858+0000 7fd563fff640 1 -- 172.21.15.97:0/421794180 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680adb30 con 0x7fd56c14eb30 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- 172.21.15.97:0/421794180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 msgr2=0x7fd56c14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c14f250 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd5680097c0 tx=0x7fd56801c450 comp rx=0 tx=0).stop 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- 172.21.15.97:0/421794180 shutdown_connections 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c14f790 0x7fd56c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- 172.21.15.97:0/421794180 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c14f250 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- 172.21.15.97:0/421794180 >> 172.21.15.97:0/421794180 conn(0x7fd56c0c5e70 msgr2=0x7fd56c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:37:59.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- 172.21.15.97:0/421794180 shutdown_connections 2023-12-04T05:37:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- 172.21.15.97:0/421794180 wait complete. 2023-12-04T05:37:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 Processor -- start 2023-12-04T05:37:59.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- start start 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 0x7fd56c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 0x7fd56c1ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0c2a30 con 0x7fd56c14eb30 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0aadd0 con 0x7fd56c14f790 2023-12-04T05:37:59.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd57352a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0c2750 con 0x7fd56c154e10 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57890/0 (socket says 172.21.15.97:57890) 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 -- 172.21.15.97:0/797350060 learned_addr learned my addr 172.21.15.97:0/797350060 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd571ac7640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 0x7fd56c1ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd570ac5640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 0x7fd56c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 -- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 msgr2=0x7fd56c1ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 0x7fd56c1ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 -- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 msgr2=0x7fd56c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 0x7fd56c06bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd5712c6640 1 -- 172.21.15.97:0/797350060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009420 con 0x7fd56c14eb30 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd571ac7640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 0x7fd56c1ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.862+0000 7fd570ac5640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 0x7fd56c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:37:59.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd5712c6640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd568000c10 tx=0x7fd5680191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680b6600 con 0x7fd56c14eb30 2023-12-04T05:37:59.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5680b6760 con 0x7fd56c14eb30 2023-12-04T05:37:59.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568009420 con 0x7fd56c14eb30 2023-12-04T05:37:59.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680b6af0 con 0x7fd56c14eb30 2023-12-04T05:37:59.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c141ee0 con 0x7fd56c14eb30 2023-12-04T05:37:59.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c068440 con 0x7fd56c14eb30 2023-12-04T05:37:59.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd5680b4040 con 0x7fd56c14eb30 2023-12-04T05:37:59.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 0x7fd550068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:37:59.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd56811eb20 con 0x7fd56c14eb30 2023-12-04T05:37:59.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.866+0000 7fd570ac5640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 0x7fd550068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:37:59.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.870+0000 7fd570ac5640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 0x7fd550068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd56c06e1c0 tx=0x7fd55c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:37:59.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:37:59.870+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5680eb9f0 con 0x7fd56c14eb30 2023-12-04T05:38:00.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.026+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd56c0c0550 con 0x7fd56c14eb30 2023-12-04T05:38:00.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd561ffb640 1 -- 172.21.15.97:0/797350060 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5680bb0a0 con 0x7fd56c14eb30 2023-12-04T05:38:00.033 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 msgr2=0x7fd550068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 0x7fd550068d90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd56c06e1c0 tx=0x7fd55c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 msgr2=0x7fd56c1419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd568000c10 tx=0x7fd5680191f0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 shutdown_connections 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd5500668d0 0x7fd550068d90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd56c154e10 0x7fd56c1ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c14f790 0x7fd56c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 --2- 172.21.15.97:0/797350060 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd56c14eb30 0x7fd56c1419a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 >> 172.21.15.97:0/797350060 conn(0x7fd56c0c5e70 msgr2=0x7fd56c0bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 shutdown_connections 2023-12-04T05:38:00.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.030+0000 7fd57352a640 1 -- 172.21.15.97:0/797350060 wait complete. 2023-12-04T05:38:00.054 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:38:00.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.190+0000 7f58c2ddf640 1 Processor -- start 2023-12-04T05:38:00.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.190+0000 7f58c2ddf640 1 -- start start 2023-12-04T05:38:00.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c2ddf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f58bc151f10 0x7f58bc0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c2ddf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c2ddf640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58bc0ca780 con 0x7f58bc0c7f00 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c2ddf640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc158cc0 con 0x7f58bc151f10 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c2ddf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0c5700 con 0x7f58bc0cac10 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f58bc0c7f00 0x7f58bc154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35808/0 (socket says 172.21.15.97:35808) 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b3fff640 1 -- 172.21.15.97:0/1388789034 learned_addr learned my addr 172.21.15.97:0/1388789034 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/1388789034 >> v2:172.21.15.97:3300/0 conn(0x7f58bc151f10 0x7f58bc0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c137c640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 -- 172.21.15.97:0/1388789034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 msgr2=0x7f58bc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 -- 172.21.15.97:0/1388789034 >> v1:172.21.15.97:6789/0 conn(0x7f58bc0c7f00 legacy=0x7f58bc154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 -- 172.21.15.97:0/1388789034 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc158720 con 0x7f58bc151f10 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c137c640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:00.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b37fe640 1 -- 172.21.15.97:0/1388789034 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226313445 0 0) 0x7f58bc0ca780 con 0x7f58bc0c7f00 2023-12-04T05:38:00.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc0c4980 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097c0 tx=0x7f58b801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346b19a4f51591c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b37fe640 1 -- 172.21.15.97:0/1388789034 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80ab600 con 0x7f58bc151f10 2023-12-04T05:38:00.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b37fe640 1 -- 172.21.15.97:0/1388789034 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80a7050 con 0x7f58bc151f10 2023-12-04T05:38:00.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.194+0000 7f58b37fe640 1 -- 172.21.15.97:0/1388789034 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80ab980 con 0x7f58bc151f10 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- 172.21.15.97:0/1388789034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 msgr2=0x7f58bc0c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc0c4980 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f58b80097c0 tx=0x7f58b801c330 comp rx=0 tx=0).stop 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- 172.21.15.97:0/1388789034 shutdown_connections 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/1388789034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc0c4980 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- 172.21.15.97:0/1388789034 >> 172.21.15.97:0/1388789034 conn(0x7f58bc073950 msgr2=0x7f58bc073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- 172.21.15.97:0/1388789034 shutdown_connections 2023-12-04T05:38:00.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- 172.21.15.97:0/1388789034 wait complete. 2023-12-04T05:38:00.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 Processor -- start 2023-12-04T05:38:00.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- start start 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 0x7f58bc14ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc155b30 con 0x7f58bc151f10 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc14d520 con 0x7f58bc0c7f00 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c2ddf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc1eda80 con 0x7f58bc0cac10 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c137c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c137c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57904/0 (socket says 172.21.15.97:57904) 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.198+0000 7f58c137c640 1 -- 172.21.15.97:0/4215224834 learned_addr learned my addr 172.21.15.97:0/4215224834 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b3fff640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 0x7f58bc14ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 -- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 msgr2=0x7f58bc14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc14dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 -- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 msgr2=0x7f58bc14ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 0x7f58bc14ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 -- 172.21.15.97:0/4215224834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009420 con 0x7f58bc151f10 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 0x7f58bc14ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c137c640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f58b4007ec0 tx=0x7f58b400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4003ba0 con 0x7f58bc151f10 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400f040 con 0x7f58bc151f10 2023-12-04T05:38:00.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400de80 con 0x7f58bc151f10 2023-12-04T05:38:00.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58bc146b40 con 0x7f58bc151f10 2023-12-04T05:38:00.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc1edcf0 con 0x7f58bc151f10 2023-12-04T05:38:00.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc155c70 con 0x7f58bc151f10 2023-12-04T05:38:00.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f58b4004030 con 0x7f58bc151f10 2023-12-04T05:38:00.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.202+0000 7f58b17fa640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 0x7f58a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.206+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f58b4084af0 con 0x7f58bc151f10 2023-12-04T05:38:00.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.206+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 0x7f58a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.206+0000 7f58c0b7b640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 0x7f58a8068d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f58b80ad000 tx=0x7f58b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.210+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58bc155c70 con 0x7f58bc151f10 2023-12-04T05:38:00.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.362+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58bc155c70 con 0x7f58bc151f10 2023-12-04T05:38:00.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.362+0000 7f58b17fa640 1 -- 172.21.15.97:0/4215224834 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f58bc155c70 con 0x7f58bc151f10 2023-12-04T05:38:00.367 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 msgr2=0x7f58a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 0x7f58a8068d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f58b80ad000 tx=0x7f58b8008040 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 msgr2=0x7f58bc145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f58b4007ec0 tx=0x7f58b400d4a0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 shutdown_connections 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58a80668d0 0x7f58a8068d90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f58bc151f10 0x7f58bc145d80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f58bc0cac10 0x7f58bc14dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 --2- 172.21.15.97:0/4215224834 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f58bc0c7f00 0x7f58bc14ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 >> 172.21.15.97:0/4215224834 conn(0x7f58bc073950 msgr2=0x7f58bc0aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 shutdown_connections 2023-12-04T05:38:00.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.366+0000 7f58c2ddf640 1 -- 172.21.15.97:0/4215224834 wait complete. 2023-12-04T05:38:00.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:38:00.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.522+0000 7f7dcb365640 1 Processor -- start 2023-12-04T05:38:00.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.522+0000 7f7dcb365640 1 -- start start 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dcb365640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7dc414eb30 0x7f7dc414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dcb365640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7dc4154fe0 0x7f7dc415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dcb365640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc4154640 con 0x7f7dc414f790 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dcb365640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc40c0bd0 con 0x7f7dc414eb30 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dcb365640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc414ef10 con 0x7f7dc4154fe0 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7dc414eb30 0x7f7dc414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7dc414eb30 0x7f7dc414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57914/0 (socket says 172.21.15.97:57914) 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 -- 172.21.15.97:0/1150536507 learned_addr learned my addr 172.21.15.97:0/1150536507 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9902640 1 --2- 172.21.15.97:0/1150536507 >> v2:172.21.15.143:3300/0 conn(0x7f7dc4154fe0 0x7f7dc415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 -- 172.21.15.97:0/1150536507 >> v2:172.21.15.143:3300/0 conn(0x7f7dc4154fe0 msgr2=0x7f7dc415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:00.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 --2- 172.21.15.97:0/1150536507 >> v2:172.21.15.143:3300/0 conn(0x7f7dc4154fe0 0x7f7dc415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 -- 172.21.15.97:0/1150536507 >> v1:172.21.15.143:6789/0 conn(0x7f7dc414f790 legacy=0x7f7dc41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:00.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.526+0000 7f7dc9101640 1 -- 172.21.15.97:0/1150536507 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc41535a0 con 0x7f7dc414eb30 2023-12-04T05:38:00.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dc9101640 1 --2- 172.21.15.97:0/1150536507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc414f250 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40a8950 tx=0x7f7dc001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d842d390b5a9396 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dbbfff640 1 -- 172.21.15.97:0/1150536507 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00a7b30 con 0x7f7dc414eb30 2023-12-04T05:38:00.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dbbfff640 1 -- 172.21.15.97:0/1150536507 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc00a7c90 con 0x7f7dc414eb30 2023-12-04T05:38:00.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dbbfff640 1 -- 172.21.15.97:0/1150536507 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00af440 con 0x7f7dc414eb30 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- 172.21.15.97:0/1150536507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 msgr2=0x7f7dc414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 --2- 172.21.15.97:0/1150536507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc414f250 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40a8950 tx=0x7f7dc001eb60 comp rx=0 tx=0).stop 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- 172.21.15.97:0/1150536507 shutdown_connections 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 --2- 172.21.15.97:0/1150536507 >> v2:172.21.15.143:3300/0 conn(0x7f7dc4154fe0 0x7f7dc415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 --2- 172.21.15.97:0/1150536507 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc414f250 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- 172.21.15.97:0/1150536507 >> 172.21.15.97:0/1150536507 conn(0x7f7dc40c5e70 msgr2=0x7f7dc40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- 172.21.15.97:0/1150536507 shutdown_connections 2023-12-04T05:38:00.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- 172.21.15.97:0/1150536507 wait complete. 2023-12-04T05:38:00.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 Processor -- start 2023-12-04T05:38:00.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.530+0000 7f7dcb365640 1 -- start start 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dc414f790 0x7f7dc4070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dc4154fe0 0x7f7dc4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41ed270 con 0x7f7dc414eb30 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41ee240 con 0x7f7dc414f790 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc4140390 con 0x7f7dc4154fe0 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57920/0 (socket says 172.21.15.97:57920) 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 -- 172.21.15.97:0/2820242563 learned_addr learned my addr 172.21.15.97:0/2820242563 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:00.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 -- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dc4154fe0 msgr2=0x7f7dc4070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dc4154fe0 0x7f7dc4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 -- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dc414f790 msgr2=0x7f7dc4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dc414f790 0x7f7dc4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 -- 172.21.15.97:0/2820242563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc000b770 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dc9101640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000b2c0 tx=0x7f7dc001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00a7930 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc00a7a90 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc40a9350 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00ba6c0 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc41ed760 con 0x7f7dc414eb30 2023-12-04T05:38:00.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4068440 con 0x7f7dc414eb30 2023-12-04T05:38:00.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.534+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7dc00ba820 con 0x7f7dc414eb30 2023-12-04T05:38:00.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.538+0000 7f7db9ffb640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 0x7f7da8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.538+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7dc011fc90 con 0x7f7dc414eb30 2023-12-04T05:38:00.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.538+0000 7f7dc8900640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 0x7f7da8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.538+0000 7f7dc8900640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 0x7f7da8068d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40ab570 tx=0x7f7db40079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.542+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7dc00ecb60 con 0x7f7dc414eb30 2023-12-04T05:38:00.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.690+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7dc4068440 con 0x7f7dc414eb30 2023-12-04T05:38:00.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.690+0000 7f7db9ffb640 1 -- 172.21.15.97:0/2820242563 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7dc00b4070 con 0x7f7dc414eb30 2023-12-04T05:38:00.694 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.690+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 msgr2=0x7f7da8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.690+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 0x7f7da8068d90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40ab570 tx=0x7f7db40079c0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 msgr2=0x7f7dc4071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000b2c0 tx=0x7f7dc001d3a0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 shutdown_connections 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7da80668d0 0x7f7da8068d90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7dc4154fe0 0x7f7dc4070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7dc414f790 0x7f7dc4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 --2- 172.21.15.97:0/2820242563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7dc414eb30 0x7f7dc4071bd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 >> 172.21.15.97:0/2820242563 conn(0x7f7dc40c5e70 msgr2=0x7f7dc40c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 shutdown_connections 2023-12-04T05:38:00.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.694+0000 7f7dcb365640 1 -- 172.21.15.97:0/2820242563 wait complete. 2023-12-04T05:38:00.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:00.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 Processor -- start 2023-12-04T05:38:00.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 -- start start 2023-12-04T05:38:00.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 0x7f38e81551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e81547d0 con 0x7f38e8151bf0 2023-12-04T05:38:00.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e8158b80 con 0x7f38e8158630 2023-12-04T05:38:00.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ef009640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80c4aa0 con 0x7f38e80c7ef0 2023-12-04T05:38:00.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ed5a6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 0x7f38e81551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38dffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ecda5640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f38e8151bf0 0x7f38e80abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52844/0 (socket says 172.21.15.97:52844) 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ecda5640 1 -- 172.21.15.97:0/714242070 learned_addr learned my addr 172.21.15.97:0/714242070 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38df7fe640 1 -- 172.21.15.97:0/714242070 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286553563 0 0) 0x7f38e81547d0 con 0x7f38e8151bf0 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38df7fe640 1 -- 172.21.15.97:0/714242070 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d0003530 con 0x7f38e8151bf0 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38dffff640 1 -- 172.21.15.97:0/714242070 >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 msgr2=0x7f38e81551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38dffff640 1 --2- 172.21.15.97:0/714242070 >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 0x7f38e81551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38dffff640 1 -- 172.21.15.97:0/714242070 >> v1:172.21.15.143:6789/0 conn(0x7f38e8151bf0 legacy=0x7f38e80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38dffff640 1 -- 172.21.15.97:0/714242070 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80c4d40 con 0x7f38e80c7ef0 2023-12-04T05:38:00.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.850+0000 7f38ed5a6640 1 --2- 172.21.15.97:0/714242070 >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 0x7f38e81551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:00.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38dffff640 1 --2- 172.21.15.97:0/714242070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e8154c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38d80097c0 tx=0x7f38d801c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4e520bcca09da7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38df7fe640 1 -- 172.21.15.97:0/714242070 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80a4780 con 0x7f38e80c7ef0 2023-12-04T05:38:00.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38df7fe640 1 -- 172.21.15.97:0/714242070 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d80a48e0 con 0x7f38e80c7ef0 2023-12-04T05:38:00.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38df7fe640 1 -- 172.21.15.97:0/714242070 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80a4c70 con 0x7f38e80c7ef0 2023-12-04T05:38:00.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 -- 172.21.15.97:0/714242070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 msgr2=0x7f38e8154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 --2- 172.21.15.97:0/714242070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e8154c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38d80097c0 tx=0x7f38d801c040 comp rx=0 tx=0).stop 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 -- 172.21.15.97:0/714242070 shutdown_connections 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 --2- 172.21.15.97:0/714242070 >> v2:172.21.15.143:3300/0 conn(0x7f38e8158630 0x7f38e81551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 --2- 172.21.15.97:0/714242070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e8154c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 -- 172.21.15.97:0/714242070 >> 172.21.15.97:0/714242070 conn(0x7f38e8073550 msgr2=0x7f38e8073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 -- 172.21.15.97:0/714242070 shutdown_connections 2023-12-04T05:38:00.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.854+0000 7f38ef009640 1 -- 172.21.15.97:0/714242070 wait complete. 2023-12-04T05:38:00.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 Processor -- start 2023-12-04T05:38:00.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- start start 2023-12-04T05:38:00.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e80acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 0x7f38e80bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80ad3e0 con 0x7f38e8158630 2023-12-04T05:38:00.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80cae50 con 0x7f38e8151bf0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80afe90 con 0x7f38e80c7ef0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57932/0 (socket says 172.21.15.97:57932) 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 -- 172.21.15.97:0/3590575811 learned_addr learned my addr 172.21.15.97:0/3590575811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ecda5640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e80acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38dffff640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 0x7f38e80bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 -- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 msgr2=0x7f38e80acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e80acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 -- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 msgr2=0x7f38e80bfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 0x7f38e80bfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 -- 172.21.15.97:0/3590575811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0009a70 con 0x7f38e8158630 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38dffff640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 0x7f38e80bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ed5a6640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f38e000efc0 tx=0x7f38e0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0009d70 con 0x7f38e8158630 2023-12-04T05:38:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e000f040 con 0x7f38e8158630 2023-12-04T05:38:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e00039a0 con 0x7f38e8158630 2023-12-04T05:38:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d8009420 con 0x7f38e8158630 2023-12-04T05:38:00.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.858+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e814c320 con 0x7f38e8158630 2023-12-04T05:38:00.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e8068440 con 0x7f38e8158630 2023-12-04T05:38:00.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f38e00144a0 con 0x7f38e8158630 2023-12-04T05:38:00.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38dd7fa640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 0x7f38d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:00.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f38e0085410 con 0x7f38e8158630 2023-12-04T05:38:00.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38ecda5640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 0x7f38d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:00.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.862+0000 7f38ecda5640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 0x7f38d4068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38e40011f0 tx=0x7f38e4007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:00.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:00.866+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38e00522e0 con 0x7f38e8158630 2023-12-04T05:38:01.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.046+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38e806c970 con 0x7f38e8158630 2023-12-04T05:38:01.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.046+0000 7f38dd7fa640 1 -- 172.21.15.97:0/3590575811 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f38e0055900 con 0x7f38e8158630 2023-12-04T05:38:01.052 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:01.052 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:01.054 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 22 2023-12-04T05:38:01.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 msgr2=0x7f38d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 0x7f38d4068d90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38e40011f0 tx=0x7f38e4007d40 comp rx=0 tx=0).stop 2023-12-04T05:38:01.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 msgr2=0x7f38e814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f38e000efc0 tx=0x7f38e0009f90 comp rx=0 tx=0).stop 2023-12-04T05:38:01.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 shutdown_connections 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38d40668d0 0x7f38d4068d90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f38e8158630 0x7f38e814b680 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38e8151bf0 0x7f38e80bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 --2- 172.21.15.97:0/3590575811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38e80c7ef0 0x7f38e80acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 >> 172.21.15.97:0/3590575811 conn(0x7f38e8073550 msgr2=0x7f38e8150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 shutdown_connections 2023-12-04T05:38:01.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.050+0000 7f38ef009640 1 -- 172.21.15.97:0/3590575811 wait complete. 2023-12-04T05:38:01.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 Processor -- start 2023-12-04T05:38:01.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 -- start start 2023-12-04T05:38:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 0x7fc4000a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc400152490 0x7fc400152900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000a9770 con 0x7fc40014fbb0 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40014ff90 con 0x7fc400152490 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc4076d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc400071730 con 0x7fc4000a8460 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc405472640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc40014fbb0 0x7fc4000a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35810/0 (socket says 172.21.15.97:35810) 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc405472640 1 -- 172.21.15.97:0/1677432135 learned_addr learned my addr 172.21.15.97:0/1677432135 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.206+0000 7fc405c73640 1 --2- 172.21.15.97:0/1677432135 >> v2:172.21.15.97:3300/0 conn(0x7fc400152490 0x7fc400152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc404c71640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 0x7fc4000a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc3f7fff640 1 -- 172.21.15.97:0/1677432135 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541732515 0 0) 0x7fc4000a9770 con 0x7fc40014fbb0 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc3f7fff640 1 -- 172.21.15.97:0/1677432135 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec003530 con 0x7fc40014fbb0 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc405c73640 1 -- 172.21.15.97:0/1677432135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 msgr2=0x7fc4000a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc405c73640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 0x7fc4000a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc405c73640 1 -- 172.21.15.97:0/1677432135 >> v1:172.21.15.97:6789/0 conn(0x7fc40014fbb0 legacy=0x7fc4000a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc405c73640 1 -- 172.21.15.97:0/1677432135 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400071a10 con 0x7fc400152490 2023-12-04T05:38:01.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc404c71640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 0x7fc4000a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:01.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc405c73640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc400152490 0x7fc400152900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bd28087e2daac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc3f7fff640 1 -- 172.21.15.97:0/1677432135 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80a58c0 con 0x7fc400152490 2023-12-04T05:38:01.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc3f7fff640 1 -- 172.21.15.97:0/1677432135 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80a5a20 con 0x7fc400152490 2023-12-04T05:38:01.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc3f7fff640 1 -- 172.21.15.97:0/1677432135 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80a5db0 con 0x7fc400152490 2023-12-04T05:38:01.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc4076d6640 1 -- 172.21.15.97:0/1677432135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc400152490 msgr2=0x7fc400152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.210+0000 7fc4076d6640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc400152490 0x7fc400152900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f801c800 comp rx=0 tx=0).stop 2023-12-04T05:38:01.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- 172.21.15.97:0/1677432135 shutdown_connections 2023-12-04T05:38:01.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc400152490 0x7fc400152900 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 --2- 172.21.15.97:0/1677432135 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4000a8460 0x7fc4000a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- 172.21.15.97:0/1677432135 >> 172.21.15.97:0/1677432135 conn(0x7fc4000c2970 msgr2=0x7fc4000c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- 172.21.15.97:0/1677432135 shutdown_connections 2023-12-04T05:38:01.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- 172.21.15.97:0/1677432135 wait complete. 2023-12-04T05:38:01.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 Processor -- start 2023-12-04T05:38:01.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- start start 2023-12-04T05:38:01.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc40014fbb0 0x7fc400144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc400152490 0x7fc400144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4001f1510 con 0x7fc4000a8460 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40014d5d0 con 0x7fc400152490 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc4076d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40014da60 con 0x7fc40014fbb0 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57948/0 (socket says 172.21.15.97:57948) 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 -- 172.21.15.97:0/3261680485 learned_addr learned my addr 172.21.15.97:0/3261680485 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405c73640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc400152490 0x7fc400144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc404c71640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc40014fbb0 0x7fc400144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 -- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc40014fbb0 msgr2=0x7fc400144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc40014fbb0 0x7fc400144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 -- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc400152490 msgr2=0x7fc400144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc400152490 0x7fc400144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 -- 172.21.15.97:0/3261680485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8009a70 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc405472640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c450 tx=0x7fc3fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.214+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc005cf0 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc005e50 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc007270 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40014f270 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4000c5ab0 con 0x7fc4000a8460 2023-12-04T05:38:01.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400068440 con 0x7fc4000a8460 2023-12-04T05:38:01.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc3fc0073d0 con 0x7fc4000a8460 2023-12-04T05:38:01.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc3f5ffb640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 0x7fc3e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc3fc083b90 con 0x7fc4000a8460 2023-12-04T05:38:01.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc404c71640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 0x7fc3e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.218+0000 7fc404c71640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 0x7fc3e4068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc400149a90 tx=0x7fc3f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.222+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3fc050bb0 con 0x7fc4000a8460 2023-12-04T05:38:01.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.374+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4000a9d60 con 0x7fc4000a8460 2023-12-04T05:38:01.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc3f5ffb640 1 -- 172.21.15.97:0/3261680485 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7fc3fc017020 con 0x7fc4000a8460 2023-12-04T05:38:01.382 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:01.382 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:01.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 msgr2=0x7fc3e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 0x7fc3e4068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc400149a90 tx=0x7fc3f0008040 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 msgr2=0x7fc40006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c450 tx=0x7fc3fc00c910 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 shutdown_connections 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc3e40668d0 0x7fc3e4068d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc400152490 0x7fc400144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc40014fbb0 0x7fc400144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 --2- 172.21.15.97:0/3261680485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc4000a8460 0x7fc40006db90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 >> 172.21.15.97:0/3261680485 conn(0x7fc4000c2970 msgr2=0x7fc400145b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 shutdown_connections 2023-12-04T05:38:01.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.378+0000 7fc4076d6640 1 -- 172.21.15.97:0/3261680485 wait complete. 2023-12-04T05:38:01.403 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T05:38:01.403 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:01.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 Processor -- start 2023-12-04T05:38:01.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 -- start start 2023-12-04T05:38:01.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83b013d1f0 0x7f83b00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b00c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 0x7f83b00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b0155120 con 0x7f83b013d1f0 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00c9960 con 0x7f83b00cab80 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b64d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b013d920 con 0x7f83b00c48b0 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83b013d1f0 0x7f83b00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f83b013d1f0 0x7f83b00ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57956/0 (socket says 172.21.15.97:57956) 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 -- 172.21.15.97:0/590715738 learned_addr learned my addr 172.21.15.97:0/590715738 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b4a73640 1 --2- 172.21.15.97:0/590715738 >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 0x7f83b00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83af7fe640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b00c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 -- 172.21.15.97:0/590715738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 msgr2=0x7f83b00c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b00c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 -- 172.21.15.97:0/590715738 >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 msgr2=0x7f83b00c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 --2- 172.21.15.97:0/590715738 >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 0x7f83b00c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83affff640 1 -- 172.21.15.97:0/590715738 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0154a60 con 0x7f83b013d1f0 2023-12-04T05:38:01.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.538+0000 7f83b4a73640 1 --2- 172.21.15.97:0/590715738 >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 0x7f83b00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83affff640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b013d1f0 0x7f83b00ca640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f83b0158d20 tx=0x7f83a001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1999ded0a37fb754 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83aeffd640 1 -- 172.21.15.97:0/590715738 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00ad640 con 0x7f83b013d1f0 2023-12-04T05:38:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83aeffd640 1 -- 172.21.15.97:0/590715738 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00ad7a0 con 0x7f83b013d1f0 2023-12-04T05:38:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83aeffd640 1 -- 172.21.15.97:0/590715738 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00adb30 con 0x7f83b013d1f0 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 -- 172.21.15.97:0/590715738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b013d1f0 msgr2=0x7f83b00ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b013d1f0 0x7f83b00ca640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f83b0158d20 tx=0x7f83a001c3b0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 -- 172.21.15.97:0/590715738 shutdown_connections 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b00c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 --2- 172.21.15.97:0/590715738 >> v2:172.21.15.143:3300/0 conn(0x7f83b00cab80 0x7f83b00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 --2- 172.21.15.97:0/590715738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b013d1f0 0x7f83b00ca640 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 -- 172.21.15.97:0/590715738 >> 172.21.15.97:0/590715738 conn(0x7f83b00ac160 msgr2=0x7f83b00c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 -- 172.21.15.97:0/590715738 shutdown_connections 2023-12-04T05:38:01.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.542+0000 7f83b64d6640 1 -- 172.21.15.97:0/590715738 wait complete. 2023-12-04T05:38:01.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 Processor -- start 2023-12-04T05:38:01.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- start start 2023-12-04T05:38:01.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b013bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83b013d1f0 0x7f83b0135770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0137e00 con 0x7f83b00cab80 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0157620 con 0x7f83b013d1f0 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01ee2f0 con 0x7f83b00c48b0 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57966/0 (socket says 172.21.15.97:57966) 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 -- 172.21.15.97:0/4206259743 learned_addr learned my addr 172.21.15.97:0/4206259743 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b4a73640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83b013d1f0 0x7f83b0135770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83affff640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b013bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 -- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 msgr2=0x7f83b013bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b013bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 -- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83b013d1f0 msgr2=0x7f83b0135770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83b013d1f0 0x7f83b0135770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 -- 172.21.15.97:0/4206259743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00094d0 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83af7fe640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f83a400d7d0 tx=0x7f83a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40096a0 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a4009800 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4009bb0 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0153a80 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.546+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b01ed6e0 con 0x7f83b00cab80 2023-12-04T05:38:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b0068440 con 0x7f83b00cab80 2023-12-04T05:38:01.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f83a4009d10 con 0x7f83b00cab80 2023-12-04T05:38:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83acff9640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 0x7f839c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f83a4084b80 con 0x7f83b00cab80 2023-12-04T05:38:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83affff640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 0x7f839c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.550+0000 7f83affff640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 0x7f839c068d90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f83a00af000 tx=0x7f83a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.554+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83a4051b00 con 0x7f83b00cab80 2023-12-04T05:38:01.739 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.734+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83b00c9b50 con 0x7f83b00cab80 2023-12-04T05:38:01.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.734+0000 7f83acff9640 1 -- 172.21.15.97:0/4206259743 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6130 (secure 0 0 0) 0x7f83a4055120 con 0x7f83b00cab80 2023-12-04T05:38:01.740 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:01.740 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:01.741 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 22 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 msgr2=0x7f839c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 0x7f839c068d90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f83a00af000 tx=0x7f83a0009040 comp rx=0 tx=0).stop 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 msgr2=0x7f83b0135230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f83a400d7d0 tx=0x7f83a400dc90 comp rx=0 tx=0).stop 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 shutdown_connections 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f839c0668d0 0x7f839c068d90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83b013d1f0 0x7f83b0135770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83b00cab80 0x7f83b0135230 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 --2- 172.21.15.97:0/4206259743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83b00c48b0 0x7f83b013bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 >> 172.21.15.97:0/4206259743 conn(0x7f83b00ac160 msgr2=0x7f83b00c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 shutdown_connections 2023-12-04T05:38:01.744 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.738+0000 7f83b64d6640 1 -- 172.21.15.97:0/4206259743 wait complete. 2023-12-04T05:38:01.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 Processor -- start 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 -- start start 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdbec06ca50 0x7fdbec0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec152300 con 0x7fdbec14e970 2023-12-04T05:38:01.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec071580 con 0x7fdbec06ca50 2023-12-04T05:38:01.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.894+0000 7fdbf3c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec14ed50 con 0x7fdbec06be00 2023-12-04T05:38:01.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdbec06ca50 0x7fdbec0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdbec06ca50 0x7fdbec0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:33116/0 (socket says 172.21.15.97:33116) 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf1a15640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fdbec14e970 0x7fdbec071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52856/0 (socket says 172.21.15.97:52856) 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 -- 172.21.15.97:0/2303569320 learned_addr learned my addr 172.21.15.97:0/2303569320 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf1214640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 -- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 msgr2=0x7fdbec06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 -- 172.21.15.97:0/2303569320 >> v1:172.21.15.143:6789/0 conn(0x7fdbec14e970 legacy=0x7fdbec071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 -- 172.21.15.97:0/2303569320 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec06cea0 con 0x7fdbec06ca50 2023-12-04T05:38:01.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf0a13640 1 -- 172.21.15.97:0/2303569320 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979375858 0 0) 0x7fdbe8001120 con 0x7fdbec14e970 2023-12-04T05:38:01.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.898+0000 7fdbf2216640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec0c1880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400d150 tx=0x7fdbe401eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d22a8b7585acd888 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf0a13640 1 -- 172.21.15.97:0/2303569320 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400b0d0 con 0x7fdbec06ca50 2023-12-04T05:38:01.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf0a13640 1 -- 172.21.15.97:0/2303569320 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400b230 con 0x7fdbec06ca50 2023-12-04T05:38:01.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf0a13640 1 -- 172.21.15.97:0/2303569320 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40a79c0 con 0x7fdbec06ca50 2023-12-04T05:38:01.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 msgr2=0x7fdbec0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec0c1880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400d150 tx=0x7fdbe401eaf0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2303569320 shutdown_connections 2023-12-04T05:38:01.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec0c1880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2303569320 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2303569320 >> 172.21.15.97:0/2303569320 conn(0x7fdbec0c2970 msgr2=0x7fdbec0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:01.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2303569320 shutdown_connections 2023-12-04T05:38:01.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2303569320 wait complete. 2023-12-04T05:38:01.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 Processor -- start 2023-12-04T05:38:01.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- start start 2023-12-04T05:38:01.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c4e40 con 0x7fdbec14e970 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c4b60 con 0x7fdbec06ca50 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf3c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0c56a0 con 0x7fdbec06be00 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf2216640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf2216640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57976/0 (socket says 172.21.15.97:57976) 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf2216640 1 -- 172.21.15.97:0/2083870098 learned_addr learned my addr 172.21.15.97:0/2083870098 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf1214640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.902+0000 7fdbf1a15640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 -- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 msgr2=0x7fdbec143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 -- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 msgr2=0x7fdbec143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:01.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:01.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 -- 172.21.15.97:0/2083870098 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe400bd40 con 0x7fdbec14e970 2023-12-04T05:38:01.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf1214640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:01.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf2216640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b1040 tx=0x7fdbe401b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4003ba0 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe4003d00 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec0c5980 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4009a10 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec15afb0 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec15b290 con 0x7fdbec14e970 2023-12-04T05:38:01.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdbe4009b70 con 0x7fdbec14e970 2023-12-04T05:38:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 0x7fdbd0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.906+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdbe411f790 con 0x7fdbec14e970 2023-12-04T05:38:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.910+0000 7fdbf1a15640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 0x7fdbd0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:01.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.910+0000 7fdbf1a15640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 0x7fdbd0068dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8000f70 tx=0x7fdbe8007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:01.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:01.910+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbe40ec710 con 0x7fdbec14e970 2023-12-04T05:38:02.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.090+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbec068440 con 0x7fdbec14e970 2023-12-04T05:38:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.090+0000 7fdbe27fc640 1 -- 172.21.15.97:0/2083870098 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6130 (secure 0 0 0) 0x7fdbe400b720 con 0x7fdbec14e970 2023-12-04T05:38:02.096 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:02.096 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:24.724414+0000","modified":"2023-12-04T05:37:27.727068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6836/525136181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":525136181},{"type":"v1","addr":"172.21.15.97:6836","nonce":525136181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 22 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 msgr2=0x7fdbd0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 0x7fdbd0068dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8000f70 tx=0x7fdbe8007240 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 msgr2=0x7fdbec148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b1040 tx=0x7fdbe401b890 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 shutdown_connections 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbd0066900 0x7fdbd0068dc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbec14e970 0x7fdbec148e80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbec06ca50 0x7fdbec143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 --2- 172.21.15.97:0/2083870098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbec06be00 0x7fdbec143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 >> 172.21.15.97:0/2083870098 conn(0x7fdbec0c2970 msgr2=0x7fdbec144770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 shutdown_connections 2023-12-04T05:38:02.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.094+0000 7fdbf3c79640 1 -- 172.21.15.97:0/2083870098 wait complete. 2023-12-04T05:38:02.117 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:02.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 Processor -- start 2023-12-04T05:38:02.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 -- start start 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c80c7ef0 0x7f31c8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f31c8158630 0x7f31c81551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c81547d0 con 0x7f31c8151bf0 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c8158b80 con 0x7f31c8158630 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.250+0000 7f31cd580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c4aa0 con 0x7f31c80c7ef0 2023-12-04T05:38:02.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c6ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f31c8151bf0 0x7f31c80abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35826/0 (socket says 172.21.15.97:35826) 2023-12-04T05:38:02.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c6ffd640 1 -- 172.21.15.97:0/4022533629 learned_addr learned my addr 172.21.15.97:0/4022533629 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:02.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 --2- 172.21.15.97:0/4022533629 >> v2:172.21.15.97:3300/0 conn(0x7f31c8158630 0x7f31c81551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31be7fc640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c80c7ef0 0x7f31c8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c67fc640 1 -- 172.21.15.97:0/4022533629 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211761648 0 0) 0x7f31c81547d0 con 0x7f31c8151bf0 2023-12-04T05:38:02.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c67fc640 1 -- 172.21.15.97:0/4022533629 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b4003530 con 0x7f31c8151bf0 2023-12-04T05:38:02.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 -- 172.21.15.97:0/4022533629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c80c7ef0 msgr2=0x7f31c8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:02.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c80c7ef0 0x7f31c8154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 -- 172.21.15.97:0/4022533629 >> v1:172.21.15.97:6789/0 conn(0x7f31c8151bf0 legacy=0x7f31c80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 -- 172.21.15.97:0/4022533629 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80c4d40 con 0x7f31c8158630 2023-12-04T05:38:02.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c77fe640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c8158630 0x7f31c81551a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097c0 tx=0x7f31c001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d397f539ec892fa server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c67fc640 1 -- 172.21.15.97:0/4022533629 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00a4780 con 0x7f31c8158630 2023-12-04T05:38:02.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c67fc640 1 -- 172.21.15.97:0/4022533629 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00a48e0 con 0x7f31c8158630 2023-12-04T05:38:02.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.254+0000 7f31c67fc640 1 -- 172.21.15.97:0/4022533629 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00a4c70 con 0x7f31c8158630 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- 172.21.15.97:0/4022533629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c8158630 msgr2=0x7f31c81551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c8158630 0x7f31c81551a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097c0 tx=0x7f31c001c040 comp rx=0 tx=0).stop 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- 172.21.15.97:0/4022533629 shutdown_connections 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c8158630 0x7f31c81551a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- 172.21.15.97:0/4022533629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c80c7ef0 0x7f31c8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- 172.21.15.97:0/4022533629 >> 172.21.15.97:0/4022533629 conn(0x7f31c8073550 msgr2=0x7f31c8073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- 172.21.15.97:0/4022533629 shutdown_connections 2023-12-04T05:38:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- 172.21.15.97:0/4022533629 wait complete. 2023-12-04T05:38:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 Processor -- start 2023-12-04T05:38:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- start start 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c8151bf0 0x7f31c80bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 0x7f31c81f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80ae2b0 con 0x7f31c80c7ef0 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81edd80 con 0x7f31c8158630 2023-12-04T05:38:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31cd580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80acd40 con 0x7f31c8151bf0 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31c6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57986/0 (socket says 172.21.15.97:57986) 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31c6ffd640 1 -- 172.21.15.97:0/3631858917 learned_addr learned my addr 172.21.15.97:0/3631858917 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31be7fc640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c8151bf0 0x7f31c80bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.258+0000 7f31c77fe640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 0x7f31c81f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 -- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c8151bf0 msgr2=0x7f31c80bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c8151bf0 0x7f31c80bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 -- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 msgr2=0x7f31c81f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 0x7f31c81f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 -- 172.21.15.97:0/3631858917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009420 con 0x7f31c80c7ef0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c77fe640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 0x7f31c81f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31c6ffd640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c420 tx=0x7f31b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8005cf0 con 0x7f31c80c7ef0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8005e50 con 0x7f31c80c7ef0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c80ad020 con 0x7f31c80c7ef0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80072d0 con 0x7f31c80c7ef0 2023-12-04T05:38:02.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c81f1130 con 0x7f31c80c7ef0 2023-12-04T05:38:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c8068440 con 0x7f31c80c7ef0 2023-12-04T05:38:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f31b8007430 con 0x7f31c80c7ef0 2023-12-04T05:38:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 0x7f31a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f31b8083d30 con 0x7f31c80c7ef0 2023-12-04T05:38:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.262+0000 7f31be7fc640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 0x7f31a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.266+0000 7f31be7fc640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 0x7f31a8068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f31b0003fd0 tx=0x7f31b00039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.266+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31b8050cb0 con 0x7f31c80c7ef0 2023-12-04T05:38:02.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.418+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31c806c970 con 0x7f31c80c7ef0 2023-12-04T05:38:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31bffff640 1 -- 172.21.15.97:0/3631858917 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20217 (secure 0 0 0) 0x7f31b8017020 con 0x7f31c80c7ef0 2023-12-04T05:38:02.425 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:02.426 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":35,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:37:44.018949+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:37:22.374120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-04T05:37:23.709890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:02.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 msgr2=0x7f31a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 0x7f31a8068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f31b0003fd0 tx=0x7f31b00039a0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 msgr2=0x7f31c81ed840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c420 tx=0x7f31b800c8e0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 shutdown_connections 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f31a80668d0 0x7f31a8068d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31c8158630 0x7f31c81f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f31c8151bf0 0x7f31c80bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 --2- 172.21.15.97:0/3631858917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31c80c7ef0 0x7f31c81ed840 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 >> 172.21.15.97:0/3631858917 conn(0x7f31c8073550 msgr2=0x7f31c81506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 shutdown_connections 2023-12-04T05:38:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.422+0000 7f31cd580640 1 -- 172.21.15.97:0/3631858917 wait complete. 2023-12-04T05:38:02.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-04T05:38:02.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 Processor -- start 2023-12-04T05:38:02.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 -- start start 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f68b8155200 0x7f68b80c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b8155640 con 0x7f68b80c67d0 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b8158b70 con 0x7f68b81586c0 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68be7d0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80c5680 con 0x7f68b8155200 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bd7ce640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f68b80c67d0 0x7f68b80c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35828/0 (socket says 172.21.15.97:35828) 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bd7ce640 1 -- 172.21.15.97:0/924239362 learned_addr learned my addr 172.21.15.97:0/924239362 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bcfcd640 1 --2- 172.21.15.97:0/924239362 >> v2:172.21.15.97:3300/0 conn(0x7f68b8155200 0x7f68b80c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68affff640 1 -- 172.21.15.97:0/924239362 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620028782 0 0) 0x7f68b8155640 con 0x7f68b80c67d0 2023-12-04T05:38:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68affff640 1 -- 172.21.15.97:0/924239362 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4003530 con 0x7f68b80c67d0 2023-12-04T05:38:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bcfcd640 1 -- 172.21.15.97:0/924239362 >> v1:172.21.15.143:6789/0 conn(0x7f68b81586c0 legacy=0x7f68b815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bcfcd640 1 -- 172.21.15.97:0/924239362 >> v1:172.21.15.97:6789/0 conn(0x7f68b80c67d0 legacy=0x7f68b80c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.582+0000 7f68bcfcd640 1 -- 172.21.15.97:0/924239362 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80c8620 con 0x7f68b8155200 2023-12-04T05:38:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68bcfcd640 1 --2- 172.21.15.97:0/924239362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b8155200 0x7f68b80c6bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f68a80097c0 tx=0x7f68a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afeb0f2c22b8a85b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68affff640 1 -- 172.21.15.97:0/924239362 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80a8970 con 0x7f68b8155200 2023-12-04T05:38:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68affff640 1 -- 172.21.15.97:0/924239362 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a80a8ad0 con 0x7f68b8155200 2023-12-04T05:38:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68affff640 1 -- 172.21.15.97:0/924239362 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a80a8e60 con 0x7f68b8155200 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 -- 172.21.15.97:0/924239362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b8155200 msgr2=0x7f68b80c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 --2- 172.21.15.97:0/924239362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b8155200 0x7f68b80c6bb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f68a80097c0 tx=0x7f68a801ec70 comp rx=0 tx=0).stop 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 -- 172.21.15.97:0/924239362 shutdown_connections 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 --2- 172.21.15.97:0/924239362 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b8155200 0x7f68b80c6bb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 -- 172.21.15.97:0/924239362 >> 172.21.15.97:0/924239362 conn(0x7f68b80ab980 msgr2=0x7f68b80abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 -- 172.21.15.97:0/924239362 shutdown_connections 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.586+0000 7f68be7d0640 1 -- 172.21.15.97:0/924239362 wait complete. 2023-12-04T05:38:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 Processor -- start 2023-12-04T05:38:02.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- start start 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68b8155200 0x7f68b814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68b81586c0 0x7f68b8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8153bb0 con 0x7f68b80c67d0 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8154510 con 0x7f68b8155200 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80afda0 con 0x7f68b81586c0 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58004/0 (socket says 172.21.15.97:58004) 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 -- 172.21.15.97:0/1235365990 learned_addr learned my addr 172.21.15.97:0/1235365990 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bcfcd640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68b8155200 0x7f68b814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bdfcf640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68b81586c0 0x7f68b8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 -- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68b81586c0 msgr2=0x7f68b8155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68b81586c0 0x7f68b8155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 -- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68b8155200 msgr2=0x7f68b814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68b8155200 0x7f68b814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 -- 172.21.15.97:0/1235365990 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009420 con 0x7f68b80c67d0 2023-12-04T05:38:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68bd7ce640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c4d0 tx=0x7f68b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4005cf0 con 0x7f68b80c67d0 2023-12-04T05:38:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4005e50 con 0x7f68b80c67d0 2023-12-04T05:38:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b81ee190 con 0x7f68b80c67d0 2023-12-04T05:38:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007270 con 0x7f68b80c67d0 2023-12-04T05:38:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.590+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b81534f0 con 0x7f68b80c67d0 2023-12-04T05:38:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b8153cf0 con 0x7f68b80c67d0 2023-12-04T05:38:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f68b40073d0 con 0x7f68b80c67d0 2023-12-04T05:38:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68adffb640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 0x7f689c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f68b4083c20 con 0x7f68b80c67d0 2023-12-04T05:38:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68bcfcd640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 0x7f689c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.594+0000 7f68bcfcd640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 0x7f689c068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68a80b2000 tx=0x7f68a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.598+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68b4050ba0 con 0x7f68b80c67d0 2023-12-04T05:38:02.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.778+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f68b804e890 con 0x7f68b80c67d0 2023-12-04T05:38:02.783 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:38:02.778+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:38:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.782+0000 7f68adffb640 1 -- 172.21.15.97:0/1235365990 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68b4017020 con 0x7f68b80c67d0 2023-12-04T05:38:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:38:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 msgr2=0x7f689c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 0x7f689c068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68a80b2000 tx=0x7f68a8008040 comp rx=0 tx=0).stop 2023-12-04T05:38:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 msgr2=0x7f68b8153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c4d0 tx=0x7f68b400c990 comp rx=0 tx=0).stop 2023-12-04T05:38:02.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 shutdown_connections 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f689c0668d0 0x7f689c068d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68b81586c0 0x7f68b8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68b8155200 0x7f68b814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 --2- 172.21.15.97:0/1235365990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f68b80c67d0 0x7f68b8153fd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 >> 172.21.15.97:0/1235365990 conn(0x7f68b80ab980 msgr2=0x7f68b80ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 shutdown_connections 2023-12-04T05:38:02.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.786+0000 7f68be7d0640 1 -- 172.21.15.97:0/1235365990 wait complete. 2023-12-04T05:38:02.795 INFO:tasks.ceph.mds.a.smithi097.stderr: -2750> 2023-12-04T05:37:29.306+0000 7ff129fc0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:38:02.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-04T05:38:02.844 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:38:02.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 Processor -- start 2023-12-04T05:38:02.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 -- start start 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3670151f10 0x7f36700c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700cac10 0x7f367015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700ca780 con 0x7f36700c7f00 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3670158cc0 con 0x7f3670151f10 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3676e46640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700c5700 con 0x7f36700cac10 2023-12-04T05:38:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3674be2640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3670151f10 0x7f36700c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f366ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f36700c7f00 0x7f3670154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:35840/0 (socket says 172.21.15.97:35840) 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f366ffff640 1 -- 172.21.15.97:0/2324890037 learned_addr learned my addr 172.21.15.97:0/2324890037 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f36753e3640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700cac10 0x7f367015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3674be2640 1 -- 172.21.15.97:0/2324890037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700cac10 msgr2=0x7f367015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3674be2640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700cac10 0x7f367015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.950+0000 7f3674be2640 1 -- 172.21.15.97:0/2324890037 >> v1:172.21.15.97:6789/0 conn(0x7f36700c7f00 legacy=0x7f3670154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3674be2640 1 -- 172.21.15.97:0/2324890037 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670158720 con 0x7f3670151f10 2023-12-04T05:38:02.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f366f7fe640 1 -- 172.21.15.97:0/2324890037 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538766742 0 0) 0x7f36700ca780 con 0x7f36700c7f00 2023-12-04T05:38:02.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3674be2640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f36700c4980 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbbd69bad21b279 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f366f7fe640 1 -- 172.21.15.97:0/2324890037 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640ab600 con 0x7f3670151f10 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f366f7fe640 1 -- 172.21.15.97:0/2324890037 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640a7050 con 0x7f3670151f10 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f366f7fe640 1 -- 172.21.15.97:0/2324890037 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640ab980 con 0x7f3670151f10 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 -- 172.21.15.97:0/2324890037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 msgr2=0x7f36700c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f36700c4980 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401c330 comp rx=0 tx=0).stop 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 -- 172.21.15.97:0/2324890037 shutdown_connections 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700cac10 0x7f367015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 --2- 172.21.15.97:0/2324890037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f36700c4980 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 -- 172.21.15.97:0/2324890037 >> 172.21.15.97:0/2324890037 conn(0x7f3670073950 msgr2=0x7f3670073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:02.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 -- 172.21.15.97:0/2324890037 shutdown_connections 2023-12-04T05:38:02.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.954+0000 7f3676e46640 1 -- 172.21.15.97:0/2324890037 wait complete. 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 Processor -- start 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 -- start start 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 0x7f36701ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700cac10 0x7f367014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f3670145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670157bc0 con 0x7f3670151f10 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670153240 con 0x7f36700cac10 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36701edcf0 con 0x7f36700c7f00 2023-12-04T05:38:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f3670145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3674be2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 0x7f36701ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3674be2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 0x7f36701ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:49814/0 (socket says 172.21.15.97:49814) 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3674be2640 1 -- 172.21.15.97:0/3953140651 learned_addr learned my addr 172.21.15.97:0/3953140651 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f366ffff640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700cac10 0x7f367014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 -- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 msgr2=0x7f36701ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 0x7f36701ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 -- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700cac10 msgr2=0x7f367014c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700cac10 0x7f367014c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 -- 172.21.15.97:0/3953140651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009420 con 0x7f3670151f10 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f36753e3640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f3670145d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3668007d60 tx=0x7f366800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668018070 con 0x7f3670151f10 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366800ed70 con 0x7f3670151f10 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668003bc0 con 0x7f3670151f10 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.958+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3670152630 con 0x7f3670151f10 2023-12-04T05:38:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3670152bf0 con 0x7f3670151f10 2023-12-04T05:38:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3670068440 con 0x7f3670151f10 2023-12-04T05:38:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3668014420 con 0x7f3670151f10 2023-12-04T05:38:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f366d7fa640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 0x7f3654068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f3668084890 con 0x7f3670151f10 2023-12-04T05:38:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.962+0000 7f3674be2640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 0x7f3654068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.966+0000 7f3674be2640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 0x7f3654068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3664019f60 tx=0x7f36640a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:02.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:02.966+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3668051860 con 0x7f3670151f10 2023-12-04T05:38:03.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.150+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3670153380 con 0x7f3670151f10 2023-12-04T05:38:03.398 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:38:03.402 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:38:03.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f366d7fa640 1 -- 172.21.15.97:0/3953140651 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3668054e80 con 0x7f3670151f10 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 msgr2=0x7f3654068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 0x7f3654068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3664019f60 tx=0x7f36640a6000 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 msgr2=0x7f3670145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f3670145d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3668007d60 tx=0x7f366800e4b0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 shutdown_connections 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f36540668d0 0x7f3654068d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3670151f10 0x7f3670145d80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36700cac10 0x7f367014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 --2- 172.21.15.97:0/3953140651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f36700c7f00 0x7f36701ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 >> 172.21.15.97:0/3953140651 conn(0x7f3670073950 msgr2=0x7f36700c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 shutdown_connections 2023-12-04T05:38:03.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.786+0000 7f3676e46640 1 -- 172.21.15.97:0/3953140651 wait complete. 2023-12-04T05:38:03.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-04T05:38:03.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.946+0000 7f2bf759e640 1 Processor -- start 2023-12-04T05:38:03.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 -- start start 2023-12-04T05:38:03.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2bf806ab30 0x7f2bf806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf8070e90 con 0x7f2bf8072910 2023-12-04T05:38:03.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf80713c0 con 0x7f2bf806ab30 2023-12-04T05:38:03.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8155320 con 0x7f2bf8151a00 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2bf806ab30 0x7f2bf806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:49820/0 (socket says 172.21.15.97:49820) 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 -- 172.21.15.97:0/930173061 learned_addr learned my addr 172.21.15.97:0/930173061 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 -- 172.21.15.97:0/930173061 >> v2:172.21.15.143:3300/0 conn(0x7f2bf806ab30 msgr2=0x7f2bf806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf5d9b640 1 -- 172.21.15.97:0/930173061 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041660243 0 0) 0x7f2bf8070e90 con 0x7f2bf8072910 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 --2- 172.21.15.97:0/930173061 >> v2:172.21.15.143:3300/0 conn(0x7f2bf806ab30 0x7f2bf806e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 -- 172.21.15.97:0/930173061 >> v1:172.21.15.143:6789/0 conn(0x7f2bf8072910 legacy=0x7f2bf806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.950+0000 7f2bf659c640 1 -- 172.21.15.97:0/930173061 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80710e0 con 0x7f2bf8151a00 2023-12-04T05:38:03.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf659c640 1 --2- 172.21.15.97:0/930173061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe376b73d81b0e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:03.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf5d9b640 1 -- 172.21.15.97:0/930173061 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80a5830 con 0x7f2bf8151a00 2023-12-04T05:38:03.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf5d9b640 1 -- 172.21.15.97:0/930173061 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80a5990 con 0x7f2bf8151a00 2023-12-04T05:38:03.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf5d9b640 1 -- 172.21.15.97:0/930173061 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80a5d20 con 0x7f2bf8151a00 2023-12-04T05:38:03.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 -- 172.21.15.97:0/930173061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 msgr2=0x7f2bf806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 --2- 172.21.15.97:0/930173061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be801c950 comp rx=0 tx=0).stop 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 -- 172.21.15.97:0/930173061 shutdown_connections 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 --2- 172.21.15.97:0/930173061 >> v2:172.21.15.143:3300/0 conn(0x7f2bf806ab30 0x7f2bf806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 --2- 172.21.15.97:0/930173061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf8151a00 0x7f2bf806a5f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 -- 172.21.15.97:0/930173061 >> 172.21.15.97:0/930173061 conn(0x7f2bf806b700 msgr2=0x7f2bf806bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 -- 172.21.15.97:0/930173061 shutdown_connections 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.954+0000 7f2bf759e640 1 -- 172.21.15.97:0/930173061 wait complete. 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 Processor -- start 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- start start 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf806ab30 0x7f2bf8149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2bf8151a00 0x7f2bf80a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80acbc0 con 0x7f2bf8072910 2023-12-04T05:38:03.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80ac320 con 0x7f2bf8151a00 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80ac600 con 0x7f2bf806ab30 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58050/0 (socket says 172.21.15.97:58050) 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 -- 172.21.15.97:0/1777231149 learned_addr learned my addr 172.21.15.97:0/1777231149 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf659c640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf806ab30 0x7f2bf8149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf6d9d640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2bf8151a00 0x7f2bf80a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 -- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf806ab30 msgr2=0x7f2bf8149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf806ab30 0x7f2bf8149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 -- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2bf8151a00 msgr2=0x7f2bf80a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2bf8151a00 0x7f2bf80a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 -- 172.21.15.97:0/1777231149 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8009b30 con 0x7f2bf8072910 2023-12-04T05:38:03.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bedd9b640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2be0001ec0 tx=0x7f2be000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be00054e0 con 0x7f2bf8072910 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0003600 con 0x7f2bf8072910 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf80ac8e0 con 0x7f2bf8072910 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be00039b0 con 0x7f2bf8072910 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf8149870 con 0x7f2bf8072910 2023-12-04T05:38:03.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.958+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf8155570 con 0x7f2bf8072910 2023-12-04T05:38:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.962+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2be0003b10 con 0x7f2bf8072910 2023-12-04T05:38:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.962+0000 7f2bef7fe640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 0x7f2bd8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.962+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f2be0083df0 con 0x7f2bf8072910 2023-12-04T05:38:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.962+0000 7f2bf659c640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 0x7f2bd8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:03.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.962+0000 7f2bf659c640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 0x7f2bd8068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2be80ae000 tx=0x7f2be80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:03.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:03.966+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2bf8155570 con 0x7f2bf8072910 2023-12-04T05:38:04.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.114+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2bf8155570 con 0x7f2bf8072910 2023-12-04T05:38:04.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.790+0000 7f2bef7fe640 1 -- 172.21.15.97:0/1777231149 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2bf8155570 con 0x7f2bf8072910 2023-12-04T05:38:04.795 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 msgr2=0x7f2bd8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 0x7f2bd8068d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2be80ae000 tx=0x7f2be80a7070 comp rx=0 tx=0).stop 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 msgr2=0x7f2bf80aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2be0001ec0 tx=0x7f2be000c8e0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 shutdown_connections 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2bd80668d0 0x7f2bd8068d90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2bf8151a00 0x7f2bf80a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2bf8072910 0x7f2bf80aa190 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 --2- 172.21.15.97:0/1777231149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2bf806ab30 0x7f2bf8149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 >> 172.21.15.97:0/1777231149 conn(0x7f2bf806b700 msgr2=0x7f2bf8154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:04.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 shutdown_connections 2023-12-04T05:38:04.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.794+0000 7f2bf759e640 1 -- 172.21.15.97:0/1777231149 wait complete. 2023-12-04T05:38:04.820 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-04T05:38:04.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 Processor -- start 2023-12-04T05:38:04.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 -- start start 2023-12-04T05:38:04.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa900c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa900c1ea0 0x7ffa9015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900c05f0 con 0x7ffa9014ea50 2023-12-04T05:38:04.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9014ee30 con 0x7ffa900c1ea0 2023-12-04T05:38:04.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa96c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90152360 con 0x7ffa900c3570 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa900c1ea0 0x7ffa9015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffa900c1ea0 0x7ffa9015bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51314/0 (socket says 172.21.15.97:51314) 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 -- 172.21.15.97:0/2234039676 learned_addr learned my addr 172.21.15.97:0/2234039676 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 -- 172.21.15.97:0/2234039676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 msgr2=0x7ffa900c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 --2- 172.21.15.97:0/2234039676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa900c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 -- 172.21.15.97:0/2234039676 >> v1:172.21.15.143:6789/0 conn(0x7ffa9014ea50 legacy=0x7ffa90152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:04.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.958+0000 7ffa95237640 1 -- 172.21.15.97:0/2234039676 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90151da0 con 0x7ffa900c1ea0 2023-12-04T05:38:04.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa95237640 1 --2- 172.21.15.97:0/2234039676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa9015bca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009e50 tx=0x7ffa8801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd4b2c80cf95b38 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa877fe640 1 -- 172.21.15.97:0/2234039676 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5790 con 0x7ffa900c1ea0 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa877fe640 1 -- 172.21.15.97:0/2234039676 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880a58f0 con 0x7ffa900c1ea0 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa877fe640 1 -- 172.21.15.97:0/2234039676 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880a5c80 con 0x7ffa900c1ea0 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 -- 172.21.15.97:0/2234039676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 msgr2=0x7ffa9015bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/2234039676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa9015bca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009e50 tx=0x7ffa8801c910 comp rx=0 tx=0).stop 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 -- 172.21.15.97:0/2234039676 shutdown_connections 2023-12-04T05:38:04.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/2234039676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa9015bca0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/2234039676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa900c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 -- 172.21.15.97:0/2234039676 >> 172.21.15.97:0/2234039676 conn(0x7ffa900c2a50 msgr2=0x7ffa900c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 -- 172.21.15.97:0/2234039676 shutdown_connections 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.962+0000 7ffa96c9a640 1 -- 172.21.15.97:0/2234039676 wait complete. 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 Processor -- start 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- start start 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa901ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9014ea50 0x7ffa900a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901ed240 con 0x7ffa900c1ea0 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901f1650 con 0x7ffa9014ea50 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900aab20 con 0x7ffa900c3570 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51324/0 (socket says 172.21.15.97:51324) 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 -- 172.21.15.97:0/1292770413 learned_addr learned my addr 172.21.15.97:0/1292770413 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa95237640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9014ea50 0x7ffa900a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:04.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa87fff640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa901ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 -- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 msgr2=0x7ffa901ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa901ed970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 -- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9014ea50 msgr2=0x7ffa900a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9014ea50 0x7ffa900a9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 -- 172.21.15.97:0/1292770413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009b30 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa94a36640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c450 tx=0x7ffa8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c012830 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0129b0 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c012d60 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa900aae00 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900bfb90 con 0x7ffa900c1ea0 2023-12-04T05:38:04.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.966+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa901ed690 con 0x7ffa900c1ea0 2023-12-04T05:38:04.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.970+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffa8c01c460 con 0x7ffa900c1ea0 2023-12-04T05:38:04.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.970+0000 7ffa857fa640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 0x7ffa7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:04.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.970+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6213+0+0 (secure 0 0 0) 0x7ffa8c0845d0 con 0x7ffa900c1ea0 2023-12-04T05:38:04.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.970+0000 7ffa87fff640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 0x7ffa7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:04.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.970+0000 7ffa87fff640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 0x7ffa7c068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa80006fd0 tx=0x7ffa80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:04.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:04.974+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa901ed690 con 0x7ffa900c1ea0 2023-12-04T05:38:05.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.130+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffa901ed690 con 0x7ffa900c1ea0 2023-12-04T05:38:05.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.978+0000 7ffa857fa640 1 -- 172.21.15.97:0/1292770413 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffa901ed690 con 0x7ffa900c1ea0 2023-12-04T05:38:05.982 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-12-04T05:38:05.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 msgr2=0x7ffa7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:05.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 0x7ffa7c068d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa80006fd0 tx=0x7ffa80008040 comp rx=0 tx=0).stop 2023-12-04T05:38:05.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 msgr2=0x7ffa900bf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:05.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c450 tx=0x7ffa8c00c910 comp rx=0 tx=0).stop 2023-12-04T05:38:05.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 shutdown_connections 2023-12-04T05:38:05.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffa7c0668d0 0x7ffa7c068d90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:05.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9014ea50 0x7ffa900a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:05.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa900c3570 0x7ffa901ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:05.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 --2- 172.21.15.97:0/1292770413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffa900c1ea0 0x7ffa900bf650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:05.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 >> 172.21.15.97:0/1292770413 conn(0x7ffa900c2a50 msgr2=0x7ffa900c2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:05.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 shutdown_connections 2023-12-04T05:38:05.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:05.982+0000 7ffa96c9a640 1 -- 172.21.15.97:0/1292770413 wait complete. 2023-12-04T05:38:06.010 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:06.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.142+0000 7ffb15054640 1 Processor -- start 2023-12-04T05:38:06.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.142+0000 7ffb15054640 1 -- start start 2023-12-04T05:38:06.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb15054640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb1006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb15054640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb1006ca50 0x7ffb100c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb15054640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb10152300 con 0x7ffb1006be00 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb15054640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb10071580 con 0x7ffb1006ca50 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb15054640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1014ed50 con 0x7ffb1014e970 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0f59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb1006ca50 0x7ffb100c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0e59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb1006be00 0x7ffb10071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32810/0 (socket says 172.21.15.97:32810) 2023-12-04T05:38:06.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0e59c640 1 -- 172.21.15.97:0/2125148634 learned_addr learned my addr 172.21.15.97:0/2125148634 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0ed9d640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb1006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0f59e640 1 -- 172.21.15.97:0/2125148634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 msgr2=0x7ffb1006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0f59e640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb1006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0f59e640 1 -- 172.21.15.97:0/2125148634 >> v1:172.21.15.97:6789/0 conn(0x7ffb1006be00 legacy=0x7ffb10071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0f59e640 1 -- 172.21.15.97:0/2125148634 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1006cea0 con 0x7ffb1006ca50 2023-12-04T05:38:06.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.146+0000 7ffb0ed9d640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb1006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:06.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb0f59e640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006ca50 0x7ffb100c1880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009d90 tx=0x7ffb0801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb681a8671c18e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb0dd9b640 1 -- 172.21.15.97:0/2125148634 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080a58f0 con 0x7ffb1006ca50 2023-12-04T05:38:06.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb0dd9b640 1 -- 172.21.15.97:0/2125148634 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb080a5a50 con 0x7ffb1006ca50 2023-12-04T05:38:06.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb0dd9b640 1 -- 172.21.15.97:0/2125148634 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080a5de0 con 0x7ffb1006ca50 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- 172.21.15.97:0/2125148634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006ca50 msgr2=0x7ffb100c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006ca50 0x7ffb100c1880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009d90 tx=0x7ffb0801c830 comp rx=0 tx=0).stop 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- 172.21.15.97:0/2125148634 shutdown_connections 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006ca50 0x7ffb100c1880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 --2- 172.21.15.97:0/2125148634 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb1006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- 172.21.15.97:0/2125148634 >> 172.21.15.97:0/2125148634 conn(0x7ffb100c2970 msgr2=0x7ffb100c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- 172.21.15.97:0/2125148634 shutdown_connections 2023-12-04T05:38:06.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- 172.21.15.97:0/2125148634 wait complete. 2023-12-04T05:38:06.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 Processor -- start 2023-12-04T05:38:06.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.150+0000 7ffb15054640 1 -- start start 2023-12-04T05:38:06.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1006ca50 0x7ffb101ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb101ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101502a0 con 0x7ffb1006be00 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10153d10 con 0x7ffb1006ca50 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10154a00 con 0x7ffb1014e970 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51350/0 (socket says 172.21.15.97:51350) 2023-12-04T05:38:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 -- 172.21.15.97:0/3218547007 learned_addr learned my addr 172.21.15.97:0/3218547007 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0f59e640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb101ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0e59c640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1006ca50 0x7ffb101ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 -- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 msgr2=0x7ffb101ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb101ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 -- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1006ca50 msgr2=0x7ffb101ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1006ca50 0x7ffb101ee2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 -- 172.21.15.97:0/3218547007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009a70 con 0x7ffb1006be00 2023-12-04T05:38:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb0ed9d640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000c7f0 tx=0x7ffb0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00007820 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00007980 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00007d30 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb100abe30 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb10150f30 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.154+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10068440 con 0x7ffb1006be00 2023-12-04T05:38:06.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.158+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb000113f0 con 0x7ffb1006be00 2023-12-04T05:38:06.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.158+0000 7ffaf77fe640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 0x7ffafc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.158+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ffb00084760 con 0x7ffb1006be00 2023-12-04T05:38:06.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.158+0000 7ffb0e59c640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 0x7ffafc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.158+0000 7ffb0e59c640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 0x7ffafc068d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a91f0 tx=0x7ffb04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.162+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb000519e0 con 0x7ffb1006be00 2023-12-04T05:38:06.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.310+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb101ee0f0 con 0x7ffb1006be00 2023-12-04T05:38:06.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffaf77fe640 1 -- 172.21.15.97:0/3218547007 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16632 (secure 0 0 0) 0x7ffb00055000 con 0x7ffb1006be00 2023-12-04T05:38:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:06.318 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":38,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:05.980236+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6836/525136181":"2023-12-05T05:38:02.783767+0000","172.21.15.97:6834/525136181":"2023-12-05T05:38:02.783767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 msgr2=0x7ffafc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 0x7ffafc068d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a91f0 tx=0x7ffb04009040 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 msgr2=0x7ffb1014b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000c7f0 tx=0x7ffb0000ccb0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 shutdown_connections 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffafc0668d0 0x7ffafc068d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb1014e970 0x7ffb101ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb1006ca50 0x7ffb101ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 --2- 172.21.15.97:0/3218547007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb1006be00 0x7ffb1014b7f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 >> 172.21.15.97:0/3218547007 conn(0x7ffb100c2970 msgr2=0x7ffb10071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 shutdown_connections 2023-12-04T05:38:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.314+0000 7ffb15054640 1 -- 172.21.15.97:0/3218547007 wait complete. 2023-12-04T05:38:06.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:37:40.181523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:37:41.370503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:06.340 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.474+0000 7f427b3b8640 1 Processor -- start 2023-12-04T05:38:06.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.474+0000 7f427b3b8640 1 -- start start 2023-12-04T05:38:06.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.474+0000 7f427b3b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4274154980 0x7f4274154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.474+0000 7f427b3b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f427b3b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740725c0 con 0x7f42740c1880 2023-12-04T05:38:06.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f427b3b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42741555e0 con 0x7f4274154980 2023-12-04T05:38:06.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f427b3b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427406eb40 con 0x7f42740c1d00 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4278953640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f42740c1880 0x7f4274151390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32822/0 (socket says 172.21.15.97:32822) 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4274154980 0x7f4274154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4278953640 1 -- 172.21.15.97:0/76793552 learned_addr learned my addr 172.21.15.97:0/76793552 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279955640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 -- 172.21.15.97:0/76793552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 msgr2=0x7f4274151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 -- 172.21.15.97:0/76793552 >> v1:172.21.15.97:6789/0 conn(0x7f42740c1880 legacy=0x7f4274151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 -- 172.21.15.97:0/76793552 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427406ee20 con 0x7f4274154980 2023-12-04T05:38:06.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f426bfff640 1 -- 172.21.15.97:0/76793552 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247685786 0 0) 0x7f42740725c0 con 0x7f42740c1880 2023-12-04T05:38:06.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279955640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:06.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f4279154640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f4274154d60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f42700097c0 tx=0x7f427001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c0be14f4fc6c88 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f426bfff640 1 -- 172.21.15.97:0/76793552 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700ac620 con 0x7f4274154980 2023-12-04T05:38:06.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f426bfff640 1 -- 172.21.15.97:0/76793552 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42700ac780 con 0x7f4274154980 2023-12-04T05:38:06.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.478+0000 7f426bfff640 1 -- 172.21.15.97:0/76793552 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700acb10 con 0x7f4274154980 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- 172.21.15.97:0/76793552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 msgr2=0x7f4274154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f4274154d60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f42700097c0 tx=0x7f427001c3c0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- 172.21.15.97:0/76793552 shutdown_connections 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- 172.21.15.97:0/76793552 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f4274154d60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- 172.21.15.97:0/76793552 >> 172.21.15.97:0/76793552 conn(0x7f42740c3980 msgr2=0x7f42740c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- 172.21.15.97:0/76793552 shutdown_connections 2023-12-04T05:38:06.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- 172.21.15.97:0/76793552 wait complete. 2023-12-04T05:38:06.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 Processor -- start 2023-12-04T05:38:06.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- start start 2023-12-04T05:38:06.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42740c1880 0x7f42741f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740aa850 con 0x7f4274154980 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274156130 con 0x7f42740c1880 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f427b3b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42741ed5f0 con 0x7f42740c1d00 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51368/0 (socket says 172.21.15.97:51368) 2023-12-04T05:38:06.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 -- 172.21.15.97:0/193811258 learned_addr learned my addr 172.21.15.97:0/193811258 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4278953640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279154640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42740c1880 0x7f42741f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 -- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 msgr2=0x7f4274146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 -- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42740c1880 msgr2=0x7f42741f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42740c1880 0x7f42741f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.482+0000 7f4279955640 1 -- 172.21.15.97:0/193811258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009420 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4279955640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f426c007f20 tx=0x7f426c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00dee0 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00f040 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c003de0 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42740aa040 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42741ed890 con 0x7f4274154980 2023-12-04T05:38:06.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4274155260 con 0x7f4274154980 2023-12-04T05:38:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f426c004030 con 0x7f4274154980 2023-12-04T05:38:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 0x7f4258068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f426c084760 con 0x7f4274154980 2023-12-04T05:38:06.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.486+0000 7f4279154640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 0x7f4258068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.490+0000 7f4279154640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 0x7f4258068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f42700ae000 tx=0x7f42700a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.490+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f426c0519d0 con 0x7f4274154980 2023-12-04T05:38:06.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42741eda20 con 0x7f4274154980 2023-12-04T05:38:06.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f4269ffb640 1 -- 172.21.15.97:0/193811258 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f426c01a020 con 0x7f4274154980 2023-12-04T05:38:06.645 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:06.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 msgr2=0x7f4258068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 0x7f4258068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f42700ae000 tx=0x7f42700a7000 comp rx=0 tx=0).stop 2023-12-04T05:38:06.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 msgr2=0x7f42741edd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f426c007f20 tx=0x7f426c00d560 comp rx=0 tx=0).stop 2023-12-04T05:38:06.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 shutdown_connections 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42580668d0 0x7f4258068d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4274154980 0x7f42741edd20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42740c1d00 0x7f4274146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 --2- 172.21.15.97:0/193811258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42740c1880 0x7f42741f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 >> 172.21.15.97:0/193811258 conn(0x7f42740c3980 msgr2=0x7f4274142a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 shutdown_connections 2023-12-04T05:38:06.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.642+0000 7f427b3b8640 1 -- 172.21.15.97:0/193811258 wait complete. 2023-12-04T05:38:06.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:38:06.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.810+0000 7f1d84e5a640 1 Processor -- start 2023-12-04T05:38:06.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.810+0000 7f1d84e5a640 1 -- start start 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d84e5a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d800af8b0 0x7f1d800c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d84e5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 0x7f1d80154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d84e5a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d80157c70 con 0x7f1d8006cb20 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d84e5a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d80152170 con 0x7f1d800af8b0 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d84e5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80157f50 con 0x7f1d80154680 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7dd9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1d8006cb20 0x7f1d800c48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32838/0 (socket says 172.21.15.97:32838) 2023-12-04T05:38:06.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7dd9b640 1 -- 172.21.15.97:0/1821841704 learned_addr learned my addr 172.21.15.97:0/1821841704 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:06.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7e59c640 1 --2- 172.21.15.97:0/1821841704 >> v2:172.21.15.143:3300/0 conn(0x7f1d800af8b0 0x7f1d800c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/1821841704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 0x7f1d80154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332159550 0 0) 0x7f1d80157c70 con 0x7f1d8006cb20 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d68003530 con 0x7f1d8006cb20 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2115779921 0 0) 0x7f1d68003530 con 0x7f1d8006cb20 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/1821841704 >> v2:172.21.15.143:3300/0 conn(0x7f1d800af8b0 msgr2=0x7f1d800c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/1821841704 >> v2:172.21.15.143:3300/0 conn(0x7f1d800af8b0 0x7f1d800c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/1821841704 >> v1:172.21.15.97:6789/0 conn(0x7f1d8006cb20 legacy=0x7f1d800c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.814+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/1821841704 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80158230 con 0x7f1d80154680 2023-12-04T05:38:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/1821841704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 0x7f1d80154ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7801c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01b9dcf09bf4cab server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74001680 con 0x7f1d80154680 2023-12-04T05:38:06.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780a55b0 con 0x7f1d80154680 2023-12-04T05:38:06.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d7d59a640 1 -- 172.21.15.97:0/1821841704 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780a5920 con 0x7f1d80154680 2023-12-04T05:38:06.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- 172.21.15.97:0/1821841704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 msgr2=0x7f1d80154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/1821841704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 0x7f1d80154ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009d90 tx=0x7f1d7801c7b0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- 172.21.15.97:0/1821841704 shutdown_connections 2023-12-04T05:38:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/1821841704 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d80154680 0x7f1d80154ad0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/1821841704 >> v2:172.21.15.143:3300/0 conn(0x7f1d800af8b0 0x7f1d800c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- 172.21.15.97:0/1821841704 >> 172.21.15.97:0/1821841704 conn(0x7f1d80073720 msgr2=0x7f1d80073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- 172.21.15.97:0/1821841704 shutdown_connections 2023-12-04T05:38:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- 172.21.15.97:0/1821841704 wait complete. 2023-12-04T05:38:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 Processor -- start 2023-12-04T05:38:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.818+0000 7f1d84e5a640 1 -- start start 2023-12-04T05:38:06.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d8006cb20 0x7f1d8014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d800af8b0 0x7f1d801ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d801ece60 con 0x7f1d80154680 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800c18c0 con 0x7f1d800af8b0 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800adc60 con 0x7f1d8006cb20 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51374/0 (socket says 172.21.15.97:51374) 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/489750214 learned_addr learned my addr 172.21.15.97:0/489750214 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7e59c640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d8006cb20 0x7f1d8014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7dd9b640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d800af8b0 0x7f1d801ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d8006cb20 msgr2=0x7f1d8014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d8006cb20 0x7f1d8014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d800af8b0 msgr2=0x7f1d801ed290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d800af8b0 0x7f1d801ed290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 -- 172.21.15.97:0/489750214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009a70 con 0x7f1d80154680 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d7ed9d640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1d7801ae60 tx=0x7f1d78019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78009450 con 0x7f1d80154680 2023-12-04T05:38:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780ad650 con 0x7f1d80154680 2023-12-04T05:38:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d800adf40 con 0x7f1d80154680 2023-12-04T05:38:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780ad9c0 con 0x7f1d80154680 2023-12-04T05:38:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d800ad950 con 0x7f1d80154680 2023-12-04T05:38:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d800ae460 con 0x7f1d80154680 2023-12-04T05:38:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.822+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d780b4070 con 0x7f1d80154680 2023-12-04T05:38:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.826+0000 7f1d6effd640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 0x7f1d60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.826+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1d7811f100 con 0x7f1d80154680 2023-12-04T05:38:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.826+0000 7f1d7e59c640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 0x7f1d60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.826+0000 7f1d7e59c640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 0x7f1d60068d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006c550 tx=0x7f1d70009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:06.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.830+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d800ae460 con 0x7f1d80154680 2023-12-04T05:38:06.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d800ae460 con 0x7f1d80154680 2023-12-04T05:38:06.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d6effd640 1 -- 172.21.15.97:0/489750214 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1d800ae460 con 0x7f1d80154680 2023-12-04T05:38:06.993 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:06.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 msgr2=0x7f1d60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 0x7f1d60068d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d8006c550 tx=0x7f1d70009190 comp rx=0 tx=0).stop 2023-12-04T05:38:06.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 msgr2=0x7f1d801ed7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:06.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1d7801ae60 tx=0x7f1d78019550 comp rx=0 tx=0).stop 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 shutdown_connections 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d600668d0 0x7f1d60068d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d80154680 0x7f1d801ed7d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d800af8b0 0x7f1d801ed290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 --2- 172.21.15.97:0/489750214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d8006cb20 0x7f1d8014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 >> 172.21.15.97:0/489750214 conn(0x7f1d80073720 msgr2=0x7f1d800c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 shutdown_connections 2023-12-04T05:38:06.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:06.990+0000 7f1d84e5a640 1 -- 172.21.15.97:0/489750214 wait complete. 2023-12-04T05:38:07.014 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:38:07.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 Processor -- start 2023-12-04T05:38:07.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 -- start start 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa320151da0 0x7fa3200abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3200c65b0 0x7fa320154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3201587f0 con 0x7fa3200ac120 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200c5020 con 0x7fa3200c65b0 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa325780640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320158600 con 0x7fa320151da0 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3200c65b0 0x7fa320154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3200c65b0 0x7fa320154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51378/0 (socket says 172.21.15.97:51378) 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 -- 172.21.15.97:0/835908787 learned_addr learned my addr 172.21.15.97:0/835908787 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:07.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31effd640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa320151da0 0x7fa3200abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 -- 172.21.15.97:0/835908787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa320151da0 msgr2=0x7fa3200abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:07.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa320151da0 0x7fa3200abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 -- 172.21.15.97:0/835908787 >> v1:172.21.15.143:6789/0 conn(0x7fa3200ac120 legacy=0x7fa3201548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:07.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.154+0000 7fa31f7fe640 1 -- 172.21.15.97:0/835908787 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200c4980 con 0x7fa3200c65b0 2023-12-04T05:38:07.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa31f7fe640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320154ff0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa318009870 tx=0x7fa31801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df6850e6f5a9abb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa31e7fc640 1 -- 172.21.15.97:0/835908787 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180ab600 con 0x7fa3200c65b0 2023-12-04T05:38:07.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa31e7fc640 1 -- 172.21.15.97:0/835908787 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3180a7050 con 0x7fa3200c65b0 2023-12-04T05:38:07.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa31e7fc640 1 -- 172.21.15.97:0/835908787 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180ab980 con 0x7fa3200c65b0 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 -- 172.21.15.97:0/835908787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 msgr2=0x7fa320154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320154ff0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa318009870 tx=0x7fa31801c470 comp rx=0 tx=0).stop 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 -- 172.21.15.97:0/835908787 shutdown_connections 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320154ff0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 --2- 172.21.15.97:0/835908787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa320151da0 0x7fa3200abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 -- 172.21.15.97:0/835908787 >> 172.21.15.97:0/835908787 conn(0x7fa3200ca000 msgr2=0x7fa3200ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 -- 172.21.15.97:0/835908787 shutdown_connections 2023-12-04T05:38:07.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.158+0000 7fa325780640 1 -- 172.21.15.97:0/835908787 wait complete. 2023-12-04T05:38:07.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 Processor -- start 2023-12-04T05:38:07.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- start start 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3200ac120 0x7fa32014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa320151da0 0x7fa320141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200ab5a0 con 0x7fa3200c65b0 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200aa9b0 con 0x7fa320151da0 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201510c0 con 0x7fa3200ac120 2023-12-04T05:38:07.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51388/0 (socket says 172.21.15.97:51388) 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 -- 172.21.15.97:0/80653365 learned_addr learned my addr 172.21.15.97:0/80653365 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa31effd640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3200ac120 0x7fa32014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa31f7fe640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa320151da0 0x7fa320141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 -- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3200ac120 msgr2=0x7fa32014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3200ac120 0x7fa32014bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 -- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa320151da0 msgr2=0x7fa320141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa320151da0 0x7fa320141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 -- 172.21.15.97:0/80653365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180094d0 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa3167fc640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa30800b410 tx=0x7fa30800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308004020 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308004180 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308011630 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200a9ac0 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.162+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3200aa080 con 0x7fa3200c65b0 2023-12-04T05:38:07.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa320068440 con 0x7fa3200c65b0 2023-12-04T05:38:07.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa308011790 con 0x7fa3200c65b0 2023-12-04T05:38:07.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa317fff640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 0x7fa300068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa308084040 con 0x7fa3200c65b0 2023-12-04T05:38:07.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa31effd640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 0x7fa300068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.166+0000 7fa31effd640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 0x7fa300068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa310003b90 tx=0x7fa3100098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.170+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa308051360 con 0x7fa3200c65b0 2023-12-04T05:38:07.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.318+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa32006d1b0 con 0x7fa3200c65b0 2023-12-04T05:38:07.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.318+0000 7fa317fff640 1 -- 172.21.15.97:0/80653365 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa308015020 con 0x7fa3200c65b0 2023-12-04T05:38:07.324 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 msgr2=0x7fa300068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 0x7fa300068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa310003b90 tx=0x7fa3100098d0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 msgr2=0x7fa320141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa30800b410 tx=0x7fa30800b8d0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 shutdown_connections 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3000668d0 0x7fa300068d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa320151da0 0x7fa320141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3200c65b0 0x7fa320141910 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 --2- 172.21.15.97:0/80653365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3200ac120 0x7fa32014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 >> 172.21.15.97:0/80653365 conn(0x7fa3200ca000 msgr2=0x7fa3200ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:07.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 shutdown_connections 2023-12-04T05:38:07.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.322+0000 7fa325780640 1 -- 172.21.15.97:0/80653365 wait complete. 2023-12-04T05:38:07.345 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:07.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 Processor -- start 2023-12-04T05:38:07.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 -- start start 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc7ec151bf0 0x7fc7ec0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 0x7fc7ec15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec1547d0 con 0x7fc7ec0c7ef0 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec158b80 con 0x7fc7ec151bf0 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7f130f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0c4aa0 con 0x7fc7ec155370 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7e27fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc7ec0c7ef0 0x7fc7ec154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32850/0 (socket says 172.21.15.97:32850) 2023-12-04T05:38:07.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7e27fc640 1 -- 172.21.15.97:0/2533006027 learned_addr learned my addr 172.21.15.97:0/2533006027 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:07.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/2533006027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 0x7fc7ec15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eaffd640 1 --2- 172.21.15.97:0/2533006027 >> v2:172.21.15.143:3300/0 conn(0x7fc7ec151bf0 0x7fc7ec0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169413036 0 0) 0x7fc7ec1547d0 con 0x7fc7ec0c7ef0 2023-12-04T05:38:07.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d8003530 con 0x7fc7ec0c7ef0 2023-12-04T05:38:07.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/2533006027 >> v2:172.21.15.143:3300/0 conn(0x7fc7ec151bf0 msgr2=0x7fc7ec0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:07.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/2533006027 >> v2:172.21.15.143:3300/0 conn(0x7fc7ec151bf0 0x7fc7ec0abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/2533006027 >> v1:172.21.15.97:6789/0 conn(0x7fc7ec0c7ef0 legacy=0x7fc7ec154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185730999 0 0) 0x7fc7d8003530 con 0x7fc7ec0c7ef0 2023-12-04T05:38:07.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.478+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/2533006027 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0c4d40 con 0x7fc7ec155370 2023-12-04T05:38:07.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/2533006027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 0x7fc7ec15efb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009d90 tx=0x7fc7e401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36fbdfa8c86df28 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc001680 con 0x7fc7ec155370 2023-12-04T05:38:07.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e40a4ac0 con 0x7fc7ec155370 2023-12-04T05:38:07.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7ea7fc640 1 -- 172.21.15.97:0/2533006027 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40a4e30 con 0x7fc7ec155370 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 -- 172.21.15.97:0/2533006027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 msgr2=0x7fc7ec15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 --2- 172.21.15.97:0/2533006027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 0x7fc7ec15efb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009d90 tx=0x7fc7e401c430 comp rx=0 tx=0).stop 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 -- 172.21.15.97:0/2533006027 shutdown_connections 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 --2- 172.21.15.97:0/2533006027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec155370 0x7fc7ec15efb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 --2- 172.21.15.97:0/2533006027 >> v2:172.21.15.143:3300/0 conn(0x7fc7ec151bf0 0x7fc7ec0abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 -- 172.21.15.97:0/2533006027 >> 172.21.15.97:0/2533006027 conn(0x7fc7ec073550 msgr2=0x7fc7ec073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 -- 172.21.15.97:0/2533006027 shutdown_connections 2023-12-04T05:38:07.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.482+0000 7fc7f130f640 1 -- 172.21.15.97:0/2533006027 wait complete. 2023-12-04T05:38:07.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 Processor -- start 2023-12-04T05:38:07.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 -- start start 2023-12-04T05:38:07.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7ec0c7ef0 0x7fc7ec0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec151bf0 0x7fc7ec0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0abb60 con 0x7fc7ec155370 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0acdd0 con 0x7fc7ec0c7ef0 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ad0b0 con 0x7fc7ec151bf0 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51402/0 (socket says 172.21.15.97:51402) 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/54743974 learned_addr learned my addr 172.21.15.97:0/54743974 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7e27fc640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec151bf0 0x7fc7ec0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eaffd640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7ec0c7ef0 0x7fc7ec0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec151bf0 msgr2=0x7fc7ec0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec151bf0 0x7fc7ec0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7ec0c7ef0 msgr2=0x7fc7ec0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7ec0c7ef0 0x7fc7ec0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 -- 172.21.15.97:0/54743974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009a70 con 0x7fc7ec155370 2023-12-04T05:38:07.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7eb7fe640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc7e401aae0 tx=0x7fc7e40194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4003da0 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4004040 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.486+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec0ab7f0 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40043f0 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec0ca5a0 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec068440 con 0x7fc7ec155370 2023-12-04T05:38:07.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7e40b3070 con 0x7fc7ec155370 2023-12-04T05:38:07.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7e3fff640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 0x7fc7cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc7e411e3c0 con 0x7fc7ec155370 2023-12-04T05:38:07.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7eaffd640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 0x7fc7cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.490+0000 7fc7eaffd640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 0x7fc7cc068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009a50 tx=0x7fc7d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.494+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7e40eb640 con 0x7fc7ec155370 2023-12-04T05:38:07.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7ec0abca0 con 0x7fc7ec155370 2023-12-04T05:38:07.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7e3fff640 1 -- 172.21.15.97:0/54743974 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fc7ec0abca0 con 0x7fc7ec155370 2023-12-04T05:38:07.678 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:07.678 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/1418854271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1418854271},{"type":"v1","addr":"172.21.15.97:6836","nonce":1418854271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:07.678 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 24 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 msgr2=0x7fc7cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 0x7fc7cc068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009a50 tx=0x7fc7d4008040 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 msgr2=0x7fc7ec1edaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc7e401aae0 tx=0x7fc7e40194f0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 shutdown_connections 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7cc0668d0 0x7fc7cc068d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7ec155370 0x7fc7ec1edaf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7ec151bf0 0x7fc7ec0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 --2- 172.21.15.97:0/54743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7ec0c7ef0 0x7fc7ec0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 >> 172.21.15.97:0/54743974 conn(0x7fc7ec073550 msgr2=0x7fc7ec153b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:07.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 shutdown_connections 2023-12-04T05:38:07.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.674+0000 7fc7f130f640 1 -- 172.21.15.97:0/54743974 wait complete. 2023-12-04T05:38:07.699 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:07.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 Processor -- start 2023-12-04T05:38:07.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 -- start start 2023-12-04T05:38:07.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8dd8155370 0x7f8dd815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd81547d0 con 0x7f8dd80c7ef0 2023-12-04T05:38:07.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd8158b80 con 0x7f8dd8155370 2023-12-04T05:38:07.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8ddc9f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80c4aa0 con 0x7f8dd8151bf0 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:60892/0 (socket says 172.21.15.97:60892) 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd6d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8dd8155370 0x7f8dd815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 -- 172.21.15.97:0/1987211243 learned_addr learned my addr 172.21.15.97:0/1987211243 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 -- 172.21.15.97:0/1987211243 >> v2:172.21.15.143:3300/0 conn(0x7f8dd8155370 msgr2=0x7f8dd815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 --2- 172.21.15.97:0/1987211243 >> v2:172.21.15.143:3300/0 conn(0x7f8dd8155370 0x7f8dd815efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 -- 172.21.15.97:0/1987211243 >> v1:172.21.15.143:6789/0 conn(0x7f8dd80c7ef0 legacy=0x7f8dd8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.834+0000 7f8dd659c640 1 -- 172.21.15.97:0/1987211243 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80c4d40 con 0x7f8dd8151bf0 2023-12-04T05:38:07.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8dd659c640 1 --2- 172.21.15.97:0/1987211243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80098a0 tx=0x7f8dc801c0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff26653e671520 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8dd5d9b640 1 -- 172.21.15.97:0/1987211243 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80a4920 con 0x7f8dd8151bf0 2023-12-04T05:38:07.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8dd5d9b640 1 -- 172.21.15.97:0/1987211243 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc80a4a80 con 0x7f8dd8151bf0 2023-12-04T05:38:07.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8dd5d9b640 1 -- 172.21.15.97:0/1987211243 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80a4e10 con 0x7f8dd8151bf0 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/1987211243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 msgr2=0x7f8dd80abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/1987211243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80098a0 tx=0x7f8dc801c0e0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/1987211243 shutdown_connections 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/1987211243 >> v2:172.21.15.143:3300/0 conn(0x7f8dd8155370 0x7f8dd815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/1987211243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8151bf0 0x7f8dd80abbb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/1987211243 >> 172.21.15.97:0/1987211243 conn(0x7f8dd8073550 msgr2=0x7f8dd8073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/1987211243 shutdown_connections 2023-12-04T05:38:07.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.838+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/1987211243 wait complete. 2023-12-04T05:38:07.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 Processor -- start 2023-12-04T05:38:07.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 -- start start 2023-12-04T05:38:07.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd80c7ef0 0x7f8dd8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8dd8155370 0x7f8dd8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80ab6c0 con 0x7f8dd8151bf0 2023-12-04T05:38:07.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd81527b0 con 0x7f8dd8155370 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80c36f0 con 0x7f8dd80c7ef0 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51418/0 (socket says 172.21.15.97:51418) 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 -- 172.21.15.97:0/2726856487 learned_addr learned my addr 172.21.15.97:0/2726856487 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dd6d9d640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8dd8155370 0x7f8dd8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dd659c640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd80c7ef0 0x7f8dd8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 -- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd80c7ef0 msgr2=0x7f8dd8152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd80c7ef0 0x7f8dd8152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 -- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8dd8155370 msgr2=0x7f8dd8156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8dd8155370 0x7f8dd8156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:07.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 -- 172.21.15.97:0/2726856487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80094d0 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcdd9b640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c730 tx=0x7f8dc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0006d60 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc000ce40 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd80c3d30 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.842+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0003bc0 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80abb80 con 0x7f8dd8151bf0 2023-12-04T05:38:07.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd8068440 con 0x7f8dd8151bf0 2023-12-04T05:38:07.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8dc0003d20 con 0x7f8dd8151bf0 2023-12-04T05:38:07.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8dcf7fe640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 0x7f8db8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:07.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f8dc0083ec0 con 0x7f8dd8151bf0 2023-12-04T05:38:07.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8dd659c640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 0x7f8db8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:07.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.846+0000 7f8dd659c640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 0x7f8db8068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80ae000 tx=0x7f8dc80a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:07.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:07.850+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8dc00511e0 con 0x7f8dd8151bf0 2023-12-04T05:38:08.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.002+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dd806c970 con 0x7f8dd8151bf0 2023-12-04T05:38:08.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.002+0000 7f8dcf7fe640 1 -- 172.21.15.97:0/2726856487 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16632 (secure 0 0 0) 0x7f8dc0016090 con 0x7f8dd8151bf0 2023-12-04T05:38:08.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:08.008 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":38,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:05.980236+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6836/525136181":"2023-12-05T05:38:02.783767+0000","172.21.15.97:6834/525136181":"2023-12-05T05:38:02.783767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:08.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 msgr2=0x7f8db8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 0x7f8db8068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80ae000 tx=0x7f8dc80a6070 comp rx=0 tx=0).stop 2023-12-04T05:38:08.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 msgr2=0x7f8dd80c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c730 tx=0x7f8dc000cbf0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 shutdown_connections 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8db8066900 0x7f8db8068dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8dd8155370 0x7f8dd8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8dd8151bf0 0x7f8dd80c31b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 --2- 172.21.15.97:0/2726856487 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd80c7ef0 0x7f8dd8152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 >> 172.21.15.97:0/2726856487 conn(0x7f8dd8073550 msgr2=0x7f8dd81506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 shutdown_connections 2023-12-04T05:38:08.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.006+0000 7f8ddc9f5640 1 -- 172.21.15.97:0/2726856487 wait complete. 2023-12-04T05:38:08.030 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-04T05:38:08.030 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:08.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 Processor -- start 2023-12-04T05:38:08.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 -- start start 2023-12-04T05:38:08.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f691406b860 0x7f69140c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f69140c1030 0x7f6914151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69140739b0 con 0x7f6914152090 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69140c15a0 con 0x7f69140c1030 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6918ff8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6914155220 con 0x7f691406b860 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6909d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f69140c1030 0x7f6914151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6909d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f69140c1030 0x7f6914151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51422/0 (socket says 172.21.15.97:51422) 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.162+0000 7f6909d9b640 1 -- 172.21.15.97:0/1903902607 learned_addr learned my addr 172.21.15.97:0/1903902607 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f691259c640 1 --2- 172.21.15.97:0/1903902607 >> v2:172.21.15.143:3300/0 conn(0x7f691406b860 0x7f69140c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6909d9b640 1 -- 172.21.15.97:0/1903902607 >> v2:172.21.15.143:3300/0 conn(0x7f691406b860 msgr2=0x7f69140c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6909d9b640 1 --2- 172.21.15.97:0/1903902607 >> v2:172.21.15.143:3300/0 conn(0x7f691406b860 0x7f69140c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6909d9b640 1 -- 172.21.15.97:0/1903902607 >> v1:172.21.15.143:6789/0 conn(0x7f6914152090 legacy=0x7f6914157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6909d9b640 1 -- 172.21.15.97:0/1903902607 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914155710 con 0x7f69140c1030 2023-12-04T05:38:08.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6909d9b640 1 --2- 172.21.15.97:0/1903902607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140c1030 0x7f6914151b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f691406c040 tx=0x7f68fc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a83b97411fc6191 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6911d9b640 1 -- 172.21.15.97:0/1903902607 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0ab600 con 0x7f69140c1030 2023-12-04T05:38:08.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6911d9b640 1 -- 172.21.15.97:0/1903902607 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0a7050 con 0x7f69140c1030 2023-12-04T05:38:08.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6911d9b640 1 -- 172.21.15.97:0/1903902607 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0ab980 con 0x7f69140c1030 2023-12-04T05:38:08.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6918ff8640 1 -- 172.21.15.97:0/1903902607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140c1030 msgr2=0x7f6914151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.166+0000 7f6918ff8640 1 --2- 172.21.15.97:0/1903902607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140c1030 0x7f6914151b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f691406c040 tx=0x7f68fc01c470 comp rx=0 tx=0).stop 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- 172.21.15.97:0/1903902607 shutdown_connections 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 --2- 172.21.15.97:0/1903902607 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69140c1030 0x7f6914151b50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 --2- 172.21.15.97:0/1903902607 >> v2:172.21.15.143:3300/0 conn(0x7f691406b860 0x7f69140c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- 172.21.15.97:0/1903902607 >> 172.21.15.97:0/1903902607 conn(0x7f69140c3130 msgr2=0x7f69140c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- 172.21.15.97:0/1903902607 shutdown_connections 2023-12-04T05:38:08.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- 172.21.15.97:0/1903902607 wait complete. 2023-12-04T05:38:08.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 Processor -- start 2023-12-04T05:38:08.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- start start 2023-12-04T05:38:08.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69140c1030 0x7f69141ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 0x7f6914152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69140aa0f0 con 0x7f691406b860 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69141ecd80 con 0x7f6914152090 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6918ff8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6914154630 con 0x7f69140c1030 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51436/0 (socket says 172.21.15.97:51436) 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 -- 172.21.15.97:0/2948016812 learned_addr learned my addr 172.21.15.97:0/2948016812 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6909d9b640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69140c1030 0x7f69141ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6912d9d640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 0x7f6914152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 -- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69140c1030 msgr2=0x7f69141ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69140c1030 0x7f69141ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 -- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 msgr2=0x7f6914152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 0x7f6914152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f691259c640 1 -- 172.21.15.97:0/2948016812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0094d0 con 0x7f691406b860 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.170+0000 7f6912d9d640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 0x7f6914152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f691259c640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f690400d800 tx=0x7f690400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400b6c0 con 0x7f691406b860 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400b820 con 0x7f691406b860 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69140a9d40 con 0x7f691406b860 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400bb90 con 0x7f691406b860 2023-12-04T05:38:08.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69141ed300 con 0x7f691406b860 2023-12-04T05:38:08.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914068440 con 0x7f691406b860 2023-12-04T05:38:08.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f690400bcf0 con 0x7f691406b860 2023-12-04T05:38:08.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 0x7f68f4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f69040847a0 con 0x7f691406b860 2023-12-04T05:38:08.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.174+0000 7f6909d9b640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 0x7f68f4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.178+0000 7f6909d9b640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 0x7f68f4068dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0ad000 tx=0x7f68fc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.178+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6904051970 con 0x7f691406b860 2023-12-04T05:38:08.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6914152b50 con 0x7f691406b860 2023-12-04T05:38:08.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f690b7fe640 1 -- 172.21.15.97:0/2948016812 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f6904054f90 con 0x7f691406b860 2023-12-04T05:38:08.366 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:08.366 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/1418854271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1418854271},{"type":"v1","addr":"172.21.15.97:6836","nonce":1418854271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:08.367 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 24 2023-12-04T05:38:08.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 msgr2=0x7f68f4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 0x7f68f4068dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0ad000 tx=0x7f68fc0a6000 comp rx=0 tx=0).stop 2023-12-04T05:38:08.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 msgr2=0x7f69141540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f690400d800 tx=0x7f690400dcc0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 shutdown_connections 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f68f4066900 0x7f68f4068dc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6914152090 0x7f6914152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69140c1030 0x7f69141ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 --2- 172.21.15.97:0/2948016812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f691406b860 0x7f69141540f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 >> 172.21.15.97:0/2948016812 conn(0x7f69140c3130 msgr2=0x7f69140c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 shutdown_connections 2023-12-04T05:38:08.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.362+0000 7f6918ff8640 1 -- 172.21.15.97:0/2948016812 wait complete. 2023-12-04T05:38:08.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:08.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 Processor -- start 2023-12-04T05:38:08.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 -- start start 2023-12-04T05:38:08.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c14fbb0 0x7f735c0a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f735c0a88e0 0x7f735c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c1530e0 con 0x7f735c0a8460 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735c14ff90 con 0x7f735c0a88e0 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7360d0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0a9770 con 0x7f735c14fbb0 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f735ad9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f735c0a88e0 0x7f735c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7351d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f735c0a8460 0x7f735c152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32858/0 (socket says 172.21.15.97:32858) 2023-12-04T05:38:08.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7351d9b640 1 -- 172.21.15.97:0/3011482565 learned_addr learned my addr 172.21.15.97:0/3011482565 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f735a59c640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c14fbb0 0x7f735c0a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.522+0000 7f7359d9b640 1 -- 172.21.15.97:0/3011482565 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386572048 0 0) 0x7f735c1530e0 con 0x7f735c0a8460 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7359d9b640 1 -- 172.21.15.97:0/3011482565 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7348003530 con 0x7f735c0a8460 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f735ad9d640 1 -- 172.21.15.97:0/3011482565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c14fbb0 msgr2=0x7f735c0a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f735ad9d640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c14fbb0 0x7f735c0a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f735ad9d640 1 -- 172.21.15.97:0/3011482565 >> v1:172.21.15.97:6789/0 conn(0x7f735c0a8460 legacy=0x7f735c152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f735ad9d640 1 -- 172.21.15.97:0/3011482565 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c071730 con 0x7f735c0a88e0 2023-12-04T05:38:08.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f735ad9d640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c0a88e0 0x7f735c152ba0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f73540097c0 tx=0x7f735401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62500d7d6243296 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7359d9b640 1 -- 172.21.15.97:0/3011482565 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540ad660 con 0x7f735c0a88e0 2023-12-04T05:38:08.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7359d9b640 1 -- 172.21.15.97:0/3011482565 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540ad7c0 con 0x7f735c0a88e0 2023-12-04T05:38:08.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7359d9b640 1 -- 172.21.15.97:0/3011482565 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540adb50 con 0x7f735c0a88e0 2023-12-04T05:38:08.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 -- 172.21.15.97:0/3011482565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c0a88e0 msgr2=0x7f735c152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c0a88e0 0x7f735c152ba0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f73540097c0 tx=0x7f735401c360 comp rx=0 tx=0).stop 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 -- 172.21.15.97:0/3011482565 shutdown_connections 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c0a88e0 0x7f735c152ba0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 --2- 172.21.15.97:0/3011482565 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c14fbb0 0x7f735c0a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 -- 172.21.15.97:0/3011482565 >> 172.21.15.97:0/3011482565 conn(0x7f735c0c2970 msgr2=0x7f735c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 -- 172.21.15.97:0/3011482565 shutdown_connections 2023-12-04T05:38:08.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.526+0000 7f7360d0f640 1 -- 172.21.15.97:0/3011482565 wait complete. 2023-12-04T05:38:08.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 Processor -- start 2023-12-04T05:38:08.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 -- start start 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 0x7f735c1ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0a88e0 0x7f735c140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c14a870 con 0x7f735c14fbb0 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1411d0 con 0x7f735c0a88e0 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7360d0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c0c5be0 con 0x7f735c0a8460 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51460/0 (socket says 172.21.15.97:51460) 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 -- 172.21.15.97:0/1025359579 learned_addr learned my addr 172.21.15.97:0/1025359579 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735a59c640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 0x7f735c1ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f7351d9b640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0a88e0 0x7f735c140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 -- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 msgr2=0x7f735c1ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 0x7f735c1ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 -- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0a88e0 msgr2=0x7f735c140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0a88e0 0x7f735c140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 -- 172.21.15.97:0/1025359579 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009420 con 0x7f735c14fbb0 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735a59c640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 0x7f735c1ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:08.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.530+0000 7f735ad9d640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7354019f90 tx=0x7f7354019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540b6610 con 0x7f735c14fbb0 2023-12-04T05:38:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73540b6770 con 0x7f735c14fbb0 2023-12-04T05:38:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73540b6b20 con 0x7f735c14fbb0 2023-12-04T05:38:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c1ee990 con 0x7f735c14fbb0 2023-12-04T05:38:08.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c14aac0 con 0x7f735c14fbb0 2023-12-04T05:38:08.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c068440 con 0x7f735c14fbb0 2023-12-04T05:38:08.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f73540b4040 con 0x7f735c14fbb0 2023-12-04T05:38:08.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 0x7f733c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f735411e670 con 0x7f735c14fbb0 2023-12-04T05:38:08.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f735a59c640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 0x7f733c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.534+0000 7f735a59c640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 0x7f733c068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f734c003fd0 tx=0x7f734c003a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.538+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73540eb840 con 0x7f735c14fbb0 2023-12-04T05:38:08.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f735c156930 con 0x7f735c14fbb0 2023-12-04T05:38:08.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f73537fe640 1 -- 172.21.15.97:0/1025359579 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f73540eee60 con 0x7f735c14fbb0 2023-12-04T05:38:08.722 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:08.723 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/1418854271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1418854271},{"type":"v1","addr":"172.21.15.97:6836","nonce":1418854271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:37:42.375840+0000","modified":"2023-12-04T05:37:45.410686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.97:6837/259028206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":259028206},{"type":"v1","addr":"172.21.15.97:6837","nonce":259028206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-04T05:38:08.723 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 24 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 msgr2=0x7f733c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 0x7f733c068d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f734c003fd0 tx=0x7f734c003a00 comp rx=0 tx=0).stop 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 msgr2=0x7f735c140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7354019f90 tx=0x7f7354019100 comp rx=0 tx=0).stop 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 shutdown_connections 2023-12-04T05:38:08.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f733c0668d0 0x7f733c068d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c14fbb0 0x7f735c140c90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0a88e0 0x7f735c140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 --2- 172.21.15.97:0/1025359579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c0a8460 0x7f735c1ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 >> 172.21.15.97:0/1025359579 conn(0x7f735c0c2970 msgr2=0x7f735c15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.718+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 shutdown_connections 2023-12-04T05:38:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.722+0000 7f7360d0f640 1 -- 172.21.15.97:0/1025359579 wait complete. 2023-12-04T05:38:08.744 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:08.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 Processor -- start 2023-12-04T05:38:08.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 -- start start 2023-12-04T05:38:08.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 0x7f9fc80c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc80739b0 con 0x7f9fc806b860 2023-12-04T05:38:08.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc8155710 con 0x7f9fc8157da0 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fce0dd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80c15a0 con 0x7f9fc80c1030 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc77fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9fc806b860 0x7f9fc8151b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32860/0 (socket says 172.21.15.97:32860) 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc77fe640 1 -- 172.21.15.97:0/304755047 learned_addr learned my addr 172.21.15.97:0/304755047 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc6ffd640 1 --2- 172.21.15.97:0/304755047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 0x7f9fc80c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc67fc640 1 -- 172.21.15.97:0/304755047 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642910019 0 0) 0x7f9fc80739b0 con 0x7f9fc806b860 2023-12-04T05:38:08.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc67fc640 1 -- 172.21.15.97:0/304755047 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb0003530 con 0x7f9fc806b860 2023-12-04T05:38:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc6ffd640 1 -- 172.21.15.97:0/304755047 >> v1:172.21.15.143:6789/0 conn(0x7f9fc8157da0 legacy=0x7f9fc8158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc6ffd640 1 -- 172.21.15.97:0/304755047 >> v1:172.21.15.97:6789/0 conn(0x7f9fc806b860 legacy=0x7f9fc8151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.878+0000 7f9fc6ffd640 1 -- 172.21.15.97:0/304755047 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8073680 con 0x7f9fc80c1030 2023-12-04T05:38:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fc6ffd640 1 --2- 172.21.15.97:0/304755047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 0x7f9fc80c2a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0097f0 tx=0x7f9fbc01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ac62bec8601138 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fc67fc640 1 -- 172.21.15.97:0/304755047 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0ab600 con 0x7f9fc80c1030 2023-12-04T05:38:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fc67fc640 1 -- 172.21.15.97:0/304755047 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0a7050 con 0x7f9fc80c1030 2023-12-04T05:38:08.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fc67fc640 1 -- 172.21.15.97:0/304755047 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0ab980 con 0x7f9fc80c1030 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 -- 172.21.15.97:0/304755047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 msgr2=0x7f9fc80c2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/304755047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 0x7f9fc80c2a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0097f0 tx=0x7f9fbc01c430 comp rx=0 tx=0).stop 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 -- 172.21.15.97:0/304755047 shutdown_connections 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/304755047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc80c1030 0x7f9fc80c2a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 -- 172.21.15.97:0/304755047 >> 172.21.15.97:0/304755047 conn(0x7f9fc80c3130 msgr2=0x7f9fc80c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 -- 172.21.15.97:0/304755047 shutdown_connections 2023-12-04T05:38:08.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.882+0000 7f9fce0dd640 1 -- 172.21.15.97:0/304755047 wait complete. 2023-12-04T05:38:08.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 Processor -- start 2023-12-04T05:38:08.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- start start 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc806b860 0x7f9fc80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc80c1030 0x7f9fc8070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81f0580 con 0x7f9fc8157da0 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81f0250 con 0x7f9fc80c1030 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc80c5df0 con 0x7f9fc806b860 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51464/0 (socket says 172.21.15.97:51464) 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 -- 172.21.15.97:0/3700956518 learned_addr learned my addr 172.21.15.97:0/3700956518 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc77fe640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc806b860 0x7f9fc80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc6ffd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc80c1030 0x7f9fc8070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 -- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc806b860 msgr2=0x7f9fc80c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc806b860 0x7f9fc80c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 -- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc80c1030 msgr2=0x7f9fc8070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc80c1030 0x7f9fc8070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 -- 172.21.15.97:0/3700956518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc009420 con 0x7f9fc8157da0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fc7fff640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c770 tx=0x7f9fc000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003b80 con 0x7f9fc8157da0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0003ce0 con 0x7f9fc8157da0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000aa90 con 0x7f9fc8157da0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc80c60d0 con 0x7f9fc8157da0 2023-12-04T05:38:08.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.886+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc80c63b0 con 0x7f9fc8157da0 2023-12-04T05:38:08.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc81f06f0 con 0x7f9fc8157da0 2023-12-04T05:38:08.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9fc000abf0 con 0x7f9fc8157da0 2023-12-04T05:38:08.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9faffff640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 0x7f9fb4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:08.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9fc0084210 con 0x7f9fc8157da0 2023-12-04T05:38:08.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9fc77fe640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 0x7f9fb4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:08.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.890+0000 7f9fc77fe640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 0x7f9fb4068dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80011f0 tx=0x7f9fb8007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:08.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:08.894+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fc0051410 con 0x7f9fc8157da0 2023-12-04T05:38:09.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fc8068440 con 0x7f9fc8157da0 2023-12-04T05:38:09.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9faffff640 1 -- 172.21.15.97:0/3700956518 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16632 (secure 0 0 0) 0x7f9fc0054a30 con 0x7f9fc8157da0 2023-12-04T05:38:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:09.054 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":38,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:05.980236+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:37:40.181523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:37:41.370503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6836/525136181":"2023-12-05T05:38:02.783767+0000","172.21.15.97:6834/525136181":"2023-12-05T05:38:02.783767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 msgr2=0x7f9fb4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 0x7f9fb4068dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80011f0 tx=0x7f9fb8007d40 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 msgr2=0x7f9fc81f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c770 tx=0x7f9fc000cc30 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 shutdown_connections 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9fb4066900 0x7f9fb4068dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fc8157da0 0x7f9fc81f0a10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc80c1030 0x7f9fc8070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 --2- 172.21.15.97:0/3700956518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9fc806b860 0x7f9fc80c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 >> 172.21.15.97:0/3700956518 conn(0x7f9fc80c3130 msgr2=0x7f9fc80c02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:09.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 shutdown_connections 2023-12-04T05:38:09.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.050+0000 7f9fce0dd640 1 -- 172.21.15.97:0/3700956518 wait complete. 2023-12-04T05:38:09.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-04T05:38:09.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 Processor -- start 2023-12-04T05:38:09.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 -- start start 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9624071380 con 0x7f9624156070 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962406cc20 con 0x7f962406e410 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f962bc9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962406cf00 con 0x7f962406c280 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f9629a36640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9624156070 0x7f96240c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32874/0 (socket says 172.21.15.97:32874) 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.210+0000 7f9629a36640 1 -- 172.21.15.97:0/1113668597 learned_addr learned my addr 172.21.15.97:0/1113668597 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:09.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f962a237640 1 --2- 172.21.15.97:0/1113668597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765846973 0 0) 0x7f9624071380 con 0x7f9624156070 2023-12-04T05:38:09.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9610003530 con 0x7f9624156070 2023-12-04T05:38:09.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f962a237640 1 -- 172.21.15.97:0/1113668597 >> v1:172.21.15.143:6789/0 conn(0x7f962406e410 legacy=0x7f9624071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567687763 0 0) 0x7f962406cc20 con 0x7f962406e410 2023-12-04T05:38:09.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f962a237640 1 -- 172.21.15.97:0/1113668597 >> v1:172.21.15.97:6789/0 conn(0x7f9624156070 legacy=0x7f96240c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f962a237640 1 -- 172.21.15.97:0/1113668597 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962415cbb0 con 0x7f962406c280 2023-12-04T05:38:09.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.214+0000 7f962a237640 1 --2- 172.21.15.97:0/1113668597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241643a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f961c009dc0 tx=0x7f961c01d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2cae5622242b40 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0a5a50 con 0x7f962406c280 2023-12-04T05:38:09.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c0a5bb0 con 0x7f962406c280 2023-12-04T05:38:09.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9628a34640 1 -- 172.21.15.97:0/1113668597 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c0ad440 con 0x7f962406c280 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- 172.21.15.97:0/1113668597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 msgr2=0x7f96241643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1113668597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241643a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f961c009dc0 tx=0x7f961c01d3d0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- 172.21.15.97:0/1113668597 shutdown_connections 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1113668597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241643a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- 172.21.15.97:0/1113668597 >> 172.21.15.97:0/1113668597 conn(0x7f96240c5e70 msgr2=0x7f96240c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- 172.21.15.97:0/1113668597 shutdown_connections 2023-12-04T05:38:09.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- 172.21.15.97:0/1113668597 wait complete. 2023-12-04T05:38:09.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 Processor -- start 2023-12-04T05:38:09.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- start start 2023-12-04T05:38:09.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9624156070 0x7f96241494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96241f5810 con 0x7f962406e410 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9624156990 con 0x7f9624156070 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f962bc9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962414c8d0 con 0x7f962406c280 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9629235640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9629235640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51476/0 (socket says 172.21.15.97:51476) 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.218+0000 7f9629235640 1 -- 172.21.15.97:0/1167082151 learned_addr learned my addr 172.21.15.97:0/1167082151 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f962a237640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9624156070 0x7f96241494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629a36640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 -- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 msgr2=0x7f96241f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 -- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9624156070 msgr2=0x7f96241494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9624156070 0x7f96241494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 -- 172.21.15.97:0/1167082151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009a70 con 0x7f962406e410 2023-12-04T05:38:09.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f9629235640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f961400c480 tx=0x7f961400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614005480 con 0x7f962406e410 2023-12-04T05:38:09.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614003600 con 0x7f962406e410 2023-12-04T05:38:09.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962414c300 con 0x7f962406e410 2023-12-04T05:38:09.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140039b0 con 0x7f962406e410 2023-12-04T05:38:09.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96241f2a90 con 0x7f962406e410 2023-12-04T05:38:09.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96240ab470 con 0x7f962406e410 2023-12-04T05:38:09.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9614003b10 con 0x7f962406e410 2023-12-04T05:38:09.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 0x7f9608068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.222+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9614083f00 con 0x7f962406e410 2023-12-04T05:38:09.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.226+0000 7f9629a36640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 0x7f9608068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.226+0000 7f9629a36640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 0x7f9608068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9620007fd0 tx=0x7f9620009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.226+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9614051180 con 0x7f962406e410 2023-12-04T05:38:09.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.410+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f9624068440 con 0x7f962406e410 2023-12-04T05:38:09.414 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:38:09.410+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:38:09.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f961a7fc640 1 -- 172.21.15.97:0/1167082151 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f96140547a0 con 0x7f962406e410 2023-12-04T05:38:09.417 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:38:09.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 msgr2=0x7f9608068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 0x7f9608068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9620007fd0 tx=0x7f9620009040 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 msgr2=0x7f9624148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f961400c480 tx=0x7f961400c940 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 shutdown_connections 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f96080668d0 0x7f9608068d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9624156070 0x7f96241494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f962406e410 0x7f9624148f90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 --2- 172.21.15.97:0/1167082151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f962406c280 0x7f96241f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 >> 172.21.15.97:0/1167082151 conn(0x7f96240c5e70 msgr2=0x7f9624151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 shutdown_connections 2023-12-04T05:38:09.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.414+0000 7f962bc9a640 1 -- 172.21.15.97:0/1167082151 wait complete. 2023-12-04T05:38:09.426 INFO:tasks.ceph.mds.c.smithi097.stderr: -2030> 2023-12-04T05:37:44.310+0000 7f2d2fd59640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:38:09.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-04T05:38:09.472 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:38:09.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 Processor -- start 2023-12-04T05:38:09.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 -- start start 2023-12-04T05:38:09.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f41700c1e70 0x7f41701524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 0x7f417006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41700aa240 con 0x7f417006c440 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417006c0c0 con 0x7f41700c1e70 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4174b96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41700aa500 con 0x7f417006d210 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4165d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f417006c440 0x7f41700a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32896/0 (socket says 172.21.15.97:32896) 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f4165d9b640 1 -- 172.21.15.97:0/321206371 learned_addr learned my addr 172.21.15.97:0/321206371 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f416ed9d640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 0x7f417006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f416e59c640 1 --2- 172.21.15.97:0/321206371 >> v2:172.21.15.143:3300/0 conn(0x7f41700c1e70 0x7f41701524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f416dd9b640 1 -- 172.21.15.97:0/321206371 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225329592 0 0) 0x7f41700aa240 con 0x7f417006c440 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.578+0000 7f416dd9b640 1 -- 172.21.15.97:0/321206371 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f415c003530 con 0x7f417006c440 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416e59c640 1 -- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 msgr2=0x7f417006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416e59c640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 0x7f417006d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416e59c640 1 -- 172.21.15.97:0/321206371 >> v1:172.21.15.97:6789/0 conn(0x7f417006c440 legacy=0x7f41700a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416e59c640 1 -- 172.21.15.97:0/321206371 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700aa7e0 con 0x7f41700c1e70 2023-12-04T05:38:09.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416ed9d640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 0x7f417006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:09.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416e59c640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41700c1e70 0x7f41701524e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0412a18eb86259 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416dd9b640 1 -- 172.21.15.97:0/321206371 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600a58f0 con 0x7f41700c1e70 2023-12-04T05:38:09.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416dd9b640 1 -- 172.21.15.97:0/321206371 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41600a5a50 con 0x7f41700c1e70 2023-12-04T05:38:09.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f416dd9b640 1 -- 172.21.15.97:0/321206371 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600a5dc0 con 0x7f41700c1e70 2023-12-04T05:38:09.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 -- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41700c1e70 msgr2=0x7f41701524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41700c1e70 0x7f41701524e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416001c920 comp rx=0 tx=0).stop 2023-12-04T05:38:09.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 -- 172.21.15.97:0/321206371 shutdown_connections 2023-12-04T05:38:09.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006d210 0x7f417006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 --2- 172.21.15.97:0/321206371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41700c1e70 0x7f41701524e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 -- 172.21.15.97:0/321206371 >> 172.21.15.97:0/321206371 conn(0x7f41700c5e70 msgr2=0x7f41700c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:09.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 -- 172.21.15.97:0/321206371 shutdown_connections 2023-12-04T05:38:09.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.582+0000 7f4174b96640 1 -- 172.21.15.97:0/321206371 wait complete. 2023-12-04T05:38:09.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 Processor -- start 2023-12-04T05:38:09.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 -- start start 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 0x7f4170071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 0x7f41701f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170154e10 con 0x7f41700c1e70 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41701547a0 con 0x7f417006d210 2023-12-04T05:38:09.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4174b96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417014f420 con 0x7f417006c440 2023-12-04T05:38:09.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51500/0 (socket says 172.21.15.97:51500) 2023-12-04T05:38:09.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 -- 172.21.15.97:0/1347939389 learned_addr learned my addr 172.21.15.97:0/1347939389 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:09.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4165d9b640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 0x7f41701f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416e59c640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 0x7f4170071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 -- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 msgr2=0x7f4170071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 0x7f4170071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 -- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 msgr2=0x7f41701f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 0x7f41701f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 -- 172.21.15.97:0/1347939389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168009420 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f4165d9b640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 0x7f41701f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416e59c640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 0x7f4170071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.586+0000 7f416ed9d640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f416800e930 tx=0x7f416800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168009680 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168004020 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680043f0 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4160009a70 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4170155f90 con 0x7f41700c1e70 2023-12-04T05:38:09.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4170068440 con 0x7f41700c1e70 2023-12-04T05:38:09.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f416800c940 con 0x7f41700c1e70 2023-12-04T05:38:09.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 0x7f4150068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:09.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f4168084440 con 0x7f41700c1e70 2023-12-04T05:38:09.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.590+0000 7f416e59c640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 0x7f4150068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:09.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.594+0000 7f416e59c640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 0x7f4150068dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41600af000 tx=0x7f41600a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:09.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.594+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4168051530 con 0x7f41700c1e70 2023-12-04T05:38:09.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:09.778+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f417006c220 con 0x7f41700c1e70 2023-12-04T05:38:10.418 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.414+0000 7f41677fe640 1 -- 172.21.15.97:0/1347939389 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4168054b50 con 0x7f41700c1e70 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 msgr2=0x7f4150068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 0x7f4150068dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41600af000 tx=0x7f41600a7070 comp rx=0 tx=0).stop 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 msgr2=0x7f41701f0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f416800e930 tx=0x7f416800edf0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 shutdown_connections 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4150066900 0x7f4150068dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f41700c1e70 0x7f41701f0f40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f417006d210 0x7f41701f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 --2- 172.21.15.97:0/1347939389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f417006c440 0x7f4170071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 >> 172.21.15.97:0/1347939389 conn(0x7f41700c5e70 msgr2=0x7f4170150350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:10.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 shutdown_connections 2023-12-04T05:38:10.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.418+0000 7f4174b96640 1 -- 172.21.15.97:0/1347939389 wait complete. 2023-12-04T05:38:10.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-04T05:38:10.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 Processor -- start 2023-12-04T05:38:10.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 -- start start 2023-12-04T05:38:10.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb4ec14b2f0 0x7fb4ec0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ec14b6d0 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec0c79d0 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f2432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec155800 con 0x7fb4ec1552b0 2023-12-04T05:38:10.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4ebfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb4ec14b2f0 0x7fb4ec0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f09cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f09cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:32782/0 (socket says 172.21.15.97:32782) 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4eb7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb4ec0c7f90 0x7fb4ec0c6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:56672/0 (socket says 172.21.15.97:56672) 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4f09cf640 1 -- 172.21.15.97:0/966912193 learned_addr learned my addr 172.21.15.97:0/966912193 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4eaffd640 1 -- 172.21.15.97:0/966912193 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578988742 0 0) 0x7fb4ec14b6d0 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4eaffd640 1 -- 172.21.15.97:0/966912193 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d4003530 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.626+0000 7fb4ebfff640 1 -- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 msgr2=0x7fb4ec0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4ebfff640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4ebfff640 1 -- 172.21.15.97:0/966912193 >> v1:172.21.15.143:6789/0 conn(0x7fb4ec0c7f90 legacy=0x7fb4ec0c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4ebfff640 1 -- 172.21.15.97:0/966912193 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0c6880 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f09cf640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4ebfff640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec0c4a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0097c0 tx=0x7fb4dc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a08e00c11395103 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4eaffd640 1 -- 172.21.15.97:0/966912193 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0ac620 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4eaffd640 1 -- 172.21.15.97:0/966912193 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0ac780 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4eaffd640 1 -- 172.21.15.97:0/966912193 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0acb10 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 -- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 msgr2=0x7fb4ec0c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec0c4a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0097c0 tx=0x7fb4dc01c3c0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 -- 172.21.15.97:0/966912193 shutdown_connections 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 --2- 172.21.15.97:0/966912193 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec0c4a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 -- 172.21.15.97:0/966912193 >> 172.21.15.97:0/966912193 conn(0x7fb4ec073720 msgr2=0x7fb4ec073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 -- 172.21.15.97:0/966912193 shutdown_connections 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.630+0000 7fb4f2432640 1 -- 172.21.15.97:0/966912193 wait complete. 2023-12-04T05:38:10.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 Processor -- start 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 -- start start 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec14a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec1ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f0610 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0ac880 con 0x7fb4ec14b2f0 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec1f0860 con 0x7fb4ec1552b0 2023-12-04T05:38:10.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51512/0 (socket says 172.21.15.97:51512) 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 -- 172.21.15.97:0/3848272068 learned_addr learned my addr 172.21.15.97:0/3848272068 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4eb7fe640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec14a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f09cf640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec1ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 -- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 msgr2=0x7fb4ec1ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec1ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 -- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 msgr2=0x7fb4ec14a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec14a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 -- 172.21.15.97:0/3848272068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009b30 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f09cf640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4ebfff640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc019ff0 tx=0x7fb4dc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0ac620 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc0b5410 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.634+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009420 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0b57a0 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec0c4040 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec068440 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb4dc0b3040 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4e8ff9640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 0x7fb4d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fb4dc11e580 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4eb7fe640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 0x7fb4d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:10.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.638+0000 7fb4eb7fe640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 0x7fb4d8068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec14eaf0 tx=0x7fb4e0007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:10.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.642+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4dc0eb700 con 0x7fb4ec0c7f90 2023-12-04T05:38:10.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:10.798+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4ec06cae0 con 0x7fb4ec0c7f90 2023-12-04T05:38:11.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4e8ff9640 1 -- 172.21.15.97:0/3848272068 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb4dc0eed20 con 0x7fb4ec0c7f90 2023-12-04T05:38:11.421 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' removed 2023-12-04T05:38:11.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 msgr2=0x7fb4d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 0x7fb4d8068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec14eaf0 tx=0x7fb4e0007d40 comp rx=0 tx=0).stop 2023-12-04T05:38:11.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 msgr2=0x7fb4ec1f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc019ff0 tx=0x7fb4dc019160 comp rx=0 tx=0).stop 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 shutdown_connections 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb4d80668d0 0x7fb4d8068d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4ec1552b0 0x7fb4ec1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4ec14b2f0 0x7fb4ec14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 --2- 172.21.15.97:0/3848272068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4ec0c7f90 0x7fb4ec1f1060 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.418+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 >> 172.21.15.97:0/3848272068 conn(0x7fb4ec073720 msgr2=0x7fb4ec0befa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:11.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.422+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 shutdown_connections 2023-12-04T05:38:11.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.422+0000 7fb4f2432640 1 -- 172.21.15.97:0/3848272068 wait complete. 2023-12-04T05:38:11.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-04T05:38:11.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 Processor -- start 2023-12-04T05:38:11.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 -- start start 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab814ea50 0x7f0ab8152810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0ab8152d50 0x7f0ab80c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80c05f0 con 0x7f0ab80c3570 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab814ee30 con 0x7f0ab8152d50 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0abd365640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8152360 con 0x7f0ab814ea50 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab77fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0ab80c3570 0x7f0ab806d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32900/0 (socket says 172.21.15.97:32900) 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab77fe640 1 -- 172.21.15.97:0/1913485535 learned_addr learned my addr 172.21.15.97:0/1913485535 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab814ea50 0x7f0ab8152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> v2:172.21.15.143:3300/0 conn(0x7f0ab8152d50 0x7f0ab80c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867896335 0 0) 0x7f0ab80c05f0 con 0x7f0ab80c3570 2023-12-04T05:38:11.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa4003530 con 0x7f0ab80c3570 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704582293 0 0) 0x7f0aa4003530 con 0x7f0ab80c3570 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab814ea50 msgr2=0x7f0ab8152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab814ea50 0x7f0ab8152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 >> v2:172.21.15.143:3300/0 conn(0x7f0ab8152d50 msgr2=0x7f0ab80c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 --2- 172.21.15.97:0/1913485535 >> v2:172.21.15.143:3300/0 conn(0x7f0ab8152d50 0x7f0ab80c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8151da0 con 0x7f0ab80c3570 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f0ab0001680 con 0x7f0ab80c3570 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> v2:172.21.15.143:3300/0 conn(0x7f0ab8152d50 0x7f0ab80c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 >> v1:172.21.15.97:6789/0 conn(0x7f0ab80c3570 legacy=0x7f0ab806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003980 0x7f0aa4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa4005190 0x7f0aa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8152360 con 0x7f0aa4003980 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400bed0 con 0x7f0aa4005190 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400c090 con 0x7f0aa40047d0 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab814ea50 0x7f0ab8152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab77fe640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa4005190 0x7f0aa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.586+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003980 0x7f0aa4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 -- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa4005190 msgr2=0x7f0aa400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa4005190 0x7f0aa400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 -- 172.21.15.97:0/1913485535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003980 msgr2=0x7f0aa4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003980 0x7f0aa4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 -- 172.21.15.97:0/1913485535 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4003530 con 0x7f0aa40047d0 2023-12-04T05:38:11.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa4003980 0x7f0aa4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000e380 tx=0x7f0aa001ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672d4b6f00b34d2a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00a5e00 con 0x7f0aa40047d0 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000f040 con 0x7f0aa40047d0 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0ab67fc640 1 -- 172.21.15.97:0/1913485535 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00ad640 con 0x7f0aa40047d0 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0abd365640 1 -- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40047d0 msgr2=0x7f0aa4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0abd365640 1 --2- 172.21.15.97:0/1913485535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000e380 tx=0x7f0aa001ce10 comp rx=0 tx=0).stop 2023-12-04T05:38:11.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0ab77fe640 1 -- 172.21.15.97:0/1913485535 reap_dead start 2023-12-04T05:38:11.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0abd365640 1 -- 172.21.15.97:0/1913485535 shutdown_connections 2023-12-04T05:38:11.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.590+0000 7f0abd365640 1 -- 172.21.15.97:0/1913485535 >> 172.21.15.97:0/1913485535 conn(0x7f0ab80c2a50 msgr2=0x7f0ab80c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:11.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- 172.21.15.97:0/1913485535 shutdown_connections 2023-12-04T05:38:11.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- 172.21.15.97:0/1913485535 wait complete. 2023-12-04T05:38:11.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 Processor -- start 2023-12-04T05:38:11.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- start start 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ab8072580 0x7f0ab80c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab8150c30 0x7f0ab81ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80c5950 con 0x7f0aa40047d0 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81f1120 con 0x7f0ab8072580 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0abd365640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81f1400 con 0x7f0ab8150c30 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51528/0 (socket says 172.21.15.97:51528) 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 -- 172.21.15.97:0/4128310894 learned_addr learned my addr 172.21.15.97:0/4128310894 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ab8072580 0x7f0ab80c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab77fe640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab8150c30 0x7f0ab81ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 -- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab8150c30 msgr2=0x7f0ab81ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab8150c30 0x7f0ab81ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 -- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ab8072580 msgr2=0x7f0ab80c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ab8072580 0x7f0ab80c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 -- 172.21.15.97:0/4128310894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80c5c30 con 0x7f0aa40047d0 2023-12-04T05:38:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.594+0000 7f0ab6ffd640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8011bb0 tx=0x7f0aa800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011ca0 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8011e00 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8014660 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab80c5330 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab80aba80 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab81f1570 con 0x7f0aa40047d0 2023-12-04T05:38:11.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0aa80147c0 con 0x7f0aa40047d0 2023-12-04T05:38:11.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 0x7f0a98068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:11.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f0aa8084d20 con 0x7f0aa40047d0 2023-12-04T05:38:11.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.598+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 0x7f0a98068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:11.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.602+0000 7f0aae7fc640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 0x7f0a98068dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00af000 tx=0x7f0aa0004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:11.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.602+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0aa8051fc0 con 0x7f0aa40047d0 2023-12-04T05:38:11.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:11.758+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ab8068440 con 0x7f0aa40047d0 2023-12-04T05:38:12.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.422+0000 7f0aaffff640 1 -- 172.21.15.97:0/4128310894 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0aa80220d0 con 0x7f0aa40047d0 2023-12-04T05:38:12.427 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' removed 2023-12-04T05:38:12.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 msgr2=0x7f0a98068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 0x7f0a98068dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00af000 tx=0x7f0aa0004ac0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 msgr2=0x7f0ab8151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8011bb0 tx=0x7f0aa800f610 comp rx=0 tx=0).stop 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 shutdown_connections 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a98066900 0x7f0a98068dc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0ab8150c30 0x7f0ab81ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0ab8072580 0x7f0ab80c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 --2- 172.21.15.97:0/4128310894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40047d0 0x7f0ab8151180 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 >> 172.21.15.97:0/4128310894 conn(0x7f0ab80c2a50 msgr2=0x7f0ab8144b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:12.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 shutdown_connections 2023-12-04T05:38:12.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.426+0000 7f0abd365640 1 -- 172.21.15.97:0/4128310894 wait complete. 2023-12-04T05:38:12.455 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-04T05:38:12.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.594+0000 7f5e9d832640 1 Processor -- start 2023-12-04T05:38:12.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.594+0000 7f5e9d832640 1 -- start start 2023-12-04T05:38:12.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9814eb30 0x7f5e9814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 0x7f5e981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e98154e10 0x7f5e98151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e980c0bd0 con 0x7f5e98154e10 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e98154640 con 0x7f5e9814f790 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e9d832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814ef10 con 0x7f5e9814eb30 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e98154e10 0x7f5e98151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5e98154e10 0x7f5e98151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51534/0 (socket says 172.21.15.97:51534) 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 -- 172.21.15.97:0/659015404 learned_addr learned my addr 172.21.15.97:0/659015404 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e8ffff640 1 --2- 172.21.15.97:0/659015404 >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 0x7f5e981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e96ffd640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9814eb30 0x7f5e9814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 -- 172.21.15.97:0/659015404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9814eb30 msgr2=0x7f5e9814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9814eb30 0x7f5e9814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 -- 172.21.15.97:0/659015404 >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 msgr2=0x7f5e981548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 --2- 172.21.15.97:0/659015404 >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 0x7f5e981548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 -- 172.21.15.97:0/659015404 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e981535a0 con 0x7f5e98154e10 2023-12-04T05:38:12.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e8ffff640 1 --2- 172.21.15.97:0/659015404 >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 0x7f5e981548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:12.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.598+0000 7f5e977fe640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e98154e10 0x7f5e98151310 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e980c6f30 tx=0x7f5e9001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26fa90697c8e9c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e967fc640 1 -- 172.21.15.97:0/659015404 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900a5730 con 0x7f5e98154e10 2023-12-04T05:38:12.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e967fc640 1 -- 172.21.15.97:0/659015404 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e900a5890 con 0x7f5e98154e10 2023-12-04T05:38:12.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e967fc640 1 -- 172.21.15.97:0/659015404 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e900a5c20 con 0x7f5e98154e10 2023-12-04T05:38:12.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- 172.21.15.97:0/659015404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e98154e10 msgr2=0x7f5e98151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e98154e10 0x7f5e98151310 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e980c6f30 tx=0x7f5e9001c9a0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- 172.21.15.97:0/659015404 shutdown_connections 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e98154e10 0x7f5e98151310 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- 172.21.15.97:0/659015404 >> v2:172.21.15.143:3300/0 conn(0x7f5e9814f790 0x7f5e981548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- 172.21.15.97:0/659015404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e9814eb30 0x7f5e9814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- 172.21.15.97:0/659015404 >> 172.21.15.97:0/659015404 conn(0x7f5e980c5e70 msgr2=0x7f5e980c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- 172.21.15.97:0/659015404 shutdown_connections 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- 172.21.15.97:0/659015404 wait complete. 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 Processor -- start 2023-12-04T05:38:12.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- start start 2023-12-04T05:38:12.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e9814f790 0x7f5e980c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 0x7f5e98149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814c030 con 0x7f5e9814eb30 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9814b860 con 0x7f5e9814f790 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e9d832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980c5a70 con 0x7f5e98154e10 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e96ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e96ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51542/0 (socket says 172.21.15.97:51542) 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e96ffd640 1 -- 172.21.15.97:0/3968637406 learned_addr learned my addr 172.21.15.97:0/3968637406 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e8ffff640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e9814f790 0x7f5e980c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.602+0000 7f5e977fe640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 0x7f5e98149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 -- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 msgr2=0x7f5e98149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 0x7f5e98149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 -- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e9814f790 msgr2=0x7f5e980c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e9814f790 0x7f5e980c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 -- 172.21.15.97:0/3968637406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90009b30 con 0x7f5e9814eb30 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e977fe640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 0x7f5e98149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:12.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e96ffd640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d800 tx=0x7f5e8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800b6c0 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800b820 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9814ba70 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800bb90 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e980c5670 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98068440 con 0x7f5e9814eb30 2023-12-04T05:38:12.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5e8800bcf0 con 0x7f5e9814eb30 2023-12-04T05:38:12.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 0x7f5e78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5e88084660 con 0x7f5e9814eb30 2023-12-04T05:38:12.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.606+0000 7f5e8ffff640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 0x7f5e78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.610+0000 7f5e8ffff640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 0x7f5e78068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e980c0430 tx=0x7f5e80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.610+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e88051b30 con 0x7f5e9814eb30 2023-12-04T05:38:12.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.762+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e9814ac80 con 0x7f5e9814eb30 2023-12-04T05:38:12.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.766+0000 7f5e94ff9640 1 -- 172.21.15.97:0/3968637406 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e88055150 con 0x7f5e9814eb30 2023-12-04T05:38:12.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 msgr2=0x7f5e78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 0x7f5e78068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e980c0430 tx=0x7f5e80008040 comp rx=0 tx=0).stop 2023-12-04T05:38:12.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 msgr2=0x7f5e9814b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800d800 tx=0x7f5e8800dcc0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 shutdown_connections 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5e780668d0 0x7f5e78068d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5e98154e10 0x7f5e98149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5e9814f790 0x7f5e980c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 --2- 172.21.15.97:0/3968637406 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5e9814eb30 0x7f5e9814b060 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 >> 172.21.15.97:0/3968637406 conn(0x7f5e980c5e70 msgr2=0x7f5e980c1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 shutdown_connections 2023-12-04T05:38:12.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.770+0000 7f5e9d832640 1 -- 172.21.15.97:0/3968637406 wait complete. 2023-12-04T05:38:12.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-04T05:38:12.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 Processor -- start 2023-12-04T05:38:12.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 -- start start 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99d0154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f99d0155060 0x7f99d015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d01554f0 con 0x7f99d00c1880 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d006caf0 con 0x7f99d0155060 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d6c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d014b440 con 0x7f99d00c1c60 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d4a15640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f99d00c1880 0x7f99d006be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32902/0 (socket says 172.21.15.97:32902) 2023-12-04T05:38:12.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d4a15640 1 -- 172.21.15.97:0/1929985775 learned_addr learned my addr 172.21.15.97:0/1929985775 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545556705 0 0) 0x7f99c4001120 con 0x7f99d00c1880 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c0003530 con 0x7f99d00c1880 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99d5216640 1 --2- 172.21.15.97:0/1929985775 >> v2:172.21.15.143:3300/0 conn(0x7f99d0155060 0x7f99d015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cffff640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99d0154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2765795201 0 0) 0x7f99c0003530 con 0x7f99d00c1880 2023-12-04T05:38:12.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 msgr2=0x7f99d0154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99d0154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 >> v2:172.21.15.143:3300/0 conn(0x7f99d0155060 msgr2=0x7f99d015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 --2- 172.21.15.97:0/1929985775 >> v2:172.21.15.143:3300/0 conn(0x7f99d0155060 0x7f99d015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00c20e0 con 0x7f99d00c1880 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f99c4001810 con 0x7f99d00c1880 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 >> v1:172.21.15.97:6789/0 conn(0x7f99d00c1880 legacy=0x7f99d006be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99c0003fb0 0x7f99c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0004d10 0x7f99c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d014b440 con 0x7f99c0003fb0 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c000ba40 con 0x7f99c0004d10 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c000bbd0 con 0x7f99d00c1c60 2023-12-04T05:38:12.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.926+0000 7f99cffff640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99c0003fb0 0x7f99c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99d4a15640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99d5216640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0004d10 0x7f99c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 -- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 msgr2=0x7f99c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d00c1c60 0x7f99c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 -- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0004d10 msgr2=0x7f99c0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0004d10 0x7f99c0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 -- 172.21.15.97:0/1929985775 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0003530 con 0x7f99c0003fb0 2023-12-04T05:38:12.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cffff640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99c0003fb0 0x7f99c00047d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00ba30 tx=0x7f99bc01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d894ba883675339b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0ac620 con 0x7f99c0003fb0 2023-12-04T05:38:12.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0a6040 con 0x7f99c0003fb0 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99cf7fe640 1 -- 172.21.15.97:0/1929985775 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0ac9c0 con 0x7f99c0003fb0 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.930+0000 7f99d6c79640 1 -- 172.21.15.97:0/1929985775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99c0003fb0 msgr2=0x7f99c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1929985775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99c0003fb0 0x7f99c00047d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00ba30 tx=0x7f99bc01c680 comp rx=0 tx=0).stop 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d5216640 1 -- 172.21.15.97:0/1929985775 reap_dead start 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 -- 172.21.15.97:0/1929985775 shutdown_connections 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 -- 172.21.15.97:0/1929985775 >> 172.21.15.97:0/1929985775 conn(0x7f99d00c2970 msgr2=0x7f99d00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 -- 172.21.15.97:0/1929985775 shutdown_connections 2023-12-04T05:38:12.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 -- 172.21.15.97:0/1929985775 wait complete. 2023-12-04T05:38:12.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 Processor -- start 2023-12-04T05:38:12.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 -- start start 2023-12-04T05:38:12.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.934+0000 7f99d6c79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 0x7f99d0151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d6c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d6c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d0147b90 0x7f99d01ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d6c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00aba00 con 0x7f99d0157d80 2023-12-04T05:38:12.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d6c79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d0148420 con 0x7f99c0003fb0 2023-12-04T05:38:12.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d6c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00ab0d0 con 0x7f99d0147b90 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51560/0 (socket says 172.21.15.97:51560) 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99cffff640 1 -- 172.21.15.97:0/1570014129 learned_addr learned my addr 172.21.15.97:0/1570014129 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.938+0000 7f99d4a15640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 0x7f99d0151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 -- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d0147b90 msgr2=0x7f99d01ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d0147b90 0x7f99d01ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 -- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 msgr2=0x7f99d0151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 0x7f99d0151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 -- 172.21.15.97:0/1570014129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d00ab3b0 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99d4a15640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 0x7f99d0151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cffff640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0ae040 tx=0x7f99c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0acc20 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0b9070 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004020 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d00ab690 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d014c6d0 con 0x7f99d0157d80 2023-12-04T05:38:12.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.942+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d00ab850 con 0x7f99d0157d80 2023-12-04T05:38:12.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.946+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99bc004180 con 0x7f99d0157d80 2023-12-04T05:38:12.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.946+0000 7f99cd7fa640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 0x7f99b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:12.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.950+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f99bc11e860 con 0x7f99d0157d80 2023-12-04T05:38:12.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.950+0000 7f99d4a15640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 0x7f99b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:12.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.950+0000 7f99d4a15640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 0x7f99b4068d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99c40012c0 tx=0x7f99c4007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:12.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:12.954+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99bc0ef980 con 0x7f99d0157d80 2023-12-04T05:38:13.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.158+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f99d0154ed0 con 0x7f99d0157d80 2023-12-04T05:38:13.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99cd7fa640 1 -- 172.21.15.97:0/1570014129 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v115) v1 ==== 159+0+0 (secure 0 0 0) 0x7f99bc0bb0e0 con 0x7f99d0157d80 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 msgr2=0x7f99b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 0x7f99b4068d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f99c40012c0 tx=0x7f99c4007a80 comp rx=0 tx=0).stop 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 msgr2=0x7f99d0147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0ae040 tx=0x7f99c0005800 comp rx=0 tx=0).stop 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 shutdown_connections 2023-12-04T05:38:13.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f99b40668d0 0x7f99b4068d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99d0147b90 0x7f99d01ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f99d0157d80 0x7f99d0147650 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 --2- 172.21.15.97:0/1570014129 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f99c0003fb0 0x7f99d0151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 >> 172.21.15.97:0/1570014129 conn(0x7f99d00c2970 msgr2=0x7f99d00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 shutdown_connections 2023-12-04T05:38:13.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.426+0000 7f99d6c79640 1 -- 172.21.15.97:0/1570014129 wait complete. 2023-12-04T05:38:13.451 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-04T05:38:13.452 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-04T05:38:13.452 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:13.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 Processor -- start 2023-12-04T05:38:13.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 -- start start 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f44071390 0x7f8f440c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440707c0 con 0x7f8f440c1880 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f44159470 con 0x7f8f44071e10 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f4b432640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4406dd10 con 0x7f8f44071390 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f491ce640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8f440c1880 0x7f8f4406be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:32910/0 (socket says 172.21.15.97:32910) 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.586+0000 7f8f491ce640 1 -- 172.21.15.97:0/612090425 learned_addr learned my addr 172.21.15.97:0/612090425 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:13.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 --2- 172.21.15.97:0/612090425 >> v2:172.21.15.143:3300/0 conn(0x7f8f44071390 0x7f8f440c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119955948 0 0) 0x7f8f440707c0 con 0x7f8f440c1880 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f440c1880 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316734021 0 0) 0x7f8f30003530 con 0x7f8f440c1880 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 >> v2:172.21.15.143:3300/0 conn(0x7f8f44071390 msgr2=0x7f8f440c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 --2- 172.21.15.97:0/612090425 >> v2:172.21.15.143:3300/0 conn(0x7f8f44071390 0x7f8f440c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 >> v1:172.21.15.143:6789/0 conn(0x7f8f44071e10 legacy=0x7f8f44161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44159750 con 0x7f8f440c1880 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f8f40001680 con 0x7f8f440c1880 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 >> v1:172.21.15.97:6789/0 conn(0x7f8f440c1880 legacy=0x7f8f4406be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f30003980 0x7f8f30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000c000 con 0x7f8f30005190 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000c170 con 0x7f8f300047d0 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000c330 con 0x7f8f30003980 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f489cd640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f491ce640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f30003980 0x7f8f30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 -- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f30003980 msgr2=0x7f8f30003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f30003980 0x7f8f30003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 -- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f300047d0 msgr2=0x7f8f30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 -- 172.21.15.97:0/612090425 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30003530 con 0x7f8f30005190 2023-12-04T05:38:13.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.590+0000 7f8f499cf640 1 -- 172.21.15.97:0/612090425 reap_dead start 2023-12-04T05:38:13.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f499cf640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f3000b990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009fc0 tx=0x7f8f3c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddcfc67970c497a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a5cb0 con 0x7f8f30005190 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00f040 con 0x7f8f30005190 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f3bfff640 1 -- 172.21.15.97:0/612090425 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c003be0 con 0x7f8f30005190 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 msgr2=0x7f8f3000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f3000b990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009fc0 tx=0x7f8f3c01cca0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- 172.21.15.97:0/612090425 shutdown_connections 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 --2- 172.21.15.97:0/612090425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f3000b990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- 172.21.15.97:0/612090425 >> 172.21.15.97:0/612090425 conn(0x7f8f440c2970 msgr2=0x7f8f440c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- 172.21.15.97:0/612090425 shutdown_connections 2023-12-04T05:38:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- 172.21.15.97:0/612090425 wait complete. 2023-12-04T05:38:13.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 Processor -- start 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- start start 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 0x7f8f440c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f441f1f10 0x7f8f44148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440bbe50 con 0x7f8f30005190 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440bb540 con 0x7f8f441f1a90 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.594+0000 7f8f4b432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440ab9f0 con 0x7f8f441f1f10 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51586/0 (socket says 172.21.15.97:51586) 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 -- 172.21.15.97:0/464168525 learned_addr learned my addr 172.21.15.97:0/464168525 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f489cd640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 0x7f8f440c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f499cf640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f441f1f10 0x7f8f44148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 -- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f441f1f10 msgr2=0x7f8f44148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f441f1f10 0x7f8f44148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 -- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 msgr2=0x7f8f440c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 0x7f8f440c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 -- 172.21.15.97:0/464168525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44156110 con 0x7f8f30005190 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f489cd640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 0x7f8f440c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f491ce640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000e730 tx=0x7f8f4000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000ee40 con 0x7f8f30005190 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000c850 con 0x7f8f30005190 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000cc00 con 0x7f8f30005190 2023-12-04T05:38:13.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f440baf30 con 0x7f8f30005190 2023-12-04T05:38:13.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f440bb1d0 con 0x7f8f30005190 2023-12-04T05:38:13.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44068440 con 0x7f8f30005190 2023-12-04T05:38:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.598+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8f4001d460 con 0x7f8f30005190 2023-12-04T05:38:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.602+0000 7f8f39ffb640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 0x7f8f28068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.602+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8f400840e0 con 0x7f8f30005190 2023-12-04T05:38:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.602+0000 7f8f489cd640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 0x7f8f28068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.602+0000 7f8f489cd640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 0x7f8f28068d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000c10 tx=0x7f8f34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.606+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f40051650 con 0x7f8f30005190 2023-12-04T05:38:13.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.754+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f440a90a0 con 0x7f8f30005190 2023-12-04T05:38:13.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f39ffb640 1 -- 172.21.15.97:0/464168525 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13100 (secure 0 0 0) 0x7f8f40001480 con 0x7f8f30005190 2023-12-04T05:38:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:13.761 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":41,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:12.421742+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/259028206":"2023-12-05T05:38:09.414516+0000","172.21.15.97:6835/259028206":"2023-12-05T05:38:09.414516+0000","172.21.15.97:6836/525136181":"2023-12-05T05:38:02.783767+0000","172.21.15.97:6834/525136181":"2023-12-05T05:38:02.783767+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:13.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 msgr2=0x7f8f28068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 0x7f8f28068d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8f34000c10 tx=0x7f8f34009040 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 msgr2=0x7f8f440a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000e730 tx=0x7f8f4000ebf0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 shutdown_connections 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f280668d0 0x7f8f28068d90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f441f1f10 0x7f8f44148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f441f1a90 0x7f8f440c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 --2- 172.21.15.97:0/464168525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f30005190 0x7f8f440a9480 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 >> 172.21.15.97:0/464168525 conn(0x7f8f440c2970 msgr2=0x7f8f441e4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:13.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 shutdown_connections 2023-12-04T05:38:13.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.758+0000 7f8f4b432640 1 -- 172.21.15.97:0/464168525 wait complete. 2023-12-04T05:38:13.782 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:13.782 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:13.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.918+0000 7fe1964c9640 1 Processor -- start 2023-12-04T05:38:13.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.918+0000 7fe1964c9640 1 -- start start 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.918+0000 7fe1964c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1900c1360 0x7fe1900700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.918+0000 7fe1964c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe19006c000 0x7fe190151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.918+0000 7fe1964c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe190150bc0 con 0x7fe1901518a0 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe1964c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe190154fd0 con 0x7fe19006c000 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe1964c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe190072160 con 0x7fe1900c1360 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe19006c000 0x7fe190151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe19006c000 0x7fe190151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51588/0 (socket says 172.21.15.97:51588) 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 -- 172.21.15.97:0/98473325 learned_addr learned my addr 172.21.15.97:0/98473325 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18ffff640 1 --2- 172.21.15.97:0/98473325 >> v2:172.21.15.143:3300/0 conn(0x7fe1900c1360 0x7fe1900700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 -- 172.21.15.97:0/98473325 >> v2:172.21.15.143:3300/0 conn(0x7fe1900c1360 msgr2=0x7fe1900700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:13.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 --2- 172.21.15.97:0/98473325 >> v2:172.21.15.143:3300/0 conn(0x7fe1900c1360 0x7fe1900700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 -- 172.21.15.97:0/98473325 >> v1:172.21.15.143:6789/0 conn(0x7fe1901518a0 legacy=0x7fe19014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 -- 172.21.15.97:0/98473325 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190072440 con 0x7fe19006c000 2023-12-04T05:38:13.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18f7fe640 1 --2- 172.21.15.97:0/98473325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe19006c000 0x7fe190151360 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe1900c6aa0 tx=0x7fe18401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3b8d8ad6a5bde7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18effd640 1 -- 172.21.15.97:0/98473325 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840ab600 con 0x7fe19006c000 2023-12-04T05:38:13.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18effd640 1 -- 172.21.15.97:0/98473325 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840a7050 con 0x7fe19006c000 2023-12-04T05:38:13.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.922+0000 7fe18effd640 1 -- 172.21.15.97:0/98473325 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840ab980 con 0x7fe19006c000 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- 172.21.15.97:0/98473325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe19006c000 msgr2=0x7fe190151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- 172.21.15.97:0/98473325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe19006c000 0x7fe190151360 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe1900c6aa0 tx=0x7fe18401c470 comp rx=0 tx=0).stop 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- 172.21.15.97:0/98473325 shutdown_connections 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- 172.21.15.97:0/98473325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe19006c000 0x7fe190151360 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- 172.21.15.97:0/98473325 >> v2:172.21.15.143:3300/0 conn(0x7fe1900c1360 0x7fe1900700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- 172.21.15.97:0/98473325 >> 172.21.15.97:0/98473325 conn(0x7fe1900c5e70 msgr2=0x7fe1900c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- 172.21.15.97:0/98473325 shutdown_connections 2023-12-04T05:38:13.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- 172.21.15.97:0/98473325 wait complete. 2023-12-04T05:38:13.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 Processor -- start 2023-12-04T05:38:13.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- start start 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe19006c000 0x7fe19014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1900c1360 0x7fe1900c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190070f60 con 0x7fe190152190 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190152dd0 con 0x7fe19006c000 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe1964c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c5860 con 0x7fe1900c1360 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe194a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe194a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:51590/0 (socket says 172.21.15.97:51590) 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe194a66640 1 -- 172.21.15.97:0/3572968956 learned_addr learned my addr 172.21.15.97:0/3572968956 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:13.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe18ffff640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe19006c000 0x7fe19014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.926+0000 7fe18f7fe640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1900c1360 0x7fe1900c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 -- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1900c1360 msgr2=0x7fe1900c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1900c1360 0x7fe1900c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 -- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe19006c000 msgr2=0x7fe19014cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe19006c000 0x7fe19014cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 -- 172.21.15.97:0/3572968956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840094d0 con 0x7fe190152190 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe194a66640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c730 tx=0x7fe18800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188003b80 con 0x7fe190152190 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188003ce0 con 0x7fe190152190 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800aa30 con 0x7fe190152190 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190152b60 con 0x7fe190152190 2023-12-04T05:38:13.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900c4050 con 0x7fe190152190 2023-12-04T05:38:13.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe190068440 con 0x7fe190152190 2023-12-04T05:38:13.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe18800ab90 con 0x7fe190152190 2023-12-04T05:38:13.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 0x7fe17c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:13.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe188083e20 con 0x7fe190152190 2023-12-04T05:38:13.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.930+0000 7fe18ffff640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 0x7fe17c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:13.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.934+0000 7fe18ffff640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 0x7fe17c068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1901f1d90 tx=0x7fe180009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:13.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:13.934+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1880513a0 con 0x7fe190152190 2023-12-04T05:38:14.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.086+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1900bf4b0 con 0x7fe190152190 2023-12-04T05:38:14.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.086+0000 7fe18cff9640 1 -- 172.21.15.97:0/3572968956 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1880549c0 con 0x7fe190152190 2023-12-04T05:38:14.092 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:14.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 msgr2=0x7fe17c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 0x7fe17c068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1901f1d90 tx=0x7fe180009190 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 msgr2=0x7fe190152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c730 tx=0x7fe18800cbf0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 shutdown_connections 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe17c0668d0 0x7fe17c068d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe190152190 0x7fe190152620 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe1900c1360 0x7fe1900c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 --2- 172.21.15.97:0/3572968956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe19006c000 0x7fe19014cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 >> 172.21.15.97:0/3572968956 conn(0x7fe1900c5e70 msgr2=0x7fe190148380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 shutdown_connections 2023-12-04T05:38:14.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.090+0000 7fe1964c9640 1 -- 172.21.15.97:0/3572968956 wait complete. 2023-12-04T05:38:14.113 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-04T05:38:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.246+0000 7f49b3dd1640 1 Processor -- start 2023-12-04T05:38:14.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b3dd1640 1 -- start start 2023-12-04T05:38:14.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b3dd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f49ac0a88e0 0x7f49ac152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b3dd1640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac1530e0 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b3dd1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0a9770 con 0x7f49ac14fbb0 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b3dd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac14ff90 con 0x7f49ac0a88e0 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f49ac0a8460 0x7f49ac152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46644/0 (socket says 172.21.15.97:46644) 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 -- 172.21.15.97:0/1194559988 learned_addr learned my addr 172.21.15.97:0/1194559988 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b236e640 1 --2- 172.21.15.97:0/1194559988 >> v2:172.21.15.143:3300/0 conn(0x7f49ac0a88e0 0x7f49ac152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167291267 0 0) 0x7f49ac1530e0 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4998003530 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196172870 0 0) 0x7f4998003530 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 >> v2:172.21.15.143:3300/0 conn(0x7f49ac0a88e0 msgr2=0x7f49ac152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 --2- 172.21.15.97:0/1194559988 >> v2:172.21.15.143:3300/0 conn(0x7f49ac0a88e0 0x7f49ac152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 >> v1:172.21.15.143:6789/0 conn(0x7f49ac14fbb0 legacy=0x7f49ac0a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac071730 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f499c001680 con 0x7f49ac0a8460 2023-12-04T05:38:14.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 >> v1:172.21.15.97:6789/0 conn(0x7f49ac0a8460 legacy=0x7f49ac152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4998003980 0x7f4998003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 0x7f4998004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4998005190 0x7f499800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac14ff90 con 0x7f49980047d0 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499800c0e0 con 0x7f4998003980 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499800c2a0 con 0x7f4998005190 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 0x7f4998004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b1b6d640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4998003980 0x7f4998003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b236e640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4998005190 0x7f499800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 -- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4998005190 msgr2=0x7f499800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4998005190 0x7f499800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 -- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4998003980 msgr2=0x7f4998003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4998003980 0x7f4998003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b136c640 1 -- 172.21.15.97:0/1194559988 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998003530 con 0x7f49980047d0 2023-12-04T05:38:14.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.250+0000 7f49b236e640 1 -- 172.21.15.97:0/1194559988 reap_dead start 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b136c640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 0x7f4998004c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c210 tx=0x7f499c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a29955d379bcf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c005ae0 con 0x7f49980047d0 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c005c60 con 0x7f49980047d0 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b0b6b640 1 -- 172.21.15.97:0/1194559988 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a59d0 con 0x7f49980047d0 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 -- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 msgr2=0x7f4998004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 0x7f4998004c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f499c00c210 tx=0x7f499c01cbc0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 -- 172.21.15.97:0/1194559988 shutdown_connections 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/1194559988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49980047d0 0x7f4998004c50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 -- 172.21.15.97:0/1194559988 >> 172.21.15.97:0/1194559988 conn(0x7f49ac0c2970 msgr2=0x7f49ac0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 -- 172.21.15.97:0/1194559988 shutdown_connections 2023-12-04T05:38:14.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.254+0000 7f49b3dd1640 1 -- 172.21.15.97:0/1194559988 wait complete. 2023-12-04T05:38:14.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 Processor -- start 2023-12-04T05:38:14.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- start start 2023-12-04T05:38:14.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 0x7f49ac0c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ac14b210 0x7f49ac14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c3ec0 con 0x7f49ac1ec710 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac1425e0 con 0x7f49980047d0 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0c5610 con 0x7f49ac14b210 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36668/0 (socket says 172.21.15.97:36668) 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 -- 172.21.15.97:0/172664336 learned_addr learned my addr 172.21.15.97:0/172664336 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b1b6d640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 0x7f49ac0c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b236e640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ac14b210 0x7f49ac14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 -- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ac14b210 msgr2=0x7f49ac14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ac14b210 0x7f49ac14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 -- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 msgr2=0x7f49ac0c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 0x7f49ac0c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 -- 172.21.15.97:0/172664336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0c58f0 con 0x7f49ac1ec710 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b1b6d640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 0x7f49ac0c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b136c640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f499c001940 tx=0x7f4998005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:14.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0b4070 con 0x7f49ac1ec710 2023-12-04T05:38:14.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c001540 con 0x7f49ac1ec710 2023-12-04T05:38:14.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5790 con 0x7f49ac1ec710 2023-12-04T05:38:14.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac1efea0 con 0x7f49ac1ec710 2023-12-04T05:38:14.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac1f0be0 con 0x7f49ac1ec710 2023-12-04T05:38:14.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.258+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac1efd00 con 0x7f49ac1ec710 2023-12-04T05:38:14.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.262+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f499c0a5910 con 0x7f49ac1ec710 2023-12-04T05:38:14.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.262+0000 7f49a27fc640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 0x7f4990068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:14.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.262+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f499c11dd50 con 0x7f49ac1ec710 2023-12-04T05:38:14.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.262+0000 7f49b1b6d640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 0x7f4990068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:14.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.262+0000 7f49b1b6d640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 0x7f4990068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49a8000c10 tx=0x7f49a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:14.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.266+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49ac1efd00 con 0x7f49ac1ec710 2023-12-04T05:38:14.473 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:14.470+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f49ac1efd00 con 0x7f49ac1ec710 2023-12-04T05:38:15.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49a27fc640 1 -- 172.21.15.97:0/172664336 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v117) v1 ==== 187+0+0 (secure 0 0 0) 0x7f49ac1efd00 con 0x7f49ac1ec710 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 msgr2=0x7f4990068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 0x7f4990068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49a8000c10 tx=0x7f49a8009040 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 msgr2=0x7f49ac1f06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f499c001940 tx=0x7f4998005800 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 shutdown_connections 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4990066900 0x7f4990068dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49ac14b210 0x7f49ac14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f49ac1ec710 0x7f49ac1f06a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 --2- 172.21.15.97:0/172664336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49980047d0 0x7f49ac0c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 >> 172.21.15.97:0/172664336 conn(0x7f49ac0c2970 msgr2=0x7f49ac0c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:15.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 shutdown_connections 2023-12-04T05:38:15.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.438+0000 7f49b3dd1640 1 -- 172.21.15.97:0/172664336 wait complete. 2023-12-04T05:38:15.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-04T05:38:15.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 Processor -- start 2023-12-04T05:38:15.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 -- start start 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f66301524e0 0x7f663006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300aa240 con 0x7f663006c440 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300aa500 con 0x7f66300c1e70 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.602+0000 7f6635b2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663006c0c0 con 0x7f66301524e0 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f663006c440 0x7f663006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46660/0 (socket says 172.21.15.97:46660) 2023-12-04T05:38:15.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 -- 172.21.15.97:0/469017057 learned_addr learned my addr 172.21.15.97:0/469017057 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662ffff640 1 --2- 172.21.15.97:0/469017057 >> v2:172.21.15.143:3300/0 conn(0x7f66301524e0 0x7f663006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714955951 0 0) 0x7f66300aa240 con 0x7f663006c440 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f661c003530 con 0x7f663006c440 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 494970587 0 0) 0x7f661c003530 con 0x7f663006c440 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 >> v2:172.21.15.143:3300/0 conn(0x7f66301524e0 msgr2=0x7f663006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 --2- 172.21.15.97:0/469017057 >> v2:172.21.15.143:3300/0 conn(0x7f66301524e0 0x7f663006d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 >> v1:172.21.15.143:6789/0 conn(0x7f66300c1e70 legacy=0x7f66300a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300aa7e0 con 0x7f663006c440 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f6618001680 con 0x7f663006c440 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 >> v1:172.21.15.97:6789/0 conn(0x7f663006c440 legacy=0x7f663006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f661c003980 0x7f661c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 0x7f661c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c005050 0x7f661c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663006c0c0 con 0x7f661c004380 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c00bfb0 con 0x7f661c005050 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c00c170 con 0x7f661c003980 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 0x7f661c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662f7fe640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f661c003980 0x7f661c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662ffff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c005050 0x7f661c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 -- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f661c003980 msgr2=0x7f661c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f661c003980 0x7f661c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 -- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c005050 msgr2=0x7f661c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c005050 0x7f661c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f6627fff640 1 -- 172.21.15.97:0/469017057 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c003530 con 0x7f661c004380 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662ffff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c005050 0x7f661c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:15.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.606+0000 7f662ffff640 1 -- 172.21.15.97:0/469017057 reap_dead start 2023-12-04T05:38:15.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6627fff640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 0x7f661c004850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f661800c190 tx=0x7f661801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd6e991b9a8bea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:15.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618005ae0 con 0x7f661c004380 2023-12-04T05:38:15.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618005c60 con 0x7f661c004380 2023-12-04T05:38:15.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f662effd640 1 -- 172.21.15.97:0/469017057 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180a5ac0 con 0x7f661c004380 2023-12-04T05:38:15.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 msgr2=0x7f661c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 0x7f661c004850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f661800c190 tx=0x7f661801cb80 comp rx=0 tx=0).stop 2023-12-04T05:38:15.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- 172.21.15.97:0/469017057 shutdown_connections 2023-12-04T05:38:15.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 --2- 172.21.15.97:0/469017057 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f661c004380 0x7f661c004850 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- 172.21.15.97:0/469017057 >> 172.21.15.97:0/469017057 conn(0x7f66300c5e70 msgr2=0x7f66300c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:15.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- 172.21.15.97:0/469017057 shutdown_connections 2023-12-04T05:38:15.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- 172.21.15.97:0/469017057 wait complete. 2023-12-04T05:38:15.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 Processor -- start 2023-12-04T05:38:15.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.610+0000 7f6635b2a640 1 -- start start 2023-12-04T05:38:15.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 0x7f66301e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 0x7f663014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663014cba0 con 0x7f66301e77a0 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6630141020 con 0x7f661c004380 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663014cdf0 con 0x7f663014de90 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36694/0 (socket says 172.21.15.97:36694) 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 -- 172.21.15.97:0/1485073919 learned_addr learned my addr 172.21.15.97:0/1485073919 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662f7fe640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 0x7f66301e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662ffff640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 0x7f663014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 -- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 msgr2=0x7f663014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 0x7f663014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 -- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 msgr2=0x7f66301e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 0x7f66301e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 -- 172.21.15.97:0/1485073919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663014d0d0 con 0x7f66301e77a0 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662f7fe640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 0x7f66301e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:15.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662ffff640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 0x7f663014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:15.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6627fff640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f661801c9b0 tx=0x7f661c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:15.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180b4070 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66180a5a90 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663014cba0 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180a5e00 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663014d690 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6630068440 con 0x7f66301e77a0 2023-12-04T05:38:15.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.614+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6618007070 con 0x7f66301e77a0 2023-12-04T05:38:15.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.618+0000 7f662cff9640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 0x7f6610068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:15.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.618+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f661811e300 con 0x7f66301e77a0 2023-12-04T05:38:15.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.618+0000 7f662f7fe640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 0x7f6610068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:15.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.618+0000 7f662f7fe640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 0x7f6610068d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c10 tx=0x7f6620007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:15.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.622+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66180eb870 con 0x7f66301e77a0 2023-12-04T05:38:15.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.770+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f663006c220 con 0x7f66301e77a0 2023-12-04T05:38:15.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.774+0000 7f662cff9640 1 -- 172.21.15.97:0/1485073919 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66180eee90 con 0x7f66301e77a0 2023-12-04T05:38:15.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 msgr2=0x7f6610068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 0x7f6610068d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c10 tx=0x7f6620007cd0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 msgr2=0x7f6630140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f661801c9b0 tx=0x7f661c005800 comp rx=0 tx=0).stop 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 shutdown_connections 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66100668d0 0x7f6610068d90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663014de90 0x7f663014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66301e77a0 0x7f6630140ae0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 --2- 172.21.15.97:0/1485073919 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f661c004380 0x7f66301e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 >> 172.21.15.97:0/1485073919 conn(0x7f66300c5e70 msgr2=0x7f6630151330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 shutdown_connections 2023-12-04T05:38:15.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:15.778+0000 7f6635b2a640 1 -- 172.21.15.97:0/1485073919 wait complete. 2023-12-04T05:38:15.801 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:38:15.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:38:15.847 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:38:15.930 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:38:15.931 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:15.931 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:15.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:38:15.940 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:15.940 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:15.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:38:15.950 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-04T05:38:15.950 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:16.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.113+0000 7f591cdb8640 1 Processor -- start 2023-12-04T05:38:16.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.113+0000 7f591cdb8640 1 -- start start 2023-12-04T05:38:16.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591cdb8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f591806be00 0x7f591806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:16.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591cdb8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5918152300 con 0x7f591814e970 2023-12-04T05:38:16.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591cdb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5918071580 con 0x7f591806ca50 2023-12-04T05:38:16.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591cdb8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591814ed50 con 0x7f591806be00 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f591814e970 0x7f5918071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46662/0 (socket says 172.21.15.97:46662) 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f591659c640 1 -- 172.21.15.97:0/2290404523 learned_addr learned my addr 172.21.15.97:0/2290404523 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f590dd9b640 1 --2- 172.21.15.97:0/2290404523 >> v2:172.21.15.143:3300/0 conn(0x7f591806be00 0x7f591806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f5915d9b640 1 -- 172.21.15.97:0/2290404523 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838621551 0 0) 0x7f59080014a0 con 0x7f591814e970 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f5915d9b640 1 -- 172.21.15.97:0/2290404523 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5904003530 con 0x7f591814e970 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f590dd9b640 1 -- 172.21.15.97:0/2290404523 >> v1:172.21.15.143:6789/0 conn(0x7f591806ca50 legacy=0x7f59180c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f590dd9b640 1 -- 172.21.15.97:0/2290404523 >> v1:172.21.15.97:6789/0 conn(0x7f591814e970 legacy=0x7f5918071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.117+0000 7f590dd9b640 1 -- 172.21.15.97:0/2290404523 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918151d60 con 0x7f591806be00 2023-12-04T05:38:16.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f590dd9b640 1 --2- 172.21.15.97:0/2290404523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591806be00 0x7f591806e150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59000097c0 tx=0x7f590001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d2263a384eedde4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:16.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f5915d9b640 1 -- 172.21.15.97:0/2290404523 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000ab5f0 con 0x7f591806be00 2023-12-04T05:38:16.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f5915d9b640 1 -- 172.21.15.97:0/2290404523 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59000ab750 con 0x7f591806be00 2023-12-04T05:38:16.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f5915d9b640 1 -- 172.21.15.97:0/2290404523 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000abae0 con 0x7f591806be00 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- 172.21.15.97:0/2290404523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591806be00 msgr2=0x7f591806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 --2- 172.21.15.97:0/2290404523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591806be00 0x7f591806e150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59000097c0 tx=0x7f590001c3f0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- 172.21.15.97:0/2290404523 shutdown_connections 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 --2- 172.21.15.97:0/2290404523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591806be00 0x7f591806e150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- 172.21.15.97:0/2290404523 >> 172.21.15.97:0/2290404523 conn(0x7f59180c2970 msgr2=0x7f59180c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- 172.21.15.97:0/2290404523 shutdown_connections 2023-12-04T05:38:16.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- 172.21.15.97:0/2290404523 wait complete. 2023-12-04T05:38:16.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 Processor -- start 2023-12-04T05:38:16.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.121+0000 7f591cdb8640 1 -- start start 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f591806ca50 0x7f59181552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591814c730 0x7f5918144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5918156780 con 0x7f591814e970 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59181545b0 con 0x7f591814c730 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59181ee990 con 0x7f591806ca50 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36700/0 (socket says 172.21.15.97:36700) 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 -- 172.21.15.97:0/481673203 learned_addr learned my addr 172.21.15.97:0/481673203 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f5916d9d640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591814c730 0x7f5918144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:16.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591659c640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f591806ca50 0x7f59181552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 -- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f591806ca50 msgr2=0x7f59181552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f591806ca50 0x7f59181552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 -- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591814c730 msgr2=0x7f5918144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591814c730 0x7f5918144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 -- 172.21.15.97:0/481673203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009420 con 0x7f591814e970 2023-12-04T05:38:16.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590dd9b640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f590001c8d0 tx=0x7f590001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900004230 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900004390 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900003860 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59181547d0 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5918154d90 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.125+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5918154f80 con 0x7f591814e970 2023-12-04T05:38:16.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.129+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f59000039c0 con 0x7f591814e970 2023-12-04T05:38:16.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.129+0000 7f590f7fe640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 0x7f58f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:16.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.129+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f59000a8050 con 0x7f591814e970 2023-12-04T05:38:16.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.129+0000 7f591659c640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 0x7f58f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:16.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.129+0000 7f591659c640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 0x7f58f8068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5908001600 tx=0x7f5908009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:16.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.133+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59000ebe10 con 0x7f591814e970 2023-12-04T05:38:16.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.313+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5918068440 con 0x7f591814e970 2023-12-04T05:38:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.313+0000 7f590f7fe640 1 -- 172.21.15.97:0/481673203 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f59000c4e90 con 0x7f591814e970 2023-12-04T05:38:16.320 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:16.320 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/1738791552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":1738791552},{"type":"v1","addr":"172.21.15.143:6834","nonce":1738791552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2644738313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2644738313},{"type":"v1","addr":"172.21.15.143:6835","nonce":2644738313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5583,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6836/1418854271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":1418854271},{"type":"v1","addr":"172.21.15.97:6836","nonce":1418854271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":5673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4198588901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6835","nonce":4198588901},{"type":"v1","addr":"172.21.15.97:6837","nonce":4198588901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-12-04T05:38:16.320 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 26 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 msgr2=0x7f58f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 0x7f58f8068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5908001600 tx=0x7f5908009040 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 msgr2=0x7f59181ebd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f590001c8d0 tx=0x7f590001ac30 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 shutdown_connections 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f58f80668d0 0x7f58f8068d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f591814c730 0x7f5918144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f591814e970 0x7f59181ebd50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 --2- 172.21.15.97:0/481673203 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f591806ca50 0x7f59181552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 >> 172.21.15.97:0/481673203 conn(0x7f59180c2970 msgr2=0x7f591806ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 shutdown_connections 2023-12-04T05:38:16.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:16.317+0000 7f591cdb8640 1 -- 172.21.15.97:0/481673203 wait complete. 2023-12-04T05:38:16.341 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T05:38:16.341 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-04T05:38:16.341 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-04T05:38:16.342 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:38:16.342 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T05:38:16.342 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-04T05:38:16.342 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-04T05:38:16.342 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:38:16.342 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T05:38:16.342 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-04T05:38:16.343 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-04T05:38:16.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:38:16.343 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T05:38:16.343 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-04T05:38:16.343 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-04T05:38:16.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:38:16.356 INFO:tasks.ceph.mds.c:Stopped 2023-12-04T05:38:16.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T05:38:16.359 INFO:tasks.ceph.mds.b:Stopped 2023-12-04T05:38:16.359 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T05:38:16.359 INFO:tasks.ceph.mds.d:Stopped 2023-12-04T05:38:16.360 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T05:38:16.407 INFO:tasks.ceph.mds.b:Started 2023-12-04T05:38:16.407 DEBUG:teuthology.parallel:result is None 2023-12-04T05:38:16.408 INFO:tasks.ceph.mds.c:Started 2023-12-04T05:38:16.408 DEBUG:teuthology.parallel:result is None 2023-12-04T05:38:16.409 INFO:tasks.ceph.mds.d:Started 2023-12-04T05:38:16.409 DEBUG:teuthology.parallel:result is None 2023-12-04T05:38:16.491 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:38:16.503 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-04T05:38:16.504 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-04T05:38:21.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-04T05:38:22.356 INFO:tasks.ceph.mds.a:Stopped 2023-12-04T05:38:22.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T05:38:22.361 INFO:tasks.ceph.mds.a:Started 2023-12-04T05:38:22.362 DEBUG:teuthology.parallel:result is None 2023-12-04T05:38:22.362 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-04T05:38:22.455 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:38:22.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 Processor -- start 2023-12-04T05:38:22.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 -- start start 2023-12-04T05:38:22.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f547c06c440 0x7f547c0a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0aa240 con 0x7f547c0a89a0 2023-12-04T05:38:22.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c06c0c0 con 0x7f547c06c440 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548438d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0aa500 con 0x7f547c0c1e70 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481928640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f547c06c440 0x7f547c0a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548292a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f547c0a89a0 0x7f547c06d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46690/0 (socket says 172.21.15.97:46690) 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f548292a640 1 -- 172.21.15.97:0/1561185071 learned_addr learned my addr 172.21.15.97:0/1561185071 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5482129640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:22.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481928640 1 -- 172.21.15.97:0/1561185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 msgr2=0x7f547c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:22.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481928640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:22.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481928640 1 -- 172.21.15.97:0/1561185071 >> v1:172.21.15.97:6789/0 conn(0x7f547c0a89a0 legacy=0x7f547c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:22.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481127640 1 -- 172.21.15.97:0/1561185071 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383179680 0 0) 0x7f547c0aa240 con 0x7f547c0a89a0 2023-12-04T05:38:22.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.509+0000 7f5481928640 1 -- 172.21.15.97:0/1561185071 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0aa7e0 con 0x7f547c06c440 2023-12-04T05:38:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f5481928640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c0a8460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78e4446dc12daff server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f5481127640 1 -- 172.21.15.97:0/1561185071 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0ab650 con 0x7f547c06c440 2023-12-04T05:38:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f5481127640 1 -- 172.21.15.97:0/1561185071 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c0ab7b0 con 0x7f547c06c440 2023-12-04T05:38:22.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f5481127640 1 -- 172.21.15.97:0/1561185071 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0abb40 con 0x7f547c06c440 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 -- 172.21.15.97:0/1561185071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 msgr2=0x7f547c0a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c0a8460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c450 comp rx=0 tx=0).stop 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 -- 172.21.15.97:0/1561185071 shutdown_connections 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c0a8460 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 --2- 172.21.15.97:0/1561185071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:22.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 -- 172.21.15.97:0/1561185071 >> 172.21.15.97:0/1561185071 conn(0x7f547c0c5e70 msgr2=0x7f547c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 -- 172.21.15.97:0/1561185071 shutdown_connections 2023-12-04T05:38:22.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.513+0000 7f548438d640 1 -- 172.21.15.97:0/1561185071 wait complete. 2023-12-04T05:38:22.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 Processor -- start 2023-12-04T05:38:22.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- start start 2023-12-04T05:38:22.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f547c0a89a0 0x7f547c1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c151c50 con 0x7f547c06c440 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14d200 con 0x7f547c0a89a0 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c14d970 con 0x7f547c0c1e70 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36746/0 (socket says 172.21.15.97:36746) 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 -- 172.21.15.97:0/3091983844 learned_addr learned my addr 172.21.15.97:0/3091983844 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 -- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 msgr2=0x7f547c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5481928640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f547c0a89a0 0x7f547c1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 -- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f547c0a89a0 msgr2=0x7f547c1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f547c0a89a0 0x7f547c1511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 -- 172.21.15.97:0/3091983844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009420 con 0x7f547c06c440 2023-12-04T05:38:22.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5482129640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f547800e870 tx=0x7f547800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478009510 con 0x7f547c06c440 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800eec0 con 0x7f547c06c440 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800cb40 con 0x7f547c06c440 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0c23d0 con 0x7f547c06c440 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c149a80 con 0x7f547c06c440 2023-12-04T05:38:22.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.517+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c149c70 con 0x7f547c06c440 2023-12-04T05:38:22.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.521+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f547800cca0 con 0x7f547c06c440 2023-12-04T05:38:22.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.521+0000 7f5472ffd640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 0x7f5460068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:22.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.521+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f54780842c0 con 0x7f547c06c440 2023-12-04T05:38:22.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.521+0000 7f5481928640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 0x7f5460068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:22.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.521+0000 7f5481928640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 0x7f5460068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f546c0af000 tx=0x7f546c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:22.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.525+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54780517b0 con 0x7f547c06c440 2023-12-04T05:38:22.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:22.685+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f547c068440 con 0x7f547c06c440 2023-12-04T05:38:24.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f5472ffd640 1 -- 172.21.15.97:0/3091983844 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5478054dd0 con 0x7f547c06c440 2023-12-04T05:38:24.297 INFO:teuthology.orchestra.run.smithi097.stderr: removed all blocklist entries 2023-12-04T05:38:24.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 msgr2=0x7f5460068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 0x7f5460068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f546c0af000 tx=0x7f546c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:24.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 msgr2=0x7f547c1ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f547800e870 tx=0x7f547800ec70 comp rx=0 tx=0).stop 2023-12-04T05:38:24.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 shutdown_connections 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f54600668d0 0x7f5460068d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f547c0c1e70 0x7f547c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f547c0a89a0 0x7f547c1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 --2- 172.21.15.97:0/3091983844 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f547c06c440 0x7f547c1ed930 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 >> 172.21.15.97:0/3091983844 conn(0x7f547c0c5e70 msgr2=0x7f547c0bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 shutdown_connections 2023-12-04T05:38:24.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.293+0000 7f548438d640 1 -- 172.21.15.97:0/3091983844 wait complete. 2023-12-04T05:38:24.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-04T05:38:24.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 Processor -- start 2023-12-04T05:38:24.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 -- start start 2023-12-04T05:38:24.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7aa813d1f0 0x7f7aa80ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa80c48b0 0x7f7aa80c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa80c9960 con 0x7f7aa80cab80 2023-12-04T05:38:24.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa8155120 con 0x7f7aa813d1f0 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7ab0417640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa813d920 con 0x7f7aa80c48b0 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7aae1b3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7aa813d1f0 0x7f7aa80ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7aae9b4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7aa80cab80 0x7f7aa8157c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59114/0 (socket says 172.21.15.97:59114) 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7aae9b4640 1 -- 172.21.15.97:0/3520247706 learned_addr learned my addr 172.21.15.97:0/3520247706 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.457+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3520247706 >> v2:172.21.15.97:3300/0 conn(0x7f7aa813d1f0 0x7f7aa80ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39840/0 (socket says 172.21.15.97:39840) 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aad9b2640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa80c48b0 0x7f7aa80c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aae1b3640 1 -- 172.21.15.97:0/3520247706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa80c48b0 msgr2=0x7f7aa80c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa80c48b0 0x7f7aa80c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aae1b3640 1 -- 172.21.15.97:0/3520247706 >> v1:172.21.15.97:6789/0 conn(0x7f7aa80cab80 legacy=0x7f7aa8157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aae1b3640 1 -- 172.21.15.97:0/3520247706 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8154a60 con 0x7f7aa813d1f0 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa813d1f0 0x7f7aa80ca640 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097c0 tx=0x7f7aa401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13b390f4954d417 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aad1b1640 1 -- 172.21.15.97:0/3520247706 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004230 con 0x7f7aa813d1f0 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aad1b1640 1 -- 172.21.15.97:0/3520247706 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa40a7050 con 0x7f7aa813d1f0 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7aad1b1640 1 -- 172.21.15.97:0/3520247706 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4003620 con 0x7f7aa813d1f0 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7ab0417640 1 -- 172.21.15.97:0/3520247706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa813d1f0 msgr2=0x7f7aa80ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.461+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa813d1f0 0x7f7aa80ca640 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097c0 tx=0x7f7aa401c330 comp rx=0 tx=0).stop 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- 172.21.15.97:0/3520247706 shutdown_connections 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa80c48b0 0x7f7aa80c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3520247706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa813d1f0 0x7f7aa80ca640 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- 172.21.15.97:0/3520247706 >> 172.21.15.97:0/3520247706 conn(0x7f7aa80ac160 msgr2=0x7f7aa80c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- 172.21.15.97:0/3520247706 shutdown_connections 2023-12-04T05:38:24.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- 172.21.15.97:0/3520247706 wait complete. 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 Processor -- start 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- start start 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aa80c48b0 0x7f7aa8156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa813d1f0 0x7f7aa8137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8157840 con 0x7f7aa80cab80 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80a9e90 con 0x7f7aa80c48b0 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa81ee000 con 0x7f7aa813d1f0 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39846/0 (socket says 172.21.15.97:39846) 2023-12-04T05:38:24.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 -- 172.21.15.97:0/3264136696 learned_addr learned my addr 172.21.15.97:0/3264136696 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aa80c48b0 0x7f7aa8156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aae9b4640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa813d1f0 0x7f7aa8137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 -- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa813d1f0 msgr2=0x7f7aa8137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa813d1f0 0x7f7aa8137d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 -- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aa80c48b0 msgr2=0x7f7aa8156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aa80c48b0 0x7f7aa8156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 -- 172.21.15.97:0/3264136696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009420 con 0x7f7aa80cab80 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7aad9b2640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800d800 tx=0x7f7a9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800b6c0 con 0x7f7aa80cab80 2023-12-04T05:38:24.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800b820 con 0x7f7aa80cab80 2023-12-04T05:38:24.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8157a90 con 0x7f7aa80cab80 2023-12-04T05:38:24.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.465+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800bbb0 con 0x7f7aa80cab80 2023-12-04T05:38:24.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa8157270 con 0x7f7aa80cab80 2023-12-04T05:38:24.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa8068440 con 0x7f7aa80cab80 2023-12-04T05:38:24.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7a9800bd10 con 0x7f7aa80cab80 2023-12-04T05:38:24.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7a9effd640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 0x7f7a8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a98084560 con 0x7f7aa80cab80 2023-12-04T05:38:24.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 0x7f7a8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.469+0000 7f7aae1b3640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 0x7f7a8c068d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40ad000 tx=0x7f7aa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.473+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a98051b80 con 0x7f7aa80cab80 2023-12-04T05:38:24.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7aa80c5230 con 0x7f7aa80cab80 2023-12-04T05:38:24.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7a9effd640 1 -- 172.21.15.97:0/3264136696 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f7a980551a0 con 0x7f7aa80cab80 2023-12-04T05:38:24.681 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:24.681 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_dump": [ 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.a", 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lOIFILRAAicRg3crgxeVlsV7NM1n7mw==", 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.b", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lYdJoOhAA/pXezZGzriXfC7PkJPYzxw==", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.c", 2023-12-04T05:38:24.683 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ljoayNBAA5Quugau8ZuP7purlpz5Ilw==", 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.d", 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l86FvBhAARfh7Pfe7OxC55XiemjCXYw==", 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:38:24.685 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.686 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.0", 2023-12-04T05:38:24.686 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQArZW1lgv9DGxAAESL7fT3cBtlDP3ZL+8SiEQ==", 2023-12-04T05:38:24.687 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.1", 2023-12-04T05:38:24.688 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAuZW1lpkkDIxAAemUKa7Rs4XiY7eaOnzCZRw==", 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.2", 2023-12-04T05:38:24.689 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAxZW1lsGxCKRAAVWWNEXg7H3hUauiE4BtjfA==", 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.3", 2023-12-04T05:38:24.690 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA0ZW1lUFbXLxAA2YUaH5LIpJU8Qq2k64ARFg==", 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.691 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.4", 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA6ZW1lJsdpOxAAtvDjgGrfndThS7iJdSYxZA==", 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.5", 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA+ZW1lZzyUBhAAwZO11IA60hqFX9N9osxCXA==", 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.6", 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBBZW1lZbuLDRAAPQBdTdQHhezNoymtejlsvA==", 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.7", 2023-12-04T05:38:24.694 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBEZW1l1q8+ExAAaoF2kTbzNXGmjW03HTVXeA==", 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.0", 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg==", 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow r", 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-04T05:38:24.696 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.1", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ==", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow r", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.admin", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ly44ACxAA1iafTImcOQmxRzlURmohcw==", 2023-12-04T05:38:24.698 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.testuser", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQCvZW1lThC4MBAAY6a1XqIxBM7+DT8ZGNNK2w==", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow rw fsname=cephfs", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow r fsname=cephfs", 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-04T05:38:24.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.x", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lLP/pKBAA0n+KwZOZL9N93B4cduwStQ==", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.y", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1l8dDaJBAANHBgEjKz2FTTo8OrJVB1pw==", 2023-12-04T05:38:24.700 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-12-04T05:38:24.701 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:38:24.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 msgr2=0x7f7a8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 0x7f7a8c068d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40ad000 tx=0x7f7aa4008040 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 msgr2=0x7f7aa8137820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800d800 tx=0x7f7a9800dcc0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 shutdown_connections 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a8c0668d0 0x7f7a8c068d90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7aa813d1f0 0x7f7aa8137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7aa80cab80 0x7f7aa8137820 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 --2- 172.21.15.97:0/3264136696 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7aa80c48b0 0x7f7aa8156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 >> 172.21.15.97:0/3264136696 conn(0x7f7aa80ac160 msgr2=0x7f7aa813c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 shutdown_connections 2023-12-04T05:38:24.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.677+0000 7f7ab0417640 1 -- 172.21.15.97:0/3264136696 wait complete. 2023-12-04T05:38:24.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-04T05:38:24.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 Processor -- start 2023-12-04T05:38:24.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 -- start start 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b9c14e700 0x7f0b9c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0b9c0bd720 0x7f0b9c158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0cad70 con 0x7f0b9c155160 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c158cd0 con 0x7f0b9c14e700 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba352a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c155630 con 0x7f0b9c0bd720 2023-12-04T05:38:24.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b9c14e700 0x7f0b9c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b9c14e700 0x7f0b9c0c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39852/0 (socket says 172.21.15.97:39852) 2023-12-04T05:38:24.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 -- 172.21.15.97:0/367007409 learned_addr learned my addr 172.21.15.97:0/367007409 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:24.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba1ac7640 1 --2- 172.21.15.97:0/367007409 >> v2:172.21.15.143:3300/0 conn(0x7f0b9c0bd720 0x7f0b9c158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 -- 172.21.15.97:0/367007409 >> v2:172.21.15.143:3300/0 conn(0x7f0b9c0bd720 msgr2=0x7f0b9c158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:24.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 --2- 172.21.15.97:0/367007409 >> v2:172.21.15.143:3300/0 conn(0x7f0b9c0bd720 0x7f0b9c158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 -- 172.21.15.97:0/367007409 >> v1:172.21.15.143:6789/0 conn(0x7f0b9c155160 legacy=0x7f0b9c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.837+0000 7f0ba12c6640 1 -- 172.21.15.97:0/367007409 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0ca4d0 con 0x7f0b9c14e700 2023-12-04T05:38:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba12c6640 1 --2- 172.21.15.97:0/367007409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c0c4a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faac5972a79b8782 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0b93fff640 1 -- 172.21.15.97:0/367007409 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b980ac410 con 0x7f0b9c14e700 2023-12-04T05:38:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0b93fff640 1 -- 172.21.15.97:0/367007409 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b980ac570 con 0x7f0b9c14e700 2023-12-04T05:38:24.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0b93fff640 1 -- 172.21.15.97:0/367007409 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b980ac900 con 0x7f0b9c14e700 2023-12-04T05:38:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 -- 172.21.15.97:0/367007409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 msgr2=0x7f0b9c0c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 --2- 172.21.15.97:0/367007409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c0c4a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009870 tx=0x7f0b9801c3b0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 -- 172.21.15.97:0/367007409 shutdown_connections 2023-12-04T05:38:24.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 --2- 172.21.15.97:0/367007409 >> v2:172.21.15.143:3300/0 conn(0x7f0b9c0bd720 0x7f0b9c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 --2- 172.21.15.97:0/367007409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c0c4a10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 -- 172.21.15.97:0/367007409 >> 172.21.15.97:0/367007409 conn(0x7f0b9c073720 msgr2=0x7f0b9c073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 -- 172.21.15.97:0/367007409 shutdown_connections 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.841+0000 7f0ba352a640 1 -- 172.21.15.97:0/367007409 wait complete. 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 Processor -- start 2023-12-04T05:38:24.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 -- start start 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b9c0bd720 0x7f0b9c1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b9c155160 0x7f0b9c1f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0c3ed0 con 0x7f0b9c14e700 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c156990 con 0x7f0b9c155160 2023-12-04T05:38:24.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c156d40 con 0x7f0b9c0bd720 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39854/0 (socket says 172.21.15.97:39854) 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 -- 172.21.15.97:0/2177975111 learned_addr learned my addr 172.21.15.97:0/2177975111 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba12c6640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b9c0bd720 0x7f0b9c1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba1ac7640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b9c155160 0x7f0b9c1f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 -- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b9c0bd720 msgr2=0x7f0b9c1451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b9c0bd720 0x7f0b9c1451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 -- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b9c155160 msgr2=0x7f0b9c1f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b9c155160 0x7f0b9c1f0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 -- 172.21.15.97:0/2177975111 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980094d0 con 0x7f0b9c14e700 2023-12-04T05:38:24.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba0ac5640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c430 tx=0x7f0b8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0052d0 con 0x7f0b9c14e700 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c005430 con 0x7f0b9c14e700 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c157020 con 0x7f0b9c14e700 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.845+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c003860 con 0x7f0b9c14e700 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c14d070 con 0x7f0b9c14e700 2023-12-04T05:38:24.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c1574d0 con 0x7f0b9c14e700 2023-12-04T05:38:24.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0b8c0039c0 con 0x7f0b9c14e700 2023-12-04T05:38:24.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0b91ffb640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 0x7f0b80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:24.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b8c083600 con 0x7f0b9c14e700 2023-12-04T05:38:24.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0ba12c6640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 0x7f0b80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:24.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.849+0000 7f0ba12c6640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 0x7f0b80068d90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0b980ae000 tx=0x7f0b98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:24.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:24.853+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b8c050c30 con 0x7f0b9c14e700 2023-12-04T05:38:25.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.053+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f0b9c068440 con 0x7f0b9c14e700 2023-12-04T05:38:25.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0b91ffb640 1 -- 172.21.15.97:0/2177975111 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+0 (secure 0 0 0) 0x7f0b8c054250 con 0x7f0b9c14e700 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 msgr2=0x7f0b80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 0x7f0b80068d90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0b980ae000 tx=0x7f0b98009040 comp rx=0 tx=0).stop 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 msgr2=0x7f0b9c14cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c430 tx=0x7f0b8c00c8f0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 shutdown_connections 2023-12-04T05:38:25.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b800668d0 0x7f0b80068d90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b9c155160 0x7f0b9c1f0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b9c14e700 0x7f0b9c14cb30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 --2- 172.21.15.97:0/2177975111 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b9c0bd720 0x7f0b9c1451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 >> 172.21.15.97:0/2177975111 conn(0x7f0b9c073720 msgr2=0x7f0b9c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 shutdown_connections 2023-12-04T05:38:25.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.057+0000 7f0ba352a640 1 -- 172.21.15.97:0/2177975111 wait complete. 2023-12-04T05:38:25.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:25.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 Processor -- start 2023-12-04T05:38:25.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 -- start start 2023-12-04T05:38:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 0x7ff52c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c154680 con 0x7ff52c0c72b0 2023-12-04T05:38:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c0afa10 con 0x7ff52c0c4d50 2023-12-04T05:38:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53237d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c154960 con 0x7ff52c0af630 2023-12-04T05:38:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53137b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff530b7a640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7ff52c0c72b0 0x7ff52c06b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:53734/0 (socket says 172.21.15.97:53734) 2023-12-04T05:38:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff530b7a640 1 -- 172.21.15.97:0/3700707642 learned_addr learned my addr 172.21.15.97:0/3700707642 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff531b7c640 1 --2- 172.21.15.97:0/3700707642 >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 0x7ff52c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff523fff640 1 -- 172.21.15.97:0/3700707642 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608546814 0 0) 0x7ff52c154680 con 0x7ff52c0c72b0 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff523fff640 1 -- 172.21.15.97:0/3700707642 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff518003530 con 0x7ff52c0c72b0 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53137b640 1 -- 172.21.15.97:0/3700707642 >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 msgr2=0x7ff52c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53137b640 1 --2- 172.21.15.97:0/3700707642 >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 0x7ff52c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53137b640 1 -- 172.21.15.97:0/3700707642 >> v1:172.21.15.143:6789/0 conn(0x7ff52c0c72b0 legacy=0x7ff52c06b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff53137b640 1 -- 172.21.15.97:0/3700707642 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c154c40 con 0x7ff52c0af630 2023-12-04T05:38:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.221+0000 7ff531b7c640 1 --2- 172.21.15.97:0/3700707642 >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 0x7ff52c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53137b640 1 --2- 172.21.15.97:0/3700707642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c0c4810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097c0 tx=0x7ff52801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478bdd94c0d25a69 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff523fff640 1 -- 172.21.15.97:0/3700707642 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280ab610 con 0x7ff52c0af630 2023-12-04T05:38:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff523fff640 1 -- 172.21.15.97:0/3700707642 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5280ab770 con 0x7ff52c0af630 2023-12-04T05:38:25.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff523fff640 1 -- 172.21.15.97:0/3700707642 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280abb00 con 0x7ff52c0af630 2023-12-04T05:38:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 -- 172.21.15.97:0/3700707642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 msgr2=0x7ff52c0c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 --2- 172.21.15.97:0/3700707642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c0c4810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097c0 tx=0x7ff52801c3f0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 -- 172.21.15.97:0/3700707642 shutdown_connections 2023-12-04T05:38:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 --2- 172.21.15.97:0/3700707642 >> v2:172.21.15.143:3300/0 conn(0x7ff52c0c4d50 0x7ff52c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 --2- 172.21.15.97:0/3700707642 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c0c4810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 -- 172.21.15.97:0/3700707642 >> 172.21.15.97:0/3700707642 conn(0x7ff52c0aba40 msgr2=0x7ff52c0abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 -- 172.21.15.97:0/3700707642 shutdown_connections 2023-12-04T05:38:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.225+0000 7ff53237d640 1 -- 172.21.15.97:0/3700707642 wait complete. 2023-12-04T05:38:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 Processor -- start 2023-12-04T05:38:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- start start 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 0x7ff52c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c14c2b0 con 0x7ff52c0c72b0 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c1f1290 con 0x7ff52c0c4d50 2023-12-04T05:38:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c0c2c40 con 0x7ff52c0af630 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39856/0 (socket says 172.21.15.97:39856) 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 -- 172.21.15.97:0/644548386 learned_addr learned my addr 172.21.15.97:0/644548386 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53137b640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff530b7a640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 0x7ff52c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 -- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 msgr2=0x7ff52c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 -- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 msgr2=0x7ff52c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 0x7ff52c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 -- 172.21.15.97:0/644548386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524009a70 con 0x7ff52c0c72b0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff530b7a640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 0x7ff52c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff531b7c640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff52400efc0 tx=0x7ff52400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524009cd0 con 0x7ff52c0c72b0 2023-12-04T05:38:25.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52400f040 con 0x7ff52c0c72b0 2023-12-04T05:38:25.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240039a0 con 0x7ff52c0c72b0 2023-12-04T05:38:25.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff528009420 con 0x7ff52c0c72b0 2023-12-04T05:38:25.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.229+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c0c2ee0 con 0x7ff52c0c72b0 2023-12-04T05:38:25.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c0c3100 con 0x7ff52c0c72b0 2023-12-04T05:38:25.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff524014480 con 0x7ff52c0c72b0 2023-12-04T05:38:25.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff521ffb640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 0x7ff510068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff524084d00 con 0x7ff52c0c72b0 2023-12-04T05:38:25.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff53137b640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 0x7ff510068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.233+0000 7ff53137b640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 0x7ff510068dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff5280af000 tx=0x7ff5280a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.237+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5240521f0 con 0x7ff52c0c72b0 2023-12-04T05:38:25.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.389+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff52c04e890 con 0x7ff52c0c72b0 2023-12-04T05:38:25.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff521ffb640 1 -- 172.21.15.97:0/644548386 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12845 (secure 0 0 0) 0x7ff524055810 con 0x7ff52c0c72b0 2023-12-04T05:38:25.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:25.397 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":46,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:24.295364+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:25.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 msgr2=0x7ff510068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 0x7ff510068dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff5280af000 tx=0x7ff5280a7000 comp rx=0 tx=0).stop 2023-12-04T05:38:25.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 msgr2=0x7ff52c1f0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff52400efc0 tx=0x7ff52400c490 comp rx=0 tx=0).stop 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 shutdown_connections 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff510066900 0x7ff510068dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff52c0c72b0 0x7ff52c1f0390 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff52c0c4d50 0x7ff52c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 --2- 172.21.15.97:0/644548386 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff52c0af630 0x7ff52c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 >> 172.21.15.97:0/644548386 conn(0x7ff52c0aba40 msgr2=0x7ff52c152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 shutdown_connections 2023-12-04T05:38:25.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.393+0000 7ff53237d640 1 -- 172.21.15.97:0/644548386 wait complete. 2023-12-04T05:38:25.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:25.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:25.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.553+0000 7f4e38e54640 1 Processor -- start 2023-12-04T05:38:25.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.553+0000 7f4e38e54640 1 -- start start 2023-12-04T05:38:25.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e38e54640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 0x7f4e340700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e38e54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e38e54640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e34150bc0 con 0x7f4e3406c000 2023-12-04T05:38:25.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e38e54640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e34154fd0 con 0x7f4e340c1360 2023-12-04T05:38:25.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e38e54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34151a70 con 0x7f4e34154af0 2023-12-04T05:38:25.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:43396/0 (socket says 172.21.15.97:43396) 2023-12-04T05:38:25.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 -- 172.21.15.97:0/2407533279 learned_addr learned my addr 172.21.15.97:0/2407533279 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:25.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e3259c640 1 --2- 172.21.15.97:0/2407533279 >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 0x7f4e340700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e31d9b640 1 -- 172.21.15.97:0/2407533279 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028086443 0 0) 0x7f4e34150bc0 con 0x7f4e3406c000 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e31d9b640 1 -- 172.21.15.97:0/2407533279 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e20003530 con 0x7f4e3406c000 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 -- 172.21.15.97:0/2407533279 >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 msgr2=0x7f4e340700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 --2- 172.21.15.97:0/2407533279 >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 0x7f4e340700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 -- 172.21.15.97:0/2407533279 >> v1:172.21.15.143:6789/0 conn(0x7f4e3406c000 legacy=0x7f4e34151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e32d9d640 1 -- 172.21.15.97:0/2407533279 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34072160 con 0x7f4e34154af0 2023-12-04T05:38:25.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.557+0000 7f4e3259c640 1 --2- 172.21.15.97:0/2407533279 >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 0x7f4e340700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:25.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e32d9d640 1 --2- 172.21.15.97:0/2407533279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77807b98ca64c80d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e31d9b640 1 -- 172.21.15.97:0/2407533279 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0ac600 con 0x7f4e34154af0 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e31d9b640 1 -- 172.21.15.97:0/2407533279 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0a8050 con 0x7f4e34154af0 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e31d9b640 1 -- 172.21.15.97:0/2407533279 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0ac980 con 0x7f4e34154af0 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- 172.21.15.97:0/2407533279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 msgr2=0x7f4e3414dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 --2- 172.21.15.97:0/2407533279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c01c4b0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- 172.21.15.97:0/2407533279 shutdown_connections 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 --2- 172.21.15.97:0/2407533279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e3414dce0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 --2- 172.21.15.97:0/2407533279 >> v2:172.21.15.143:3300/0 conn(0x7f4e340c1360 0x7f4e340700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- 172.21.15.97:0/2407533279 >> 172.21.15.97:0/2407533279 conn(0x7f4e340c5e70 msgr2=0x7f4e340c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- 172.21.15.97:0/2407533279 shutdown_connections 2023-12-04T05:38:25.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- 172.21.15.97:0/2407533279 wait complete. 2023-12-04T05:38:25.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 Processor -- start 2023-12-04T05:38:25.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.561+0000 7f4e38e54640 1 -- start start 2023-12-04T05:38:25.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e340c1360 0x7f4e340c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e341476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341509e0 con 0x7f4e3406c000 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c4510 con 0x7f4e340c1360 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c47f0 con 0x7f4e34154af0 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39868/0 (socket says 172.21.15.97:39868) 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 -- 172.21.15.97:0/3618128928 learned_addr learned my addr 172.21.15.97:0/3618128928 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e32d9d640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e341476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e29d9b640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e340c1360 0x7f4e340c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 -- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 msgr2=0x7f4e341476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e341476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 -- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e340c1360 msgr2=0x7f4e340c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e340c1360 0x7f4e340c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 -- 172.21.15.97:0/3618128928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009a70 con 0x7f4e3406c000 2023-12-04T05:38:25.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e32d9d640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e341476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:25.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e3259c640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400efc0 tx=0x7f4e2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24014680 con 0x7f4e3406c000 2023-12-04T05:38:25.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400f040 con 0x7f4e3406c000 2023-12-04T05:38:25.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24014a00 con 0x7f4e3406c000 2023-12-04T05:38:25.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c0094d0 con 0x7f4e3406c000 2023-12-04T05:38:25.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340c41a0 con 0x7f4e3406c000 2023-12-04T05:38:25.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34068440 con 0x7f4e3406c000 2023-12-04T05:38:25.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.565+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e24014b60 con 0x7f4e3406c000 2023-12-04T05:38:25.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.569+0000 7f4e2b7fe640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 0x7f4e14068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.569+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e240851f0 con 0x7f4e3406c000 2023-12-04T05:38:25.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.569+0000 7f4e29d9b640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 0x7f4e14068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.569+0000 7f4e29d9b640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 0x7f4e14068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e341493e0 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.573+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e24052780 con 0x7f4e3406c000 2023-12-04T05:38:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.721+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e34070940 con 0x7f4e3406c000 2023-12-04T05:38:25.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.721+0000 7f4e2b7fe640 1 -- 172.21.15.97:0/3618128928 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e24055da0 con 0x7f4e3406c000 2023-12-04T05:38:25.728 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:25.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 msgr2=0x7f4e14068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 0x7f4e14068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e341493e0 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2023-12-04T05:38:25.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 msgr2=0x7f4e340c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400efc0 tx=0x7f4e2400c490 comp rx=0 tx=0).stop 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 shutdown_connections 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4e140668d0 0x7f4e14068d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e34154af0 0x7f4e341476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e340c1360 0x7f4e340c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 --2- 172.21.15.97:0/3618128928 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4e3406c000 0x7f4e340c28b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 >> 172.21.15.97:0/3618128928 conn(0x7f4e340c5e70 msgr2=0x7f4e340c62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 shutdown_connections 2023-12-04T05:38:25.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.725+0000 7f4e38e54640 1 -- 172.21.15.97:0/3618128928 wait complete. 2023-12-04T05:38:25.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:38:25.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.881+0000 7f7e0dc9c640 1 Processor -- start 2023-12-04T05:38:25.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.881+0000 7f7e0dc9c640 1 -- start start 2023-12-04T05:38:25.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e0dc9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 0x7f7e080c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e0dc9c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7e08157da0 0x7f7e08158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e0dc9c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080739b0 con 0x7f7e0806b860 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e0dc9c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080c15a0 con 0x7f7e08157da0 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e0dc9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e08155220 con 0x7f7e080c1030 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7e08157da0 0x7f7e08158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7e08157da0 0x7f7e08158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39872/0 (socket says 172.21.15.97:39872) 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 -- 172.21.15.97:0/2032324859 learned_addr learned my addr 172.21.15.97:0/2032324859 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7dfffff640 1 --2- 172.21.15.97:0/2032324859 >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 0x7f7e080c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 -- 172.21.15.97:0/2032324859 >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 msgr2=0x7f7e080c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 --2- 172.21.15.97:0/2032324859 >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 0x7f7e080c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 -- 172.21.15.97:0/2032324859 >> v1:172.21.15.143:6789/0 conn(0x7f7e0806b860 legacy=0x7f7e08151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 -- 172.21.15.97:0/2032324859 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08155710 con 0x7f7e08157da0 2023-12-04T05:38:25.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7dfffff640 1 --2- 172.21.15.97:0/2032324859 >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 0x7f7e080c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:25.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.885+0000 7f7e07fff640 1 --2- 172.21.15.97:0/2032324859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e08157da0 0x7f7e08158250 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7e080aba00 tx=0x7f7e0001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ccdbfa03fe50f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e06ffd640 1 -- 172.21.15.97:0/2032324859 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000a56d0 con 0x7f7e08157da0 2023-12-04T05:38:25.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e06ffd640 1 -- 172.21.15.97:0/2032324859 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e000a5830 con 0x7f7e08157da0 2023-12-04T05:38:25.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e06ffd640 1 -- 172.21.15.97:0/2032324859 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e000a5bc0 con 0x7f7e08157da0 2023-12-04T05:38:25.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/2032324859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e08157da0 msgr2=0x7f7e08158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/2032324859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e08157da0 0x7f7e08158250 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7e080aba00 tx=0x7f7e0001c900 comp rx=0 tx=0).stop 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/2032324859 shutdown_connections 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/2032324859 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e08157da0 0x7f7e08158250 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/2032324859 >> v2:172.21.15.143:3300/0 conn(0x7f7e080c1030 0x7f7e080c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/2032324859 >> 172.21.15.97:0/2032324859 conn(0x7f7e080c3130 msgr2=0x7f7e080c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/2032324859 shutdown_connections 2023-12-04T05:38:25.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/2032324859 wait complete. 2023-12-04T05:38:25.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 Processor -- start 2023-12-04T05:38:25.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- start start 2023-12-04T05:38:25.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e0806b860 0x7f7e080aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e08157da0 0x7f7e08152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08072700 con 0x7f7e080c1030 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081f0fd0 con 0x7f7e08157da0 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7e0dc9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081534c0 con 0x7f7e0806b860 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7dfffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7dfffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39884/0 (socket says 172.21.15.97:39884) 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.889+0000 7f7dfffff640 1 -- 172.21.15.97:0/3388754817 learned_addr learned my addr 172.21.15.97:0/3388754817 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:25.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e077fe640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e0806b860 0x7f7e080aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e07fff640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e08157da0 0x7f7e08152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 -- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e0806b860 msgr2=0x7f7e080aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e0806b860 0x7f7e080aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 -- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e08157da0 msgr2=0x7f7e08152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e08157da0 0x7f7e08152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 -- 172.21.15.97:0/3388754817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009b30 con 0x7f7e080c1030 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7dfffff640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c7f0 tx=0x7f7df000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000cea0 con 0x7f7e080c1030 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0007a30 con 0x7f7e080c1030 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0007de0 con 0x7f7e080c1030 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e080ab6d0 con 0x7f7e080c1030 2023-12-04T05:38:25.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08070fe0 con 0x7f7e080c1030 2023-12-04T05:38:25.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e080abbf0 con 0x7f7e080c1030 2023-12-04T05:38:25.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.893+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7df00113f0 con 0x7f7e080c1030 2023-12-04T05:38:25.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.897+0000 7f7e04ff9640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 0x7f7de8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:25.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.897+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7df0084080 con 0x7f7e080c1030 2023-12-04T05:38:25.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.897+0000 7f7e077fe640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 0x7f7de8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:25.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.897+0000 7f7e077fe640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 0x7f7de8068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e081ea9b0 tx=0x7f7df8007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:25.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:25.901+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e080abbf0 con 0x7f7e080c1030 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e08070e40 con 0x7f7e080c1030 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e04ff9640 1 -- 172.21.15.97:0/3388754817 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7e08070e40 con 0x7f7e080c1030 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:38:26.062 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:38:26.063 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:26.063 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:38:26.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 msgr2=0x7f7de8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 0x7f7de8068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e081ea9b0 tx=0x7f7df8007e40 comp rx=0 tx=0).stop 2023-12-04T05:38:26.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 msgr2=0x7f7e08152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c7f0 tx=0x7f7df000ccb0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 shutdown_connections 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7de80668d0 0x7f7de8068d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e08157da0 0x7f7e08152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e080c1030 0x7f7e08152a40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 --2- 172.21.15.97:0/3388754817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e0806b860 0x7f7e080aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 >> 172.21.15.97:0/3388754817 conn(0x7f7e080c3130 msgr2=0x7f7e081565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:26.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 shutdown_connections 2023-12-04T05:38:26.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.057+0000 7f7e0dc9c640 1 -- 172.21.15.97:0/3388754817 wait complete. 2023-12-04T05:38:26.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T05:38:26.084 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T05:38:26.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 Processor -- start 2023-12-04T05:38:26.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 -- start start 2023-12-04T05:38:26.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff134152b40 0x7ff134158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff1340711f0 0x7ff13406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13406c8c0 con 0x7ff13406c490 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340c3700 con 0x7ff1340711f0 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13bd2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134070d60 con 0x7ff134152b40 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff1340711f0 0x7ff13406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13a2c7640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff13406c490 0x7ff1340c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59116/0 (socket says 172.21.15.97:59116) 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff13a2c7640 1 -- 172.21.15.97:0/3601717496 learned_addr learned my addr 172.21.15.97:0/3601717496 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff1340711f0 0x7ff13406bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39894/0 (socket says 172.21.15.97:39894) 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff139ac6640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff134152b40 0x7ff134158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 -- 172.21.15.97:0/3601717496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff134152b40 msgr2=0x7ff134158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff134152b40 0x7ff134158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 -- 172.21.15.97:0/3601717496 >> v1:172.21.15.97:6789/0 conn(0x7ff13406c490 legacy=0x7ff1340c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.221+0000 7ff1392c5640 1 -- 172.21.15.97:0/3601717496 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134152f20 con 0x7ff1340711f0 2023-12-04T05:38:26.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff1392c5640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1340711f0 0x7ff13406bf50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff12401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8060b7629d3fda server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:26.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff138ac4640 1 -- 172.21.15.97:0/3601717496 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240ac620 con 0x7ff1340711f0 2023-12-04T05:38:26.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff138ac4640 1 -- 172.21.15.97:0/3601717496 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240ac780 con 0x7ff1340711f0 2023-12-04T05:38:26.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff138ac4640 1 -- 172.21.15.97:0/3601717496 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240acb10 con 0x7ff1340711f0 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 -- 172.21.15.97:0/3601717496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1340711f0 msgr2=0x7ff13406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1340711f0 0x7ff13406bf50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff1240097c0 tx=0x7ff12401c3c0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 -- 172.21.15.97:0/3601717496 shutdown_connections 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff1340711f0 0x7ff13406bf50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/3601717496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff134152b40 0x7ff134158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 -- 172.21.15.97:0/3601717496 >> 172.21.15.97:0/3601717496 conn(0x7ff1340c2a50 msgr2=0x7ff1340c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:26.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 -- 172.21.15.97:0/3601717496 shutdown_connections 2023-12-04T05:38:26.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.225+0000 7ff13bd2a640 1 -- 172.21.15.97:0/3601717496 wait complete. 2023-12-04T05:38:26.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 Processor -- start 2023-12-04T05:38:26.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- start start 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 0x7ff1340a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 0x7ff1340ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ab100 con 0x7ff13406c490 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340a8b50 con 0x7ff134152b40 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340aa480 con 0x7ff1340711f0 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39910/0 (socket says 172.21.15.97:39910) 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 -- 172.21.15.97:0/1093837247 learned_addr learned my addr 172.21.15.97:0/1093837247 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13a2c7640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 0x7ff1340ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff1392c5640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 0x7ff1340a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 -- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 msgr2=0x7ff1340a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 0x7ff1340a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 -- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 msgr2=0x7ff1340ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 0x7ff1340ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 -- 172.21.15.97:0/1093837247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009420 con 0x7ff13406c490 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13a2c7640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 0x7ff1340ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff1392c5640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 0x7ff1340a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff139ac6640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d5f0 tx=0x7ff13000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:26.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300125f0 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130012750 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1340aa760 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130012ae0 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340aad20 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.229+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1340ab370 con 0x7ff13406c490 2023-12-04T05:38:26.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.233+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff130012c40 con 0x7ff13406c490 2023-12-04T05:38:26.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.233+0000 7ff12a7fc640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 0x7ff118068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:26.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.233+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff130084500 con 0x7ff13406c490 2023-12-04T05:38:26.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.233+0000 7ff1392c5640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 0x7ff118068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:26.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.233+0000 7ff1392c5640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 0x7ff118068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff1240ae000 tx=0x7ff124008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:26.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.237+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff130051b20 con 0x7ff13406c490 2023-12-04T05:38:26.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:26.389+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff134068440 con 0x7ff13406c490 2023-12-04T05:38:27.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.313+0000 7ff12a7fc640 1 -- 172.21.15.97:0/1093837247 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff130055140 con 0x7ff13406c490 2023-12-04T05:38:27.320 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-12-04T05:38:27.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 msgr2=0x7ff118068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 0x7ff118068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff1240ae000 tx=0x7ff124008040 comp rx=0 tx=0).stop 2023-12-04T05:38:27.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 msgr2=0x7ff13414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff13000d5f0 tx=0x7ff13000dab0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 shutdown_connections 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff1180668d0 0x7ff118068d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff134152b40 0x7ff1340ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff1340711f0 0x7ff1340a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 --2- 172.21.15.97:0/1093837247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff13406c490 0x7ff13414bf50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 >> 172.21.15.97:0/1093837247 conn(0x7ff1340c2a50 msgr2=0x7ff134159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:27.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.317+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 shutdown_connections 2023-12-04T05:38:27.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.321+0000 7ff13bd2a640 1 -- 172.21.15.97:0/1093837247 wait complete. 2023-12-04T05:38:27.351 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:38:27.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 Processor -- start 2023-12-04T05:38:27.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 -- start start 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04b00c1fb0 0x7f04b00c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b0154880 con 0x7f04b0072800 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b006e160 con 0x7f04b0158800 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b86c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b0158c90 con 0x7f04b00c1fb0 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b6465640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04b00c1fb0 0x7f04b00c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b6465640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f04b00c1fb0 0x7f04b00c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39918/0 (socket says 172.21.15.97:39918) 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b6465640 1 -- 172.21.15.97:0/4234929779 learned_addr learned my addr 172.21.15.97:0/4234929779 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:27.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.493+0000 7f04b5c64640 1 --1- 172.21.15.97:0/4234929779 >> v1:172.21.15.97:6789/0 conn(0x7f04b0072800 0x7f04b0155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59118/0 (socket says 172.21.15.97:59118) 2023-12-04T05:38:27.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b6465640 1 -- 172.21.15.97:0/4234929779 >> v1:172.21.15.143:6789/0 conn(0x7f04b0158800 legacy=0x7f04b006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:27.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b6465640 1 -- 172.21.15.97:0/4234929779 >> v1:172.21.15.97:6789/0 conn(0x7f04b0072800 legacy=0x7f04b0155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b6465640 1 -- 172.21.15.97:0/4234929779 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b006e440 con 0x7f04b00c1fb0 2023-12-04T05:38:27.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b6465640 1 --2- 172.21.15.97:0/4234929779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c1fb0 0x7f04b00c10c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009870 tx=0x7f04ac01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27396e943a305e50 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:27.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b5463640 1 -- 172.21.15.97:0/4234929779 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0ab600 con 0x7f04b00c1fb0 2023-12-04T05:38:27.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b5463640 1 -- 172.21.15.97:0/4234929779 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0a7050 con 0x7f04b00c1fb0 2023-12-04T05:38:27.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b5463640 1 -- 172.21.15.97:0/4234929779 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0ab980 con 0x7f04b00c1fb0 2023-12-04T05:38:27.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 -- 172.21.15.97:0/4234929779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c1fb0 msgr2=0x7f04b00c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 --2- 172.21.15.97:0/4234929779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c1fb0 0x7f04b00c10c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009870 tx=0x7f04ac01c3b0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 -- 172.21.15.97:0/4234929779 shutdown_connections 2023-12-04T05:38:27.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 --2- 172.21.15.97:0/4234929779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b00c1fb0 0x7f04b00c10c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 -- 172.21.15.97:0/4234929779 >> 172.21.15.97:0/4234929779 conn(0x7f04b00c31c0 msgr2=0x7f04b00c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:27.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.497+0000 7f04b86c9640 1 -- 172.21.15.97:0/4234929779 shutdown_connections 2023-12-04T05:38:27.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- 172.21.15.97:0/4234929779 wait complete. 2023-12-04T05:38:27.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 Processor -- start 2023-12-04T05:38:27.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- start start 2023-12-04T05:38:27.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:27.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 0x7f04b01421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04b0158800 0x7f04b0142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b013ffd0 con 0x7f04b0072800 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0149740 con 0x7f04b0158800 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b013f730 con 0x7f04b00c1fb0 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39924/0 (socket says 172.21.15.97:39924) 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 -- 172.21.15.97:0/2292163904 learned_addr learned my addr 172.21.15.97:0/2292163904 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6c66640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04b0158800 0x7f04b0142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b5c64640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 0x7f04b01421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 -- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 msgr2=0x7f04b01421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 0x7f04b01421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 -- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04b0158800 msgr2=0x7f04b0142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04b0158800 0x7f04b0142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:27.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 -- 172.21.15.97:0/2292163904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0094d0 con 0x7f04b0072800 2023-12-04T05:38:27.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b5c64640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 0x7f04b01421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:27.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b6465640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0ae040 tx=0x7f04ac019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:27.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b4640 con 0x7f04b0072800 2023-12-04T05:38:27.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0b47a0 con 0x7f04b0072800 2023-12-04T05:38:27.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b4b30 con 0x7f04b0072800 2023-12-04T05:38:27.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b013fa10 con 0x7f04b0072800 2023-12-04T05:38:27.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.501+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b0148a20 con 0x7f04b0072800 2023-12-04T05:38:27.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0068440 con 0x7f04b0072800 2023-12-04T05:38:27.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f04ac0b2070 con 0x7f04b0072800 2023-12-04T05:38:27.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04a6ffd640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 0x7f0494068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:27.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f04ac11e520 con 0x7f04b0072800 2023-12-04T05:38:27.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04b5c64640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 0x7f0494068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:27.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.505+0000 7f04b5c64640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 0x7f0494068dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:27.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.509+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04ac0eb9b0 con 0x7f04b0072800 2023-12-04T05:38:27.667 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:27.661+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04b014a6f0 con 0x7f04b0072800 2023-12-04T05:38:27.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-04T05:38:28.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.321+0000 7f04a6ffd640 1 -- 172.21.15.97:0/2292163904 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f04ac0b00d0 con 0x7f04b0072800 2023-12-04T05:38:28.327 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 msgr2=0x7f0494068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 0x7f0494068dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0009040 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 msgr2=0x7f04b01484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0ae040 tx=0x7f04ac019150 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 shutdown_connections 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0494066900 0x7f0494068dc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04b0158800 0x7f04b0142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04b00c1fb0 0x7f04b01421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 --2- 172.21.15.97:0/2292163904 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04b0072800 0x7f04b01484e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 >> 172.21.15.97:0/2292163904 conn(0x7f04b00c31c0 msgr2=0x7f04b00c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:28.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 shutdown_connections 2023-12-04T05:38:28.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.325+0000 7f04b86c9640 1 -- 172.21.15.97:0/2292163904 wait complete. 2023-12-04T05:38:28.364 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T05:38:28.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.497+0000 7fcc16474640 1 Processor -- start 2023-12-04T05:38:28.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.497+0000 7fcc16474640 1 -- start start 2023-12-04T05:38:28.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc16474640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 0x7fcc100c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc16474640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc10071ea0 0x7fcc100c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc16474640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100c0960 con 0x7fcc100c4cc0 2023-12-04T05:38:28.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc16474640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1006cde0 con 0x7fcc10071ea0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc16474640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1006c820 con 0x7fcc101544f0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15472640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcc100c4cc0 0x7fcc10153de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59124/0 (socket says 172.21.15.97:59124) 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15472640 1 -- 172.21.15.97:0/1960354917 learned_addr learned my addr 172.21.15.97:0/1960354917 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 --2- 172.21.15.97:0/1960354917 >> v2:172.21.15.97:3300/0 conn(0x7fcc10071ea0 0x7fcc100c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc14c71640 1 --2- 172.21.15.97:0/1960354917 >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 0x7fcc100c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc07fff640 1 -- 172.21.15.97:0/1960354917 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907141815 0 0) 0x7fcc100c0960 con 0x7fcc100c4cc0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc07fff640 1 -- 172.21.15.97:0/1960354917 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbfc003530 con 0x7fcc100c4cc0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 -- 172.21.15.97:0/1960354917 >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 msgr2=0x7fcc100c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 --2- 172.21.15.97:0/1960354917 >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 0x7fcc100c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 -- 172.21.15.97:0/1960354917 >> v1:172.21.15.97:6789/0 conn(0x7fcc100c4cc0 legacy=0x7fcc10153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 -- 172.21.15.97:0/1960354917 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1006cb00 con 0x7fcc10071ea0 2023-12-04T05:38:28.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc14c71640 1 --2- 172.21.15.97:0/1960354917 >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 0x7fcc100c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:28.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.501+0000 7fcc15c73640 1 --2- 172.21.15.97:0/1960354917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc10071ea0 0x7fcc100c2850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcc1006d760 tx=0x7fcc0801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897ce4d927378a4c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:28.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc07fff640 1 -- 172.21.15.97:0/1960354917 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080a5850 con 0x7fcc10071ea0 2023-12-04T05:38:28.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc07fff640 1 -- 172.21.15.97:0/1960354917 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080a59b0 con 0x7fcc10071ea0 2023-12-04T05:38:28.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc07fff640 1 -- 172.21.15.97:0/1960354917 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080a5d40 con 0x7fcc10071ea0 2023-12-04T05:38:28.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- 172.21.15.97:0/1960354917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc10071ea0 msgr2=0x7fcc100c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- 172.21.15.97:0/1960354917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc10071ea0 0x7fcc100c2850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcc1006d760 tx=0x7fcc0801c880 comp rx=0 tx=0).stop 2023-12-04T05:38:28.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- 172.21.15.97:0/1960354917 shutdown_connections 2023-12-04T05:38:28.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- 172.21.15.97:0/1960354917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc10071ea0 0x7fcc100c2850 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- 172.21.15.97:0/1960354917 >> v2:172.21.15.143:3300/0 conn(0x7fcc101544f0 0x7fcc100c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- 172.21.15.97:0/1960354917 >> 172.21.15.97:0/1960354917 conn(0x7fcc1006ad80 msgr2=0x7fcc100c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:28.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- 172.21.15.97:0/1960354917 shutdown_connections 2023-12-04T05:38:28.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- 172.21.15.97:0/1960354917 wait complete. 2023-12-04T05:38:28.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 Processor -- start 2023-12-04T05:38:28.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- start start 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc10071ea0 0x7fcc100a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc101544f0 0x7fcc1014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc101ef2e0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10157a80 con 0x7fcc101544f0 2023-12-04T05:38:28.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc16474640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1014d7a0 con 0x7fcc10071ea0 2023-12-04T05:38:28.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc14c71640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc14c71640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39950/0 (socket says 172.21.15.97:39950) 2023-12-04T05:38:28.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.505+0000 7fcc14c71640 1 -- 172.21.15.97:0/354747068 learned_addr learned my addr 172.21.15.97:0/354747068 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:28.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc15c73640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc101544f0 0x7fcc1014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc15472640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc10071ea0 0x7fcc100a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 -- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc10071ea0 msgr2=0x7fcc100a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc10071ea0 0x7fcc100a7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 -- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc101544f0 msgr2=0x7fcc1014b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc101544f0 0x7fcc1014b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 -- 172.21.15.97:0/354747068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009a70 con 0x7fcc100c4cc0 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc14c71640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000d800 tx=0x7fcc0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00009660 con 0x7fcc100c4cc0 2023-12-04T05:38:28.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000097c0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00009b70 con 0x7fcc100c4cc0 2023-12-04T05:38:28.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc100a8080 con 0x7fcc100c4cc0 2023-12-04T05:38:28.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc100a82b0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc101ef550 con 0x7fcc100c4cc0 2023-12-04T05:38:28.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.509+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc00009cd0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.513+0000 7fcc05ffb640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 0x7fcbf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:28.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.513+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcc000850d0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.513+0000 7fcc15472640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 0x7fcbf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:28.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.513+0000 7fcc15472640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 0x7fcbf4068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0011f0 tx=0x7fcc0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:28.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.517+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc000523e0 con 0x7fcc100c4cc0 2023-12-04T05:38:28.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:28.697+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcc1006d3a0 con 0x7fcc100c4cc0 2023-12-04T05:38:29.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.345+0000 7fcc05ffb640 1 -- 172.21.15.97:0/354747068 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcc00055a00 con 0x7fcc100c4cc0 2023-12-04T05:38:29.352 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 8 and data pool 9 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.349+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 msgr2=0x7fcbf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.349+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 0x7fcbf4068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0011f0 tx=0x7fcc0c009040 comp rx=0 tx=0).stop 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.349+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 msgr2=0x7fcc100a70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.349+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000d800 tx=0x7fcc0000dcc0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 shutdown_connections 2023-12-04T05:38:29.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcbf40668d0 0x7fcbf4068d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc101544f0 0x7fcc1014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc100c4cc0 0x7fcc100a70f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 --2- 172.21.15.97:0/354747068 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc10071ea0 0x7fcc100a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 >> 172.21.15.97:0/354747068 conn(0x7fcc1006ad80 msgr2=0x7fcc100702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 shutdown_connections 2023-12-04T05:38:29.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.353+0000 7fcc16474640 1 -- 172.21.15.97:0/354747068 wait complete. 2023-12-04T05:38:29.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:29.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 Processor -- start 2023-12-04T05:38:29.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 -- start start 2023-12-04T05:38:29.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2a44151bf0 0x7f2a440abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a441547d0 con 0x7f2a44155370 2023-12-04T05:38:29.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a44158b80 con 0x7f2a440c7ef0 2023-12-04T05:38:29.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4c2c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440c4aa0 con 0x7f2a44151bf0 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4a866640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2a44155370 0x7f2a4415efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59126/0 (socket says 172.21.15.97:59126) 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4a866640 1 -- 172.21.15.97:0/1138817036 learned_addr learned my addr 172.21.15.97:0/1138817036 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394066971 0 0) 0x7f2a441547d0 con 0x7f2a44155370 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a30003530 con 0x7f2a44155370 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a4a065640 1 --2- 172.21.15.97:0/1138817036 >> v2:172.21.15.143:3300/0 conn(0x7f2a44151bf0 0x7f2a440abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846591379 0 0) 0x7f2a30003530 con 0x7f2a44155370 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 >> v2:172.21.15.143:3300/0 conn(0x7f2a44151bf0 msgr2=0x7f2a440abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:29.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 --2- 172.21.15.97:0/1138817036 >> v2:172.21.15.143:3300/0 conn(0x7f2a44151bf0 0x7f2a440abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 >> v1:172.21.15.143:6789/0 conn(0x7f2a440c7ef0 legacy=0x7f2a44154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440c4d40 con 0x7f2a44155370 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f2a3c001a00 con 0x7f2a44155370 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 >> v1:172.21.15.97:6789/0 conn(0x7f2a44155370 legacy=0x7f2a4415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a300039d0 0x7f2a30003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a300047d0 0x7f2a30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440c4aa0 con 0x7f2a300052b0 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3000c1b0 con 0x7f2a300039d0 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.529+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3000c370 con 0x7f2a300047d0 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a065640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a300039d0 0x7f2a30003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a49864640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a300047d0 0x7f2a30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 -- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a300047d0 msgr2=0x7f2a30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a300047d0 0x7f2a30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 -- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a300039d0 msgr2=0x7f2a30003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a300039d0 0x7f2a30003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 -- 172.21.15.97:0/1138817036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30003530 con 0x7f2a300052b0 2023-12-04T05:38:29.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a065640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a300039d0 0x7f2a30003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 -- 172.21.15.97:0/1138817036 reap_dead start 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a4a866640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a3000b990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406c660 tx=0x7f2a3c01cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2125044d8829e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0ab070 con 0x7f2a300052b0 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0a6490 con 0x7f2a300052b0 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.533+0000 7f2a49063640 1 -- 172.21.15.97:0/1138817036 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0a6840 con 0x7f2a300052b0 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 msgr2=0x7f2a3000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a3000b990 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406c660 tx=0x7f2a3c01cf20 comp rx=0 tx=0).stop 2023-12-04T05:38:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/1138817036 shutdown_connections 2023-12-04T05:38:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/1138817036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a3000b990 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/1138817036 >> 172.21.15.97:0/1138817036 conn(0x7f2a44073550 msgr2=0x7f2a44073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/1138817036 shutdown_connections 2023-12-04T05:38:29.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/1138817036 wait complete. 2023-12-04T05:38:29.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 Processor -- start 2023-12-04T05:38:29.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- start start 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a4414e960 0x7f2a44153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a4414f060 0x7f2a44153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44152550 con 0x7f2a300052b0 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441533e0 con 0x7f2a4414e960 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4c2c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44152270 con 0x7f2a4414f060 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39966/0 (socket says 172.21.15.97:39966) 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 -- 172.21.15.97:0/3403983995 learned_addr learned my addr 172.21.15.97:0/3403983995 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a866640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a4414f060 0x7f2a44153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a49864640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a4414e960 0x7f2a44153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 -- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a4414f060 msgr2=0x7f2a44153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a4414f060 0x7f2a44153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 -- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a4414e960 msgr2=0x7f2a44153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a4414e960 0x7f2a44153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 -- 172.21.15.97:0/3403983995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4414d140 con 0x7f2a300052b0 2023-12-04T05:38:29.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.537+0000 7f2a4a065640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2a40011ac0 tx=0x7f2a40011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000fc10 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000fd70 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4414d420 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000fee0 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4414d940 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4414d5e0 con 0x7f2a300052b0 2023-12-04T05:38:29.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a40004240 con 0x7f2a300052b0 2023-12-04T05:38:29.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 0x7f2a28068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a40084aa0 con 0x7f2a300052b0 2023-12-04T05:38:29.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a49864640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 0x7f2a28068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.541+0000 7f2a49864640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 0x7f2a28068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bf4b0 tx=0x7f2a34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.545+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a40051e00 con 0x7f2a300052b0 2023-12-04T05:38:29.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a44068440 con 0x7f2a300052b0 2023-12-04T05:38:29.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a3affd640 1 -- 172.21.15.97:0/3403983995 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16566 (secure 0 0 0) 0x7f2a40022070 con 0x7f2a300052b0 2023-12-04T05:38:29.702 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:29.702 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":49,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:28.701620+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 msgr2=0x7f2a28068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 0x7f2a28068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bf4b0 tx=0x7f2a34009040 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 msgr2=0x7f2a44152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2a40011ac0 tx=0x7f2a40011f80 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 shutdown_connections 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a280668d0 0x7f2a28068d90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a4414f060 0x7f2a44153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a4414e960 0x7f2a44153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 --2- 172.21.15.97:0/3403983995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a300052b0 0x7f2a44152a70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 >> 172.21.15.97:0/3403983995 conn(0x7f2a44073550 msgr2=0x7f2a4406bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:29.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 shutdown_connections 2023-12-04T05:38:29.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.697+0000 7f2a4c2c9640 1 -- 172.21.15.97:0/3403983995 wait complete. 2023-12-04T05:38:29.723 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:29.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 Processor -- start 2023-12-04T05:38:29.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 -- start start 2023-12-04T05:38:29.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61c40c5400 0x7f61c40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c40d0 0x7f61c415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c40c32c0 con 0x7f61c40c0be0 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c40c5860 con 0x7f61c40c5400 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c983a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c26b0 con 0x7f61c40c40d0 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61c40c5400 0x7f61c40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f61c40c5400 0x7f61c40c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39976/0 (socket says 172.21.15.97:39976) 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 -- 172.21.15.97:0/389318874 learned_addr learned my addr 172.21.15.97:0/389318874 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c9039640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c40d0 0x7f61c415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 -- 172.21.15.97:0/389318874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c40d0 msgr2=0x7f61c415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c40d0 0x7f61c415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 -- 172.21.15.97:0/389318874 >> v1:172.21.15.143:6789/0 conn(0x7f61c40c0be0 legacy=0x7f61c4153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.857+0000 7f61c3fff640 1 -- 172.21.15.97:0/389318874 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40c2990 con 0x7f61c40c5400 2023-12-04T05:38:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c3fff640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c40c3b90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61b000bb10 tx=0x7f61b001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33eed2f8392a348 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c37fe640 1 -- 172.21.15.97:0/389318874 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00a7a30 con 0x7f61c40c5400 2023-12-04T05:38:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c37fe640 1 -- 172.21.15.97:0/389318874 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b00a7b90 con 0x7f61c40c5400 2023-12-04T05:38:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c37fe640 1 -- 172.21.15.97:0/389318874 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00af440 con 0x7f61c40c5400 2023-12-04T05:38:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- 172.21.15.97:0/389318874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 msgr2=0x7f61c40c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c40c3b90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61b000bb10 tx=0x7f61b001eb50 comp rx=0 tx=0).stop 2023-12-04T05:38:29.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- 172.21.15.97:0/389318874 shutdown_connections 2023-12-04T05:38:29.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c40d0 0x7f61c415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 --2- 172.21.15.97:0/389318874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c40c3b90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- 172.21.15.97:0/389318874 >> 172.21.15.97:0/389318874 conn(0x7f61c40c5a50 msgr2=0x7f61c40c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:29.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- 172.21.15.97:0/389318874 shutdown_connections 2023-12-04T05:38:29.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- 172.21.15.97:0/389318874 wait complete. 2023-12-04T05:38:29.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 Processor -- start 2023-12-04T05:38:29.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.861+0000 7f61c983a640 1 -- start start 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c0be0 0x7f61c40a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c40c40d0 0x7f61c40a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40a6c70 con 0x7f61c40c5400 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4155c10 con 0x7f61c40c40d0 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40a71a0 con 0x7f61c40c0be0 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39978/0 (socket says 172.21.15.97:39978) 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 -- 172.21.15.97:0/1389213692 learned_addr learned my addr 172.21.15.97:0/1389213692 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:29.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c8838640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c0be0 0x7f61c40a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c3fff640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c40c40d0 0x7f61c40a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 -- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c0be0 msgr2=0x7f61c40a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c0be0 0x7f61c40a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 -- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c40c40d0 msgr2=0x7f61c40a8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c40c40d0 0x7f61c40a8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 -- 172.21.15.97:0/1389213692 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b000b770 con 0x7f61c40c5400 2023-12-04T05:38:29.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c9039640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00efc0 tx=0x7f61bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc014480 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00f040 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc014820 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c40a6460 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c40a6ec0 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.865+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c4155d80 con 0x7f61c40c5400 2023-12-04T05:38:29.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.869+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f61bc014980 con 0x7f61c40c5400 2023-12-04T05:38:29.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.869+0000 7f61c17fa640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 0x7f61a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:29.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.869+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61bc084e50 con 0x7f61c40c5400 2023-12-04T05:38:29.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.869+0000 7f61c8838640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 0x7f61a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:29.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.869+0000 7f61c8838640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 0x7f61a8068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007fd0 tx=0x7f61b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:29.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:29.873+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61bc052130 con 0x7f61c40c5400 2023-12-04T05:38:30.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.025+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61c404e890 con 0x7f61c40c5400 2023-12-04T05:38:30.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.025+0000 7f61c17fa640 1 -- 172.21.15.97:0/1389213692 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16566 (secure 0 0 0) 0x7f61bc055750 con 0x7f61c40c5400 2023-12-04T05:38:30.031 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:30.032 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":49,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:28.701620+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 msgr2=0x7f61a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 0x7f61a8068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007fd0 tx=0x7f61b8009040 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 msgr2=0x7f61c41eceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00efc0 tx=0x7f61bc00c490 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 shutdown_connections 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f61a80668d0 0x7f61a8068d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61c40c5400 0x7f61c41eceb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61c40c40d0 0x7f61c40a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 --2- 172.21.15.97:0/1389213692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f61c40c0be0 0x7f61c40a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 >> 172.21.15.97:0/1389213692 conn(0x7f61c40c5a50 msgr2=0x7f61c40664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 shutdown_connections 2023-12-04T05:38:30.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.029+0000 7f61c983a640 1 -- 172.21.15.97:0/1389213692 wait complete. 2023-12-04T05:38:30.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T05:38:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 Processor -- start 2023-12-04T05:38:30.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 -- start start 2023-12-04T05:38:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc0940cac10 0x7fc0941600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940ca780 con 0x7fc094151f10 2023-12-04T05:38:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc094158720 con 0x7fc0940c7f00 2023-12-04T05:38:30.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09c65f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094158cc0 con 0x7fc0940cac10 2023-12-04T05:38:30.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09a3fb640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc094151f10 0x7fc0940c4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59140/0 (socket says 172.21.15.97:59140) 2023-12-04T05:38:30.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09a3fb640 1 -- 172.21.15.97:0/2212045675 learned_addr learned my addr 172.21.15.97:0/2212045675 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:30.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc09abfc640 1 --2- 172.21.15.97:0/2212045675 >> v2:172.21.15.143:3300/0 conn(0x7fc0940cac10 0x7fc0941600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368851120 0 0) 0x7fc0940ca780 con 0x7fc094151f10 2023-12-04T05:38:30.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc080003530 con 0x7fc094151f10 2023-12-04T05:38:30.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559813855 0 0) 0x7fc080003530 con 0x7fc094151f10 2023-12-04T05:38:30.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 >> v2:172.21.15.143:3300/0 conn(0x7fc0940cac10 msgr2=0x7fc0941600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:30.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 --2- 172.21.15.97:0/2212045675 >> v2:172.21.15.143:3300/0 conn(0x7fc0940cac10 0x7fc0941600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 >> v1:172.21.15.143:6789/0 conn(0x7fc0940c7f00 legacy=0x7fc094154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940bd830 con 0x7fc094151f10 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fc090001680 con 0x7fc094151f10 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 >> v1:172.21.15.97:6789/0 conn(0x7fc094151f10 legacy=0x7fc0940c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080003980 0x7fc080003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0800047d0 0x7fc080004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 0x7fc08000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094158cc0 con 0x7fc080005190 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08000c0e0 con 0x7fc080003980 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.189+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08000c2a0 con 0x7fc0800047d0 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 0x7fc08000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09a3fb640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080003980 0x7fc080003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc099bfa640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0800047d0 0x7fc080004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 -- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0800047d0 msgr2=0x7fc080004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0800047d0 0x7fc080004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 -- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080003980 msgr2=0x7fc080003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080003980 0x7fc080003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 -- 172.21.15.97:0/2212045675 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080003530 con 0x7fc080005190 2023-12-04T05:38:30.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc099bfa640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc0800047d0 0x7fc080004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 -- 172.21.15.97:0/2212045675 reap_dead start 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc09abfc640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 0x7fc08000b990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009f90 tx=0x7fc08c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fffeabdb550db8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0a5c70 con 0x7fc080005190 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00f040 con 0x7fc080005190 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.193+0000 7fc0993f9640 1 -- 172.21.15.97:0/2212045675 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0ad440 con 0x7fc080005190 2023-12-04T05:38:30.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 msgr2=0x7fc08000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 0x7fc08000b990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009f90 tx=0x7fc08c01cc60 comp rx=0 tx=0).stop 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- 172.21.15.97:0/2212045675 shutdown_connections 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 --2- 172.21.15.97:0/2212045675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc080005190 0x7fc08000b990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- 172.21.15.97:0/2212045675 >> 172.21.15.97:0/2212045675 conn(0x7fc094073950 msgr2=0x7fc094073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- 172.21.15.97:0/2212045675 shutdown_connections 2023-12-04T05:38:30.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- 172.21.15.97:0/2212045675 wait complete. 2023-12-04T05:38:30.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 Processor -- start 2023-12-04T05:38:30.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- start start 2023-12-04T05:38:30.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080005190 0x7fc0941ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc094148730 0x7fc094155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941edaf0 con 0x7fc0940aac90 2023-12-04T05:38:30.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940c8aa0 con 0x7fc080005190 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09c65f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094156e50 con 0x7fc094148730 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40002/0 (socket says 172.21.15.97:40002) 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 -- 172.21.15.97:0/982031637 learned_addr learned my addr 172.21.15.97:0/982031637 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09a3fb640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080005190 0x7fc0941ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc09abfc640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc094148730 0x7fc094155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 -- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc094148730 msgr2=0x7fc094155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc094148730 0x7fc094155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 -- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080005190 msgr2=0x7fc0941ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080005190 0x7fc0941ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.197+0000 7fc099bfa640 1 -- 172.21.15.97:0/982031637 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094157130 con 0x7fc0940aac90 2023-12-04T05:38:30.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc099bfa640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc084010f30 tx=0x7fc08400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:30.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084005270 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400d030 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094157410 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400ee50 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0941579d0 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094148b10 con 0x7fc0940aac90 2023-12-04T05:38:30.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc084003600 con 0x7fc0940aac90 2023-12-04T05:38:30.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 0x7fc078068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:30.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc084087a60 con 0x7fc0940aac90 2023-12-04T05:38:30.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc09a3fb640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 0x7fc078068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:30.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.201+0000 7fc09a3fb640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 0x7fc078068dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc090000c10 tx=0x7fc090001440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:30.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.205+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc084054c90 con 0x7fc0940aac90 2023-12-04T05:38:30.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:30.397+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc094068440 con 0x7fc0940aac90 2023-12-04T05:38:31.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.333+0000 7fc08affd640 1 -- 172.21.15.97:0/982031637 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc0840582b0 con 0x7fc0940aac90 2023-12-04T05:38:31.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 msgr2=0x7fc078068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 0x7fc078068dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc090000c10 tx=0x7fc090001440 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 msgr2=0x7fc0941481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc084010f30 tx=0x7fc08400e530 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 shutdown_connections 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc078066900 0x7fc078068dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc094148730 0x7fc094155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc0940aac90 0x7fc0941481f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 --2- 172.21.15.97:0/982031637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc080005190 0x7fc0941ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 >> 172.21.15.97:0/982031637 conn(0x7fc094073950 msgr2=0x7fc09414b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 shutdown_connections 2023-12-04T05:38:31.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.337+0000 7fc09c65f640 1 -- 172.21.15.97:0/982031637 wait complete. 2023-12-04T05:38:31.366 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:38:31.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T05:38:31.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 Processor -- start 2023-12-04T05:38:31.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 -- start start 2023-12-04T05:38:31.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdcb406c440 0x7fdcb41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406d210 0x7fdcb406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb40aa240 con 0x7fdcb40c1e70 2023-12-04T05:38:31.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb406c0c0 con 0x7fdcb406c440 2023-12-04T05:38:31.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcbbff8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb40aa500 con 0x7fdcb406d210 2023-12-04T05:38:31.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9d94640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdcb40c1e70 0x7fdcb40a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59154/0 (socket says 172.21.15.97:59154) 2023-12-04T05:38:31.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9d94640 1 -- 172.21.15.97:0/3045444744 learned_addr learned my addr 172.21.15.97:0/3045444744 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9593640 1 --2- 172.21.15.97:0/3045444744 >> v2:172.21.15.143:3300/0 conn(0x7fdcb406c440 0x7fdcb41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcba595640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406d210 0x7fdcb406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391157256 0 0) 0x7fdcb40aa240 con 0x7fdcb40c1e70 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca0003530 con 0x7fdcb40c1e70 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9593640 1 -- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406d210 msgr2=0x7fdcb406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9593640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406d210 0x7fdcb406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9593640 1 -- 172.21.15.97:0/3045444744 >> v1:172.21.15.97:6789/0 conn(0x7fdcb40c1e70 legacy=0x7fdcb40a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913333898 0 0) 0x7fdca0003530 con 0x7fdcb40c1e70 2023-12-04T05:38:31.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.505+0000 7fdcb9593640 1 -- 172.21.15.97:0/3045444744 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb40aa7e0 con 0x7fdcb406c440 2023-12-04T05:38:31.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcb9593640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb406c440 0x7fdcb41524e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097c0 tx=0x7fdca401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4e37ba4b209703 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:31.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0001680 con 0x7fdcb406c440 2023-12-04T05:38:31.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40a7050 con 0x7fdcb406c440 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcb8d92640 1 -- 172.21.15.97:0/3045444744 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40ab620 con 0x7fdcb406c440 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 -- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb406c440 msgr2=0x7fdcb41524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb406c440 0x7fdcb41524e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdca40097c0 tx=0x7fdca401c370 comp rx=0 tx=0).stop 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 -- 172.21.15.97:0/3045444744 shutdown_connections 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406d210 0x7fdcb406d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/3045444744 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb406c440 0x7fdcb41524e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 -- 172.21.15.97:0/3045444744 >> 172.21.15.97:0/3045444744 conn(0x7fdcb40c5e70 msgr2=0x7fdcb40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 -- 172.21.15.97:0/3045444744 shutdown_connections 2023-12-04T05:38:31.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.509+0000 7fdcbbff8640 1 -- 172.21.15.97:0/3045444744 wait complete. 2023-12-04T05:38:31.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 Processor -- start 2023-12-04T05:38:31.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- start start 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406c440 0x7fdcb4071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb40c1e70 0x7fdcb4154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4072080 con 0x7fdcb406d210 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb41f5000 con 0x7fdcb40c1e70 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb41f4710 con 0x7fdcb406c440 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40008/0 (socket says 172.21.15.97:40008) 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 -- 172.21.15.97:0/990499481 learned_addr learned my addr 172.21.15.97:0/990499481 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcba595640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb40c1e70 0x7fdcb4154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9d94640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406c440 0x7fdcb4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 -- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406c440 msgr2=0x7fdcb4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406c440 0x7fdcb4071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 -- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb40c1e70 msgr2=0x7fdcb4154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb40c1e70 0x7fdcb4154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 -- 172.21.15.97:0/990499481 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4009420 con 0x7fdcb406d210 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcb9593640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdca401aa20 tx=0x7fdca4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40b4400 con 0x7fdcb406d210 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40b4560 con 0x7fdcb406d210 2023-12-04T05:38:31.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40b4910 con 0x7fdcb406d210 2023-12-04T05:38:31.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb41f49b0 con 0x7fdcb406d210 2023-12-04T05:38:31.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.513+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb4071a80 con 0x7fdcb406d210 2023-12-04T05:38:31.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb4068440 con 0x7fdcb406d210 2023-12-04T05:38:31.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdca40b2040 con 0x7fdcb406d210 2023-12-04T05:38:31.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcaa7fc640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 0x7fdc98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:31.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca411df90 con 0x7fdcb406d210 2023-12-04T05:38:31.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcb9d94640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 0x7fdc98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:31.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.517+0000 7fdcb9d94640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 0x7fdc98068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0006b60 tx=0x7fdcb0001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:31.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.521+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdca40eb1d0 con 0x7fdcb406d210 2023-12-04T05:38:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:31.705+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdcb40c1890 con 0x7fdcb406d210 2023-12-04T05:38:32.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.345+0000 7fdcaa7fc640 1 -- 172.21.15.97:0/990499481 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdca40b0030 con 0x7fdcb406d210 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 msgr2=0x7fdc98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 0x7fdc98068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0006b60 tx=0x7fdcb0001dd0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 msgr2=0x7fdcb40c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdca401aa20 tx=0x7fdca4019110 comp rx=0 tx=0).stop 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 shutdown_connections 2023-12-04T05:38:32.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc980668d0 0x7fdc98068d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcb40c1e70 0x7fdcb4154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdcb406d210 0x7fdcb40c2880 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 --2- 172.21.15.97:0/990499481 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdcb406c440 0x7fdcb4071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 >> 172.21.15.97:0/990499481 conn(0x7fdcb40c5e70 msgr2=0x7fdcb40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 shutdown_connections 2023-12-04T05:38:32.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.349+0000 7fdcbbff8640 1 -- 172.21.15.97:0/990499481 wait complete. 2023-12-04T05:38:32.374 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T05:38:32.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:32.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 Processor -- start 2023-12-04T05:38:32.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 -- start start 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3d040bd720 0x7f3d04158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d040cad70 con 0x7f3d0414e700 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d04155630 con 0x7f3d04155160 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d0a196640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d04158cd0 con 0x7f3d040bd720 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d037fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3d0414e700 0x7f3d040c4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59164/0 (socket says 172.21.15.97:59164) 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d037fe640 1 -- 172.21.15.97:0/312962081 learned_addr learned my addr 172.21.15.97:0/312962081 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309114286 0 0) 0x7f3d040cad70 con 0x7f3d0414e700 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d03fff640 1 --2- 172.21.15.97:0/312962081 >> v2:172.21.15.143:3300/0 conn(0x7f3d040bd720 0x7f3d04158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cec003530 con 0x7f3d0414e700 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2032806212 0 0) 0x7f3cec003530 con 0x7f3d0414e700 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 >> v2:172.21.15.143:3300/0 conn(0x7f3d040bd720 msgr2=0x7f3d04158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 --2- 172.21.15.97:0/312962081 >> v2:172.21.15.143:3300/0 conn(0x7f3d040bd720 0x7f3d04158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 >> v1:172.21.15.143:6789/0 conn(0x7f3d04155160 legacy=0x7f3d04158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d040ca4d0 con 0x7f3d0414e700 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f3cf40016a0 con 0x7f3d0414e700 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 >> v1:172.21.15.97:6789/0 conn(0x7f3d0414e700 legacy=0x7f3d040c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 0x7f3cec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0047d0 0x7f3cec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0052b0 0x7f3cec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04158cd0 con 0x7f3cec0039b0 2023-12-04T05:38:32.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec00c1b0 con 0x7f3cec0052b0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec00c370 con 0x7f3cec0047d0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.509+0000 7f3d037fe640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 0x7f3cec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d03fff640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0052b0 0x7f3cec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d02ffd640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0047d0 0x7f3cec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 -- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0047d0 msgr2=0x7f3cec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0047d0 0x7f3cec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 -- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0052b0 msgr2=0x7f3cec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0052b0 0x7f3cec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 -- 172.21.15.97:0/312962081 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec003530 con 0x7f3cec0039b0 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d03fff640 1 -- 172.21.15.97:0/312962081 reap_dead start 2023-12-04T05:38:32.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d02ffd640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0047d0 0x7f3cec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:32.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d037fe640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 0x7f3cec003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001ec0 tx=0x7f3cf401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17fc3168fc59ada server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40058e0 con 0x7f3cec0039b0 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4005a40 con 0x7f3cec0039b0 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d027fc640 1 -- 172.21.15.97:0/312962081 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4005e50 con 0x7f3cec0039b0 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d0a196640 1 -- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 msgr2=0x7f3cec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d0a196640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 0x7f3cec003dd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001ec0 tx=0x7f3cf401cb50 comp rx=0 tx=0).stop 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.513+0000 7f3d0a196640 1 -- 172.21.15.97:0/312962081 shutdown_connections 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 --2- 172.21.15.97:0/312962081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3cec0039b0 0x7f3cec003dd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- 172.21.15.97:0/312962081 >> 172.21.15.97:0/312962081 conn(0x7f3d04073720 msgr2=0x7f3d04073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- 172.21.15.97:0/312962081 shutdown_connections 2023-12-04T05:38:32.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- 172.21.15.97:0/312962081 wait complete. 2023-12-04T05:38:32.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 Processor -- start 2023-12-04T05:38:32.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- start start 2023-12-04T05:38:32.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0039b0 0x7f3d041f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d041eef80 0x7f3d041ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041f1090 con 0x7f3d041ef920 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041ee4a0 con 0x7f3cec0039b0 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d0a196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041ee780 con 0x7f3d041eef80 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40026/0 (socket says 172.21.15.97:40026) 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 -- 172.21.15.97:0/1826203375 learned_addr learned my addr 172.21.15.97:0/1826203375 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d037fe640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0039b0 0x7f3d041f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d02ffd640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d041eef80 0x7f3d041ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 -- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d041eef80 msgr2=0x7f3d041ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d041eef80 0x7f3d041ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 -- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0039b0 msgr2=0x7f3d041f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0039b0 0x7f3d041f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 -- 172.21.15.97:0/1826203375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d041eea60 con 0x7f3d041ef920 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.517+0000 7f3d03fff640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3d040a9980 tx=0x7f3cfc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00e040 con 0x7f3d041ef920 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc00f040 con 0x7f3d041ef920 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d040c1b30 con 0x7f3d041ef920 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc015430 con 0x7f3d041ef920 2023-12-04T05:38:32.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d040bfdd0 con 0x7f3d041ef920 2023-12-04T05:38:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d041eeca0 con 0x7f3d041ef920 2023-12-04T05:38:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3cfc015590 con 0x7f3d041ef920 2023-12-04T05:38:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 0x7f3cf0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cfc084d10 con 0x7f3d041ef920 2023-12-04T05:38:32.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3d037fe640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 0x7f3cf0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.521+0000 7f3d037fe640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 0x7f3cf0068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40ab000 tx=0x7f3cf40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.525+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d041eeca0 con 0x7f3d041ef920 2023-12-04T05:38:32.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d041eeca0 con 0x7f3d041ef920 2023-12-04T05:38:32.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3cebfff640 1 -- 172.21.15.97:0/1826203375 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f3d041eeca0 con 0x7f3d041ef920 2023-12-04T05:38:32.710 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:32.710 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-04T05:38:32.710 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 32 2023-12-04T05:38:32.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 msgr2=0x7f3cf0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 0x7f3cf0068dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40ab000 tx=0x7f3cf40a7070 comp rx=0 tx=0).stop 2023-12-04T05:38:32.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 msgr2=0x7f3d040bdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3d040a9980 tx=0x7f3cfc00f1b0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 shutdown_connections 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3cf0066900 0x7f3cf0068dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d041ef920 0x7f3d040bdfb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d041eef80 0x7f3d041ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 --2- 172.21.15.97:0/1826203375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0039b0 0x7f3d041f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 >> 172.21.15.97:0/1826203375 conn(0x7f3d04073720 msgr2=0x7f3d040c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 shutdown_connections 2023-12-04T05:38:32.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.705+0000 7f3d0a196640 1 -- 172.21.15.97:0/1826203375 wait complete. 2023-12-04T05:38:32.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.861+0000 7f051d580640 1 Processor -- start 2023-12-04T05:38:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.861+0000 7f051d580640 1 -- start start 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05180c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 0x7f051806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f051806dd40 0x7f051814da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05180a8670 con 0x7f051806dd40 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051806c550 con 0x7f051806bee0 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f051d580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051806e170 con 0x7f05180a9470 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f051806dd40 0x7f051814da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f051806dd40 0x7f051814da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40032/0 (socket says 172.21.15.97:40032) 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 -- 172.21.15.97:0/2468226307 learned_addr learned my addr 172.21.15.97:0/2468226307 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f050e7fc640 1 --2- 172.21.15.97:0/2468226307 >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 0x7f051806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f0516ffd640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05180c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 -- 172.21.15.97:0/2468226307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 msgr2=0x7f05180c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05180c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 -- 172.21.15.97:0/2468226307 >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 msgr2=0x7f051806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 --2- 172.21.15.97:0/2468226307 >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 0x7f051806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f05177fe640 1 -- 172.21.15.97:0/2468226307 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051806c760 con 0x7f051806dd40 2023-12-04T05:38:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.865+0000 7f050e7fc640 1 --2- 172.21.15.97:0/2468226307 >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 0x7f051806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:32.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f05177fe640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806dd40 0x7f051814da50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0518072620 tx=0x7f051001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663af5a4b8bfe028 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f05167fc640 1 -- 172.21.15.97:0/2468226307 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000b2d0 con 0x7f051806dd40 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f05167fc640 1 -- 172.21.15.97:0/2468226307 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000b430 con 0x7f051806dd40 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f05167fc640 1 -- 172.21.15.97:0/2468226307 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100a7c50 con 0x7f051806dd40 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- 172.21.15.97:0/2468226307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806dd40 msgr2=0x7f051814da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806dd40 0x7f051814da50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0518072620 tx=0x7f051001eba0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- 172.21.15.97:0/2468226307 shutdown_connections 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806dd40 0x7f051814da50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 --2- 172.21.15.97:0/2468226307 >> v2:172.21.15.143:3300/0 conn(0x7f051806bee0 0x7f051806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 --2- 172.21.15.97:0/2468226307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05180c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- 172.21.15.97:0/2468226307 >> 172.21.15.97:0/2468226307 conn(0x7f05180c2970 msgr2=0x7f05180c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- 172.21.15.97:0/2468226307 shutdown_connections 2023-12-04T05:38:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- 172.21.15.97:0/2468226307 wait complete. 2023-12-04T05:38:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 Processor -- start 2023-12-04T05:38:32.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.869+0000 7f051d580640 1 -- start start 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 0x7f05181530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05181475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518151630 con 0x7f051806bee0 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518072290 con 0x7f051806dd40 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05181edf30 con 0x7f05180a9470 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40038/0 (socket says 172.21.15.97:40038) 2023-12-04T05:38:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 -- 172.21.15.97:0/3616740489 learned_addr learned my addr 172.21.15.97:0/3616740489 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050e7fc640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 0x7f05181530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f05177fe640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05181475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 -- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 msgr2=0x7f05181475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05181475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 -- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 msgr2=0x7f05181530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 0x7f05181530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 -- 172.21.15.97:0/3616740489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051000bd40 con 0x7f051806bee0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f05177fe640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05181475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050e7fc640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 0x7f05181530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f0516ffd640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f050000d620 tx=0x7f050000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05000125f0 con 0x7f051806bee0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500012750 con 0x7f051806bee0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051815ba40 con 0x7f051806bee0 2023-12-04T05:38:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500012ae0 con 0x7f051806bee0 2023-12-04T05:38:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0518071bd0 con 0x7f051806bee0 2023-12-04T05:38:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051806b8d0 con 0x7f051806bee0 2023-12-04T05:38:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.873+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0500012c40 con 0x7f051806bee0 2023-12-04T05:38:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.877+0000 7f050ffff640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 0x7f04f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:32.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.877+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0500084780 con 0x7f051806bee0 2023-12-04T05:38:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.877+0000 7f050e7fc640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 0x7f04f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:32.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.877+0000 7f050e7fc640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 0x7f04f8068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05180abf20 tx=0x7f0508008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:32.881+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0500051a50 con 0x7f051806bee0 2023-12-04T05:38:33.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.029+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0518068440 con 0x7f051806bee0 2023-12-04T05:38:33.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.029+0000 7f050ffff640 1 -- 172.21.15.97:0/3616740489 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16553 (secure 0 0 0) 0x7f0500007380 con 0x7f051806bee0 2023-12-04T05:38:33.035 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:33.035 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":50,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:30.330858+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:33.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 msgr2=0x7f04f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 0x7f04f8068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05180abf20 tx=0x7f0508008040 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 msgr2=0x7f05181ed9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f050000d620 tx=0x7f050000dae0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 shutdown_connections 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f04f80668d0 0x7f04f8068d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05180a9470 0x7f05181475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f051806dd40 0x7f05181530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 --2- 172.21.15.97:0/3616740489 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f051806bee0 0x7f05181ed9f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 >> 172.21.15.97:0/3616740489 conn(0x7f05180c2970 msgr2=0x7f051814c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 shutdown_connections 2023-12-04T05:38:33.037 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.033+0000 7f051d580640 1 -- 172.21.15.97:0/3616740489 wait complete. 2023-12-04T05:38:33.055 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:38:33.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:33.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.185+0000 7f8a10009640 1 Processor -- start 2023-12-04T05:38:33.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.185+0000 7f8a10009640 1 -- start start 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8a080a9470 0x7f8a080c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0806bee0 0x7f8a0806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a0806dd40 0x7f8a0814da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080a8670 con 0x7f8a0806dd40 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0806c550 con 0x7f8a080a9470 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a10009640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0806e170 con 0x7f8a0806bee0 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a0806dd40 0x7f8a0814da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8a0806dd40 0x7f8a0814da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40048/0 (socket says 172.21.15.97:40048) 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 -- 172.21.15.97:0/863204179 learned_addr learned my addr 172.21.15.97:0/863204179 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0dda5640 1 --2- 172.21.15.97:0/863204179 >> v2:172.21.15.143:3300/0 conn(0x7f8a080a9470 0x7f8a080c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0d5a4640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0806bee0 0x7f8a0806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 -- 172.21.15.97:0/863204179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0806bee0 msgr2=0x7f8a0806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0806bee0 0x7f8a0806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 -- 172.21.15.97:0/863204179 >> v2:172.21.15.143:3300/0 conn(0x7f8a080a9470 msgr2=0x7f8a080c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 --2- 172.21.15.97:0/863204179 >> v2:172.21.15.143:3300/0 conn(0x7f8a080a9470 0x7f8a080c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.189+0000 7f8a0e5a6640 1 -- 172.21.15.97:0/863204179 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0806c760 con 0x7f8a0806dd40 2023-12-04T05:38:33.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a0e5a6640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806dd40 0x7f8a0814da50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a080c6f10 tx=0x7f8a0001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c848d9032c3532e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a0cda3640 1 -- 172.21.15.97:0/863204179 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000a5820 con 0x7f8a0806dd40 2023-12-04T05:38:33.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a0cda3640 1 -- 172.21.15.97:0/863204179 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000a5980 con 0x7f8a0806dd40 2023-12-04T05:38:33.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a0cda3640 1 -- 172.21.15.97:0/863204179 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000a5d10 con 0x7f8a0806dd40 2023-12-04T05:38:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- 172.21.15.97:0/863204179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806dd40 msgr2=0x7f8a0814da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806dd40 0x7f8a0814da50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a080c6f10 tx=0x7f8a0001c9a0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- 172.21.15.97:0/863204179 shutdown_connections 2023-12-04T05:38:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a0806bee0 0x7f8a0806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 --2- 172.21.15.97:0/863204179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806dd40 0x7f8a0814da50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 --2- 172.21.15.97:0/863204179 >> v2:172.21.15.143:3300/0 conn(0x7f8a080a9470 0x7f8a080c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- 172.21.15.97:0/863204179 >> 172.21.15.97:0/863204179 conn(0x7f8a080c2970 msgr2=0x7f8a080c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- 172.21.15.97:0/863204179 shutdown_connections 2023-12-04T05:38:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- 172.21.15.97:0/863204179 wait complete. 2023-12-04T05:38:33.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 Processor -- start 2023-12-04T05:38:33.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.193+0000 7f8a10009640 1 -- start start 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 0x7f8a08071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a080a9470 0x7f8a0813e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080707c0 con 0x7f8a0806bee0 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08070fd0 con 0x7f8a0806dd40 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08070a10 con 0x7f8a080a9470 2023-12-04T05:38:33.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40062/0 (socket says 172.21.15.97:40062) 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 -- 172.21.15.97:0/1034519304 learned_addr learned my addr 172.21.15.97:0/1034519304 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0d5a4640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 0x7f8a08071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 -- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a080a9470 msgr2=0x7f8a0813e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0e5a6640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a080a9470 0x7f8a0813e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a080a9470 0x7f8a0813e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 -- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 msgr2=0x7f8a08071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 0x7f8a08071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 -- 172.21.15.97:0/1034519304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00009b30 con 0x7f8a0806bee0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0d5a4640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 0x7f8a08071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a0dda5640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400d5f0 tx=0x7f8a0400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040125f0 con 0x7f8a0806bee0 2023-12-04T05:38:33.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04012750 con 0x7f8a0806bee0 2023-12-04T05:38:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a08070cf0 con 0x7f8a0806bee0 2023-12-04T05:38:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04012ae0 con 0x7f8a0806bee0 2023-12-04T05:38:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a081404c0 con 0x7f8a0806bee0 2023-12-04T05:38:33.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a08140680 con 0x7f8a0806bee0 2023-12-04T05:38:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.197+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a04012c40 con 0x7f8a0806bee0 2023-12-04T05:38:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.201+0000 7f89fe7fc640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 0x7f89ec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.201+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a04084910 con 0x7f8a0806bee0 2023-12-04T05:38:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.201+0000 7f8a0d5a4640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 0x7f89ec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.201+0000 7f8a0d5a4640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 0x7f89ec068dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8a080ac390 tx=0x7f89f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.205+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a04051ab0 con 0x7f8a0806bee0 2023-12-04T05:38:33.312 INFO:tasks.ceph.mds.a.smithi097.stderr:2023-12-04T05:38:33.305+0000 7f62d7463640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:38:33.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.353+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a08148c80 con 0x7f89ec066900 2023-12-04T05:38:33.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.361+0000 7f89fe7fc640 1 -- 172.21.15.97:0/1034519304 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277287 (secure 0 0 0) 0x7f8a08148c80 con 0x7f89ec066900 2023-12-04T05:38:33.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:33.371 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 msgr2=0x7f89ec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 0x7f89ec068dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8a080ac390 tx=0x7f89f8008040 comp rx=0 tx=0).stop 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 msgr2=0x7f8a08145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400d5f0 tx=0x7f8a0400dab0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 shutdown_connections 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f89ec066900 0x7f89ec068dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a080a9470 0x7f8a0813e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a0806dd40 0x7f8a08071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 --2- 172.21.15.97:0/1034519304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a0806bee0 0x7f8a08145670 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 >> 172.21.15.97:0/1034519304 conn(0x7f8a080c2970 msgr2=0x7f8a080bfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 shutdown_connections 2023-12-04T05:38:33.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.365+0000 7f8a10009640 1 -- 172.21.15.97:0/1034519304 wait complete. 2023-12-04T05:38:33.388 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-04T05:38:32.213013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221712,"kb_used_data":5544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5677056,"data_stored":3042728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891969"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332858+0000","last_change":"2023-12-04T05:38:27.332858+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332858+0000","last_undegraded":"2023-12-04T05:38:27.332858+0000","last_fullsized":"2023-12-04T05:38:27.332858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325761+0000","last_change":"2023-12-04T05:38:27.325761+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325761+0000","last_undegraded":"2023-12-04T05:38:27.325761+0000","last_fullsized":"2023-12-04T05:38:27.325761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332786+0000","last_change":"2023-12-04T05:38:27.332786+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332786+0000","last_undegraded":"2023-12-04T05:38:27.332786+0000","last_fullsized":"2023-12-04T05:38:27.332786+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330697+0000","last_change":"2023-12-04T05:38:27.330697+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330697+0000","last_undegraded":"2023-12-04T05:38:27.330697+0000","last_fullsized":"2023-12-04T05:38:27.330697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330579+0000","last_change":"2023-12-04T05:38:27.330579+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330579+0000","last_undegraded":"2023-12-04T05:38:27.330579+0000","last_fullsized":"2023-12-04T05:38:27.330579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332740+0000","last_change":"2023-12-04T05:38:27.332740+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332740+0000","last_undegraded":"2023-12-04T05:38:27.332740+0000","last_fullsized":"2023-12-04T05:38:27.332740+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330456+0000","last_change":"2023-12-04T05:38:27.330456+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330456+0000","last_undegraded":"2023-12-04T05:38:27.330456+0000","last_fullsized":"2023-12-04T05:38:27.330456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.331233+0000","last_change":"2023-12-04T05:38:27.331233+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.331233+0000","last_undegraded":"2023-12-04T05:38:27.331233+0000","last_fullsized":"2023-12-04T05:38:27.331233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328764+0000","last_change":"2023-12-04T05:38:27.328764+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328764+0000","last_undegraded":"2023-12-04T05:38:27.328764+0000","last_fullsized":"2023-12-04T05:38:27.328764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325146+0000","last_change":"2023-12-04T05:38:27.325146+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325146+0000","last_undegraded":"2023-12-04T05:38:27.325146+0000","last_fullsized":"2023-12-04T05:38:27.325146+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329749+0000","last_change":"2023-12-04T05:38:27.329749+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329749+0000","last_undegraded":"2023-12-04T05:38:27.329749+0000","last_fullsized":"2023-12-04T05:38:27.329749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330507+0000","last_change":"2023-12-04T05:38:27.330507+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330507+0000","last_undegraded":"2023-12-04T05:38:27.330507+0000","last_fullsized":"2023-12-04T05:38:27.330507+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325119+0000","last_change":"2023-12-04T05:38:27.325119+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325119+0000","last_undegraded":"2023-12-04T05:38:27.325119+0000","last_fullsized":"2023-12-04T05:38:27.325119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327698+0000","last_change":"2023-12-04T05:38:27.327698+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327698+0000","last_undegraded":"2023-12-04T05:38:27.327698+0000","last_fullsized":"2023-12-04T05:38:27.327698+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329874+0000","last_change":"2023-12-04T05:38:27.329874+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329874+0000","last_undegraded":"2023-12-04T05:38:27.329874+0000","last_fullsized":"2023-12-04T05:38:27.329874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328687+0000","last_change":"2023-12-04T05:38:27.328687+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328687+0000","last_undegraded":"2023-12-04T05:38:27.328687+0000","last_fullsized":"2023-12-04T05:38:27.328687+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324487+0000","last_change":"2023-12-04T05:38:27.324487+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324487+0000","last_undegraded":"2023-12-04T05:38:27.324487+0000","last_fullsized":"2023-12-04T05:38:27.324487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.333868+0000","last_change":"2023-12-04T05:38:27.333868+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.333868+0000","last_undegraded":"2023-12-04T05:38:27.333868+0000","last_fullsized":"2023-12-04T05:38:27.333868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329436+0000","last_change":"2023-12-04T05:38:27.329436+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329436+0000","last_undegraded":"2023-12-04T05:38:27.329436+0000","last_fullsized":"2023-12-04T05:38:27.329436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332873+0000","last_change":"2023-12-04T05:38:27.332873+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332873+0000","last_undegraded":"2023-12-04T05:38:27.332873+0000","last_fullsized":"2023-12-04T05:38:27.332873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324273+0000","last_change":"2023-12-04T05:38:27.324273+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324273+0000","last_undegraded":"2023-12-04T05:38:27.324273+0000","last_fullsized":"2023-12-04T05:38:27.324273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335757+0000","last_change":"2023-12-04T05:38:27.335757+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335757+0000","last_undegraded":"2023-12-04T05:38:27.335757+0000","last_fullsized":"2023-12-04T05:38:27.335757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328834+0000","last_change":"2023-12-04T05:38:27.328834+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328834+0000","last_undegraded":"2023-12-04T05:38:27.328834+0000","last_fullsized":"2023-12-04T05:38:27.328834+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335424+0000","last_change":"2023-12-04T05:38:27.335424+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335424+0000","last_undegraded":"2023-12-04T05:38:27.335424+0000","last_fullsized":"2023-12-04T05:38:27.335424+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332799+0000","last_change":"2023-12-04T05:38:27.332799+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332799+0000","last_undegraded":"2023-12-04T05:38:27.332799+0000","last_fullsized":"2023-12-04T05:38:27.332799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330955+0000","last_change":"2023-12-04T05:38:27.330955+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330955+0000","last_undegraded":"2023-12-04T05:38:27.330955+0000","last_fullsized":"2023-12-04T05:38:27.330955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328865+0000","last_change":"2023-12-04T05:38:27.328865+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328865+0000","last_undegraded":"2023-12-04T05:38:27.328865+0000","last_fullsized":"2023-12-04T05:38:27.328865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335132+0000","last_change":"2023-12-04T05:38:27.335132+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335132+0000","last_undegraded":"2023-12-04T05:38:27.335132+0000","last_fullsized":"2023-12-04T05:38:27.335132+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328919+0000","last_change":"2023-12-04T05:38:27.328919+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328919+0000","last_undegraded":"2023-12-04T05:38:27.328919+0000","last_fullsized":"2023-12-04T05:38:27.328919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335047+0000","last_change":"2023-12-04T05:38:27.335047+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335047+0000","last_undegraded":"2023-12-04T05:38:27.335047+0000","last_fullsized":"2023-12-04T05:38:27.335047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324269+0000","last_change":"2023-12-04T05:38:27.324269+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324269+0000","last_undegraded":"2023-12-04T05:38:27.324269+0000","last_fullsized":"2023-12-04T05:38:27.324269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327689+0000","last_change":"2023-12-04T05:38:27.327689+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327689+0000","last_undegraded":"2023-12-04T05:38:27.327689+0000","last_fullsized":"2023-12-04T05:38:27.327689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-04T05:38:24.300607+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:24.300607+0000","last_peered":"2023-12-04T05:38:24.300607+0000","last_clean":"2023-12-04T05:38:24.300607+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:24.300607+0000","last_undegraded":"2023-12-04T05:38:24.300607+0000","last_fullsized":"2023-12-04T05:38:24.300607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.71199999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.875},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.755}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.62},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.872},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.90000000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.84499999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.81699999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.312},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.622}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.432}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.90500000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.84899999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:33.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:33.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:38:33.479 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:38:33.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 Processor -- start 2023-12-04T05:38:33.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 -- start start 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87e0151ed0 0x7f87e00c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 0x7f87e0154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00c4e50 con 0x7f87e00bd650 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00c56d0 con 0x7f87e0151ed0 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87e689c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e01552d0 con 0x7f87e00c7ec0 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87e0151ed0 0x7f87e00c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f87e0151ed0 0x7f87e00c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40072/0 (socket says 172.21.15.97:40072) 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 -- 172.21.15.97:0/4095740511 learned_addr learned my addr 172.21.15.97:0/4095740511 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:33.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87df7fe640 1 --2- 172.21.15.97:0/4095740511 >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 0x7f87e0154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 -- 172.21.15.97:0/4095740511 >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 msgr2=0x7f87e0154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:33.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 --2- 172.21.15.97:0/4095740511 >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 0x7f87e0154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 -- 172.21.15.97:0/4095740511 >> v1:172.21.15.143:6789/0 conn(0x7f87e00bd650 legacy=0x7f87e0154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:33.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87dffff640 1 -- 172.21.15.97:0/4095740511 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00c52e0 con 0x7f87e0151ed0 2023-12-04T05:38:33.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.565+0000 7f87df7fe640 1 --2- 172.21.15.97:0/4095740511 >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 0x7f87e0154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:33.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87dffff640 1 --2- 172.21.15.97:0/4095740511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e0151ed0 0x7f87e00c69d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f87e00c74e0 tx=0x7f87d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3fd0e6125b246b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87deffd640 1 -- 172.21.15.97:0/4095740511 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00ab600 con 0x7f87e0151ed0 2023-12-04T05:38:33.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87deffd640 1 -- 172.21.15.97:0/4095740511 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00ab760 con 0x7f87e0151ed0 2023-12-04T05:38:33.575 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87deffd640 1 -- 172.21.15.97:0/4095740511 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00abaf0 con 0x7f87e0151ed0 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 -- 172.21.15.97:0/4095740511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e0151ed0 msgr2=0x7f87e00c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 --2- 172.21.15.97:0/4095740511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e0151ed0 0x7f87e00c69d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f87e00c74e0 tx=0x7f87d001c400 comp rx=0 tx=0).stop 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 -- 172.21.15.97:0/4095740511 shutdown_connections 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 --2- 172.21.15.97:0/4095740511 >> v2:172.21.15.143:3300/0 conn(0x7f87e00c7ec0 0x7f87e0154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 --2- 172.21.15.97:0/4095740511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e0151ed0 0x7f87e00c69d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 -- 172.21.15.97:0/4095740511 >> 172.21.15.97:0/4095740511 conn(0x7f87e0073b20 msgr2=0x7f87e00c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 -- 172.21.15.97:0/4095740511 shutdown_connections 2023-12-04T05:38:33.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.569+0000 7f87e689c640 1 -- 172.21.15.97:0/4095740511 wait complete. 2023-12-04T05:38:33.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 Processor -- start 2023-12-04T05:38:33.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 -- start start 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 0x7f87e01f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87e00c04a0 0x7f87e0153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e01f1210 con 0x7f87e00bd650 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e01ed380 con 0x7f87e00c7ec0 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e01ecd50 con 0x7f87e00c04a0 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40078/0 (socket says 172.21.15.97:40078) 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 -- 172.21.15.97:0/851611388 learned_addr learned my addr 172.21.15.97:0/851611388 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:33.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e4e39640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87e00c04a0 0x7f87e0153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87df7fe640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 0x7f87e01f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 -- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87e00c04a0 msgr2=0x7f87e0153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87e00c04a0 0x7f87e0153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 -- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 msgr2=0x7f87e01f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 0x7f87e01f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 -- 172.21.15.97:0/851611388 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00094d0 con 0x7f87e00bd650 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87df7fe640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 0x7f87e01f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dffff640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f87d001a030 tx=0x7f87d001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00b4800 con 0x7f87e00bd650 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00b4980 con 0x7f87e00bd650 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e00abbc0 con 0x7f87e00bd650 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.573+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00b4d30 con 0x7f87e00bd650 2023-12-04T05:38:33.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e01ed010 con 0x7f87e00bd650 2023-12-04T05:38:33.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0068440 con 0x7f87e00bd650 2023-12-04T05:38:33.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87d00c7440 con 0x7f87e00bd650 2023-12-04T05:38:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87dcff9640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 0x7f87cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87d011efc0 con 0x7f87e00bd650 2023-12-04T05:38:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87df7fe640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 0x7f87cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.577+0000 7f87df7fe640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 0x7f87cc068dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87e00bd620 tx=0x7f87d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.581+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87d00ec1f0 con 0x7f87e00bd650 2023-12-04T05:38:33.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.729+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87e0161820 con 0x7f87cc066900 2023-12-04T05:38:33.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.737+0000 7f87dcff9640 1 -- 172.21.15.97:0/851611388 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277287 (secure 0 0 0) 0x7f87d400a810 con 0x7f87cc066900 2023-12-04T05:38:33.745 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:33.747 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 msgr2=0x7f87cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 0x7f87cc068dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87e00bd620 tx=0x7f87d4008040 comp rx=0 tx=0).stop 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 msgr2=0x7f87e01ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f87d001a030 tx=0x7f87d001ac40 comp rx=0 tx=0).stop 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 shutdown_connections 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87cc066900 0x7f87cc068dc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87e00c04a0 0x7f87e0153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87e00c7ec0 0x7f87e01f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 --2- 172.21.15.97:0/851611388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87e00bd650 0x7f87e01ed810 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 >> 172.21.15.97:0/851611388 conn(0x7f87e0073b20 msgr2=0x7f87e014ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 shutdown_connections 2023-12-04T05:38:33.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.741+0000 7f87e689c640 1 -- 172.21.15.97:0/851611388 wait complete. 2023-12-04T05:38:33.765 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-04T05:38:32.213013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221712,"kb_used_data":5544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5677056,"data_stored":3042728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891969"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332858+0000","last_change":"2023-12-04T05:38:27.332858+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332858+0000","last_undegraded":"2023-12-04T05:38:27.332858+0000","last_fullsized":"2023-12-04T05:38:27.332858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325761+0000","last_change":"2023-12-04T05:38:27.325761+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325761+0000","last_undegraded":"2023-12-04T05:38:27.325761+0000","last_fullsized":"2023-12-04T05:38:27.325761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332786+0000","last_change":"2023-12-04T05:38:27.332786+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332786+0000","last_undegraded":"2023-12-04T05:38:27.332786+0000","last_fullsized":"2023-12-04T05:38:27.332786+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330697+0000","last_change":"2023-12-04T05:38:27.330697+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330697+0000","last_undegraded":"2023-12-04T05:38:27.330697+0000","last_fullsized":"2023-12-04T05:38:27.330697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330579+0000","last_change":"2023-12-04T05:38:27.330579+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330579+0000","last_undegraded":"2023-12-04T05:38:27.330579+0000","last_fullsized":"2023-12-04T05:38:27.330579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332740+0000","last_change":"2023-12-04T05:38:27.332740+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332740+0000","last_undegraded":"2023-12-04T05:38:27.332740+0000","last_fullsized":"2023-12-04T05:38:27.332740+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330456+0000","last_change":"2023-12-04T05:38:27.330456+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330456+0000","last_undegraded":"2023-12-04T05:38:27.330456+0000","last_fullsized":"2023-12-04T05:38:27.330456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.331233+0000","last_change":"2023-12-04T05:38:27.331233+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.331233+0000","last_undegraded":"2023-12-04T05:38:27.331233+0000","last_fullsized":"2023-12-04T05:38:27.331233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328764+0000","last_change":"2023-12-04T05:38:27.328764+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328764+0000","last_undegraded":"2023-12-04T05:38:27.328764+0000","last_fullsized":"2023-12-04T05:38:27.328764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325146+0000","last_change":"2023-12-04T05:38:27.325146+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325146+0000","last_undegraded":"2023-12-04T05:38:27.325146+0000","last_fullsized":"2023-12-04T05:38:27.325146+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329749+0000","last_change":"2023-12-04T05:38:27.329749+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329749+0000","last_undegraded":"2023-12-04T05:38:27.329749+0000","last_fullsized":"2023-12-04T05:38:27.329749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330507+0000","last_change":"2023-12-04T05:38:27.330507+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330507+0000","last_undegraded":"2023-12-04T05:38:27.330507+0000","last_fullsized":"2023-12-04T05:38:27.330507+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325119+0000","last_change":"2023-12-04T05:38:27.325119+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325119+0000","last_undegraded":"2023-12-04T05:38:27.325119+0000","last_fullsized":"2023-12-04T05:38:27.325119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327698+0000","last_change":"2023-12-04T05:38:27.327698+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327698+0000","last_undegraded":"2023-12-04T05:38:27.327698+0000","last_fullsized":"2023-12-04T05:38:27.327698+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329874+0000","last_change":"2023-12-04T05:38:27.329874+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329874+0000","last_undegraded":"2023-12-04T05:38:27.329874+0000","last_fullsized":"2023-12-04T05:38:27.329874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328687+0000","last_change":"2023-12-04T05:38:27.328687+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328687+0000","last_undegraded":"2023-12-04T05:38:27.328687+0000","last_fullsized":"2023-12-04T05:38:27.328687+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324487+0000","last_change":"2023-12-04T05:38:27.324487+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324487+0000","last_undegraded":"2023-12-04T05:38:27.324487+0000","last_fullsized":"2023-12-04T05:38:27.324487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.333868+0000","last_change":"2023-12-04T05:38:27.333868+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.333868+0000","last_undegraded":"2023-12-04T05:38:27.333868+0000","last_fullsized":"2023-12-04T05:38:27.333868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329436+0000","last_change":"2023-12-04T05:38:27.329436+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329436+0000","last_undegraded":"2023-12-04T05:38:27.329436+0000","last_fullsized":"2023-12-04T05:38:27.329436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332873+0000","last_change":"2023-12-04T05:38:27.332873+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332873+0000","last_undegraded":"2023-12-04T05:38:27.332873+0000","last_fullsized":"2023-12-04T05:38:27.332873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324273+0000","last_change":"2023-12-04T05:38:27.324273+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324273+0000","last_undegraded":"2023-12-04T05:38:27.324273+0000","last_fullsized":"2023-12-04T05:38:27.324273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335757+0000","last_change":"2023-12-04T05:38:27.335757+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335757+0000","last_undegraded":"2023-12-04T05:38:27.335757+0000","last_fullsized":"2023-12-04T05:38:27.335757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328834+0000","last_change":"2023-12-04T05:38:27.328834+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328834+0000","last_undegraded":"2023-12-04T05:38:27.328834+0000","last_fullsized":"2023-12-04T05:38:27.328834+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335424+0000","last_change":"2023-12-04T05:38:27.335424+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335424+0000","last_undegraded":"2023-12-04T05:38:27.335424+0000","last_fullsized":"2023-12-04T05:38:27.335424+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332799+0000","last_change":"2023-12-04T05:38:27.332799+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332799+0000","last_undegraded":"2023-12-04T05:38:27.332799+0000","last_fullsized":"2023-12-04T05:38:27.332799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330955+0000","last_change":"2023-12-04T05:38:27.330955+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330955+0000","last_undegraded":"2023-12-04T05:38:27.330955+0000","last_fullsized":"2023-12-04T05:38:27.330955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328865+0000","last_change":"2023-12-04T05:38:27.328865+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328865+0000","last_undegraded":"2023-12-04T05:38:27.328865+0000","last_fullsized":"2023-12-04T05:38:27.328865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335132+0000","last_change":"2023-12-04T05:38:27.335132+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335132+0000","last_undegraded":"2023-12-04T05:38:27.335132+0000","last_fullsized":"2023-12-04T05:38:27.335132+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328919+0000","last_change":"2023-12-04T05:38:27.328919+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328919+0000","last_undegraded":"2023-12-04T05:38:27.328919+0000","last_fullsized":"2023-12-04T05:38:27.328919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335047+0000","last_change":"2023-12-04T05:38:27.335047+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335047+0000","last_undegraded":"2023-12-04T05:38:27.335047+0000","last_fullsized":"2023-12-04T05:38:27.335047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324269+0000","last_change":"2023-12-04T05:38:27.324269+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324269+0000","last_undegraded":"2023-12-04T05:38:27.324269+0000","last_fullsized":"2023-12-04T05:38:27.324269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327689+0000","last_change":"2023-12-04T05:38:27.327689+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327689+0000","last_undegraded":"2023-12-04T05:38:27.327689+0000","last_fullsized":"2023-12-04T05:38:27.327689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-04T05:38:24.300607+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:24.300607+0000","last_peered":"2023-12-04T05:38:24.300607+0000","last_clean":"2023-12-04T05:38:24.300607+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:24.300607+0000","last_undegraded":"2023-12-04T05:38:24.300607+0000","last_fullsized":"2023-12-04T05:38:24.300607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.71199999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.875},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.755}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.62},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.872},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.90000000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.84499999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.81699999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.312},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.622}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.432}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.90500000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.84899999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:33.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:33.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.941+0000 7ffb9ca46640 1 Processor -- start 2023-12-04T05:38:33.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.941+0000 7ffb9ca46640 1 -- start start 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9ca46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb98154d50 0x7ffb9806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9ca46640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffb980a9470 0x7ffb9806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9ca46640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9806c760 con 0x7ffb98154260 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9ca46640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980a8670 con 0x7ffb980a9470 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9ca46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9806c550 con 0x7ffb98154d50 2023-12-04T05:38:33.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9659c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb98154260 0x7ffb98154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:59166/0 (socket says 172.21.15.97:59166) 2023-12-04T05:38:33.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb9659c640 1 -- 172.21.15.97:0/1151857836 learned_addr learned my addr 172.21.15.97:0/1151857836 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:33.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb96d9d640 1 --2- 172.21.15.97:0/1151857836 >> v2:172.21.15.97:3300/0 conn(0x7ffb980a9470 0x7ffb9806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb8dd9b640 1 --2- 172.21.15.97:0/1151857836 >> v2:172.21.15.143:3300/0 conn(0x7ffb98154d50 0x7ffb9806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb96d9d640 1 -- 172.21.15.97:0/1151857836 >> v2:172.21.15.143:3300/0 conn(0x7ffb98154d50 msgr2=0x7ffb9806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:33.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb96d9d640 1 --2- 172.21.15.97:0/1151857836 >> v2:172.21.15.143:3300/0 conn(0x7ffb98154d50 0x7ffb9806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb96d9d640 1 -- 172.21.15.97:0/1151857836 >> v1:172.21.15.97:6789/0 conn(0x7ffb98154260 legacy=0x7ffb98154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.945+0000 7ffb96d9d640 1 -- 172.21.15.97:0/1151857836 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9806ca40 con 0x7ffb980a9470 2023-12-04T05:38:33.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb96d9d640 1 --2- 172.21.15.97:0/1151857836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb980a9470 0x7ffb9806dd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ffb98151a20 tx=0x7ffb9001e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8fae6c9bcaf5fb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb95d9b640 1 -- 172.21.15.97:0/1151857836 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900b2600 con 0x7ffb980a9470 2023-12-04T05:38:33.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb95d9b640 1 -- 172.21.15.97:0/1151857836 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900b2760 con 0x7ffb980a9470 2023-12-04T05:38:33.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb95d9b640 1 -- 172.21.15.97:0/1151857836 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900b2af0 con 0x7ffb980a9470 2023-12-04T05:38:33.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- 172.21.15.97:0/1151857836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb980a9470 msgr2=0x7ffb9806dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/1151857836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb980a9470 0x7ffb9806dd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ffb98151a20 tx=0x7ffb9001e640 comp rx=0 tx=0).stop 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- 172.21.15.97:0/1151857836 shutdown_connections 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/1151857836 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb980a9470 0x7ffb9806dd40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/1151857836 >> v2:172.21.15.143:3300/0 conn(0x7ffb98154d50 0x7ffb9806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- 172.21.15.97:0/1151857836 >> 172.21.15.97:0/1151857836 conn(0x7ffb980c2970 msgr2=0x7ffb980c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- 172.21.15.97:0/1151857836 shutdown_connections 2023-12-04T05:38:33.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- 172.21.15.97:0/1151857836 wait complete. 2023-12-04T05:38:33.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 Processor -- start 2023-12-04T05:38:33.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.949+0000 7ffb9ca46640 1 -- start start 2023-12-04T05:38:33.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb980a9470 0x7ffb98071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb98154d50 0x7ffb9813ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98153bf0 con 0x7ffb98154260 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980c5bf0 con 0x7ffb980a9470 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980c3b00 con 0x7ffb98154d50 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:40102/0 (socket says 172.21.15.97:40102) 2023-12-04T05:38:33.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 -- 172.21.15.97:0/3302933846 learned_addr learned my addr 172.21.15.97:0/3302933846 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:33.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb96d9d640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb98154d50 0x7ffb9813ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9659c640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb980a9470 0x7ffb98071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 -- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb98154d50 msgr2=0x7ffb9813ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb98154d50 0x7ffb9813ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 -- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb980a9470 msgr2=0x7ffb98071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb980a9470 0x7ffb98071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 -- 172.21.15.97:0/3302933846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90009420 con 0x7ffb98154260 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8dd9b640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffb80007e60 tx=0x7ffb8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80003ba0 con 0x7ffb98154260 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8000ee90 con 0x7ffb98154260 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80004030 con 0x7ffb98154260 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb981ed920 con 0x7ffb98154260 2023-12-04T05:38:33.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb981edc00 con 0x7ffb98154260 2023-12-04T05:38:33.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb98068440 con 0x7ffb98154260 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.953+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb80004190 con 0x7ffb98154260 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.957+0000 7ffb8f7fe640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 0x7ffb78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.957+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb80084690 con 0x7ffb98154260 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.957+0000 7ffb9659c640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 0x7ffb78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.957+0000 7ffb9659c640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 0x7ffb78068d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005890 tx=0x7ffb88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:33.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:33.961+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb80051a10 con 0x7ffb98154260 2023-12-04T05:38:34.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.105+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb9814e4e0 con 0x7ffb780668d0 2023-12-04T05:38:34.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.113+0000 7ffb8f7fe640 1 -- 172.21.15.97:0/3302933846 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277287 (secure 0 0 0) 0x7ffb9814e4e0 con 0x7ffb780668d0 2023-12-04T05:38:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:34.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 msgr2=0x7ffb78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 0x7ffb78068d90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb88005890 tx=0x7ffb88009040 comp rx=0 tx=0).stop 2023-12-04T05:38:34.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 msgr2=0x7ffb9813e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ffb80007e60 tx=0x7ffb8000e4b0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 shutdown_connections 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb780668d0 0x7ffb78068d90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb98154d50 0x7ffb9813ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb98154260 0x7ffb9813e730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 --2- 172.21.15.97:0/3302933846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb980a9470 0x7ffb98071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 >> 172.21.15.97:0/3302933846 conn(0x7ffb980c2970 msgr2=0x7ffb9806d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 shutdown_connections 2023-12-04T05:38:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.117+0000 7ffb9ca46640 1 -- 172.21.15.97:0/3302933846 wait complete. 2023-12-04T05:38:34.142 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-04T05:38:32.213013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":221712,"kb_used_data":5544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5677056,"data_stored":3042728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891969"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332858+0000","last_change":"2023-12-04T05:38:27.332858+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332858+0000","last_undegraded":"2023-12-04T05:38:27.332858+0000","last_fullsized":"2023-12-04T05:38:27.332858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325761+0000","last_change":"2023-12-04T05:38:27.325761+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325761+0000","last_undegraded":"2023-12-04T05:38:27.325761+0000","last_fullsized":"2023-12-04T05:38:27.325761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332786+0000","last_change":"2023-12-04T05:38:27.332786+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332786+0000","last_undegraded":"2023-12-04T05:38:27.332786+0000","last_fullsized":"2023-12-04T05:38:27.332786+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330697+0000","last_change":"2023-12-04T05:38:27.330697+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330697+0000","last_undegraded":"2023-12-04T05:38:27.330697+0000","last_fullsized":"2023-12-04T05:38:27.330697+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330579+0000","last_change":"2023-12-04T05:38:27.330579+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330579+0000","last_undegraded":"2023-12-04T05:38:27.330579+0000","last_fullsized":"2023-12-04T05:38:27.330579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332740+0000","last_change":"2023-12-04T05:38:27.332740+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332740+0000","last_undegraded":"2023-12-04T05:38:27.332740+0000","last_fullsized":"2023-12-04T05:38:27.332740+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330456+0000","last_change":"2023-12-04T05:38:27.330456+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330456+0000","last_undegraded":"2023-12-04T05:38:27.330456+0000","last_fullsized":"2023-12-04T05:38:27.330456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.331233+0000","last_change":"2023-12-04T05:38:27.331233+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.331233+0000","last_undegraded":"2023-12-04T05:38:27.331233+0000","last_fullsized":"2023-12-04T05:38:27.331233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328764+0000","last_change":"2023-12-04T05:38:27.328764+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328764+0000","last_undegraded":"2023-12-04T05:38:27.328764+0000","last_fullsized":"2023-12-04T05:38:27.328764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325146+0000","last_change":"2023-12-04T05:38:27.325146+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325146+0000","last_undegraded":"2023-12-04T05:38:27.325146+0000","last_fullsized":"2023-12-04T05:38:27.325146+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329749+0000","last_change":"2023-12-04T05:38:27.329749+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329749+0000","last_undegraded":"2023-12-04T05:38:27.329749+0000","last_fullsized":"2023-12-04T05:38:27.329749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330507+0000","last_change":"2023-12-04T05:38:27.330507+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330507+0000","last_undegraded":"2023-12-04T05:38:27.330507+0000","last_fullsized":"2023-12-04T05:38:27.330507+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.325119+0000","last_change":"2023-12-04T05:38:27.325119+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.325119+0000","last_undegraded":"2023-12-04T05:38:27.325119+0000","last_fullsized":"2023-12-04T05:38:27.325119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327698+0000","last_change":"2023-12-04T05:38:27.327698+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327698+0000","last_undegraded":"2023-12-04T05:38:27.327698+0000","last_fullsized":"2023-12-04T05:38:27.327698+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329874+0000","last_change":"2023-12-04T05:38:27.329874+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329874+0000","last_undegraded":"2023-12-04T05:38:27.329874+0000","last_fullsized":"2023-12-04T05:38:27.329874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328687+0000","last_change":"2023-12-04T05:38:27.328687+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328687+0000","last_undegraded":"2023-12-04T05:38:27.328687+0000","last_fullsized":"2023-12-04T05:38:27.328687+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324487+0000","last_change":"2023-12-04T05:38:27.324487+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324487+0000","last_undegraded":"2023-12-04T05:38:27.324487+0000","last_fullsized":"2023-12-04T05:38:27.324487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.333868+0000","last_change":"2023-12-04T05:38:27.333868+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.333868+0000","last_undegraded":"2023-12-04T05:38:27.333868+0000","last_fullsized":"2023-12-04T05:38:27.333868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.329436+0000","last_change":"2023-12-04T05:38:27.329436+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.329436+0000","last_undegraded":"2023-12-04T05:38:27.329436+0000","last_fullsized":"2023-12-04T05:38:27.329436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332873+0000","last_change":"2023-12-04T05:38:27.332873+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332873+0000","last_undegraded":"2023-12-04T05:38:27.332873+0000","last_fullsized":"2023-12-04T05:38:27.332873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324273+0000","last_change":"2023-12-04T05:38:27.324273+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324273+0000","last_undegraded":"2023-12-04T05:38:27.324273+0000","last_fullsized":"2023-12-04T05:38:27.324273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335757+0000","last_change":"2023-12-04T05:38:27.335757+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335757+0000","last_undegraded":"2023-12-04T05:38:27.335757+0000","last_fullsized":"2023-12-04T05:38:27.335757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328834+0000","last_change":"2023-12-04T05:38:27.328834+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328834+0000","last_undegraded":"2023-12-04T05:38:27.328834+0000","last_fullsized":"2023-12-04T05:38:27.328834+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335424+0000","last_change":"2023-12-04T05:38:27.335424+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335424+0000","last_undegraded":"2023-12-04T05:38:27.335424+0000","last_fullsized":"2023-12-04T05:38:27.335424+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.332799+0000","last_change":"2023-12-04T05:38:27.332799+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.332799+0000","last_undegraded":"2023-12-04T05:38:27.332799+0000","last_fullsized":"2023-12-04T05:38:27.332799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.330955+0000","last_change":"2023-12-04T05:38:27.330955+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.330955+0000","last_undegraded":"2023-12-04T05:38:27.330955+0000","last_fullsized":"2023-12-04T05:38:27.330955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328865+0000","last_change":"2023-12-04T05:38:27.328865+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328865+0000","last_undegraded":"2023-12-04T05:38:27.328865+0000","last_fullsized":"2023-12-04T05:38:27.328865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335132+0000","last_change":"2023-12-04T05:38:27.335132+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335132+0000","last_undegraded":"2023-12-04T05:38:27.335132+0000","last_fullsized":"2023-12-04T05:38:27.335132+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.328919+0000","last_change":"2023-12-04T05:38:27.328919+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.328919+0000","last_undegraded":"2023-12-04T05:38:27.328919+0000","last_fullsized":"2023-12-04T05:38:27.328919+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.335047+0000","last_change":"2023-12-04T05:38:27.335047+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.335047+0000","last_undegraded":"2023-12-04T05:38:27.335047+0000","last_fullsized":"2023-12-04T05:38:27.335047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.324269+0000","last_change":"2023-12-04T05:38:27.324269+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.324269+0000","last_undegraded":"2023-12-04T05:38:27.324269+0000","last_fullsized":"2023-12-04T05:38:27.324269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:38:28.320731+0000","last_change":"2023-12-04T05:38:28.320731+0000","last_active":"2023-12-04T05:38:28.320731+0000","last_peered":"2023-12-04T05:38:28.320731+0000","last_clean":"2023-12-04T05:38:28.320731+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:28.320731+0000","last_undegraded":"2023-12-04T05:38:28.320731+0000","last_fullsized":"2023-12-04T05:38:28.320731+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-04T05:38:27.327689+0000","last_change":"2023-12-04T05:38:27.327689+0000","last_active":"2023-12-04T05:38:27.311466+0000","last_peered":"2023-12-04T05:38:27.311466+0000","last_clean":"2023-12-04T05:38:27.311466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:38:27.327689+0000","last_undegraded":"2023-12-04T05:38:27.327689+0000","last_fullsized":"2023-12-04T05:38:27.327689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-04T05:38:24.300607+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:24.300607+0000","last_peered":"2023-12-04T05:38:24.300607+0000","last_clean":"2023-12-04T05:38:24.300607+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:24.300607+0000","last_undegraded":"2023-12-04T05:38:24.300607+0000","last_fullsized":"2023-12-04T05:38:24.300607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77700000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.85699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.71199999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.875},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.755}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.62},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.872},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.90000000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54400000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.74099999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.60699999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.84499999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.81699999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.312},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":0.622}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505}]},{"osd":4,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":8.5719999999999992,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":8.4860000000000007,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.38200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":6.2779999999999996,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":7.8289999999999997,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.432}]},{"osd":3,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.0380000000000003,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":8.4309999999999992,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.47799999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.8150000000000004,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.83499999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.234,"5min":8.234,"15min":8.234},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.90500000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":7.1630000000000003,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.84899999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:37:29 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":8.1910000000000007,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.8470000000000004,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:34.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-12-04T05:38:34.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-12-04T05:38:34.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-12-04T05:38:34.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.332858+0000', 'last_change': '2023-12-04T05:38:27.332858+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.332858+0000', 'last_undegraded': '2023-12-04T05:38:27.332858+0000', 'last_fullsized': '2023-12-04T05:38:27.332858+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.325761+0000', 'last_change': '2023-12-04T05:38:27.325761+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.325761+0000', 'last_undegraded': '2023-12-04T05:38:27.325761+0000', 'last_fullsized': '2023-12-04T05:38:27.325761+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-12-04T05:38:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.332786+0000', 'last_change': '2023-12-04T05:38:27.332786+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.332786+0000', 'last_undegraded': '2023-12-04T05:38:27.332786+0000', 'last_fullsized': '2023-12-04T05:38:27.332786+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.330697+0000', 'last_change': '2023-12-04T05:38:27.330697+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.330697+0000', 'last_undegraded': '2023-12-04T05:38:27.330697+0000', 'last_fullsized': '2023-12-04T05:38:27.330697+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.330579+0000', 'last_change': '2023-12-04T05:38:27.330579+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.330579+0000', 'last_undegraded': '2023-12-04T05:38:27.330579+0000', 'last_fullsized': '2023-12-04T05:38:27.330579+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-12-04T05:38:34.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.332740+0000', 'last_change': '2023-12-04T05:38:27.332740+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.332740+0000', 'last_undegraded': '2023-12-04T05:38:27.332740+0000', 'last_fullsized': '2023-12-04T05:38:27.332740+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.330456+0000', 'last_change': '2023-12-04T05:38:27.330456+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.330456+0000', 'last_undegraded': '2023-12-04T05:38:27.330456+0000', 'last_fullsized': '2023-12-04T05:38:27.330456+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.331233+0000', 'last_change': '2023-12-04T05:38:27.331233+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.331233+0000', 'last_undegraded': '2023-12-04T05:38:27.331233+0000', 'last_fullsized': '2023-12-04T05:38:27.331233+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-12-04T05:38:34.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.328764+0000', 'last_change': '2023-12-04T05:38:27.328764+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.328764+0000', 'last_undegraded': '2023-12-04T05:38:27.328764+0000', 'last_fullsized': '2023-12-04T05:38:27.328764+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.325146+0000', 'last_change': '2023-12-04T05:38:27.325146+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.325146+0000', 'last_undegraded': '2023-12-04T05:38:27.325146+0000', 'last_fullsized': '2023-12-04T05:38:27.325146+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.329749+0000', 'last_change': '2023-12-04T05:38:27.329749+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.329749+0000', 'last_undegraded': '2023-12-04T05:38:27.329749+0000', 'last_fullsized': '2023-12-04T05:38:27.329749+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-04T05:38:34.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.330507+0000', 'last_change': '2023-12-04T05:38:27.330507+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.330507+0000', 'last_undegraded': '2023-12-04T05:38:27.330507+0000', 'last_fullsized': '2023-12-04T05:38:27.330507+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.325119+0000', 'last_change': '2023-12-04T05:38:27.325119+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.325119+0000', 'last_undegraded': '2023-12-04T05:38:27.325119+0000', 'last_fullsized': '2023-12-04T05:38:27.325119+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-12-04T05:38:34.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.327698+0000', 'last_change': '2023-12-04T05:38:27.327698+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.327698+0000', 'last_undegraded': '2023-12-04T05:38:27.327698+0000', 'last_fullsized': '2023-12-04T05:38:27.327698+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.329874+0000', 'last_change': '2023-12-04T05:38:27.329874+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.329874+0000', 'last_undegraded': '2023-12-04T05:38:27.329874+0000', 'last_fullsized': '2023-12-04T05:38:27.329874+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.328687+0000', 'last_change': '2023-12-04T05:38:27.328687+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.328687+0000', 'last_undegraded': '2023-12-04T05:38:27.328687+0000', 'last_fullsized': '2023-12-04T05:38:27.328687+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.324487+0000', 'last_change': '2023-12-04T05:38:27.324487+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.324487+0000', 'last_undegraded': '2023-12-04T05:38:27.324487+0000', 'last_fullsized': '2023-12-04T05:38:27.324487+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.333868+0000', 'last_change': '2023-12-04T05:38:27.333868+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.333868+0000', 'last_undegraded': '2023-12-04T05:38:27.333868+0000', 'last_fullsized': '2023-12-04T05:38:27.333868+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.329436+0000', 'last_change': '2023-12-04T05:38:27.329436+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.329436+0000', 'last_undegraded': '2023-12-04T05:38:27.329436+0000', 'last_fullsized': '2023-12-04T05:38:27.329436+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-12-04T05:38:34.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.332873+0000', 'last_change': '2023-12-04T05:38:27.332873+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.332873+0000', 'last_undegraded': '2023-12-04T05:38:27.332873+0000', 'last_fullsized': '2023-12-04T05:38:27.332873+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.324273+0000', 'last_change': '2023-12-04T05:38:27.324273+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.324273+0000', 'last_undegraded': '2023-12-04T05:38:27.324273+0000', 'last_fullsized': '2023-12-04T05:38:27.324273+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.335757+0000', 'last_change': '2023-12-04T05:38:27.335757+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.335757+0000', 'last_undegraded': '2023-12-04T05:38:27.335757+0000', 'last_fullsized': '2023-12-04T05:38:27.335757+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-04T05:38:34.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.328834+0000', 'last_change': '2023-12-04T05:38:27.328834+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.328834+0000', 'last_undegraded': '2023-12-04T05:38:27.328834+0000', 'last_fullsized': '2023-12-04T05:38:27.328834+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.335424+0000', 'last_change': '2023-12-04T05:38:27.335424+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.335424+0000', 'last_undegraded': '2023-12-04T05:38:27.335424+0000', 'last_fullsized': '2023-12-04T05:38:27.335424+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-12-04T05:38:34.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.332799+0000', 'last_change': '2023-12-04T05:38:27.332799+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.332799+0000', 'last_undegraded': '2023-12-04T05:38:27.332799+0000', 'last_fullsized': '2023-12-04T05:38:27.332799+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.330955+0000', 'last_change': '2023-12-04T05:38:27.330955+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.330955+0000', 'last_undegraded': '2023-12-04T05:38:27.330955+0000', 'last_fullsized': '2023-12-04T05:38:27.330955+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.328865+0000', 'last_change': '2023-12-04T05:38:27.328865+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.328865+0000', 'last_undegraded': '2023-12-04T05:38:27.328865+0000', 'last_fullsized': '2023-12-04T05:38:27.328865+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.335132+0000', 'last_change': '2023-12-04T05:38:27.335132+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.335132+0000', 'last_undegraded': '2023-12-04T05:38:27.335132+0000', 'last_fullsized': '2023-12-04T05:38:27.335132+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.328919+0000', 'last_change': '2023-12-04T05:38:27.328919+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.328919+0000', 'last_undegraded': '2023-12-04T05:38:27.328919+0000', 'last_fullsized': '2023-12-04T05:38:27.328919+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.335047+0000', 'last_change': '2023-12-04T05:38:27.335047+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.335047+0000', 'last_undegraded': '2023-12-04T05:38:27.335047+0000', 'last_fullsized': '2023-12-04T05:38:27.335047+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-12-04T05:38:34.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.324269+0000', 'last_change': '2023-12-04T05:38:27.324269+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.324269+0000', 'last_undegraded': '2023-12-04T05:38:27.324269+0000', 'last_fullsized': '2023-12-04T05:38:27.324269+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-04T05:38:28.320731+0000', 'last_change': '2023-12-04T05:38:28.320731+0000', 'last_active': '2023-12-04T05:38:28.320731+0000', 'last_peered': '2023-12-04T05:38:28.320731+0000', 'last_clean': '2023-12-04T05:38:28.320731+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:28.320731+0000', 'last_undegraded': '2023-12-04T05:38:28.320731+0000', 'last_fullsized': '2023-12-04T05:38:28.320731+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:28.320731+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-12-04T05:38:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-04T05:38:27.327689+0000', 'last_change': '2023-12-04T05:38:27.327689+0000', 'last_active': '2023-12-04T05:38:27.311466+0000', 'last_peered': '2023-12-04T05:38:27.311466+0000', 'last_clean': '2023-12-04T05:38:27.311466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-04T05:38:27.327689+0000', 'last_undegraded': '2023-12-04T05:38:27.327689+0000', 'last_fullsized': '2023-12-04T05:38:27.327689+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'last_clean_scrub_stamp': '2023-12-04T05:38:27.311466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-04T05:38:34.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-04T05:38:34.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 Processor -- start 2023-12-04T05:38:34.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 -- start start 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0aa40c2a00 0x7f0aa41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40739b0 con 0x7f0aa40c1030 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa4155710 con 0x7f0aa406b860 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aaa4d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40c15a0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0aa40c1030 0x7f0aa4157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60012/0 (socket says 172.21.15.97:60012) 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa37fe640 1 -- 172.21.15.97:0/2851643348 learned_addr learned my addr 172.21.15.97:0/2851643348 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:34.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa8a73640 1 --2- 172.21.15.97:0/2851643348 >> v2:172.21.15.97:3300/0 conn(0x7f0aa40c2a00 0x7f0aa41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa2ffd640 1 -- 172.21.15.97:0/2851643348 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785414914 0 0) 0x7f0aa40739b0 con 0x7f0aa40c1030 2023-12-04T05:38:34.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa2ffd640 1 -- 172.21.15.97:0/2851643348 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8c003530 con 0x7f0aa40c1030 2023-12-04T05:38:34.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa8a73640 1 -- 172.21.15.97:0/2851643348 >> v1:172.21.15.143:6789/0 conn(0x7f0aa406b860 legacy=0x7f0aa4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa8a73640 1 -- 172.21.15.97:0/2851643348 >> v1:172.21.15.97:6789/0 conn(0x7f0aa40c1030 legacy=0x7f0aa4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.317+0000 7f0aa8a73640 1 -- 172.21.15.97:0/2851643348 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4073680 con 0x7f0aa40c2a00 2023-12-04T05:38:34.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aa8a73640 1 --2- 172.21.15.97:0/2851643348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41584b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63610cb5e3903b25 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aa2ffd640 1 -- 172.21.15.97:0/2851643348 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a5890 con 0x7f0aa40c2a00 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aa2ffd640 1 -- 172.21.15.97:0/2851643348 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0a59f0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aa2ffd640 1 -- 172.21.15.97:0/2851643348 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0a5d80 con 0x7f0aa40c2a00 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/2851643348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 msgr2=0x7f0aa41584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/2851643348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41584b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c01c8c0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/2851643348 shutdown_connections 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/2851643348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41584b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/2851643348 >> 172.21.15.97:0/2851643348 conn(0x7f0aa40c3130 msgr2=0x7f0aa40c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/2851643348 shutdown_connections 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.321+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/2851643348 wait complete. 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 Processor -- start 2023-12-04T05:38:34.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- start start 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa406b860 0x7f0aa41efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 0x7f0aa414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40722f0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41f0000 con 0x7f0aa406b860 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4072b00 con 0x7f0aa40c1030 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58642/0 (socket says 172.21.15.97:58642) 2023-12-04T05:38:34.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 -- 172.21.15.97:0/991334313 learned_addr learned my addr 172.21.15.97:0/991334313 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:34.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa3fff640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa406b860 0x7f0aa41efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa37fe640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 0x7f0aa414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 -- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 msgr2=0x7f0aa414ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 0x7f0aa414ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 -- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa406b860 msgr2=0x7f0aa41efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa406b860 0x7f0aa41efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 -- 172.21.15.97:0/991334313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c009a70 con 0x7f0aa40c2a00 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa37fe640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 0x7f0aa414ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa8a73640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0b0040 tx=0x7f0a9c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0b9650 con 0x7f0aa40c2a00 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0b97d0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0b9b80 con 0x7f0aa40c2a00 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa4072540 con 0x7f0aa40c2a00 2023-12-04T05:38:34.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa414e680 con 0x7f0aa40c2a00 2023-12-04T05:38:34.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.325+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa414e4c0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.329+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a9c0b9ce0 con 0x7f0aa40c2a00 2023-12-04T05:38:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.329+0000 7f0aa0ff9640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 0x7f0a90068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.329+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a9c11f460 con 0x7f0aa40c2a00 2023-12-04T05:38:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.329+0000 7f0aa3fff640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 0x7f0a90068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.329+0000 7f0aa3fff640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 0x7f0a90068dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0a94000f70 tx=0x7f0a94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.333+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a9c0ec610 con 0x7f0aa40c2a00 2023-12-04T05:38:34.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0aa4068440 con 0x7f0aa40c2a00 2023-12-04T05:38:34.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aa0ff9640 1 -- 172.21.15.97:0/991334313 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7f0a9c0efc30 con 0x7f0aa40c2a00 2023-12-04T05:38:34.542 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:34.543 INFO:teuthology.orchestra.run.smithi097.stdout:{"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":139,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1701668187,"num_in_osds":8,"osd_in_since":1701668177,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":227422208,"bytes_avail":772866691072,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-12-04T05:38:10.209511+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-04T05:38:34.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 msgr2=0x7f0a90068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 0x7f0a90068dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0a94000f70 tx=0x7f0a94009040 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 msgr2=0x7f0aa41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.537+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0b0040 tx=0x7f0a9c019660 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 shutdown_connections 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a90066900 0x7f0a90068dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0aa40c2a00 0x7f0aa41539f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0aa40c1030 0x7f0aa414ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 --2- 172.21.15.97:0/991334313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0aa406b860 0x7f0aa41efac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 >> 172.21.15.97:0/991334313 conn(0x7f0aa40c3130 msgr2=0x7f0aa4151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 shutdown_connections 2023-12-04T05:38:34.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.541+0000 7f0aaa4d6640 1 -- 172.21.15.97:0/991334313 wait complete. 2023-12-04T05:38:34.564 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-04T05:38:34.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:34.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 Processor -- start 2023-12-04T05:38:34.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 -- start start 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd02414e970 0x7fd02406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd02406be00 0x7fd02406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd024152300 con 0x7fd024071a10 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd024071580 con 0x7fd02406be00 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd02abf5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02414ed50 con 0x7fd02414e970 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd02406be00 0x7fd02406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd029192640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd024071a10 0x7fd0240c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60024/0 (socket says 172.21.15.97:60024) 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd02406be00 0x7fd02406ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58644/0 (socket says 172.21.15.97:58644) 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd029192640 1 -- 172.21.15.97:0/1382360037 learned_addr learned my addr 172.21.15.97:0/1382360037 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:34.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd028991640 1 --2- 172.21.15.97:0/1382360037 >> v2:172.21.15.143:3300/0 conn(0x7fd02414e970 0x7fd02406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 -- 172.21.15.97:0/1382360037 >> v2:172.21.15.143:3300/0 conn(0x7fd02414e970 msgr2=0x7fd02406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:34.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1382360037 >> v2:172.21.15.143:3300/0 conn(0x7fd02414e970 0x7fd02406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 -- 172.21.15.97:0/1382360037 >> v1:172.21.15.97:6789/0 conn(0x7fd024071a10 legacy=0x7fd0240c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01bfff640 1 -- 172.21.15.97:0/1382360037 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024151d60 con 0x7fd02406be00 2023-12-04T05:38:34.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.697+0000 7fd01b7fe640 1 -- 172.21.15.97:0/1382360037 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397088950 0 0) 0x7fd01c0014a0 con 0x7fd024071a10 2023-12-04T05:38:34.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1382360037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd02406ca50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd024072510 tx=0x7fd01401ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab2f9624d5ae19b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd01b7fe640 1 -- 172.21.15.97:0/1382360037 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0140a7940 con 0x7fd02406be00 2023-12-04T05:38:34.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd01b7fe640 1 -- 172.21.15.97:0/1382360037 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0140a7aa0 con 0x7fd02406be00 2023-12-04T05:38:34.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd01b7fe640 1 -- 172.21.15.97:0/1382360037 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0140a7e30 con 0x7fd02406be00 2023-12-04T05:38:34.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 -- 172.21.15.97:0/1382360037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 msgr2=0x7fd02406ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1382360037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd02406ca50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd024072510 tx=0x7fd01401ea70 comp rx=0 tx=0).stop 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 -- 172.21.15.97:0/1382360037 shutdown_connections 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1382360037 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd02406ca50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1382360037 >> v2:172.21.15.143:3300/0 conn(0x7fd02414e970 0x7fd02406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 -- 172.21.15.97:0/1382360037 >> 172.21.15.97:0/1382360037 conn(0x7fd0240c2970 msgr2=0x7fd0240c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 -- 172.21.15.97:0/1382360037 shutdown_connections 2023-12-04T05:38:34.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.701+0000 7fd02abf5640 1 -- 172.21.15.97:0/1382360037 wait complete. 2023-12-04T05:38:34.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 Processor -- start 2023-12-04T05:38:34.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- start start 2023-12-04T05:38:34.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 0x7fd024144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.711 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd02414e970 0x7fd024144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024153be0 con 0x7fd02406be00 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024153540 con 0x7fd024071a10 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241450a0 con 0x7fd02414e970 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58660/0 (socket says 172.21.15.97:58660) 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 -- 172.21.15.97:0/1793716876 learned_addr learned my addr 172.21.15.97:0/1793716876 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 0x7fd024144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd029192640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd02414e970 0x7fd024144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 -- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd02414e970 msgr2=0x7fd024144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd02414e970 0x7fd024144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 -- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 msgr2=0x7fd024144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 0x7fd024144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 -- 172.21.15.97:0/1793716876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01400b6c0 con 0x7fd02406be00 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 0x7fd024144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:34.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd028991640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d620 tx=0x7fd02000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000b620 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000b780 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000bb10 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0240c5c90 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.705+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd024152ef0 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024068440 con 0x7fd02406be00 2023-12-04T05:38:34.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd02000bc70 con 0x7fd02406be00 2023-12-04T05:38:34.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd0197fa640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 0x7fd010068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:34.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0200848a0 con 0x7fd02406be00 2023-12-04T05:38:34.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 0x7fd010068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:34.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.709+0000 7fd01bfff640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 0x7fd010068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0140b1000 tx=0x7fd014008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:34.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.713+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd020051b70 con 0x7fd02406be00 2023-12-04T05:38:34.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.861+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd024072310 con 0x7fd0100668d0 2023-12-04T05:38:34.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.869+0000 7fd0197fa640 1 -- 172.21.15.97:0/1793716876 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289199 (secure 0 0 0) 0x7fd024072310 con 0x7fd0100668d0 2023-12-04T05:38:34.877 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:34.878 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:34.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 msgr2=0x7fd010068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 0x7fd010068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0140b1000 tx=0x7fd014008040 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 msgr2=0x7fd024154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d620 tx=0x7fd02000dae0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 shutdown_connections 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0100668d0 0x7fd010068d90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd02414e970 0x7fd024144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd024071a10 0x7fd024144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 --2- 172.21.15.97:0/1793716876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd02406be00 0x7fd024154fb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 >> 172.21.15.97:0/1793716876 conn(0x7fd0240c2970 msgr2=0x7fd02406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 shutdown_connections 2023-12-04T05:38:34.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:34.873+0000 7fd02abf5640 1 -- 172.21.15.97:0/1793716876 wait complete. 2023-12-04T05:38:34.897 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-12-04T05:38:34.213309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222092,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752628,"statfs":{"total":773094113280,"available":772866691072,"internally_reserved":0,"allocated":6037504,"data_stored":3202284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000955"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343909+0000","last_change":"2023-12-04T05:38:29.352962+0000","last_active":"2023-12-04T05:38:30.343909+0000","last_peered":"2023-12-04T05:38:30.343909+0000","last_clean":"2023-12-04T05:38:30.343909+0000","last_became_active":"2023-12-04T05:38:29.352682+0000","last_became_peered":"2023-12-04T05:38:29.352682+0000","last_unstale":"2023-12-04T05:38:30.343909+0000","last_undegraded":"2023-12-04T05:38:30.343909+0000","last_fullsized":"2023-12-04T05:38:30.343909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:46.992332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340053+0000","last_change":"2023-12-04T05:38:29.357484+0000","last_active":"2023-12-04T05:38:30.340053+0000","last_peered":"2023-12-04T05:38:30.340053+0000","last_clean":"2023-12-04T05:38:30.340053+0000","last_became_active":"2023-12-04T05:38:29.356776+0000","last_became_peered":"2023-12-04T05:38:29.356776+0000","last_unstale":"2023-12-04T05:38:30.340053+0000","last_undegraded":"2023-12-04T05:38:30.340053+0000","last_fullsized":"2023-12-04T05:38:30.340053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:18.360524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343979+0000","last_change":"2023-12-04T05:38:29.369361+0000","last_active":"2023-12-04T05:38:30.343979+0000","last_peered":"2023-12-04T05:38:30.343979+0000","last_clean":"2023-12-04T05:38:30.343979+0000","last_became_active":"2023-12-04T05:38:29.369066+0000","last_became_peered":"2023-12-04T05:38:29.369066+0000","last_unstale":"2023-12-04T05:38:30.343979+0000","last_undegraded":"2023-12-04T05:38:30.343979+0000","last_fullsized":"2023-12-04T05:38:30.343979+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344595+0000","last_change":"2023-12-04T05:38:29.352890+0000","last_active":"2023-12-04T05:38:30.344595+0000","last_peered":"2023-12-04T05:38:30.344595+0000","last_clean":"2023-12-04T05:38:30.344595+0000","last_became_active":"2023-12-04T05:38:29.352561+0000","last_became_peered":"2023-12-04T05:38:29.352561+0000","last_unstale":"2023-12-04T05:38:30.344595+0000","last_undegraded":"2023-12-04T05:38:30.344595+0000","last_fullsized":"2023-12-04T05:38:30.344595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:26.518247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343561+0000","last_change":"2023-12-04T05:38:29.357624+0000","last_active":"2023-12-04T05:38:30.343561+0000","last_peered":"2023-12-04T05:38:30.343561+0000","last_clean":"2023-12-04T05:38:30.343561+0000","last_became_active":"2023-12-04T05:38:29.357119+0000","last_became_peered":"2023-12-04T05:38:29.357119+0000","last_unstale":"2023-12-04T05:38:30.343561+0000","last_undegraded":"2023-12-04T05:38:30.343561+0000","last_fullsized":"2023-12-04T05:38:30.343561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:20.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343081+0000","last_change":"2023-12-04T05:38:29.346548+0000","last_active":"2023-12-04T05:38:30.343081+0000","last_peered":"2023-12-04T05:38:30.343081+0000","last_clean":"2023-12-04T05:38:30.343081+0000","last_became_active":"2023-12-04T05:38:29.346283+0000","last_became_peered":"2023-12-04T05:38:29.346283+0000","last_unstale":"2023-12-04T05:38:30.343081+0000","last_undegraded":"2023-12-04T05:38:30.343081+0000","last_fullsized":"2023-12-04T05:38:30.343081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341413+0000","last_change":"2023-12-04T05:38:29.357730+0000","last_active":"2023-12-04T05:38:30.341413+0000","last_peered":"2023-12-04T05:38:30.341413+0000","last_clean":"2023-12-04T05:38:30.341413+0000","last_became_active":"2023-12-04T05:38:29.357470+0000","last_became_peered":"2023-12-04T05:38:29.357470+0000","last_unstale":"2023-12-04T05:38:30.341413+0000","last_undegraded":"2023-12-04T05:38:30.341413+0000","last_fullsized":"2023-12-04T05:38:30.341413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:55.944927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339842+0000","last_change":"2023-12-04T05:38:29.344652+0000","last_active":"2023-12-04T05:38:30.339842+0000","last_peered":"2023-12-04T05:38:30.339842+0000","last_clean":"2023-12-04T05:38:30.339842+0000","last_became_active":"2023-12-04T05:38:29.344365+0000","last_became_peered":"2023-12-04T05:38:29.344365+0000","last_unstale":"2023-12-04T05:38:30.339842+0000","last_undegraded":"2023-12-04T05:38:30.339842+0000","last_fullsized":"2023-12-04T05:38:30.339842+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:23.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342784+0000","last_change":"2023-12-04T05:38:29.361093+0000","last_active":"2023-12-04T05:38:30.342784+0000","last_peered":"2023-12-04T05:38:30.342784+0000","last_clean":"2023-12-04T05:38:30.342784+0000","last_became_active":"2023-12-04T05:38:29.360800+0000","last_became_peered":"2023-12-04T05:38:29.360800+0000","last_unstale":"2023-12-04T05:38:30.342784+0000","last_undegraded":"2023-12-04T05:38:30.342784+0000","last_fullsized":"2023-12-04T05:38:30.342784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:18.687515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344171+0000","last_change":"2023-12-04T05:38:29.353550+0000","last_active":"2023-12-04T05:38:30.344171+0000","last_peered":"2023-12-04T05:38:30.344171+0000","last_clean":"2023-12-04T05:38:30.344171+0000","last_became_active":"2023-12-04T05:38:29.353168+0000","last_became_peered":"2023-12-04T05:38:29.353168+0000","last_unstale":"2023-12-04T05:38:30.344171+0000","last_undegraded":"2023-12-04T05:38:30.344171+0000","last_fullsized":"2023-12-04T05:38:30.344171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:20.689218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344042+0000","last_change":"2023-12-04T05:38:29.357106+0000","last_active":"2023-12-04T05:38:30.344042+0000","last_peered":"2023-12-04T05:38:30.344042+0000","last_clean":"2023-12-04T05:38:30.344042+0000","last_became_active":"2023-12-04T05:38:29.356781+0000","last_became_peered":"2023-12-04T05:38:29.356781+0000","last_unstale":"2023-12-04T05:38:30.344042+0000","last_undegraded":"2023-12-04T05:38:30.344042+0000","last_fullsized":"2023-12-04T05:38:30.344042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:17.004052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344649+0000","last_change":"2023-12-04T05:38:29.358871+0000","last_active":"2023-12-04T05:38:30.344649+0000","last_peered":"2023-12-04T05:38:30.344649+0000","last_clean":"2023-12-04T05:38:30.344649+0000","last_became_active":"2023-12-04T05:38:29.358575+0000","last_became_peered":"2023-12-04T05:38:29.358575+0000","last_unstale":"2023-12-04T05:38:30.344649+0000","last_undegraded":"2023-12-04T05:38:30.344649+0000","last_fullsized":"2023-12-04T05:38:30.344649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341949+0000","last_change":"2023-12-04T05:38:29.363316+0000","last_active":"2023-12-04T05:38:30.341949+0000","last_peered":"2023-12-04T05:38:30.341949+0000","last_clean":"2023-12-04T05:38:30.341949+0000","last_became_active":"2023-12-04T05:38:29.362949+0000","last_became_peered":"2023-12-04T05:38:29.362949+0000","last_unstale":"2023-12-04T05:38:30.341949+0000","last_undegraded":"2023-12-04T05:38:30.341949+0000","last_fullsized":"2023-12-04T05:38:30.341949+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:35.750245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341662+0000","last_change":"2023-12-04T05:38:29.351970+0000","last_active":"2023-12-04T05:38:30.341662+0000","last_peered":"2023-12-04T05:38:30.341662+0000","last_clean":"2023-12-04T05:38:30.341662+0000","last_became_active":"2023-12-04T05:38:29.351547+0000","last_became_peered":"2023-12-04T05:38:29.351547+0000","last_unstale":"2023-12-04T05:38:30.341662+0000","last_undegraded":"2023-12-04T05:38:30.341662+0000","last_fullsized":"2023-12-04T05:38:30.341662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:22:28.844459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342230+0000","last_change":"2023-12-04T05:38:29.349829+0000","last_active":"2023-12-04T05:38:30.342230+0000","last_peered":"2023-12-04T05:38:30.342230+0000","last_clean":"2023-12-04T05:38:30.342230+0000","last_became_active":"2023-12-04T05:38:29.349570+0000","last_became_peered":"2023-12-04T05:38:29.349570+0000","last_unstale":"2023-12-04T05:38:30.342230+0000","last_undegraded":"2023-12-04T05:38:30.342230+0000","last_fullsized":"2023-12-04T05:38:30.342230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:42:30.244005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343015+0000","last_change":"2023-12-04T05:38:29.343672+0000","last_active":"2023-12-04T05:38:30.343015+0000","last_peered":"2023-12-04T05:38:30.343015+0000","last_clean":"2023-12-04T05:38:30.343015+0000","last_became_active":"2023-12-04T05:38:29.343378+0000","last_became_peered":"2023-12-04T05:38:29.343378+0000","last_unstale":"2023-12-04T05:38:30.343015+0000","last_undegraded":"2023-12-04T05:38:30.343015+0000","last_fullsized":"2023-12-04T05:38:30.343015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340244+0000","last_change":"2023-12-04T05:38:29.348038+0000","last_active":"2023-12-04T05:38:30.340244+0000","last_peered":"2023-12-04T05:38:30.340244+0000","last_clean":"2023-12-04T05:38:30.340244+0000","last_became_active":"2023-12-04T05:38:29.346419+0000","last_became_peered":"2023-12-04T05:38:29.346419+0000","last_unstale":"2023-12-04T05:38:30.340244+0000","last_undegraded":"2023-12-04T05:38:30.340244+0000","last_fullsized":"2023-12-04T05:38:30.340244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:28.971735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344075+0000","last_change":"2023-12-04T05:38:29.370721+0000","last_active":"2023-12-04T05:38:30.344075+0000","last_peered":"2023-12-04T05:38:30.344075+0000","last_clean":"2023-12-04T05:38:30.344075+0000","last_became_active":"2023-12-04T05:38:29.370199+0000","last_became_peered":"2023-12-04T05:38:29.370199+0000","last_unstale":"2023-12-04T05:38:30.344075+0000","last_undegraded":"2023-12-04T05:38:30.344075+0000","last_fullsized":"2023-12-04T05:38:30.344075+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343771+0000","last_change":"2023-12-04T05:38:29.355850+0000","last_active":"2023-12-04T05:38:30.343771+0000","last_peered":"2023-12-04T05:38:30.343771+0000","last_clean":"2023-12-04T05:38:30.343771+0000","last_became_active":"2023-12-04T05:38:29.355549+0000","last_became_peered":"2023-12-04T05:38:29.355549+0000","last_unstale":"2023-12-04T05:38:30.343771+0000","last_undegraded":"2023-12-04T05:38:30.343771+0000","last_fullsized":"2023-12-04T05:38:30.343771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:07.261586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340050+0000","last_change":"2023-12-04T05:38:29.345961+0000","last_active":"2023-12-04T05:38:30.340050+0000","last_peered":"2023-12-04T05:38:30.340050+0000","last_clean":"2023-12-04T05:38:30.340050+0000","last_became_active":"2023-12-04T05:38:29.345359+0000","last_became_peered":"2023-12-04T05:38:29.345359+0000","last_unstale":"2023-12-04T05:38:30.340050+0000","last_undegraded":"2023-12-04T05:38:30.340050+0000","last_fullsized":"2023-12-04T05:38:30.340050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:19.090966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343762+0000","last_change":"2023-12-04T05:38:29.366491+0000","last_active":"2023-12-04T05:38:30.343762+0000","last_peered":"2023-12-04T05:38:30.343762+0000","last_clean":"2023-12-04T05:38:30.343762+0000","last_became_active":"2023-12-04T05:38:29.366202+0000","last_became_peered":"2023-12-04T05:38:29.366202+0000","last_unstale":"2023-12-04T05:38:30.343762+0000","last_undegraded":"2023-12-04T05:38:30.343762+0000","last_fullsized":"2023-12-04T05:38:30.343762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340190+0000","last_change":"2023-12-04T05:38:29.353157+0000","last_active":"2023-12-04T05:38:30.340190+0000","last_peered":"2023-12-04T05:38:30.340190+0000","last_clean":"2023-12-04T05:38:30.340190+0000","last_became_active":"2023-12-04T05:38:29.352879+0000","last_became_peered":"2023-12-04T05:38:29.352879+0000","last_unstale":"2023-12-04T05:38:30.340190+0000","last_undegraded":"2023-12-04T05:38:30.340190+0000","last_fullsized":"2023-12-04T05:38:30.340190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:02.199367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343806+0000","last_change":"2023-12-04T05:38:29.368754+0000","last_active":"2023-12-04T05:38:30.343806+0000","last_peered":"2023-12-04T05:38:30.343806+0000","last_clean":"2023-12-04T05:38:30.343806+0000","last_became_active":"2023-12-04T05:38:29.368261+0000","last_became_peered":"2023-12-04T05:38:29.368261+0000","last_unstale":"2023-12-04T05:38:30.343806+0000","last_undegraded":"2023-12-04T05:38:30.343806+0000","last_fullsized":"2023-12-04T05:38:30.343806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341491+0000","last_change":"2023-12-04T05:38:29.363152+0000","last_active":"2023-12-04T05:38:30.341491+0000","last_peered":"2023-12-04T05:38:30.341491+0000","last_clean":"2023-12-04T05:38:30.341491+0000","last_became_active":"2023-12-04T05:38:29.362819+0000","last_became_peered":"2023-12-04T05:38:29.362819+0000","last_unstale":"2023-12-04T05:38:30.341491+0000","last_undegraded":"2023-12-04T05:38:30.341491+0000","last_fullsized":"2023-12-04T05:38:30.341491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:09.247784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344090+0000","last_change":"2023-12-04T05:38:29.362074+0000","last_active":"2023-12-04T05:38:30.344090+0000","last_peered":"2023-12-04T05:38:30.344090+0000","last_clean":"2023-12-04T05:38:30.344090+0000","last_became_active":"2023-12-04T05:38:29.361714+0000","last_became_peered":"2023-12-04T05:38:29.361714+0000","last_unstale":"2023-12-04T05:38:30.344090+0000","last_undegraded":"2023-12-04T05:38:30.344090+0000","last_fullsized":"2023-12-04T05:38:30.344090+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:51.063339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344980+0000","last_change":"2023-12-04T05:38:29.361452+0000","last_active":"2023-12-04T05:38:30.344980+0000","last_peered":"2023-12-04T05:38:30.344980+0000","last_clean":"2023-12-04T05:38:30.344980+0000","last_became_active":"2023-12-04T05:38:29.361006+0000","last_became_peered":"2023-12-04T05:38:29.361006+0000","last_unstale":"2023-12-04T05:38:30.344980+0000","last_undegraded":"2023-12-04T05:38:30.344980+0000","last_fullsized":"2023-12-04T05:38:30.344980+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344071+0000","last_change":"2023-12-04T05:38:29.347468+0000","last_active":"2023-12-04T05:38:30.344071+0000","last_peered":"2023-12-04T05:38:30.344071+0000","last_clean":"2023-12-04T05:38:30.344071+0000","last_became_active":"2023-12-04T05:38:29.347197+0000","last_became_peered":"2023-12-04T05:38:29.347197+0000","last_unstale":"2023-12-04T05:38:30.344071+0000","last_undegraded":"2023-12-04T05:38:30.344071+0000","last_fullsized":"2023-12-04T05:38:30.344071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343878+0000","last_change":"2023-12-04T05:38:29.356542+0000","last_active":"2023-12-04T05:38:30.343878+0000","last_peered":"2023-12-04T05:38:30.343878+0000","last_clean":"2023-12-04T05:38:30.343878+0000","last_became_active":"2023-12-04T05:38:29.356279+0000","last_became_peered":"2023-12-04T05:38:29.356279+0000","last_unstale":"2023-12-04T05:38:30.343878+0000","last_undegraded":"2023-12-04T05:38:30.343878+0000","last_fullsized":"2023-12-04T05:38:30.343878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:24:36.475992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340306+0000","last_change":"2023-12-04T05:38:29.357772+0000","last_active":"2023-12-04T05:38:30.340306+0000","last_peered":"2023-12-04T05:38:30.340306+0000","last_clean":"2023-12-04T05:38:30.340306+0000","last_became_active":"2023-12-04T05:38:29.357471+0000","last_became_peered":"2023-12-04T05:38:29.357471+0000","last_unstale":"2023-12-04T05:38:30.340306+0000","last_undegraded":"2023-12-04T05:38:30.340306+0000","last_fullsized":"2023-12-04T05:38:30.340306+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:00.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343732+0000","last_change":"2023-12-04T05:38:29.369540+0000","last_active":"2023-12-04T05:38:30.343732+0000","last_peered":"2023-12-04T05:38:30.343732+0000","last_clean":"2023-12-04T05:38:30.343732+0000","last_became_active":"2023-12-04T05:38:29.369243+0000","last_became_peered":"2023-12-04T05:38:29.369243+0000","last_unstale":"2023-12-04T05:38:30.343732+0000","last_undegraded":"2023-12-04T05:38:30.343732+0000","last_fullsized":"2023-12-04T05:38:30.343732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343081+0000","last_change":"2023-12-04T05:38:29.351869+0000","last_active":"2023-12-04T05:38:30.343081+0000","last_peered":"2023-12-04T05:38:30.343081+0000","last_clean":"2023-12-04T05:38:30.343081+0000","last_became_active":"2023-12-04T05:38:29.350826+0000","last_became_peered":"2023-12-04T05:38:29.350826+0000","last_unstale":"2023-12-04T05:38:30.343081+0000","last_undegraded":"2023-12-04T05:38:30.343081+0000","last_fullsized":"2023-12-04T05:38:30.343081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:12.441421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343139+0000","last_change":"2023-12-04T05:38:29.346210+0000","last_active":"2023-12-04T05:38:30.343139+0000","last_peered":"2023-12-04T05:38:30.343139+0000","last_clean":"2023-12-04T05:38:30.343139+0000","last_became_active":"2023-12-04T05:38:29.345870+0000","last_became_peered":"2023-12-04T05:38:29.345870+0000","last_unstale":"2023-12-04T05:38:30.343139+0000","last_undegraded":"2023-12-04T05:38:30.343139+0000","last_fullsized":"2023-12-04T05:38:30.343139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344407+0000","last_change":"2023-12-04T05:38:29.358811+0000","last_active":"2023-12-04T05:38:30.344407+0000","last_peered":"2023-12-04T05:38:30.344407+0000","last_clean":"2023-12-04T05:38:30.344407+0000","last_became_active":"2023-12-04T05:38:29.358559+0000","last_became_peered":"2023-12-04T05:38:29.358559+0000","last_unstale":"2023-12-04T05:38:30.344407+0000","last_undegraded":"2023-12-04T05:38:30.344407+0000","last_fullsized":"2023-12-04T05:38:30.344407+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:40.775232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379626+0000","last_change":"2023-12-04T05:38:28.357084+0000","last_active":"2023-12-04T05:38:29.379626+0000","last_peered":"2023-12-04T05:38:29.379626+0000","last_clean":"2023-12-04T05:38:29.379626+0000","last_became_active":"2023-12-04T05:38:28.356727+0000","last_became_peered":"2023-12-04T05:38:28.356727+0000","last_unstale":"2023-12-04T05:38:29.379626+0000","last_undegraded":"2023-12-04T05:38:29.379626+0000","last_fullsized":"2023-12-04T05:38:29.379626+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:17.923080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344010+0000","last_change":"2023-12-04T05:38:29.362758+0000","last_active":"2023-12-04T05:38:30.344010+0000","last_peered":"2023-12-04T05:38:30.344010+0000","last_clean":"2023-12-04T05:38:30.344010+0000","last_became_active":"2023-12-04T05:38:29.362402+0000","last_became_peered":"2023-12-04T05:38:29.362402+0000","last_unstale":"2023-12-04T05:38:30.344010+0000","last_undegraded":"2023-12-04T05:38:30.344010+0000","last_fullsized":"2023-12-04T05:38:30.344010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:19.743112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.376586+0000","last_change":"2023-12-04T05:38:28.347627+0000","last_active":"2023-12-04T05:38:29.376586+0000","last_peered":"2023-12-04T05:38:29.376586+0000","last_clean":"2023-12-04T05:38:29.376586+0000","last_became_active":"2023-12-04T05:38:28.345941+0000","last_became_peered":"2023-12-04T05:38:28.345941+0000","last_unstale":"2023-12-04T05:38:29.376586+0000","last_undegraded":"2023-12-04T05:38:29.376586+0000","last_fullsized":"2023-12-04T05:38:29.376586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:48.649051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343856+0000","last_change":"2023-12-04T05:38:29.360274+0000","last_active":"2023-12-04T05:38:30.343856+0000","last_peered":"2023-12-04T05:38:30.343856+0000","last_clean":"2023-12-04T05:38:30.343856+0000","last_became_active":"2023-12-04T05:38:29.359956+0000","last_became_peered":"2023-12-04T05:38:29.359956+0000","last_unstale":"2023-12-04T05:38:30.343856+0000","last_undegraded":"2023-12-04T05:38:30.343856+0000","last_fullsized":"2023-12-04T05:38:30.343856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379435+0000","last_change":"2023-12-04T05:38:28.353084+0000","last_active":"2023-12-04T05:38:29.379435+0000","last_peered":"2023-12-04T05:38:29.379435+0000","last_clean":"2023-12-04T05:38:29.379435+0000","last_became_active":"2023-12-04T05:38:28.351122+0000","last_became_peered":"2023-12-04T05:38:28.351122+0000","last_unstale":"2023-12-04T05:38:29.379435+0000","last_undegraded":"2023-12-04T05:38:29.379435+0000","last_fullsized":"2023-12-04T05:38:29.379435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:42.125435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344189+0000","last_change":"2023-12-04T05:38:29.358876+0000","last_active":"2023-12-04T05:38:30.344189+0000","last_peered":"2023-12-04T05:38:30.344189+0000","last_clean":"2023-12-04T05:38:30.344189+0000","last_became_active":"2023-12-04T05:38:29.358607+0000","last_became_peered":"2023-12-04T05:38:29.358607+0000","last_unstale":"2023-12-04T05:38:30.344189+0000","last_undegraded":"2023-12-04T05:38:30.344189+0000","last_fullsized":"2023-12-04T05:38:30.344189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:49.658316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.377154+0000","last_change":"2023-12-04T05:38:28.355795+0000","last_active":"2023-12-04T05:38:29.377154+0000","last_peered":"2023-12-04T05:38:29.377154+0000","last_clean":"2023-12-04T05:38:29.377154+0000","last_became_active":"2023-12-04T05:38:28.355356+0000","last_became_peered":"2023-12-04T05:38:28.355356+0000","last_unstale":"2023-12-04T05:38:29.377154+0000","last_undegraded":"2023-12-04T05:38:29.377154+0000","last_fullsized":"2023-12-04T05:38:29.377154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:07.408506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340073+0000","last_change":"2023-12-04T05:38:29.355352+0000","last_active":"2023-12-04T05:38:30.340073+0000","last_peered":"2023-12-04T05:38:30.340073+0000","last_clean":"2023-12-04T05:38:30.340073+0000","last_became_active":"2023-12-04T05:38:29.353176+0000","last_became_peered":"2023-12-04T05:38:29.353176+0000","last_unstale":"2023-12-04T05:38:30.340073+0000","last_undegraded":"2023-12-04T05:38:30.340073+0000","last_fullsized":"2023-12-04T05:38:30.340073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:07:18.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.373932+0000","last_change":"2023-12-04T05:38:28.351077+0000","last_active":"2023-12-04T05:38:29.373932+0000","last_peered":"2023-12-04T05:38:29.373932+0000","last_clean":"2023-12-04T05:38:29.373932+0000","last_became_active":"2023-12-04T05:38:28.350462+0000","last_became_peered":"2023-12-04T05:38:28.350462+0000","last_unstale":"2023-12-04T05:38:29.373932+0000","last_undegraded":"2023-12-04T05:38:29.373932+0000","last_fullsized":"2023-12-04T05:38:29.373932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:19.679953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340051+0000","last_change":"2023-12-04T05:38:29.345510+0000","last_active":"2023-12-04T05:38:30.340051+0000","last_peered":"2023-12-04T05:38:30.340051+0000","last_clean":"2023-12-04T05:38:30.340051+0000","last_became_active":"2023-12-04T05:38:29.345223+0000","last_became_peered":"2023-12-04T05:38:29.345223+0000","last_unstale":"2023-12-04T05:38:30.340051+0000","last_undegraded":"2023-12-04T05:38:30.340051+0000","last_fullsized":"2023-12-04T05:38:30.340051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:04.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379363+0000","last_change":"2023-12-04T05:38:28.351389+0000","last_active":"2023-12-04T05:38:29.379363+0000","last_peered":"2023-12-04T05:38:29.379363+0000","last_clean":"2023-12-04T05:38:29.379363+0000","last_became_active":"2023-12-04T05:38:28.350142+0000","last_became_peered":"2023-12-04T05:38:28.350142+0000","last_unstale":"2023-12-04T05:38:29.379363+0000","last_undegraded":"2023-12-04T05:38:29.379363+0000","last_fullsized":"2023-12-04T05:38:29.379363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:54.935662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341641+0000","last_change":"2023-12-04T05:38:29.360246+0000","last_active":"2023-12-04T05:38:30.341641+0000","last_peered":"2023-12-04T05:38:30.341641+0000","last_clean":"2023-12-04T05:38:30.341641+0000","last_became_active":"2023-12-04T05:38:29.359538+0000","last_became_peered":"2023-12-04T05:38:29.359538+0000","last_unstale":"2023-12-04T05:38:30.341641+0000","last_undegraded":"2023-12-04T05:38:30.341641+0000","last_fullsized":"2023-12-04T05:38:30.341641+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:07.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350276+0000","last_change":"2023-12-04T05:38:28.350133+0000","last_active":"2023-12-04T05:38:29.350276+0000","last_peered":"2023-12-04T05:38:29.350276+0000","last_clean":"2023-12-04T05:38:29.350276+0000","last_became_active":"2023-12-04T05:38:28.349752+0000","last_became_peered":"2023-12-04T05:38:28.349752+0000","last_unstale":"2023-12-04T05:38:29.350276+0000","last_undegraded":"2023-12-04T05:38:29.350276+0000","last_fullsized":"2023-12-04T05:38:29.350276+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:16.876613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339871+0000","last_change":"2023-12-04T05:38:29.349000+0000","last_active":"2023-12-04T05:38:30.339871+0000","last_peered":"2023-12-04T05:38:30.339871+0000","last_clean":"2023-12-04T05:38:30.339871+0000","last_became_active":"2023-12-04T05:38:29.348695+0000","last_became_peered":"2023-12-04T05:38:29.348695+0000","last_unstale":"2023-12-04T05:38:30.339871+0000","last_undegraded":"2023-12-04T05:38:30.339871+0000","last_fullsized":"2023-12-04T05:38:30.339871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:06.352663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.340949+0000","last_change":"2023-12-04T05:38:28.350256+0000","last_active":"2023-12-04T05:38:29.340949+0000","last_peered":"2023-12-04T05:38:29.340949+0000","last_clean":"2023-12-04T05:38:29.340949+0000","last_became_active":"2023-12-04T05:38:28.349886+0000","last_became_peered":"2023-12-04T05:38:28.349886+0000","last_unstale":"2023-12-04T05:38:29.340949+0000","last_undegraded":"2023-12-04T05:38:29.340949+0000","last_fullsized":"2023-12-04T05:38:29.340949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:35.559263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342791+0000","last_change":"2023-12-04T05:38:29.358064+0000","last_active":"2023-12-04T05:38:30.342791+0000","last_peered":"2023-12-04T05:38:30.342791+0000","last_clean":"2023-12-04T05:38:30.342791+0000","last_became_active":"2023-12-04T05:38:29.357794+0000","last_became_peered":"2023-12-04T05:38:29.357794+0000","last_unstale":"2023-12-04T05:38:30.342791+0000","last_undegraded":"2023-12-04T05:38:30.342791+0000","last_fullsized":"2023-12-04T05:38:30.342791+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:18.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.357145+0000","last_change":"2023-12-04T05:38:28.359951+0000","last_active":"2023-12-04T05:38:29.357145+0000","last_peered":"2023-12-04T05:38:29.357145+0000","last_clean":"2023-12-04T05:38:29.357145+0000","last_became_active":"2023-12-04T05:38:28.359676+0000","last_became_peered":"2023-12-04T05:38:28.359676+0000","last_unstale":"2023-12-04T05:38:29.357145+0000","last_undegraded":"2023-12-04T05:38:29.357145+0000","last_fullsized":"2023-12-04T05:38:29.357145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344365+0000","last_change":"2023-12-04T05:38:29.367074+0000","last_active":"2023-12-04T05:38:30.344365+0000","last_peered":"2023-12-04T05:38:30.344365+0000","last_clean":"2023-12-04T05:38:30.344365+0000","last_became_active":"2023-12-04T05:38:29.366753+0000","last_became_peered":"2023-12-04T05:38:29.366753+0000","last_unstale":"2023-12-04T05:38:30.344365+0000","last_undegraded":"2023-12-04T05:38:30.344365+0000","last_fullsized":"2023-12-04T05:38:30.344365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.337883+0000","last_change":"2023-12-04T05:38:28.356218+0000","last_active":"2023-12-04T05:38:29.337883+0000","last_peered":"2023-12-04T05:38:29.337883+0000","last_clean":"2023-12-04T05:38:29.337883+0000","last_became_active":"2023-12-04T05:38:28.355927+0000","last_became_peered":"2023-12-04T05:38:28.355927+0000","last_unstale":"2023-12-04T05:38:29.337883+0000","last_undegraded":"2023-12-04T05:38:29.337883+0000","last_fullsized":"2023-12-04T05:38:29.337883+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:20.717537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343599+0000","last_change":"2023-12-04T05:38:29.354032+0000","last_active":"2023-12-04T05:38:30.343599+0000","last_peered":"2023-12-04T05:38:30.343599+0000","last_clean":"2023-12-04T05:38:30.343599+0000","last_became_active":"2023-12-04T05:38:29.353619+0000","last_became_peered":"2023-12-04T05:38:29.353619+0000","last_unstale":"2023-12-04T05:38:30.343599+0000","last_undegraded":"2023-12-04T05:38:30.343599+0000","last_fullsized":"2023-12-04T05:38:30.343599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:05:21.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379334+0000","last_change":"2023-12-04T05:38:28.362801+0000","last_active":"2023-12-04T05:38:29.379334+0000","last_peered":"2023-12-04T05:38:29.379334+0000","last_clean":"2023-12-04T05:38:29.379334+0000","last_became_active":"2023-12-04T05:38:28.362494+0000","last_became_peered":"2023-12-04T05:38:28.362494+0000","last_unstale":"2023-12-04T05:38:29.379334+0000","last_undegraded":"2023-12-04T05:38:29.379334+0000","last_fullsized":"2023-12-04T05:38:29.379334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:17.678250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344117+0000","last_change":"2023-12-04T05:38:29.365812+0000","last_active":"2023-12-04T05:38:30.344117+0000","last_peered":"2023-12-04T05:38:30.344117+0000","last_clean":"2023-12-04T05:38:30.344117+0000","last_became_active":"2023-12-04T05:38:29.365171+0000","last_became_peered":"2023-12-04T05:38:29.365171+0000","last_unstale":"2023-12-04T05:38:30.344117+0000","last_undegraded":"2023-12-04T05:38:30.344117+0000","last_fullsized":"2023-12-04T05:38:30.344117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.381187+0000","last_change":"2023-12-04T05:38:28.352009+0000","last_active":"2023-12-04T05:38:29.381187+0000","last_peered":"2023-12-04T05:38:29.381187+0000","last_clean":"2023-12-04T05:38:29.381187+0000","last_became_active":"2023-12-04T05:38:28.351727+0000","last_became_peered":"2023-12-04T05:38:28.351727+0000","last_unstale":"2023-12-04T05:38:29.381187+0000","last_undegraded":"2023-12-04T05:38:29.381187+0000","last_fullsized":"2023-12-04T05:38:29.381187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:18.733847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344718+0000","last_change":"2023-12-04T05:38:29.359861+0000","last_active":"2023-12-04T05:38:30.344718+0000","last_peered":"2023-12-04T05:38:30.344718+0000","last_clean":"2023-12-04T05:38:30.344718+0000","last_became_active":"2023-12-04T05:38:29.359381+0000","last_became_peered":"2023-12-04T05:38:29.359381+0000","last_unstale":"2023-12-04T05:38:30.344718+0000","last_undegraded":"2023-12-04T05:38:30.344718+0000","last_fullsized":"2023-12-04T05:38:30.344718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372600+0000","last_change":"2023-12-04T05:38:28.358003+0000","last_active":"2023-12-04T05:38:29.372600+0000","last_peered":"2023-12-04T05:38:29.372600+0000","last_clean":"2023-12-04T05:38:29.372600+0000","last_became_active":"2023-12-04T05:38:28.357687+0000","last_became_peered":"2023-12-04T05:38:28.357687+0000","last_unstale":"2023-12-04T05:38:29.372600+0000","last_undegraded":"2023-12-04T05:38:29.372600+0000","last_fullsized":"2023-12-04T05:38:29.372600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:32.658162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343952+0000","last_change":"2023-12-04T05:38:29.366087+0000","last_active":"2023-12-04T05:38:30.343952+0000","last_peered":"2023-12-04T05:38:30.343952+0000","last_clean":"2023-12-04T05:38:30.343952+0000","last_became_active":"2023-12-04T05:38:29.365734+0000","last_became_peered":"2023-12-04T05:38:29.365734+0000","last_unstale":"2023-12-04T05:38:30.343952+0000","last_undegraded":"2023-12-04T05:38:30.343952+0000","last_fullsized":"2023-12-04T05:38:30.343952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.341874+0000","last_change":"2023-12-04T05:38:28.343022+0000","last_active":"2023-12-04T05:38:29.341874+0000","last_peered":"2023-12-04T05:38:29.341874+0000","last_clean":"2023-12-04T05:38:29.341874+0000","last_became_active":"2023-12-04T05:38:28.342601+0000","last_became_peered":"2023-12-04T05:38:28.342601+0000","last_unstale":"2023-12-04T05:38:29.341874+0000","last_undegraded":"2023-12-04T05:38:29.341874+0000","last_fullsized":"2023-12-04T05:38:29.341874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341395+0000","last_change":"2023-12-04T05:38:29.359927+0000","last_active":"2023-12-04T05:38:30.341395+0000","last_peered":"2023-12-04T05:38:30.341395+0000","last_clean":"2023-12-04T05:38:30.341395+0000","last_became_active":"2023-12-04T05:38:29.359643+0000","last_became_peered":"2023-12-04T05:38:29.359643+0000","last_unstale":"2023-12-04T05:38:30.341395+0000","last_undegraded":"2023-12-04T05:38:30.341395+0000","last_fullsized":"2023-12-04T05:38:30.341395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:11.572404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350416+0000","last_change":"2023-12-04T05:38:28.355765+0000","last_active":"2023-12-04T05:38:29.350416+0000","last_peered":"2023-12-04T05:38:29.350416+0000","last_clean":"2023-12-04T05:38:29.350416+0000","last_became_active":"2023-12-04T05:38:28.355180+0000","last_became_peered":"2023-12-04T05:38:28.355180+0000","last_unstale":"2023-12-04T05:38:29.350416+0000","last_undegraded":"2023-12-04T05:38:29.350416+0000","last_fullsized":"2023-12-04T05:38:29.350416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:40.049769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344038+0000","last_change":"2023-12-04T05:38:29.369054+0000","last_active":"2023-12-04T05:38:30.344038+0000","last_peered":"2023-12-04T05:38:30.344038+0000","last_clean":"2023-12-04T05:38:30.344038+0000","last_became_active":"2023-12-04T05:38:29.368644+0000","last_became_peered":"2023-12-04T05:38:29.368644+0000","last_unstale":"2023-12-04T05:38:30.344038+0000","last_undegraded":"2023-12-04T05:38:30.344038+0000","last_fullsized":"2023-12-04T05:38:30.344038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.378533+0000","last_change":"2023-12-04T05:38:28.356435+0000","last_active":"2023-12-04T05:38:29.378533+0000","last_peered":"2023-12-04T05:38:29.378533+0000","last_clean":"2023-12-04T05:38:29.378533+0000","last_became_active":"2023-12-04T05:38:28.356110+0000","last_became_peered":"2023-12-04T05:38:28.356110+0000","last_unstale":"2023-12-04T05:38:29.378533+0000","last_undegraded":"2023-12-04T05:38:29.378533+0000","last_fullsized":"2023-12-04T05:38:29.378533+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344088+0000","last_change":"2023-12-04T05:38:29.370474+0000","last_active":"2023-12-04T05:38:30.344088+0000","last_peered":"2023-12-04T05:38:30.344088+0000","last_clean":"2023-12-04T05:38:30.344088+0000","last_became_active":"2023-12-04T05:38:29.369734+0000","last_became_peered":"2023-12-04T05:38:29.369734+0000","last_unstale":"2023-12-04T05:38:30.344088+0000","last_undegraded":"2023-12-04T05:38:30.344088+0000","last_fullsized":"2023-12-04T05:38:30.344088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372457+0000","last_change":"2023-12-04T05:38:28.354536+0000","last_active":"2023-12-04T05:38:29.372457+0000","last_peered":"2023-12-04T05:38:29.372457+0000","last_clean":"2023-12-04T05:38:29.372457+0000","last_became_active":"2023-12-04T05:38:28.354124+0000","last_became_peered":"2023-12-04T05:38:28.354124+0000","last_unstale":"2023-12-04T05:38:29.372457+0000","last_undegraded":"2023-12-04T05:38:29.372457+0000","last_fullsized":"2023-12-04T05:38:29.372457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:27.391838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.345013+0000","last_change":"2023-12-04T05:38:29.359106+0000","last_active":"2023-12-04T05:38:30.345013+0000","last_peered":"2023-12-04T05:38:30.345013+0000","last_clean":"2023-12-04T05:38:30.345013+0000","last_became_active":"2023-12-04T05:38:29.358391+0000","last_became_peered":"2023-12-04T05:38:29.358391+0000","last_unstale":"2023-12-04T05:38:30.345013+0000","last_undegraded":"2023-12-04T05:38:30.345013+0000","last_fullsized":"2023-12-04T05:38:30.345013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379490+0000","last_change":"2023-12-04T05:38:28.354825+0000","last_active":"2023-12-04T05:38:29.379490+0000","last_peered":"2023-12-04T05:38:29.379490+0000","last_clean":"2023-12-04T05:38:29.379490+0000","last_became_active":"2023-12-04T05:38:28.354518+0000","last_became_peered":"2023-12-04T05:38:28.354518+0000","last_unstale":"2023-12-04T05:38:29.379490+0000","last_undegraded":"2023-12-04T05:38:29.379490+0000","last_fullsized":"2023-12-04T05:38:29.379490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340065+0000","last_change":"2023-12-04T05:38:29.346154+0000","last_active":"2023-12-04T05:38:30.340065+0000","last_peered":"2023-12-04T05:38:30.340065+0000","last_clean":"2023-12-04T05:38:30.340065+0000","last_became_active":"2023-12-04T05:38:29.345711+0000","last_became_peered":"2023-12-04T05:38:29.345711+0000","last_unstale":"2023-12-04T05:38:30.340065+0000","last_undegraded":"2023-12-04T05:38:30.340065+0000","last_fullsized":"2023-12-04T05:38:30.340065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:17.288502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.377121+0000","last_change":"2023-12-04T05:38:28.356962+0000","last_active":"2023-12-04T05:38:29.377121+0000","last_peered":"2023-12-04T05:38:29.377121+0000","last_clean":"2023-12-04T05:38:29.377121+0000","last_became_active":"2023-12-04T05:38:28.356599+0000","last_became_peered":"2023-12-04T05:38:28.356599+0000","last_unstale":"2023-12-04T05:38:29.377121+0000","last_undegraded":"2023-12-04T05:38:29.377121+0000","last_fullsized":"2023-12-04T05:38:29.377121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344253+0000","last_change":"2023-12-04T05:38:29.365123+0000","last_active":"2023-12-04T05:38:30.344253+0000","last_peered":"2023-12-04T05:38:30.344253+0000","last_clean":"2023-12-04T05:38:30.344253+0000","last_became_active":"2023-12-04T05:38:29.364212+0000","last_became_peered":"2023-12-04T05:38:29.364212+0000","last_unstale":"2023-12-04T05:38:30.344253+0000","last_undegraded":"2023-12-04T05:38:30.344253+0000","last_fullsized":"2023-12-04T05:38:30.344253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.333846+0000","last_change":"2023-12-04T05:38:28.350111+0000","last_active":"2023-12-04T05:38:29.333846+0000","last_peered":"2023-12-04T05:38:29.333846+0000","last_clean":"2023-12-04T05:38:29.333846+0000","last_became_active":"2023-12-04T05:38:28.349788+0000","last_became_peered":"2023-12-04T05:38:28.349788+0000","last_unstale":"2023-12-04T05:38:29.333846+0000","last_undegraded":"2023-12-04T05:38:29.333846+0000","last_fullsized":"2023-12-04T05:38:29.333846+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344575+0000","last_change":"2023-12-04T05:38:29.359656+0000","last_active":"2023-12-04T05:38:30.344575+0000","last_peered":"2023-12-04T05:38:30.344575+0000","last_clean":"2023-12-04T05:38:30.344575+0000","last_became_active":"2023-12-04T05:38:29.358747+0000","last_became_peered":"2023-12-04T05:38:29.358747+0000","last_unstale":"2023-12-04T05:38:30.344575+0000","last_undegraded":"2023-12-04T05:38:30.344575+0000","last_fullsized":"2023-12-04T05:38:30.344575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:43.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372814+0000","last_change":"2023-12-04T05:38:28.357652+0000","last_active":"2023-12-04T05:38:29.372814+0000","last_peered":"2023-12-04T05:38:29.372814+0000","last_clean":"2023-12-04T05:38:29.372814+0000","last_became_active":"2023-12-04T05:38:28.357276+0000","last_became_peered":"2023-12-04T05:38:28.357276+0000","last_unstale":"2023-12-04T05:38:29.372814+0000","last_undegraded":"2023-12-04T05:38:29.372814+0000","last_fullsized":"2023-12-04T05:38:29.372814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:25.246379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343546+0000","last_change":"2023-12-04T05:38:29.347237+0000","last_active":"2023-12-04T05:38:30.343546+0000","last_peered":"2023-12-04T05:38:30.343546+0000","last_clean":"2023-12-04T05:38:30.343546+0000","last_became_active":"2023-12-04T05:38:29.346964+0000","last_became_peered":"2023-12-04T05:38:29.346964+0000","last_unstale":"2023-12-04T05:38:30.343546+0000","last_undegraded":"2023-12-04T05:38:30.343546+0000","last_fullsized":"2023-12-04T05:38:30.343546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344584+0000","last_change":"2023-12-04T05:38:28.353652+0000","last_active":"2023-12-04T05:38:29.344584+0000","last_peered":"2023-12-04T05:38:29.344584+0000","last_clean":"2023-12-04T05:38:29.344584+0000","last_became_active":"2023-12-04T05:38:28.353358+0000","last_became_peered":"2023-12-04T05:38:28.353358+0000","last_unstale":"2023-12-04T05:38:29.344584+0000","last_undegraded":"2023-12-04T05:38:29.344584+0000","last_fullsized":"2023-12-04T05:38:29.344584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:15.125860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343913+0000","last_change":"2023-12-04T05:38:29.366166+0000","last_active":"2023-12-04T05:38:30.343913+0000","last_peered":"2023-12-04T05:38:30.343913+0000","last_clean":"2023-12-04T05:38:30.343913+0000","last_became_active":"2023-12-04T05:38:29.365434+0000","last_became_peered":"2023-12-04T05:38:29.365434+0000","last_unstale":"2023-12-04T05:38:30.343913+0000","last_undegraded":"2023-12-04T05:38:30.343913+0000","last_fullsized":"2023-12-04T05:38:30.343913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.349545+0000","last_change":"2023-12-04T05:38:28.353323+0000","last_active":"2023-12-04T05:38:29.349545+0000","last_peered":"2023-12-04T05:38:29.349545+0000","last_clean":"2023-12-04T05:38:29.349545+0000","last_became_active":"2023-12-04T05:38:28.352993+0000","last_became_peered":"2023-12-04T05:38:28.352993+0000","last_unstale":"2023-12-04T05:38:29.349545+0000","last_undegraded":"2023-12-04T05:38:29.349545+0000","last_fullsized":"2023-12-04T05:38:29.349545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:17.139808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344999+0000","last_change":"2023-12-04T05:38:29.355646+0000","last_active":"2023-12-04T05:38:30.344999+0000","last_peered":"2023-12-04T05:38:30.344999+0000","last_clean":"2023-12-04T05:38:30.344999+0000","last_became_active":"2023-12-04T05:38:29.355239+0000","last_became_peered":"2023-12-04T05:38:29.355239+0000","last_unstale":"2023-12-04T05:38:30.344999+0000","last_undegraded":"2023-12-04T05:38:30.344999+0000","last_fullsized":"2023-12-04T05:38:30.344999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379655+0000","last_change":"2023-12-04T05:38:28.339404+0000","last_active":"2023-12-04T05:38:29.379655+0000","last_peered":"2023-12-04T05:38:29.379655+0000","last_clean":"2023-12-04T05:38:29.379655+0000","last_became_active":"2023-12-04T05:38:28.339126+0000","last_became_peered":"2023-12-04T05:38:28.339126+0000","last_unstale":"2023-12-04T05:38:29.379655+0000","last_undegraded":"2023-12-04T05:38:29.379655+0000","last_fullsized":"2023-12-04T05:38:29.379655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:09:54.445347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.345124+0000","last_change":"2023-12-04T05:38:29.359342+0000","last_active":"2023-12-04T05:38:30.345124+0000","last_peered":"2023-12-04T05:38:30.345124+0000","last_clean":"2023-12-04T05:38:30.345124+0000","last_became_active":"2023-12-04T05:38:29.358806+0000","last_became_peered":"2023-12-04T05:38:29.358806+0000","last_unstale":"2023-12-04T05:38:30.345124+0000","last_undegraded":"2023-12-04T05:38:30.345124+0000","last_fullsized":"2023-12-04T05:38:30.345124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344488+0000","last_change":"2023-12-04T05:38:28.351967+0000","last_active":"2023-12-04T05:38:30.344488+0000","last_peered":"2023-12-04T05:38:30.344488+0000","last_clean":"2023-12-04T05:38:30.344488+0000","last_became_active":"2023-12-04T05:38:28.350680+0000","last_became_peered":"2023-12-04T05:38:28.350680+0000","last_unstale":"2023-12-04T05:38:30.344488+0000","last_undegraded":"2023-12-04T05:38:30.344488+0000","last_fullsized":"2023-12-04T05:38:30.344488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:37.289509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343648+0000","last_change":"2023-12-04T05:38:29.355636+0000","last_active":"2023-12-04T05:38:30.343648+0000","last_peered":"2023-12-04T05:38:30.343648+0000","last_clean":"2023-12-04T05:38:30.343648+0000","last_became_active":"2023-12-04T05:38:29.354320+0000","last_became_peered":"2023-12-04T05:38:29.354320+0000","last_unstale":"2023-12-04T05:38:30.343648+0000","last_undegraded":"2023-12-04T05:38:30.343648+0000","last_fullsized":"2023-12-04T05:38:30.343648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:36.568528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.342287+0000","last_change":"2023-12-04T05:38:28.338365+0000","last_active":"2023-12-04T05:38:29.342287+0000","last_peered":"2023-12-04T05:38:29.342287+0000","last_clean":"2023-12-04T05:38:29.342287+0000","last_became_active":"2023-12-04T05:38:28.337946+0000","last_became_peered":"2023-12-04T05:38:28.337946+0000","last_unstale":"2023-12-04T05:38:29.342287+0000","last_undegraded":"2023-12-04T05:38:29.342287+0000","last_fullsized":"2023-12-04T05:38:29.342287+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:22.800341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344253+0000","last_change":"2023-12-04T05:38:29.352860+0000","last_active":"2023-12-04T05:38:30.344253+0000","last_peered":"2023-12-04T05:38:30.344253+0000","last_clean":"2023-12-04T05:38:30.344253+0000","last_became_active":"2023-12-04T05:38:29.352511+0000","last_became_peered":"2023-12-04T05:38:29.352511+0000","last_unstale":"2023-12-04T05:38:30.344253+0000","last_undegraded":"2023-12-04T05:38:30.344253+0000","last_fullsized":"2023-12-04T05:38:30.344253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:21.726802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350310+0000","last_change":"2023-12-04T05:38:28.350094+0000","last_active":"2023-12-04T05:38:29.350310+0000","last_peered":"2023-12-04T05:38:29.350310+0000","last_clean":"2023-12-04T05:38:29.350310+0000","last_became_active":"2023-12-04T05:38:28.349731+0000","last_became_peered":"2023-12-04T05:38:28.349731+0000","last_unstale":"2023-12-04T05:38:29.350310+0000","last_undegraded":"2023-12-04T05:38:29.350310+0000","last_fullsized":"2023-12-04T05:38:29.350310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:07.362253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340235+0000","last_change":"2023-12-04T05:38:29.350276+0000","last_active":"2023-12-04T05:38:30.340235+0000","last_peered":"2023-12-04T05:38:30.340235+0000","last_clean":"2023-12-04T05:38:30.340235+0000","last_became_active":"2023-12-04T05:38:29.350015+0000","last_became_peered":"2023-12-04T05:38:29.350015+0000","last_unstale":"2023-12-04T05:38:30.340235+0000","last_undegraded":"2023-12-04T05:38:30.340235+0000","last_fullsized":"2023-12-04T05:38:30.340235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:07.900096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344239+0000","last_change":"2023-12-04T05:38:28.353620+0000","last_active":"2023-12-04T05:38:29.344239+0000","last_peered":"2023-12-04T05:38:29.344239+0000","last_clean":"2023-12-04T05:38:29.344239+0000","last_became_active":"2023-12-04T05:38:28.353260+0000","last_became_peered":"2023-12-04T05:38:28.353260+0000","last_unstale":"2023-12-04T05:38:29.344239+0000","last_undegraded":"2023-12-04T05:38:29.344239+0000","last_fullsized":"2023-12-04T05:38:29.344239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:12.165110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343952+0000","last_change":"2023-12-04T05:38:29.366519+0000","last_active":"2023-12-04T05:38:30.343952+0000","last_peered":"2023-12-04T05:38:30.343952+0000","last_clean":"2023-12-04T05:38:30.343952+0000","last_became_active":"2023-12-04T05:38:29.366308+0000","last_became_peered":"2023-12-04T05:38:29.366308+0000","last_unstale":"2023-12-04T05:38:30.343952+0000","last_undegraded":"2023-12-04T05:38:30.343952+0000","last_fullsized":"2023-12-04T05:38:30.343952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.341299+0000","last_change":"2023-12-04T05:38:28.350853+0000","last_active":"2023-12-04T05:38:29.341299+0000","last_peered":"2023-12-04T05:38:29.341299+0000","last_clean":"2023-12-04T05:38:29.341299+0000","last_became_active":"2023-12-04T05:38:28.350557+0000","last_became_peered":"2023-12-04T05:38:28.350557+0000","last_unstale":"2023-12-04T05:38:29.341299+0000","last_undegraded":"2023-12-04T05:38:29.341299+0000","last_fullsized":"2023-12-04T05:38:29.341299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343268+0000","last_change":"2023-12-04T05:38:29.348446+0000","last_active":"2023-12-04T05:38:30.343268+0000","last_peered":"2023-12-04T05:38:30.343268+0000","last_clean":"2023-12-04T05:38:30.343268+0000","last_became_active":"2023-12-04T05:38:29.348081+0000","last_became_peered":"2023-12-04T05:38:29.348081+0000","last_unstale":"2023-12-04T05:38:30.343268+0000","last_undegraded":"2023-12-04T05:38:30.343268+0000","last_fullsized":"2023-12-04T05:38:30.343268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:33.662249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344427+0000","last_change":"2023-12-04T05:38:28.346850+0000","last_active":"2023-12-04T05:38:29.344427+0000","last_peered":"2023-12-04T05:38:29.344427+0000","last_clean":"2023-12-04T05:38:29.344427+0000","last_became_active":"2023-12-04T05:38:28.346605+0000","last_became_peered":"2023-12-04T05:38:28.346605+0000","last_unstale":"2023-12-04T05:38:29.344427+0000","last_undegraded":"2023-12-04T05:38:29.344427+0000","last_fullsized":"2023-12-04T05:38:29.344427+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:22.166638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339915+0000","last_change":"2023-12-04T05:38:29.348990+0000","last_active":"2023-12-04T05:38:30.339915+0000","last_peered":"2023-12-04T05:38:30.339915+0000","last_clean":"2023-12-04T05:38:30.339915+0000","last_became_active":"2023-12-04T05:38:29.348709+0000","last_became_peered":"2023-12-04T05:38:29.348709+0000","last_unstale":"2023-12-04T05:38:30.339915+0000","last_undegraded":"2023-12-04T05:38:30.339915+0000","last_fullsized":"2023-12-04T05:38:30.339915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:17.966249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.338588+0000","last_change":"2023-12-04T05:38:28.358626+0000","last_active":"2023-12-04T05:38:29.338588+0000","last_peered":"2023-12-04T05:38:29.338588+0000","last_clean":"2023-12-04T05:38:29.338588+0000","last_became_active":"2023-12-04T05:38:28.358311+0000","last_became_peered":"2023-12-04T05:38:28.358311+0000","last_unstale":"2023-12-04T05:38:29.338588+0000","last_undegraded":"2023-12-04T05:38:29.338588+0000","last_fullsized":"2023-12-04T05:38:29.338588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:23.323105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339917+0000","last_change":"2023-12-04T05:38:29.345465+0000","last_active":"2023-12-04T05:38:30.339917+0000","last_peered":"2023-12-04T05:38:30.339917+0000","last_clean":"2023-12-04T05:38:30.339917+0000","last_became_active":"2023-12-04T05:38:29.345189+0000","last_became_peered":"2023-12-04T05:38:29.345189+0000","last_unstale":"2023-12-04T05:38:30.339917+0000","last_undegraded":"2023-12-04T05:38:30.339917+0000","last_fullsized":"2023-12-04T05:38:30.339917+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:03.546556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.342576+0000","last_change":"2023-12-04T05:38:28.351607+0000","last_active":"2023-12-04T05:38:29.342576+0000","last_peered":"2023-12-04T05:38:29.342576+0000","last_clean":"2023-12-04T05:38:29.342576+0000","last_became_active":"2023-12-04T05:38:28.351286+0000","last_became_peered":"2023-12-04T05:38:28.351286+0000","last_unstale":"2023-12-04T05:38:29.342576+0000","last_undegraded":"2023-12-04T05:38:29.342576+0000","last_fullsized":"2023-12-04T05:38:29.342576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:39:41.882728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343631+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:30.343631+0000","last_peered":"2023-12-04T05:38:30.343631+0000","last_clean":"2023-12-04T05:38:30.343631+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:30.343631+0000","last_undegraded":"2023-12-04T05:38:30.343631+0000","last_fullsized":"2023-12-04T05:38:30.343631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":842619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.74099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.745},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.496}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76500000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73199999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72299999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.752}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.73499999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.311}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.624},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.498}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.754}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.536},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":4.7160000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":5.2759999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":3.5030000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":5.4130000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":3.3940000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":3.4399999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":5.3710000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":5.4889999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":4.1639999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":4.2619999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":3.472}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":5.4550000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":4.218}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.81699999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.94399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.878}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1208320,"data_stored":844653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.501}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.433},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.623},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:37.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:38.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.045+0000 7fad3389c640 1 Processor -- start 2023-12-04T05:38:38.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.045+0000 7fad3389c640 1 -- start start 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad3389c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c14e970 0x7fad2c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad3389c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad2c06ca50 0x7fad2c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad3389c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c152300 con 0x7fad2c06be00 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad3389c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c071580 con 0x7fad2c06ca50 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad3389c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c14ed50 con 0x7fad2c14e970 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad2c06ca50 0x7fad2c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad2c06ca50 0x7fad2c0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58672/0 (socket says 172.21.15.97:58672) 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 -- 172.21.15.97:0/174480517 learned_addr learned my addr 172.21.15.97:0/174480517 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31638640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c14e970 0x7fad2c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 -- 172.21.15.97:0/174480517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c14e970 msgr2=0x7fad2c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c14e970 0x7fad2c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 -- 172.21.15.97:0/174480517 >> v1:172.21.15.143:6789/0 conn(0x7fad2c06be00 legacy=0x7fad2c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.049+0000 7fad31e39640 1 -- 172.21.15.97:0/174480517 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c06cea0 con 0x7fad2c06ca50 2023-12-04T05:38:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad31e39640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c06ca50 0x7fad2c0c1880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad24009e50 tx=0x7fad2401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9aded082c94a99c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad23fff640 1 -- 172.21.15.97:0/174480517 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240a57b0 con 0x7fad2c06ca50 2023-12-04T05:38:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad23fff640 1 -- 172.21.15.97:0/174480517 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad240a5910 con 0x7fad2c06ca50 2023-12-04T05:38:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad23fff640 1 -- 172.21.15.97:0/174480517 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240a5ca0 con 0x7fad2c06ca50 2023-12-04T05:38:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- 172.21.15.97:0/174480517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c06ca50 msgr2=0x7fad2c0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c06ca50 0x7fad2c0c1880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad24009e50 tx=0x7fad2401c8f0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- 172.21.15.97:0/174480517 shutdown_connections 2023-12-04T05:38:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c06ca50 0x7fad2c0c1880 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 --2- 172.21.15.97:0/174480517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c14e970 0x7fad2c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- 172.21.15.97:0/174480517 >> 172.21.15.97:0/174480517 conn(0x7fad2c0c2970 msgr2=0x7fad2c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- 172.21.15.97:0/174480517 shutdown_connections 2023-12-04T05:38:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- 172.21.15.97:0/174480517 wait complete. 2023-12-04T05:38:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 Processor -- start 2023-12-04T05:38:38.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.053+0000 7fad3389c640 1 -- start start 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad2c06be00 0x7fad2c0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 0x7fad2c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0c5710 con 0x7fad2c14e970 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c155330 con 0x7fad2c06be00 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c155610 con 0x7fad2c06ca50 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad30e37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 0x7fad2c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58674/0 (socket says 172.21.15.97:58674) 2023-12-04T05:38:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 -- 172.21.15.97:0/1521465865 learned_addr learned my addr 172.21.15.97:0/1521465865 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31638640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad2c06be00 0x7fad2c0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 -- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 msgr2=0x7fad2c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 0x7fad2c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 -- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad2c06be00 msgr2=0x7fad2c0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad2c06be00 0x7fad2c0c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 -- 172.21.15.97:0/1521465865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009b30 con 0x7fad2c14e970 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad30e37640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 0x7fad2c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad31e39640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad240af040 tx=0x7fad24019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240b8880 con 0x7fad2c14e970 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad240b89e0 con 0x7fad2c14e970 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240b8d90 con 0x7fad2c14e970 2023-12-04T05:38:38.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c148ea0 con 0x7fad2c14e970 2023-12-04T05:38:38.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c149460 con 0x7fad2c14e970 2023-12-04T05:38:38.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.057+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c149650 con 0x7fad2c14e970 2023-12-04T05:38:38.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.061+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad240b6440 con 0x7fad2c14e970 2023-12-04T05:38:38.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.061+0000 7fad21ffb640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 0x7fad10068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.061+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad2411fab0 con 0x7fad2c14e970 2023-12-04T05:38:38.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.061+0000 7fad31638640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 0x7fad10068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.061+0000 7fad31638640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 0x7fad10068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06e5a0 tx=0x7fad28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.065+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad240ecd10 con 0x7fad2c14e970 2023-12-04T05:38:38.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.213+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad2c0a85f0 con 0x7fad100668d0 2023-12-04T05:38:38.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.221+0000 7fad21ffb640 1 -- 172.21.15.97:0/1521465865 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289199 (secure 0 0 0) 0x7fad280108d0 con 0x7fad100668d0 2023-12-04T05:38:38.228 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:38.230 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:38.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 msgr2=0x7fad10068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 0x7fad10068d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad2c06e5a0 tx=0x7fad28008040 comp rx=0 tx=0).stop 2023-12-04T05:38:38.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 msgr2=0x7fad2c1ee7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad240af040 tx=0x7fad24019690 comp rx=0 tx=0).stop 2023-12-04T05:38:38.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 shutdown_connections 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad100668d0 0x7fad10068d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad2c14e970 0x7fad2c1ee7b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad2c06ca50 0x7fad2c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 --2- 172.21.15.97:0/1521465865 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad2c06be00 0x7fad2c0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 >> 172.21.15.97:0/1521465865 conn(0x7fad2c0c2970 msgr2=0x7fad2c14f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 shutdown_connections 2023-12-04T05:38:38.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.225+0000 7fad3389c640 1 -- 172.21.15.97:0/1521465865 wait complete. 2023-12-04T05:38:38.249 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-04T05:38:38.214232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222092,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752628,"statfs":{"total":773094113280,"available":772866691072,"internally_reserved":0,"allocated":6037504,"data_stored":3202284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.883083"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343909+0000","last_change":"2023-12-04T05:38:29.352962+0000","last_active":"2023-12-04T05:38:30.343909+0000","last_peered":"2023-12-04T05:38:30.343909+0000","last_clean":"2023-12-04T05:38:30.343909+0000","last_became_active":"2023-12-04T05:38:29.352682+0000","last_became_peered":"2023-12-04T05:38:29.352682+0000","last_unstale":"2023-12-04T05:38:30.343909+0000","last_undegraded":"2023-12-04T05:38:30.343909+0000","last_fullsized":"2023-12-04T05:38:30.343909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:46.992332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340053+0000","last_change":"2023-12-04T05:38:29.357484+0000","last_active":"2023-12-04T05:38:30.340053+0000","last_peered":"2023-12-04T05:38:30.340053+0000","last_clean":"2023-12-04T05:38:30.340053+0000","last_became_active":"2023-12-04T05:38:29.356776+0000","last_became_peered":"2023-12-04T05:38:29.356776+0000","last_unstale":"2023-12-04T05:38:30.340053+0000","last_undegraded":"2023-12-04T05:38:30.340053+0000","last_fullsized":"2023-12-04T05:38:30.340053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:18.360524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343979+0000","last_change":"2023-12-04T05:38:29.369361+0000","last_active":"2023-12-04T05:38:30.343979+0000","last_peered":"2023-12-04T05:38:30.343979+0000","last_clean":"2023-12-04T05:38:30.343979+0000","last_became_active":"2023-12-04T05:38:29.369066+0000","last_became_peered":"2023-12-04T05:38:29.369066+0000","last_unstale":"2023-12-04T05:38:30.343979+0000","last_undegraded":"2023-12-04T05:38:30.343979+0000","last_fullsized":"2023-12-04T05:38:30.343979+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344595+0000","last_change":"2023-12-04T05:38:29.352890+0000","last_active":"2023-12-04T05:38:30.344595+0000","last_peered":"2023-12-04T05:38:30.344595+0000","last_clean":"2023-12-04T05:38:30.344595+0000","last_became_active":"2023-12-04T05:38:29.352561+0000","last_became_peered":"2023-12-04T05:38:29.352561+0000","last_unstale":"2023-12-04T05:38:30.344595+0000","last_undegraded":"2023-12-04T05:38:30.344595+0000","last_fullsized":"2023-12-04T05:38:30.344595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:26.518247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343561+0000","last_change":"2023-12-04T05:38:29.357624+0000","last_active":"2023-12-04T05:38:30.343561+0000","last_peered":"2023-12-04T05:38:30.343561+0000","last_clean":"2023-12-04T05:38:30.343561+0000","last_became_active":"2023-12-04T05:38:29.357119+0000","last_became_peered":"2023-12-04T05:38:29.357119+0000","last_unstale":"2023-12-04T05:38:30.343561+0000","last_undegraded":"2023-12-04T05:38:30.343561+0000","last_fullsized":"2023-12-04T05:38:30.343561+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:20.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343081+0000","last_change":"2023-12-04T05:38:29.346548+0000","last_active":"2023-12-04T05:38:30.343081+0000","last_peered":"2023-12-04T05:38:30.343081+0000","last_clean":"2023-12-04T05:38:30.343081+0000","last_became_active":"2023-12-04T05:38:29.346283+0000","last_became_peered":"2023-12-04T05:38:29.346283+0000","last_unstale":"2023-12-04T05:38:30.343081+0000","last_undegraded":"2023-12-04T05:38:30.343081+0000","last_fullsized":"2023-12-04T05:38:30.343081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341413+0000","last_change":"2023-12-04T05:38:29.357730+0000","last_active":"2023-12-04T05:38:30.341413+0000","last_peered":"2023-12-04T05:38:30.341413+0000","last_clean":"2023-12-04T05:38:30.341413+0000","last_became_active":"2023-12-04T05:38:29.357470+0000","last_became_peered":"2023-12-04T05:38:29.357470+0000","last_unstale":"2023-12-04T05:38:30.341413+0000","last_undegraded":"2023-12-04T05:38:30.341413+0000","last_fullsized":"2023-12-04T05:38:30.341413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:55.944927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339842+0000","last_change":"2023-12-04T05:38:29.344652+0000","last_active":"2023-12-04T05:38:30.339842+0000","last_peered":"2023-12-04T05:38:30.339842+0000","last_clean":"2023-12-04T05:38:30.339842+0000","last_became_active":"2023-12-04T05:38:29.344365+0000","last_became_peered":"2023-12-04T05:38:29.344365+0000","last_unstale":"2023-12-04T05:38:30.339842+0000","last_undegraded":"2023-12-04T05:38:30.339842+0000","last_fullsized":"2023-12-04T05:38:30.339842+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:23.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342784+0000","last_change":"2023-12-04T05:38:29.361093+0000","last_active":"2023-12-04T05:38:30.342784+0000","last_peered":"2023-12-04T05:38:30.342784+0000","last_clean":"2023-12-04T05:38:30.342784+0000","last_became_active":"2023-12-04T05:38:29.360800+0000","last_became_peered":"2023-12-04T05:38:29.360800+0000","last_unstale":"2023-12-04T05:38:30.342784+0000","last_undegraded":"2023-12-04T05:38:30.342784+0000","last_fullsized":"2023-12-04T05:38:30.342784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:18.687515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344171+0000","last_change":"2023-12-04T05:38:29.353550+0000","last_active":"2023-12-04T05:38:30.344171+0000","last_peered":"2023-12-04T05:38:30.344171+0000","last_clean":"2023-12-04T05:38:30.344171+0000","last_became_active":"2023-12-04T05:38:29.353168+0000","last_became_peered":"2023-12-04T05:38:29.353168+0000","last_unstale":"2023-12-04T05:38:30.344171+0000","last_undegraded":"2023-12-04T05:38:30.344171+0000","last_fullsized":"2023-12-04T05:38:30.344171+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:20.689218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344042+0000","last_change":"2023-12-04T05:38:29.357106+0000","last_active":"2023-12-04T05:38:30.344042+0000","last_peered":"2023-12-04T05:38:30.344042+0000","last_clean":"2023-12-04T05:38:30.344042+0000","last_became_active":"2023-12-04T05:38:29.356781+0000","last_became_peered":"2023-12-04T05:38:29.356781+0000","last_unstale":"2023-12-04T05:38:30.344042+0000","last_undegraded":"2023-12-04T05:38:30.344042+0000","last_fullsized":"2023-12-04T05:38:30.344042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:17.004052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344649+0000","last_change":"2023-12-04T05:38:29.358871+0000","last_active":"2023-12-04T05:38:30.344649+0000","last_peered":"2023-12-04T05:38:30.344649+0000","last_clean":"2023-12-04T05:38:30.344649+0000","last_became_active":"2023-12-04T05:38:29.358575+0000","last_became_peered":"2023-12-04T05:38:29.358575+0000","last_unstale":"2023-12-04T05:38:30.344649+0000","last_undegraded":"2023-12-04T05:38:30.344649+0000","last_fullsized":"2023-12-04T05:38:30.344649+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341949+0000","last_change":"2023-12-04T05:38:29.363316+0000","last_active":"2023-12-04T05:38:30.341949+0000","last_peered":"2023-12-04T05:38:30.341949+0000","last_clean":"2023-12-04T05:38:30.341949+0000","last_became_active":"2023-12-04T05:38:29.362949+0000","last_became_peered":"2023-12-04T05:38:29.362949+0000","last_unstale":"2023-12-04T05:38:30.341949+0000","last_undegraded":"2023-12-04T05:38:30.341949+0000","last_fullsized":"2023-12-04T05:38:30.341949+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:35.750245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341662+0000","last_change":"2023-12-04T05:38:29.351970+0000","last_active":"2023-12-04T05:38:30.341662+0000","last_peered":"2023-12-04T05:38:30.341662+0000","last_clean":"2023-12-04T05:38:30.341662+0000","last_became_active":"2023-12-04T05:38:29.351547+0000","last_became_peered":"2023-12-04T05:38:29.351547+0000","last_unstale":"2023-12-04T05:38:30.341662+0000","last_undegraded":"2023-12-04T05:38:30.341662+0000","last_fullsized":"2023-12-04T05:38:30.341662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:22:28.844459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342230+0000","last_change":"2023-12-04T05:38:29.349829+0000","last_active":"2023-12-04T05:38:30.342230+0000","last_peered":"2023-12-04T05:38:30.342230+0000","last_clean":"2023-12-04T05:38:30.342230+0000","last_became_active":"2023-12-04T05:38:29.349570+0000","last_became_peered":"2023-12-04T05:38:29.349570+0000","last_unstale":"2023-12-04T05:38:30.342230+0000","last_undegraded":"2023-12-04T05:38:30.342230+0000","last_fullsized":"2023-12-04T05:38:30.342230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:42:30.244005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343015+0000","last_change":"2023-12-04T05:38:29.343672+0000","last_active":"2023-12-04T05:38:30.343015+0000","last_peered":"2023-12-04T05:38:30.343015+0000","last_clean":"2023-12-04T05:38:30.343015+0000","last_became_active":"2023-12-04T05:38:29.343378+0000","last_became_peered":"2023-12-04T05:38:29.343378+0000","last_unstale":"2023-12-04T05:38:30.343015+0000","last_undegraded":"2023-12-04T05:38:30.343015+0000","last_fullsized":"2023-12-04T05:38:30.343015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340244+0000","last_change":"2023-12-04T05:38:29.348038+0000","last_active":"2023-12-04T05:38:30.340244+0000","last_peered":"2023-12-04T05:38:30.340244+0000","last_clean":"2023-12-04T05:38:30.340244+0000","last_became_active":"2023-12-04T05:38:29.346419+0000","last_became_peered":"2023-12-04T05:38:29.346419+0000","last_unstale":"2023-12-04T05:38:30.340244+0000","last_undegraded":"2023-12-04T05:38:30.340244+0000","last_fullsized":"2023-12-04T05:38:30.340244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:28.971735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344075+0000","last_change":"2023-12-04T05:38:29.370721+0000","last_active":"2023-12-04T05:38:30.344075+0000","last_peered":"2023-12-04T05:38:30.344075+0000","last_clean":"2023-12-04T05:38:30.344075+0000","last_became_active":"2023-12-04T05:38:29.370199+0000","last_became_peered":"2023-12-04T05:38:29.370199+0000","last_unstale":"2023-12-04T05:38:30.344075+0000","last_undegraded":"2023-12-04T05:38:30.344075+0000","last_fullsized":"2023-12-04T05:38:30.344075+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343771+0000","last_change":"2023-12-04T05:38:29.355850+0000","last_active":"2023-12-04T05:38:30.343771+0000","last_peered":"2023-12-04T05:38:30.343771+0000","last_clean":"2023-12-04T05:38:30.343771+0000","last_became_active":"2023-12-04T05:38:29.355549+0000","last_became_peered":"2023-12-04T05:38:29.355549+0000","last_unstale":"2023-12-04T05:38:30.343771+0000","last_undegraded":"2023-12-04T05:38:30.343771+0000","last_fullsized":"2023-12-04T05:38:30.343771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:07.261586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340050+0000","last_change":"2023-12-04T05:38:29.345961+0000","last_active":"2023-12-04T05:38:30.340050+0000","last_peered":"2023-12-04T05:38:30.340050+0000","last_clean":"2023-12-04T05:38:30.340050+0000","last_became_active":"2023-12-04T05:38:29.345359+0000","last_became_peered":"2023-12-04T05:38:29.345359+0000","last_unstale":"2023-12-04T05:38:30.340050+0000","last_undegraded":"2023-12-04T05:38:30.340050+0000","last_fullsized":"2023-12-04T05:38:30.340050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:19.090966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343762+0000","last_change":"2023-12-04T05:38:29.366491+0000","last_active":"2023-12-04T05:38:30.343762+0000","last_peered":"2023-12-04T05:38:30.343762+0000","last_clean":"2023-12-04T05:38:30.343762+0000","last_became_active":"2023-12-04T05:38:29.366202+0000","last_became_peered":"2023-12-04T05:38:29.366202+0000","last_unstale":"2023-12-04T05:38:30.343762+0000","last_undegraded":"2023-12-04T05:38:30.343762+0000","last_fullsized":"2023-12-04T05:38:30.343762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340190+0000","last_change":"2023-12-04T05:38:29.353157+0000","last_active":"2023-12-04T05:38:30.340190+0000","last_peered":"2023-12-04T05:38:30.340190+0000","last_clean":"2023-12-04T05:38:30.340190+0000","last_became_active":"2023-12-04T05:38:29.352879+0000","last_became_peered":"2023-12-04T05:38:29.352879+0000","last_unstale":"2023-12-04T05:38:30.340190+0000","last_undegraded":"2023-12-04T05:38:30.340190+0000","last_fullsized":"2023-12-04T05:38:30.340190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:02.199367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343806+0000","last_change":"2023-12-04T05:38:29.368754+0000","last_active":"2023-12-04T05:38:30.343806+0000","last_peered":"2023-12-04T05:38:30.343806+0000","last_clean":"2023-12-04T05:38:30.343806+0000","last_became_active":"2023-12-04T05:38:29.368261+0000","last_became_peered":"2023-12-04T05:38:29.368261+0000","last_unstale":"2023-12-04T05:38:30.343806+0000","last_undegraded":"2023-12-04T05:38:30.343806+0000","last_fullsized":"2023-12-04T05:38:30.343806+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341491+0000","last_change":"2023-12-04T05:38:29.363152+0000","last_active":"2023-12-04T05:38:30.341491+0000","last_peered":"2023-12-04T05:38:30.341491+0000","last_clean":"2023-12-04T05:38:30.341491+0000","last_became_active":"2023-12-04T05:38:29.362819+0000","last_became_peered":"2023-12-04T05:38:29.362819+0000","last_unstale":"2023-12-04T05:38:30.341491+0000","last_undegraded":"2023-12-04T05:38:30.341491+0000","last_fullsized":"2023-12-04T05:38:30.341491+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:09.247784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344090+0000","last_change":"2023-12-04T05:38:29.362074+0000","last_active":"2023-12-04T05:38:30.344090+0000","last_peered":"2023-12-04T05:38:30.344090+0000","last_clean":"2023-12-04T05:38:30.344090+0000","last_became_active":"2023-12-04T05:38:29.361714+0000","last_became_peered":"2023-12-04T05:38:29.361714+0000","last_unstale":"2023-12-04T05:38:30.344090+0000","last_undegraded":"2023-12-04T05:38:30.344090+0000","last_fullsized":"2023-12-04T05:38:30.344090+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:51.063339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344980+0000","last_change":"2023-12-04T05:38:29.361452+0000","last_active":"2023-12-04T05:38:30.344980+0000","last_peered":"2023-12-04T05:38:30.344980+0000","last_clean":"2023-12-04T05:38:30.344980+0000","last_became_active":"2023-12-04T05:38:29.361006+0000","last_became_peered":"2023-12-04T05:38:29.361006+0000","last_unstale":"2023-12-04T05:38:30.344980+0000","last_undegraded":"2023-12-04T05:38:30.344980+0000","last_fullsized":"2023-12-04T05:38:30.344980+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344071+0000","last_change":"2023-12-04T05:38:29.347468+0000","last_active":"2023-12-04T05:38:30.344071+0000","last_peered":"2023-12-04T05:38:30.344071+0000","last_clean":"2023-12-04T05:38:30.344071+0000","last_became_active":"2023-12-04T05:38:29.347197+0000","last_became_peered":"2023-12-04T05:38:29.347197+0000","last_unstale":"2023-12-04T05:38:30.344071+0000","last_undegraded":"2023-12-04T05:38:30.344071+0000","last_fullsized":"2023-12-04T05:38:30.344071+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343878+0000","last_change":"2023-12-04T05:38:29.356542+0000","last_active":"2023-12-04T05:38:30.343878+0000","last_peered":"2023-12-04T05:38:30.343878+0000","last_clean":"2023-12-04T05:38:30.343878+0000","last_became_active":"2023-12-04T05:38:29.356279+0000","last_became_peered":"2023-12-04T05:38:29.356279+0000","last_unstale":"2023-12-04T05:38:30.343878+0000","last_undegraded":"2023-12-04T05:38:30.343878+0000","last_fullsized":"2023-12-04T05:38:30.343878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:24:36.475992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340306+0000","last_change":"2023-12-04T05:38:29.357772+0000","last_active":"2023-12-04T05:38:30.340306+0000","last_peered":"2023-12-04T05:38:30.340306+0000","last_clean":"2023-12-04T05:38:30.340306+0000","last_became_active":"2023-12-04T05:38:29.357471+0000","last_became_peered":"2023-12-04T05:38:29.357471+0000","last_unstale":"2023-12-04T05:38:30.340306+0000","last_undegraded":"2023-12-04T05:38:30.340306+0000","last_fullsized":"2023-12-04T05:38:30.340306+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:00.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343732+0000","last_change":"2023-12-04T05:38:29.369540+0000","last_active":"2023-12-04T05:38:30.343732+0000","last_peered":"2023-12-04T05:38:30.343732+0000","last_clean":"2023-12-04T05:38:30.343732+0000","last_became_active":"2023-12-04T05:38:29.369243+0000","last_became_peered":"2023-12-04T05:38:29.369243+0000","last_unstale":"2023-12-04T05:38:30.343732+0000","last_undegraded":"2023-12-04T05:38:30.343732+0000","last_fullsized":"2023-12-04T05:38:30.343732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343081+0000","last_change":"2023-12-04T05:38:29.351869+0000","last_active":"2023-12-04T05:38:30.343081+0000","last_peered":"2023-12-04T05:38:30.343081+0000","last_clean":"2023-12-04T05:38:30.343081+0000","last_became_active":"2023-12-04T05:38:29.350826+0000","last_became_peered":"2023-12-04T05:38:29.350826+0000","last_unstale":"2023-12-04T05:38:30.343081+0000","last_undegraded":"2023-12-04T05:38:30.343081+0000","last_fullsized":"2023-12-04T05:38:30.343081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:12.441421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343139+0000","last_change":"2023-12-04T05:38:29.346210+0000","last_active":"2023-12-04T05:38:30.343139+0000","last_peered":"2023-12-04T05:38:30.343139+0000","last_clean":"2023-12-04T05:38:30.343139+0000","last_became_active":"2023-12-04T05:38:29.345870+0000","last_became_peered":"2023-12-04T05:38:29.345870+0000","last_unstale":"2023-12-04T05:38:30.343139+0000","last_undegraded":"2023-12-04T05:38:30.343139+0000","last_fullsized":"2023-12-04T05:38:30.343139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344407+0000","last_change":"2023-12-04T05:38:29.358811+0000","last_active":"2023-12-04T05:38:30.344407+0000","last_peered":"2023-12-04T05:38:30.344407+0000","last_clean":"2023-12-04T05:38:30.344407+0000","last_became_active":"2023-12-04T05:38:29.358559+0000","last_became_peered":"2023-12-04T05:38:29.358559+0000","last_unstale":"2023-12-04T05:38:30.344407+0000","last_undegraded":"2023-12-04T05:38:30.344407+0000","last_fullsized":"2023-12-04T05:38:30.344407+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:40.775232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379626+0000","last_change":"2023-12-04T05:38:28.357084+0000","last_active":"2023-12-04T05:38:29.379626+0000","last_peered":"2023-12-04T05:38:29.379626+0000","last_clean":"2023-12-04T05:38:29.379626+0000","last_became_active":"2023-12-04T05:38:28.356727+0000","last_became_peered":"2023-12-04T05:38:28.356727+0000","last_unstale":"2023-12-04T05:38:29.379626+0000","last_undegraded":"2023-12-04T05:38:29.379626+0000","last_fullsized":"2023-12-04T05:38:29.379626+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:17.923080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344010+0000","last_change":"2023-12-04T05:38:29.362758+0000","last_active":"2023-12-04T05:38:30.344010+0000","last_peered":"2023-12-04T05:38:30.344010+0000","last_clean":"2023-12-04T05:38:30.344010+0000","last_became_active":"2023-12-04T05:38:29.362402+0000","last_became_peered":"2023-12-04T05:38:29.362402+0000","last_unstale":"2023-12-04T05:38:30.344010+0000","last_undegraded":"2023-12-04T05:38:30.344010+0000","last_fullsized":"2023-12-04T05:38:30.344010+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:19.743112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.376586+0000","last_change":"2023-12-04T05:38:28.347627+0000","last_active":"2023-12-04T05:38:29.376586+0000","last_peered":"2023-12-04T05:38:29.376586+0000","last_clean":"2023-12-04T05:38:29.376586+0000","last_became_active":"2023-12-04T05:38:28.345941+0000","last_became_peered":"2023-12-04T05:38:28.345941+0000","last_unstale":"2023-12-04T05:38:29.376586+0000","last_undegraded":"2023-12-04T05:38:29.376586+0000","last_fullsized":"2023-12-04T05:38:29.376586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:48.649051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343856+0000","last_change":"2023-12-04T05:38:29.360274+0000","last_active":"2023-12-04T05:38:30.343856+0000","last_peered":"2023-12-04T05:38:30.343856+0000","last_clean":"2023-12-04T05:38:30.343856+0000","last_became_active":"2023-12-04T05:38:29.359956+0000","last_became_peered":"2023-12-04T05:38:29.359956+0000","last_unstale":"2023-12-04T05:38:30.343856+0000","last_undegraded":"2023-12-04T05:38:30.343856+0000","last_fullsized":"2023-12-04T05:38:30.343856+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379435+0000","last_change":"2023-12-04T05:38:28.353084+0000","last_active":"2023-12-04T05:38:29.379435+0000","last_peered":"2023-12-04T05:38:29.379435+0000","last_clean":"2023-12-04T05:38:29.379435+0000","last_became_active":"2023-12-04T05:38:28.351122+0000","last_became_peered":"2023-12-04T05:38:28.351122+0000","last_unstale":"2023-12-04T05:38:29.379435+0000","last_undegraded":"2023-12-04T05:38:29.379435+0000","last_fullsized":"2023-12-04T05:38:29.379435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:42.125435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344189+0000","last_change":"2023-12-04T05:38:29.358876+0000","last_active":"2023-12-04T05:38:30.344189+0000","last_peered":"2023-12-04T05:38:30.344189+0000","last_clean":"2023-12-04T05:38:30.344189+0000","last_became_active":"2023-12-04T05:38:29.358607+0000","last_became_peered":"2023-12-04T05:38:29.358607+0000","last_unstale":"2023-12-04T05:38:30.344189+0000","last_undegraded":"2023-12-04T05:38:30.344189+0000","last_fullsized":"2023-12-04T05:38:30.344189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:49.658316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.377154+0000","last_change":"2023-12-04T05:38:28.355795+0000","last_active":"2023-12-04T05:38:29.377154+0000","last_peered":"2023-12-04T05:38:29.377154+0000","last_clean":"2023-12-04T05:38:29.377154+0000","last_became_active":"2023-12-04T05:38:28.355356+0000","last_became_peered":"2023-12-04T05:38:28.355356+0000","last_unstale":"2023-12-04T05:38:29.377154+0000","last_undegraded":"2023-12-04T05:38:29.377154+0000","last_fullsized":"2023-12-04T05:38:29.377154+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:07.408506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340073+0000","last_change":"2023-12-04T05:38:29.355352+0000","last_active":"2023-12-04T05:38:30.340073+0000","last_peered":"2023-12-04T05:38:30.340073+0000","last_clean":"2023-12-04T05:38:30.340073+0000","last_became_active":"2023-12-04T05:38:29.353176+0000","last_became_peered":"2023-12-04T05:38:29.353176+0000","last_unstale":"2023-12-04T05:38:30.340073+0000","last_undegraded":"2023-12-04T05:38:30.340073+0000","last_fullsized":"2023-12-04T05:38:30.340073+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:07:18.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.373932+0000","last_change":"2023-12-04T05:38:28.351077+0000","last_active":"2023-12-04T05:38:29.373932+0000","last_peered":"2023-12-04T05:38:29.373932+0000","last_clean":"2023-12-04T05:38:29.373932+0000","last_became_active":"2023-12-04T05:38:28.350462+0000","last_became_peered":"2023-12-04T05:38:28.350462+0000","last_unstale":"2023-12-04T05:38:29.373932+0000","last_undegraded":"2023-12-04T05:38:29.373932+0000","last_fullsized":"2023-12-04T05:38:29.373932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:19.679953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340051+0000","last_change":"2023-12-04T05:38:29.345510+0000","last_active":"2023-12-04T05:38:30.340051+0000","last_peered":"2023-12-04T05:38:30.340051+0000","last_clean":"2023-12-04T05:38:30.340051+0000","last_became_active":"2023-12-04T05:38:29.345223+0000","last_became_peered":"2023-12-04T05:38:29.345223+0000","last_unstale":"2023-12-04T05:38:30.340051+0000","last_undegraded":"2023-12-04T05:38:30.340051+0000","last_fullsized":"2023-12-04T05:38:30.340051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:04.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379363+0000","last_change":"2023-12-04T05:38:28.351389+0000","last_active":"2023-12-04T05:38:29.379363+0000","last_peered":"2023-12-04T05:38:29.379363+0000","last_clean":"2023-12-04T05:38:29.379363+0000","last_became_active":"2023-12-04T05:38:28.350142+0000","last_became_peered":"2023-12-04T05:38:28.350142+0000","last_unstale":"2023-12-04T05:38:29.379363+0000","last_undegraded":"2023-12-04T05:38:29.379363+0000","last_fullsized":"2023-12-04T05:38:29.379363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:54.935662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341641+0000","last_change":"2023-12-04T05:38:29.360246+0000","last_active":"2023-12-04T05:38:30.341641+0000","last_peered":"2023-12-04T05:38:30.341641+0000","last_clean":"2023-12-04T05:38:30.341641+0000","last_became_active":"2023-12-04T05:38:29.359538+0000","last_became_peered":"2023-12-04T05:38:29.359538+0000","last_unstale":"2023-12-04T05:38:30.341641+0000","last_undegraded":"2023-12-04T05:38:30.341641+0000","last_fullsized":"2023-12-04T05:38:30.341641+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:07.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350276+0000","last_change":"2023-12-04T05:38:28.350133+0000","last_active":"2023-12-04T05:38:29.350276+0000","last_peered":"2023-12-04T05:38:29.350276+0000","last_clean":"2023-12-04T05:38:29.350276+0000","last_became_active":"2023-12-04T05:38:28.349752+0000","last_became_peered":"2023-12-04T05:38:28.349752+0000","last_unstale":"2023-12-04T05:38:29.350276+0000","last_undegraded":"2023-12-04T05:38:29.350276+0000","last_fullsized":"2023-12-04T05:38:29.350276+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:16.876613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339871+0000","last_change":"2023-12-04T05:38:29.349000+0000","last_active":"2023-12-04T05:38:30.339871+0000","last_peered":"2023-12-04T05:38:30.339871+0000","last_clean":"2023-12-04T05:38:30.339871+0000","last_became_active":"2023-12-04T05:38:29.348695+0000","last_became_peered":"2023-12-04T05:38:29.348695+0000","last_unstale":"2023-12-04T05:38:30.339871+0000","last_undegraded":"2023-12-04T05:38:30.339871+0000","last_fullsized":"2023-12-04T05:38:30.339871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:06.352663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.340949+0000","last_change":"2023-12-04T05:38:28.350256+0000","last_active":"2023-12-04T05:38:29.340949+0000","last_peered":"2023-12-04T05:38:29.340949+0000","last_clean":"2023-12-04T05:38:29.340949+0000","last_became_active":"2023-12-04T05:38:28.349886+0000","last_became_peered":"2023-12-04T05:38:28.349886+0000","last_unstale":"2023-12-04T05:38:29.340949+0000","last_undegraded":"2023-12-04T05:38:29.340949+0000","last_fullsized":"2023-12-04T05:38:29.340949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:35.559263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.342791+0000","last_change":"2023-12-04T05:38:29.358064+0000","last_active":"2023-12-04T05:38:30.342791+0000","last_peered":"2023-12-04T05:38:30.342791+0000","last_clean":"2023-12-04T05:38:30.342791+0000","last_became_active":"2023-12-04T05:38:29.357794+0000","last_became_peered":"2023-12-04T05:38:29.357794+0000","last_unstale":"2023-12-04T05:38:30.342791+0000","last_undegraded":"2023-12-04T05:38:30.342791+0000","last_fullsized":"2023-12-04T05:38:30.342791+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:18.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.357145+0000","last_change":"2023-12-04T05:38:28.359951+0000","last_active":"2023-12-04T05:38:29.357145+0000","last_peered":"2023-12-04T05:38:29.357145+0000","last_clean":"2023-12-04T05:38:29.357145+0000","last_became_active":"2023-12-04T05:38:28.359676+0000","last_became_peered":"2023-12-04T05:38:28.359676+0000","last_unstale":"2023-12-04T05:38:29.357145+0000","last_undegraded":"2023-12-04T05:38:29.357145+0000","last_fullsized":"2023-12-04T05:38:29.357145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344365+0000","last_change":"2023-12-04T05:38:29.367074+0000","last_active":"2023-12-04T05:38:30.344365+0000","last_peered":"2023-12-04T05:38:30.344365+0000","last_clean":"2023-12-04T05:38:30.344365+0000","last_became_active":"2023-12-04T05:38:29.366753+0000","last_became_peered":"2023-12-04T05:38:29.366753+0000","last_unstale":"2023-12-04T05:38:30.344365+0000","last_undegraded":"2023-12-04T05:38:30.344365+0000","last_fullsized":"2023-12-04T05:38:30.344365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.337883+0000","last_change":"2023-12-04T05:38:28.356218+0000","last_active":"2023-12-04T05:38:29.337883+0000","last_peered":"2023-12-04T05:38:29.337883+0000","last_clean":"2023-12-04T05:38:29.337883+0000","last_became_active":"2023-12-04T05:38:28.355927+0000","last_became_peered":"2023-12-04T05:38:28.355927+0000","last_unstale":"2023-12-04T05:38:29.337883+0000","last_undegraded":"2023-12-04T05:38:29.337883+0000","last_fullsized":"2023-12-04T05:38:29.337883+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:20.717537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343599+0000","last_change":"2023-12-04T05:38:29.354032+0000","last_active":"2023-12-04T05:38:30.343599+0000","last_peered":"2023-12-04T05:38:30.343599+0000","last_clean":"2023-12-04T05:38:30.343599+0000","last_became_active":"2023-12-04T05:38:29.353619+0000","last_became_peered":"2023-12-04T05:38:29.353619+0000","last_unstale":"2023-12-04T05:38:30.343599+0000","last_undegraded":"2023-12-04T05:38:30.343599+0000","last_fullsized":"2023-12-04T05:38:30.343599+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:05:21.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379334+0000","last_change":"2023-12-04T05:38:28.362801+0000","last_active":"2023-12-04T05:38:29.379334+0000","last_peered":"2023-12-04T05:38:29.379334+0000","last_clean":"2023-12-04T05:38:29.379334+0000","last_became_active":"2023-12-04T05:38:28.362494+0000","last_became_peered":"2023-12-04T05:38:28.362494+0000","last_unstale":"2023-12-04T05:38:29.379334+0000","last_undegraded":"2023-12-04T05:38:29.379334+0000","last_fullsized":"2023-12-04T05:38:29.379334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:17.678250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344117+0000","last_change":"2023-12-04T05:38:29.365812+0000","last_active":"2023-12-04T05:38:30.344117+0000","last_peered":"2023-12-04T05:38:30.344117+0000","last_clean":"2023-12-04T05:38:30.344117+0000","last_became_active":"2023-12-04T05:38:29.365171+0000","last_became_peered":"2023-12-04T05:38:29.365171+0000","last_unstale":"2023-12-04T05:38:30.344117+0000","last_undegraded":"2023-12-04T05:38:30.344117+0000","last_fullsized":"2023-12-04T05:38:30.344117+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.381187+0000","last_change":"2023-12-04T05:38:28.352009+0000","last_active":"2023-12-04T05:38:29.381187+0000","last_peered":"2023-12-04T05:38:29.381187+0000","last_clean":"2023-12-04T05:38:29.381187+0000","last_became_active":"2023-12-04T05:38:28.351727+0000","last_became_peered":"2023-12-04T05:38:28.351727+0000","last_unstale":"2023-12-04T05:38:29.381187+0000","last_undegraded":"2023-12-04T05:38:29.381187+0000","last_fullsized":"2023-12-04T05:38:29.381187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:18.733847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344718+0000","last_change":"2023-12-04T05:38:29.359861+0000","last_active":"2023-12-04T05:38:30.344718+0000","last_peered":"2023-12-04T05:38:30.344718+0000","last_clean":"2023-12-04T05:38:30.344718+0000","last_became_active":"2023-12-04T05:38:29.359381+0000","last_became_peered":"2023-12-04T05:38:29.359381+0000","last_unstale":"2023-12-04T05:38:30.344718+0000","last_undegraded":"2023-12-04T05:38:30.344718+0000","last_fullsized":"2023-12-04T05:38:30.344718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372600+0000","last_change":"2023-12-04T05:38:28.358003+0000","last_active":"2023-12-04T05:38:29.372600+0000","last_peered":"2023-12-04T05:38:29.372600+0000","last_clean":"2023-12-04T05:38:29.372600+0000","last_became_active":"2023-12-04T05:38:28.357687+0000","last_became_peered":"2023-12-04T05:38:28.357687+0000","last_unstale":"2023-12-04T05:38:29.372600+0000","last_undegraded":"2023-12-04T05:38:29.372600+0000","last_fullsized":"2023-12-04T05:38:29.372600+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:32.658162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343952+0000","last_change":"2023-12-04T05:38:29.366087+0000","last_active":"2023-12-04T05:38:30.343952+0000","last_peered":"2023-12-04T05:38:30.343952+0000","last_clean":"2023-12-04T05:38:30.343952+0000","last_became_active":"2023-12-04T05:38:29.365734+0000","last_became_peered":"2023-12-04T05:38:29.365734+0000","last_unstale":"2023-12-04T05:38:30.343952+0000","last_undegraded":"2023-12-04T05:38:30.343952+0000","last_fullsized":"2023-12-04T05:38:30.343952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.341874+0000","last_change":"2023-12-04T05:38:28.343022+0000","last_active":"2023-12-04T05:38:29.341874+0000","last_peered":"2023-12-04T05:38:29.341874+0000","last_clean":"2023-12-04T05:38:29.341874+0000","last_became_active":"2023-12-04T05:38:28.342601+0000","last_became_peered":"2023-12-04T05:38:28.342601+0000","last_unstale":"2023-12-04T05:38:29.341874+0000","last_undegraded":"2023-12-04T05:38:29.341874+0000","last_fullsized":"2023-12-04T05:38:29.341874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.341395+0000","last_change":"2023-12-04T05:38:29.359927+0000","last_active":"2023-12-04T05:38:30.341395+0000","last_peered":"2023-12-04T05:38:30.341395+0000","last_clean":"2023-12-04T05:38:30.341395+0000","last_became_active":"2023-12-04T05:38:29.359643+0000","last_became_peered":"2023-12-04T05:38:29.359643+0000","last_unstale":"2023-12-04T05:38:30.341395+0000","last_undegraded":"2023-12-04T05:38:30.341395+0000","last_fullsized":"2023-12-04T05:38:30.341395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:11.572404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350416+0000","last_change":"2023-12-04T05:38:28.355765+0000","last_active":"2023-12-04T05:38:29.350416+0000","last_peered":"2023-12-04T05:38:29.350416+0000","last_clean":"2023-12-04T05:38:29.350416+0000","last_became_active":"2023-12-04T05:38:28.355180+0000","last_became_peered":"2023-12-04T05:38:28.355180+0000","last_unstale":"2023-12-04T05:38:29.350416+0000","last_undegraded":"2023-12-04T05:38:29.350416+0000","last_fullsized":"2023-12-04T05:38:29.350416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:40.049769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344038+0000","last_change":"2023-12-04T05:38:29.369054+0000","last_active":"2023-12-04T05:38:30.344038+0000","last_peered":"2023-12-04T05:38:30.344038+0000","last_clean":"2023-12-04T05:38:30.344038+0000","last_became_active":"2023-12-04T05:38:29.368644+0000","last_became_peered":"2023-12-04T05:38:29.368644+0000","last_unstale":"2023-12-04T05:38:30.344038+0000","last_undegraded":"2023-12-04T05:38:30.344038+0000","last_fullsized":"2023-12-04T05:38:30.344038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.378533+0000","last_change":"2023-12-04T05:38:28.356435+0000","last_active":"2023-12-04T05:38:29.378533+0000","last_peered":"2023-12-04T05:38:29.378533+0000","last_clean":"2023-12-04T05:38:29.378533+0000","last_became_active":"2023-12-04T05:38:28.356110+0000","last_became_peered":"2023-12-04T05:38:28.356110+0000","last_unstale":"2023-12-04T05:38:29.378533+0000","last_undegraded":"2023-12-04T05:38:29.378533+0000","last_fullsized":"2023-12-04T05:38:29.378533+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344088+0000","last_change":"2023-12-04T05:38:29.370474+0000","last_active":"2023-12-04T05:38:30.344088+0000","last_peered":"2023-12-04T05:38:30.344088+0000","last_clean":"2023-12-04T05:38:30.344088+0000","last_became_active":"2023-12-04T05:38:29.369734+0000","last_became_peered":"2023-12-04T05:38:29.369734+0000","last_unstale":"2023-12-04T05:38:30.344088+0000","last_undegraded":"2023-12-04T05:38:30.344088+0000","last_fullsized":"2023-12-04T05:38:30.344088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372457+0000","last_change":"2023-12-04T05:38:28.354536+0000","last_active":"2023-12-04T05:38:29.372457+0000","last_peered":"2023-12-04T05:38:29.372457+0000","last_clean":"2023-12-04T05:38:29.372457+0000","last_became_active":"2023-12-04T05:38:28.354124+0000","last_became_peered":"2023-12-04T05:38:28.354124+0000","last_unstale":"2023-12-04T05:38:29.372457+0000","last_undegraded":"2023-12-04T05:38:29.372457+0000","last_fullsized":"2023-12-04T05:38:29.372457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:27.391838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.345013+0000","last_change":"2023-12-04T05:38:29.359106+0000","last_active":"2023-12-04T05:38:30.345013+0000","last_peered":"2023-12-04T05:38:30.345013+0000","last_clean":"2023-12-04T05:38:30.345013+0000","last_became_active":"2023-12-04T05:38:29.358391+0000","last_became_peered":"2023-12-04T05:38:29.358391+0000","last_unstale":"2023-12-04T05:38:30.345013+0000","last_undegraded":"2023-12-04T05:38:30.345013+0000","last_fullsized":"2023-12-04T05:38:30.345013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379490+0000","last_change":"2023-12-04T05:38:28.354825+0000","last_active":"2023-12-04T05:38:29.379490+0000","last_peered":"2023-12-04T05:38:29.379490+0000","last_clean":"2023-12-04T05:38:29.379490+0000","last_became_active":"2023-12-04T05:38:28.354518+0000","last_became_peered":"2023-12-04T05:38:28.354518+0000","last_unstale":"2023-12-04T05:38:29.379490+0000","last_undegraded":"2023-12-04T05:38:29.379490+0000","last_fullsized":"2023-12-04T05:38:29.379490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340065+0000","last_change":"2023-12-04T05:38:29.346154+0000","last_active":"2023-12-04T05:38:30.340065+0000","last_peered":"2023-12-04T05:38:30.340065+0000","last_clean":"2023-12-04T05:38:30.340065+0000","last_became_active":"2023-12-04T05:38:29.345711+0000","last_became_peered":"2023-12-04T05:38:29.345711+0000","last_unstale":"2023-12-04T05:38:30.340065+0000","last_undegraded":"2023-12-04T05:38:30.340065+0000","last_fullsized":"2023-12-04T05:38:30.340065+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:17.288502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.377121+0000","last_change":"2023-12-04T05:38:28.356962+0000","last_active":"2023-12-04T05:38:29.377121+0000","last_peered":"2023-12-04T05:38:29.377121+0000","last_clean":"2023-12-04T05:38:29.377121+0000","last_became_active":"2023-12-04T05:38:28.356599+0000","last_became_peered":"2023-12-04T05:38:28.356599+0000","last_unstale":"2023-12-04T05:38:29.377121+0000","last_undegraded":"2023-12-04T05:38:29.377121+0000","last_fullsized":"2023-12-04T05:38:29.377121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344253+0000","last_change":"2023-12-04T05:38:29.365123+0000","last_active":"2023-12-04T05:38:30.344253+0000","last_peered":"2023-12-04T05:38:30.344253+0000","last_clean":"2023-12-04T05:38:30.344253+0000","last_became_active":"2023-12-04T05:38:29.364212+0000","last_became_peered":"2023-12-04T05:38:29.364212+0000","last_unstale":"2023-12-04T05:38:30.344253+0000","last_undegraded":"2023-12-04T05:38:30.344253+0000","last_fullsized":"2023-12-04T05:38:30.344253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.333846+0000","last_change":"2023-12-04T05:38:28.350111+0000","last_active":"2023-12-04T05:38:29.333846+0000","last_peered":"2023-12-04T05:38:29.333846+0000","last_clean":"2023-12-04T05:38:29.333846+0000","last_became_active":"2023-12-04T05:38:28.349788+0000","last_became_peered":"2023-12-04T05:38:28.349788+0000","last_unstale":"2023-12-04T05:38:29.333846+0000","last_undegraded":"2023-12-04T05:38:29.333846+0000","last_fullsized":"2023-12-04T05:38:29.333846+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344575+0000","last_change":"2023-12-04T05:38:29.359656+0000","last_active":"2023-12-04T05:38:30.344575+0000","last_peered":"2023-12-04T05:38:30.344575+0000","last_clean":"2023-12-04T05:38:30.344575+0000","last_became_active":"2023-12-04T05:38:29.358747+0000","last_became_peered":"2023-12-04T05:38:29.358747+0000","last_unstale":"2023-12-04T05:38:30.344575+0000","last_undegraded":"2023-12-04T05:38:30.344575+0000","last_fullsized":"2023-12-04T05:38:30.344575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:43.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.372814+0000","last_change":"2023-12-04T05:38:28.357652+0000","last_active":"2023-12-04T05:38:29.372814+0000","last_peered":"2023-12-04T05:38:29.372814+0000","last_clean":"2023-12-04T05:38:29.372814+0000","last_became_active":"2023-12-04T05:38:28.357276+0000","last_became_peered":"2023-12-04T05:38:28.357276+0000","last_unstale":"2023-12-04T05:38:29.372814+0000","last_undegraded":"2023-12-04T05:38:29.372814+0000","last_fullsized":"2023-12-04T05:38:29.372814+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:25.246379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343546+0000","last_change":"2023-12-04T05:38:29.347237+0000","last_active":"2023-12-04T05:38:30.343546+0000","last_peered":"2023-12-04T05:38:30.343546+0000","last_clean":"2023-12-04T05:38:30.343546+0000","last_became_active":"2023-12-04T05:38:29.346964+0000","last_became_peered":"2023-12-04T05:38:29.346964+0000","last_unstale":"2023-12-04T05:38:30.343546+0000","last_undegraded":"2023-12-04T05:38:30.343546+0000","last_fullsized":"2023-12-04T05:38:30.343546+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344584+0000","last_change":"2023-12-04T05:38:28.353652+0000","last_active":"2023-12-04T05:38:29.344584+0000","last_peered":"2023-12-04T05:38:29.344584+0000","last_clean":"2023-12-04T05:38:29.344584+0000","last_became_active":"2023-12-04T05:38:28.353358+0000","last_became_peered":"2023-12-04T05:38:28.353358+0000","last_unstale":"2023-12-04T05:38:29.344584+0000","last_undegraded":"2023-12-04T05:38:29.344584+0000","last_fullsized":"2023-12-04T05:38:29.344584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:15.125860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343913+0000","last_change":"2023-12-04T05:38:29.366166+0000","last_active":"2023-12-04T05:38:30.343913+0000","last_peered":"2023-12-04T05:38:30.343913+0000","last_clean":"2023-12-04T05:38:30.343913+0000","last_became_active":"2023-12-04T05:38:29.365434+0000","last_became_peered":"2023-12-04T05:38:29.365434+0000","last_unstale":"2023-12-04T05:38:30.343913+0000","last_undegraded":"2023-12-04T05:38:30.343913+0000","last_fullsized":"2023-12-04T05:38:30.343913+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.349545+0000","last_change":"2023-12-04T05:38:28.353323+0000","last_active":"2023-12-04T05:38:29.349545+0000","last_peered":"2023-12-04T05:38:29.349545+0000","last_clean":"2023-12-04T05:38:29.349545+0000","last_became_active":"2023-12-04T05:38:28.352993+0000","last_became_peered":"2023-12-04T05:38:28.352993+0000","last_unstale":"2023-12-04T05:38:29.349545+0000","last_undegraded":"2023-12-04T05:38:29.349545+0000","last_fullsized":"2023-12-04T05:38:29.349545+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:17.139808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344999+0000","last_change":"2023-12-04T05:38:29.355646+0000","last_active":"2023-12-04T05:38:30.344999+0000","last_peered":"2023-12-04T05:38:30.344999+0000","last_clean":"2023-12-04T05:38:30.344999+0000","last_became_active":"2023-12-04T05:38:29.355239+0000","last_became_peered":"2023-12-04T05:38:29.355239+0000","last_unstale":"2023-12-04T05:38:30.344999+0000","last_undegraded":"2023-12-04T05:38:30.344999+0000","last_fullsized":"2023-12-04T05:38:30.344999+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.379655+0000","last_change":"2023-12-04T05:38:28.339404+0000","last_active":"2023-12-04T05:38:29.379655+0000","last_peered":"2023-12-04T05:38:29.379655+0000","last_clean":"2023-12-04T05:38:29.379655+0000","last_became_active":"2023-12-04T05:38:28.339126+0000","last_became_peered":"2023-12-04T05:38:28.339126+0000","last_unstale":"2023-12-04T05:38:29.379655+0000","last_undegraded":"2023-12-04T05:38:29.379655+0000","last_fullsized":"2023-12-04T05:38:29.379655+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:09:54.445347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.345124+0000","last_change":"2023-12-04T05:38:29.359342+0000","last_active":"2023-12-04T05:38:30.345124+0000","last_peered":"2023-12-04T05:38:30.345124+0000","last_clean":"2023-12-04T05:38:30.345124+0000","last_became_active":"2023-12-04T05:38:29.358806+0000","last_became_peered":"2023-12-04T05:38:29.358806+0000","last_unstale":"2023-12-04T05:38:30.345124+0000","last_undegraded":"2023-12-04T05:38:30.345124+0000","last_fullsized":"2023-12-04T05:38:30.345124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344488+0000","last_change":"2023-12-04T05:38:28.351967+0000","last_active":"2023-12-04T05:38:30.344488+0000","last_peered":"2023-12-04T05:38:30.344488+0000","last_clean":"2023-12-04T05:38:30.344488+0000","last_became_active":"2023-12-04T05:38:28.350680+0000","last_became_peered":"2023-12-04T05:38:28.350680+0000","last_unstale":"2023-12-04T05:38:30.344488+0000","last_undegraded":"2023-12-04T05:38:30.344488+0000","last_fullsized":"2023-12-04T05:38:30.344488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:37.289509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343648+0000","last_change":"2023-12-04T05:38:29.355636+0000","last_active":"2023-12-04T05:38:30.343648+0000","last_peered":"2023-12-04T05:38:30.343648+0000","last_clean":"2023-12-04T05:38:30.343648+0000","last_became_active":"2023-12-04T05:38:29.354320+0000","last_became_peered":"2023-12-04T05:38:29.354320+0000","last_unstale":"2023-12-04T05:38:30.343648+0000","last_undegraded":"2023-12-04T05:38:30.343648+0000","last_fullsized":"2023-12-04T05:38:30.343648+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:36.568528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.342287+0000","last_change":"2023-12-04T05:38:28.338365+0000","last_active":"2023-12-04T05:38:29.342287+0000","last_peered":"2023-12-04T05:38:29.342287+0000","last_clean":"2023-12-04T05:38:29.342287+0000","last_became_active":"2023-12-04T05:38:28.337946+0000","last_became_peered":"2023-12-04T05:38:28.337946+0000","last_unstale":"2023-12-04T05:38:29.342287+0000","last_undegraded":"2023-12-04T05:38:29.342287+0000","last_fullsized":"2023-12-04T05:38:29.342287+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:22.800341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.344253+0000","last_change":"2023-12-04T05:38:29.352860+0000","last_active":"2023-12-04T05:38:30.344253+0000","last_peered":"2023-12-04T05:38:30.344253+0000","last_clean":"2023-12-04T05:38:30.344253+0000","last_became_active":"2023-12-04T05:38:29.352511+0000","last_became_peered":"2023-12-04T05:38:29.352511+0000","last_unstale":"2023-12-04T05:38:30.344253+0000","last_undegraded":"2023-12-04T05:38:30.344253+0000","last_fullsized":"2023-12-04T05:38:30.344253+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:21.726802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.350310+0000","last_change":"2023-12-04T05:38:28.350094+0000","last_active":"2023-12-04T05:38:29.350310+0000","last_peered":"2023-12-04T05:38:29.350310+0000","last_clean":"2023-12-04T05:38:29.350310+0000","last_became_active":"2023-12-04T05:38:28.349731+0000","last_became_peered":"2023-12-04T05:38:28.349731+0000","last_unstale":"2023-12-04T05:38:29.350310+0000","last_undegraded":"2023-12-04T05:38:29.350310+0000","last_fullsized":"2023-12-04T05:38:29.350310+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:07.362253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.340235+0000","last_change":"2023-12-04T05:38:29.350276+0000","last_active":"2023-12-04T05:38:30.340235+0000","last_peered":"2023-12-04T05:38:30.340235+0000","last_clean":"2023-12-04T05:38:30.340235+0000","last_became_active":"2023-12-04T05:38:29.350015+0000","last_became_peered":"2023-12-04T05:38:29.350015+0000","last_unstale":"2023-12-04T05:38:30.340235+0000","last_undegraded":"2023-12-04T05:38:30.340235+0000","last_fullsized":"2023-12-04T05:38:30.340235+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:07.900096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344239+0000","last_change":"2023-12-04T05:38:28.353620+0000","last_active":"2023-12-04T05:38:29.344239+0000","last_peered":"2023-12-04T05:38:29.344239+0000","last_clean":"2023-12-04T05:38:29.344239+0000","last_became_active":"2023-12-04T05:38:28.353260+0000","last_became_peered":"2023-12-04T05:38:28.353260+0000","last_unstale":"2023-12-04T05:38:29.344239+0000","last_undegraded":"2023-12-04T05:38:29.344239+0000","last_fullsized":"2023-12-04T05:38:29.344239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:12.165110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343952+0000","last_change":"2023-12-04T05:38:29.366519+0000","last_active":"2023-12-04T05:38:30.343952+0000","last_peered":"2023-12-04T05:38:30.343952+0000","last_clean":"2023-12-04T05:38:30.343952+0000","last_became_active":"2023-12-04T05:38:29.366308+0000","last_became_peered":"2023-12-04T05:38:29.366308+0000","last_unstale":"2023-12-04T05:38:30.343952+0000","last_undegraded":"2023-12-04T05:38:30.343952+0000","last_fullsized":"2023-12-04T05:38:30.343952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.341299+0000","last_change":"2023-12-04T05:38:28.350853+0000","last_active":"2023-12-04T05:38:29.341299+0000","last_peered":"2023-12-04T05:38:29.341299+0000","last_clean":"2023-12-04T05:38:29.341299+0000","last_became_active":"2023-12-04T05:38:28.350557+0000","last_became_peered":"2023-12-04T05:38:28.350557+0000","last_unstale":"2023-12-04T05:38:29.341299+0000","last_undegraded":"2023-12-04T05:38:29.341299+0000","last_fullsized":"2023-12-04T05:38:29.341299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343268+0000","last_change":"2023-12-04T05:38:29.348446+0000","last_active":"2023-12-04T05:38:30.343268+0000","last_peered":"2023-12-04T05:38:30.343268+0000","last_clean":"2023-12-04T05:38:30.343268+0000","last_became_active":"2023-12-04T05:38:29.348081+0000","last_became_peered":"2023-12-04T05:38:29.348081+0000","last_unstale":"2023-12-04T05:38:30.343268+0000","last_undegraded":"2023-12-04T05:38:30.343268+0000","last_fullsized":"2023-12-04T05:38:30.343268+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:33.662249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.344427+0000","last_change":"2023-12-04T05:38:28.346850+0000","last_active":"2023-12-04T05:38:29.344427+0000","last_peered":"2023-12-04T05:38:29.344427+0000","last_clean":"2023-12-04T05:38:29.344427+0000","last_became_active":"2023-12-04T05:38:28.346605+0000","last_became_peered":"2023-12-04T05:38:28.346605+0000","last_unstale":"2023-12-04T05:38:29.344427+0000","last_undegraded":"2023-12-04T05:38:29.344427+0000","last_fullsized":"2023-12-04T05:38:29.344427+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:22.166638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339915+0000","last_change":"2023-12-04T05:38:29.348990+0000","last_active":"2023-12-04T05:38:30.339915+0000","last_peered":"2023-12-04T05:38:30.339915+0000","last_clean":"2023-12-04T05:38:30.339915+0000","last_became_active":"2023-12-04T05:38:29.348709+0000","last_became_peered":"2023-12-04T05:38:29.348709+0000","last_unstale":"2023-12-04T05:38:30.339915+0000","last_undegraded":"2023-12-04T05:38:30.339915+0000","last_fullsized":"2023-12-04T05:38:30.339915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:17.966249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.338588+0000","last_change":"2023-12-04T05:38:28.358626+0000","last_active":"2023-12-04T05:38:29.338588+0000","last_peered":"2023-12-04T05:38:29.338588+0000","last_clean":"2023-12-04T05:38:29.338588+0000","last_became_active":"2023-12-04T05:38:28.358311+0000","last_became_peered":"2023-12-04T05:38:28.358311+0000","last_unstale":"2023-12-04T05:38:29.338588+0000","last_undegraded":"2023-12-04T05:38:29.338588+0000","last_fullsized":"2023-12-04T05:38:29.338588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:23.323105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.339917+0000","last_change":"2023-12-04T05:38:29.345465+0000","last_active":"2023-12-04T05:38:30.339917+0000","last_peered":"2023-12-04T05:38:30.339917+0000","last_clean":"2023-12-04T05:38:30.339917+0000","last_became_active":"2023-12-04T05:38:29.345189+0000","last_became_peered":"2023-12-04T05:38:29.345189+0000","last_unstale":"2023-12-04T05:38:30.339917+0000","last_undegraded":"2023-12-04T05:38:30.339917+0000","last_fullsized":"2023-12-04T05:38:30.339917+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:03.546556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-04T05:38:29.342576+0000","last_change":"2023-12-04T05:38:28.351607+0000","last_active":"2023-12-04T05:38:29.342576+0000","last_peered":"2023-12-04T05:38:29.342576+0000","last_clean":"2023-12-04T05:38:29.342576+0000","last_became_active":"2023-12-04T05:38:28.351286+0000","last_became_peered":"2023-12-04T05:38:28.351286+0000","last_unstale":"2023-12-04T05:38:29.342576+0000","last_undegraded":"2023-12-04T05:38:29.342576+0000","last_fullsized":"2023-12-04T05:38:29.342576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:39:41.882728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-04T05:38:30.343631+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:30.343631+0000","last_peered":"2023-12-04T05:38:30.343631+0000","last_clean":"2023-12-04T05:38:30.343631+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:30.343631+0000","last_undegraded":"2023-12-04T05:38:30.343631+0000","last_fullsized":"2023-12-04T05:38:30.343631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1200128,"data_stored":842619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.621}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.74099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.745},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.496}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64500000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.76500000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.73199999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72299999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.752}]},{"osd":5,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.73499999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.311}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.624},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.498}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.754}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.536},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":4.7160000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":5.2759999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":3.5030000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":5.4130000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":3.3940000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":3.4399999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":5.3710000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.375,"5min":3.375,"15min":3.375},"last":5.4889999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.569,"5min":3.569,"15min":3.569},"last":4.1639999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":4.2619999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":3.472}]},{"osd":7,"last update":"Mon Dec 4 05:37:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":5.4550000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":4.218}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.81699999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.94399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.878}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1208320,"data_stored":844653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.501}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.433},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.623},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:38.253 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:38:38.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-04T05:38:38.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 Processor -- start 2023-12-04T05:38:38.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 -- start start 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9694151d60 0x7f9694155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f969406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f969406a5f0 0x7f969406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96940c34d0 con 0x7f969406a5f0 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9694152140 con 0x7f9694151d60 2023-12-04T05:38:38.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969bd1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969406b530 con 0x7f969406f7f0 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f969406a5f0 0x7f969406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f969406a5f0 0x7f969406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58676/0 (socket says 172.21.15.97:58676) 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 -- 172.21.15.97:0/3559875664 learned_addr learned my addr 172.21.15.97:0/3559875664 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f96992b8640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f969406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f9699ab9640 1 --2- 172.21.15.97:0/3559875664 >> v2:172.21.15.143:3300/0 conn(0x7f9694151d60 0x7f9694155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 -- 172.21.15.97:0/3559875664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 msgr2=0x7f969406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f969406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 -- 172.21.15.97:0/3559875664 >> v2:172.21.15.143:3300/0 conn(0x7f9694151d60 msgr2=0x7f9694155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 --2- 172.21.15.97:0/3559875664 >> v2:172.21.15.143:3300/0 conn(0x7f9694151d60 0x7f9694155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.433+0000 7f969a2ba640 1 -- 172.21.15.97:0/3559875664 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96941556b0 con 0x7f969406a5f0 2023-12-04T05:38:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969a2ba640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f969406a5f0 0x7f969406aaa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96940c7ec0 tx=0x7f968c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f28a1608c89a5b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f9698ab7640 1 -- 172.21.15.97:0/3559875664 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0a5530 con 0x7f969406a5f0 2023-12-04T05:38:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f9698ab7640 1 -- 172.21.15.97:0/3559875664 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c0a5690 con 0x7f969406a5f0 2023-12-04T05:38:38.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f9698ab7640 1 -- 172.21.15.97:0/3559875664 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0a5a20 con 0x7f969406a5f0 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 -- 172.21.15.97:0/3559875664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f969406a5f0 msgr2=0x7f969406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f969406a5f0 0x7f969406aaa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96940c7ec0 tx=0x7f968c01c8b0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 -- 172.21.15.97:0/3559875664 shutdown_connections 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f969406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 --2- 172.21.15.97:0/3559875664 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f969406a5f0 0x7f969406aaa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 --2- 172.21.15.97:0/3559875664 >> v2:172.21.15.143:3300/0 conn(0x7f9694151d60 0x7f9694155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 -- 172.21.15.97:0/3559875664 >> 172.21.15.97:0/3559875664 conn(0x7f96940c3980 msgr2=0x7f96940c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 -- 172.21.15.97:0/3559875664 shutdown_connections 2023-12-04T05:38:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.437+0000 7f969bd1d640 1 -- 172.21.15.97:0/3559875664 wait complete. 2023-12-04T05:38:38.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 Processor -- start 2023-12-04T05:38:38.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- start start 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f969406a5f0 0x7f9694158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f96941f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694153920 con 0x7f9694151d60 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941477f0 con 0x7f969406a5f0 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96941535f0 con 0x7f969406f7f0 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58684/0 (socket says 172.21.15.97:58684) 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 -- 172.21.15.97:0/1105792225 learned_addr learned my addr 172.21.15.97:0/1105792225 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f9699ab9640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f969406a5f0 0x7f9694158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f96992b8640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f96941f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 -- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 msgr2=0x7f96941f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f96941f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 -- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f969406a5f0 msgr2=0x7f9694158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f969406a5f0 0x7f9694158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 -- 172.21.15.97:0/1105792225 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c009b30 con 0x7f9694151d60 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969a2ba640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f968c0af040 tx=0x7f968c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b8670 con 0x7f9694151d60 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c0b87d0 con 0x7f9694151d60 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b8b80 con 0x7f9694151d60 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941f0ef0 con 0x7f9694151d60 2023-12-04T05:38:38.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694155df0 con 0x7f9694151d60 2023-12-04T05:38:38.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.441+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694153ad0 con 0x7f9694151d60 2023-12-04T05:38:38.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.445+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f968c0b8ce0 con 0x7f9694151d60 2023-12-04T05:38:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.445+0000 7f968a7fc640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 0x7f9678068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.445+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f968c11f6d0 con 0x7f9694151d60 2023-12-04T05:38:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.445+0000 7f9699ab9640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 0x7f9678068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.445+0000 7f9699ab9640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 0x7f9678068dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96900079c0 tx=0x7f9690008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.449+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9694153ad0 con 0x7f9694151d60 2023-12-04T05:38:38.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.649+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9694153ad0 con 0x7f9694151d60 2023-12-04T05:38:38.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.653+0000 7f968a7fc640 1 -- 172.21.15.97:0/1105792225 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f968c0bc0b0 con 0x7f9694151d60 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg== 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T05:38:38.659 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.0 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 msgr2=0x7f9678068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 0x7f9678068dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96900079c0 tx=0x7f9690008040 comp rx=0 tx=0).stop 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 msgr2=0x7f9694153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f968c0af040 tx=0x7f968c019650 comp rx=0 tx=0).stop 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 shutdown_connections 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9678066900 0x7f9678068dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9694151d60 0x7f9694153db0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f969406f7f0 0x7f96941f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 --2- 172.21.15.97:0/1105792225 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f969406a5f0 0x7f9694158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 >> 172.21.15.97:0/1105792225 conn(0x7f96940c3980 msgr2=0x7f9694146360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:38.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 shutdown_connections 2023-12-04T05:38:38.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.657+0000 7f969bd1d640 1 -- 172.21.15.97:0/1105792225 wait complete. 2023-12-04T05:38:38.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:38.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 Processor -- start 2023-12-04T05:38:38.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 -- start start 2023-12-04T05:38:38.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8068151bf0 0x7f80680abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80681547d0 con 0x7f8068158630 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8068158b80 con 0x7f8068151bf0 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806e8c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80680c4aa0 con 0x7f80680c7ef0 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f80677fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f80677fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:34538/0 (socket says 172.21.15.97:34538) 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f80677fe640 1 -- 172.21.15.97:0/1754610681 learned_addr learned my addr 172.21.15.97:0/1754610681 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f806ce66640 1 --1- 172.21.15.97:0/1754610681 >> v1:172.21.15.143:6789/0 conn(0x7f8068158630 0x7f80680c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52348/0 (socket says 172.21.15.97:52348) 2023-12-04T05:38:38.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f8067fff640 1 --2- 172.21.15.97:0/1754610681 >> v2:172.21.15.143:3300/0 conn(0x7f8068151bf0 0x7f80680abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f8067fff640 1 -- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 msgr2=0x7f8068154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f8067fff640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f8067fff640 1 -- 172.21.15.97:0/1754610681 >> v1:172.21.15.143:6789/0 conn(0x7f8068158630 legacy=0x7f80680c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f8067fff640 1 -- 172.21.15.97:0/1754610681 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680c4d40 con 0x7f8068151bf0 2023-12-04T05:38:38.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.813+0000 7f80677fe640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:38.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f8067fff640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f80680abbb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b407b27dfc4df9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f8066ffd640 1 -- 172.21.15.97:0/1754610681 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580a5670 con 0x7f8068151bf0 2023-12-04T05:38:38.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f8066ffd640 1 -- 172.21.15.97:0/1754610681 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580a57d0 con 0x7f8068151bf0 2023-12-04T05:38:38.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f8066ffd640 1 -- 172.21.15.97:0/1754610681 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580a5b60 con 0x7f8068151bf0 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 -- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 msgr2=0x7f80680abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f80680abbb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c040 comp rx=0 tx=0).stop 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 -- 172.21.15.97:0/1754610681 shutdown_connections 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 --2- 172.21.15.97:0/1754610681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f80680abbb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 -- 172.21.15.97:0/1754610681 >> 172.21.15.97:0/1754610681 conn(0x7f8068073550 msgr2=0x7f8068073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 -- 172.21.15.97:0/1754610681 shutdown_connections 2023-12-04T05:38:38.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.817+0000 7f806e8c9640 1 -- 172.21.15.97:0/1754610681 wait complete. 2023-12-04T05:38:38.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 Processor -- start 2023-12-04T05:38:38.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- start start 2023-12-04T05:38:38.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f8068157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680ad440 con 0x7f8068158630 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80681eefb0 con 0x7f8068151bf0 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806814db70 con 0x7f80680c7ef0 2023-12-04T05:38:38.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58690/0 (socket says 172.21.15.97:58690) 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 -- 172.21.15.97:0/3505108041 learned_addr learned my addr 172.21.15.97:0/3505108041 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f8067fff640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f80677fe640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f8068157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 -- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 msgr2=0x7f8068147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068147640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 -- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 msgr2=0x7f8068157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f8068157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 -- 172.21.15.97:0/3505108041 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c0094d0 con 0x7f8068158630 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806ce66640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f806000c7a0 tx=0x7f806000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000a640 con 0x7f8068158630 2023-12-04T05:38:38.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000a7a0 con 0x7f8068158630 2023-12-04T05:38:38.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000ab10 con 0x7f8068158630 2023-12-04T05:38:38.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8058009420 con 0x7f8068158630 2023-12-04T05:38:38.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.821+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806814e130 con 0x7f8068158630 2023-12-04T05:38:38.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80680c57c0 con 0x7f8068158630 2023-12-04T05:38:38.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f806000ac70 con 0x7f8068158630 2023-12-04T05:38:38.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f8064ff9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 0x7f8054068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:38.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8060083ba0 con 0x7f8068158630 2023-12-04T05:38:38.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f8067fff640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 0x7f8054068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:38.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.825+0000 7f8067fff640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 0x7f8054068dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80580ad000 tx=0x7f80580a8040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:38.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:38.829+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8060050e80 con 0x7f8068158630 2023-12-04T05:38:39.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.005+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f806814e320 con 0x7f8068158630 2023-12-04T05:38:39.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f8064ff9640 1 -- 172.21.15.97:0/3505108041 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f8060017020 con 0x7f8068158630 2023-12-04T05:38:39.014 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:39.015 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5736,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 32 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 msgr2=0x7f8054068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 0x7f8054068dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80580ad000 tx=0x7f80580a8040 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 msgr2=0x7f80681576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f806000c7a0 tx=0x7f806000cc60 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 shutdown_connections 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8054066900 0x7f8054068dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8068158630 0x7f80681576a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8068151bf0 0x7f8068157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 --2- 172.21.15.97:0/3505108041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80680c7ef0 0x7f8068147640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 >> 172.21.15.97:0/3505108041 conn(0x7f8068073550 msgr2=0x7f806815f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 shutdown_connections 2023-12-04T05:38:39.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.009+0000 7f806e8c9640 1 -- 172.21.15.97:0/3505108041 wait complete. 2023-12-04T05:38:39.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T05:38:28.702052+0000', 'modified': '2023-12-04T05:38:31.710088+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5757}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5757': {'gid': 5757, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6837/3150893568', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6836', 'nonce': 3150893568}, {'type': 'v1', 'addr': '172.21.15.97:6837', 'nonce': 3150893568}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T05:38:39.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T05:38:39.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-04T05:38:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 Processor -- start 2023-12-04T05:38:39.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 -- start start 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d8151a60 0x7f42d8154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 0x7f42d80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d8151e40 con 0x7f42d8151a60 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80c7150 con 0x7f42d80c7c90 2023-12-04T05:38:39.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42deb93640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80c68b0 con 0x7f42d80c4c50 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d8151a60 0x7f42d8154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f42d8151a60 0x7f42d8154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58706/0 (socket says 172.21.15.97:58706) 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 -- 172.21.15.97:0/505239525 learned_addr learned my addr 172.21.15.97:0/505239525 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42dd390640 1 --2- 172.21.15.97:0/505239525 >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 0x7f42d80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42de392640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 -- 172.21.15.97:0/505239525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 msgr2=0x7f42d806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 -- 172.21.15.97:0/505239525 >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 msgr2=0x7f42d80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 --2- 172.21.15.97:0/505239525 >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 0x7f42d80c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42ddb91640 1 -- 172.21.15.97:0/505239525 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80c6b90 con 0x7f42d8151a60 2023-12-04T05:38:39.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42dd390640 1 --2- 172.21.15.97:0/505239525 >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 0x7f42d80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:39.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.573+0000 7f42de392640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42ddb91640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8154e30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f42d80c5fa0 tx=0x7f42d401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac664f42b024aec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42dcb8f640 1 -- 172.21.15.97:0/505239525 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40ab600 con 0x7f42d8151a60 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42dcb8f640 1 -- 172.21.15.97:0/505239525 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d40a7050 con 0x7f42d8151a60 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42dcb8f640 1 -- 172.21.15.97:0/505239525 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40ab980 con 0x7f42d8151a60 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 -- 172.21.15.97:0/505239525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 msgr2=0x7f42d8154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8154e30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f42d80c5fa0 tx=0x7f42d401c430 comp rx=0 tx=0).stop 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 -- 172.21.15.97:0/505239525 shutdown_connections 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 --2- 172.21.15.97:0/505239525 >> v2:172.21.15.143:3300/0 conn(0x7f42d80c7c90 0x7f42d80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 --2- 172.21.15.97:0/505239525 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8154e30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 -- 172.21.15.97:0/505239525 >> 172.21.15.97:0/505239525 conn(0x7f42d80abb50 msgr2=0x7f42d80abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 -- 172.21.15.97:0/505239525 shutdown_connections 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.577+0000 7f42deb93640 1 -- 172.21.15.97:0/505239525 wait complete. 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 Processor -- start 2023-12-04T05:38:39.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- start start 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42d80c7c90 0x7f42d814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80af3a0 con 0x7f42d8151a60 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d81f0a70 con 0x7f42d80c7c90 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80af640 con 0x7f42d80c4c50 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58710/0 (socket says 172.21.15.97:58710) 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 -- 172.21.15.97:0/2733408781 learned_addr learned my addr 172.21.15.97:0/2733408781 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42ddb91640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42dd390640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42d80c7c90 0x7f42d814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 -- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 msgr2=0x7f42d80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 -- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42d80c7c90 msgr2=0x7f42d814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42d80c7c90 0x7f42d814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 -- 172.21.15.97:0/2733408781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40094d0 con 0x7f42d8151a60 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42de392640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007ef0 tx=0x7f42d000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42ce7fc640 1 -- 172.21.15.97:0/2733408781 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0003ba0 con 0x7f42d8151a60 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42ce7fc640 1 -- 172.21.15.97:0/2733408781 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d000f040 con 0x7f42d8151a60 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d81f0d50 con 0x7f42d8151a60 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42ce7fc640 1 -- 172.21.15.97:0/2733408781 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d000de80 con 0x7f42d8151a60 2023-12-04T05:38:39.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.581+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d80adae0 con 0x7f42d8151a60 2023-12-04T05:38:39.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ce7fc640 1 -- 172.21.15.97:0/2733408781 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f42d0004030 con 0x7f42d8151a60 2023-12-04T05:38:39.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ce7fc640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 0x7f42bc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ce7fc640 1 -- 172.21.15.97:0/2733408781 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42d00846c0 con 0x7f42d8151a60 2023-12-04T05:38:39.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ddb91640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 0x7f42bc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 Processor -- start 2023-12-04T05:38:39.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 -- start start 2023-12-04T05:38:39.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ddb91640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 0x7f42bc068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42d40ad000 tx=0x7f42d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 0x5568da0753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da0bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9f3e110 con 0x5568da0758e0 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9ece9a0 con 0x5568da076200 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568d9ecbed0 con 0x5568da074fc0 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42dd390640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42dd390640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58720/0 (socket says 172.21.15.97:58720) 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42dd390640 1 -- 172.21.15.97:0/3332421977 learned_addr learned my addr 172.21.15.97:0/3332421977 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 0x5568da0753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.585+0000 7f42de392640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da0bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 -- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 msgr2=0x5568da0753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 0x5568da0753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 -- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 msgr2=0x5568da0bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da0bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 -- 172.21.15.97:0/3332421977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568d9bbf890 con 0x5568da0758e0 2023-12-04T05:38:39.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 0x5568da0753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:39.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009a10 tx=0x7f42c8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f450393baf058f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42bb7fe640 1 -- 172.21.15.97:0/3332421977 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8010d00 con 0x5568da0758e0 2023-12-04T05:38:39.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42bb7fe640 1 -- 172.21.15.97:0/3332421977 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800c050 con 0x5568da0758e0 2023-12-04T05:38:39.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42bb7fe640 1 -- 172.21.15.97:0/3332421977 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8015670 con 0x5568da0758e0 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- 172.21.15.97:0/3332421977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 msgr2=0x5568da075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009a10 tx=0x7f42c8009ed0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- 172.21.15.97:0/3332421977 shutdown_connections 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da0bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da0758e0 0x5568da075cc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- 172.21.15.97:0/3332421977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da074fc0 0x5568da0753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- 172.21.15.97:0/3332421977 >> 172.21.15.97:0/3332421977 conn(0x5568da0b3830 msgr2=0x5568da0b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- 172.21.15.97:0/3332421977 shutdown_connections 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- 172.21.15.97:0/3332421977 wait complete. 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- start start 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 Processor -- start 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0758e0 0x5568da07c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da07cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9ec77c0 con 0x5568da074fc0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9e7fbf0 con 0x5568da076200 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568d9e85a90 con 0x5568da0758e0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42e3164000 10 client.0 _ll_register_callbacks cb 0x5568da062e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58734/0 (socket says 172.21.15.97:58734) 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42ddb91640 1 -- 172.21.15.97:0/3406726741 learned_addr learned my addr 172.21.15.97:0/3406726741 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42de392640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da07cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.589+0000 7f42dd390640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0758e0 0x5568da07c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 -- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0758e0 msgr2=0x5568da07c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0758e0 0x5568da07c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 -- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 msgr2=0x5568da07cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da07cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 -- 172.21.15.97:0/3406726741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c8009640 con 0x5568da074fc0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42d4097db0 tx=0x7f42d401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7d874c1887be17 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40b5790 con 0x5568da074fc0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42d40b58f0 con 0x5568da074fc0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568d9e89470 con 0x5568da074fc0 2023-12-04T05:38:39.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42d40b5ab0 con 0x5568da074fc0 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 10 client.5922 fetch_fsmap learned FSMap version 32 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5568d9e88190 con 0x5568da074fc0 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568d9e89470 con 0x5568da074fc0 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42d40b5c10 con 0x5568da074fc0 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 10 client.5922 fetch_fsmap finished waiting for FSMap version 32 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 10 client.5922 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T05:38:39.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 20 client.5922 populate_metadata read hostname 'smithi097' 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0c9310 0x5568da0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 4 client.5922 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 --> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568d9e8cb50 con 0x5568da0c9310 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42dd390640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0c9310 0x5568da0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42dd390640 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0c9310 0x5568da0cb700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1e4410c998329c server_cookie=b1b30de17ddf2b26 in_seq=0 out_seq=0 2023-12-04T05:38:39.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 10 client.5922 ms_handle_connect on v2:172.21.15.97:6836/3150893568 2023-12-04T05:38:39.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3406726741 <== mds.0 v2:172.21.15.97:6836/3150893568 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5568d9e8cb50 con 0x5568da0c9310 2023-12-04T05:38:39.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 10 client.5922 handle_command_reply: tid=0 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 client.5922 shutdown 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 msgr2=0x5568da07c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42d4097db0 tx=0x7f42d401ac70 comp rx=0 tx=0).stop 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 shutdown_connections 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0c9310 0x5568da0cb700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da076200 0x5568da07cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0758e0 0x5568da07c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 --2- 172.21.15.97:0/3406726741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da07c220 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42b8ff9640 0 client.5922 ms_handle_reset on v2:172.21.15.97:6836/3150893568 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 >> 172.21.15.97:0/3406726741 conn(0x5568da0b3830 msgr2=0x5568da0b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 shutdown_connections 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.593+0000 7f42e3164000 1 -- 172.21.15.97:0/3406726741 wait complete. 2023-12-04T05:38:39.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.597+0000 7f42e3164000 20 client.5922 trim_cache size 0 max 16384 2023-12-04T05:38:39.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 Processor -- start 2023-12-04T05:38:39.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 -- start start 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0b3830 0x5568da073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da074fc0 0x5568da0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9b80940 con 0x5568da078960 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9f4e570 con 0x5568da074fc0 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.609+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568d9ec1ac0 con 0x5568da0b3830 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58742/0 (socket says 172.21.15.97:58742) 2023-12-04T05:38:39.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 -- 172.21.15.97:0/3691305217 learned_addr learned my addr 172.21.15.97:0/3691305217 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42dd390640 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0b3830 0x5568da073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42de392640 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da074fc0 0x5568da0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 -- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0b3830 msgr2=0x5568da073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0b3830 0x5568da073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 -- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da074fc0 msgr2=0x5568da0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da074fc0 0x5568da0cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 -- 172.21.15.97:0/3691305217 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568d9e6e490 con 0x5568da078960 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f42d40ae040 tx=0x7f42d40be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f088cc0b89b344 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42bbfff640 1 -- 172.21.15.97:0/3691305217 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40ab7f0 con 0x5568da078960 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42bbfff640 1 -- 172.21.15.97:0/3691305217 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d40c1980 con 0x5568da078960 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42bbfff640 1 -- 172.21.15.97:0/3691305217 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40c1cf0 con 0x5568da078960 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- 172.21.15.97:0/3691305217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 msgr2=0x5568da074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f42d40ae040 tx=0x7f42d40be000 comp rx=0 tx=0).stop 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- 172.21.15.97:0/3691305217 shutdown_connections 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da074fc0 0x5568da0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da0b3830 0x5568da073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- 172.21.15.97:0/3691305217 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da078960 0x5568da074970 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- 172.21.15.97:0/3691305217 >> 172.21.15.97:0/3691305217 conn(0x5568da07cc60 msgr2=0x5568da0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- 172.21.15.97:0/3691305217 shutdown_connections 2023-12-04T05:38:39.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- 172.21.15.97:0/3691305217 wait complete. 2023-12-04T05:38:39.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- start start 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 Processor -- start 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da078960 0x5568da123110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 0x5568da0e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9f08440 con 0x5568da074fc0 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568d9ec6650 con 0x5568da0b3830 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568da0793a0 con 0x5568da078960 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42e3164000 10 client.0 _ll_register_callbacks cb 0x5568d9ed28e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58756/0 (socket says 172.21.15.97:58756) 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42ddb91640 1 -- 172.21.15.97:0/3220867927 learned_addr learned my addr 172.21.15.97:0/3220867927 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.613+0000 7f42dd390640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da078960 0x5568da123110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42de392640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 0x5568da0e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 -- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da078960 msgr2=0x5568da123110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da078960 0x5568da123110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 -- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 msgr2=0x5568da0e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 0x5568da0e6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 -- 172.21.15.97:0/3220867927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568d9e88190 con 0x5568da074fc0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42de392640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 0x5568da0e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42ddb91640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f42d401c910 tx=0x7f42d40a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bcd239282ab715 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d40b5790 con 0x5568da074fc0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42d40abe40 con 0x5568da074fc0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568da079f60 con 0x5568da074fc0 2023-12-04T05:38:39.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42d40ab7f0 con 0x5568da074fc0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 10 client.5928 fetch_fsmap learned FSMap version 32 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5568d9bbfcc0 con 0x5568da074fc0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568da079f60 con 0x5568da074fc0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f42d40b5b00 con 0x5568da074fc0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 10 client.5928 fetch_fsmap finished waiting for FSMap version 32 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 10 client.5928 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 20 client.5928 populate_metadata read hostname 'smithi097' 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0758e0 0x5568da0e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 4 client.5928 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 --> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5568d9ec6110 con 0x5568da0758e0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42dd390640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0758e0 0x5568da0e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42dd390640 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0758e0 0x5568da0e73e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eaefaee68ff02c1 server_cookie=f370c1e311d30076 in_seq=0 out_seq=0 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 10 client.5928 ms_handle_connect on v2:172.21.15.97:6836/3150893568 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 1 -- 172.21.15.97:0/3220867927 <== mds.0 v2:172.21.15.97:6836/3150893568 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5568d9ec6110 con 0x5568da0758e0 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 10 client.5928 handle_command_reply: tid=0 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 client.5928 shutdown 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 msgr2=0x5568da122bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f42d401c910 tx=0x7f42d40a8000 comp rx=0 tx=0).stop 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 shutdown_connections 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:6836/3150893568,v1:172.21.15.97:6837/3150893568] conn(0x5568da0758e0 0x5568da0e73e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5568da0b3830 0x5568da0e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5568da078960 0x5568da123110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 --2- 172.21.15.97:0/3220867927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5568da074fc0 0x5568da122bd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42b8ff9640 0 client.5928 ms_handle_reset on v2:172.21.15.97:6836/3150893568 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 >> 172.21.15.97:0/3220867927 conn(0x5568da07cc60 msgr2=0x5568da0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 shutdown_connections 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 1 -- 172.21.15.97:0/3220867927 wait complete. 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42e3164000 20 client.5928 trim_cache size 0 max 16384 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "76f28696-8109-44bf-b432-6ecc5796b8c9", 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-12-04T05:38:39.630 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 5757, 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 10.271558919, 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 32, 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 50, 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 50, 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 17.163356490999998 2023-12-04T05:38:39.631 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:38:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 msgr2=0x7f42bc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 0x7f42bc068dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f42d40ad000 tx=0x7f42d4008040 comp rx=0 tx=0).stop 2023-12-04T05:38:39.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 msgr2=0x7f42d8152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42d0007ef0 tx=0x7f42d000d4a0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 shutdown_connections 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f42bc066900 0x7f42bc068dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f42d8151a60 0x7f42d8152270 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42d80c7c90 0x7f42d814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 --2- 172.21.15.97:0/2733408781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42d80c4c50 0x7f42d80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 >> 172.21.15.97:0/2733408781 conn(0x7f42d80abb50 msgr2=0x7f42d814ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 shutdown_connections 2023-12-04T05:38:39.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.617+0000 7f42deb93640 1 -- 172.21.15.97:0/2733408781 wait complete. 2023-12-04T05:38:39.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:38:39.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.773+0000 7f2993432640 1 Processor -- start 2023-12-04T05:38:39.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.773+0000 7f2993432640 1 -- start start 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2993432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 0x7f298c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2993432640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c152300 con 0x7f298c06be00 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2993432640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c071580 con 0x7f298c06ca50 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2993432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c14ed50 con 0x7f298c14e970 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29909cd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f298c06be00 0x7f298c071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60028/0 (socket says 172.21.15.97:60028) 2023-12-04T05:38:39.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29909cd640 1 -- 172.21.15.97:0/3103071796 learned_addr learned my addr 172.21.15.97:0/3103071796 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:39.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29911ce640 1 --2- 172.21.15.97:0/3103071796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 0x7f298c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703710168 0 0) 0x7f297c001120 con 0x7f298c06be00 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2978003530 con 0x7f298c06be00 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059463526 0 0) 0x7f298c071580 con 0x7f298c06ca50 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c001120 con 0x7f298c06ca50 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29911ce640 1 -- 172.21.15.97:0/3103071796 >> v1:172.21.15.143:6789/0 conn(0x7f298c06ca50 legacy=0x7f298c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29911ce640 1 -- 172.21.15.97:0/3103071796 >> v1:172.21.15.97:6789/0 conn(0x7f298c06be00 legacy=0x7f298c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.777+0000 7f29911ce640 1 -- 172.21.15.97:0/3103071796 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c06cea0 con 0x7f298c14e970 2023-12-04T05:38:39.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f29911ce640 1 --2- 172.21.15.97:0/3103071796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 0x7f298c06e150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f29880097f0 tx=0x7f298801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cd82a98b46e8c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880ac400 con 0x7f298c14e970 2023-12-04T05:38:39.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880a8050 con 0x7f298c14e970 2023-12-04T05:38:39.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2983fff640 1 -- 172.21.15.97:0/3103071796 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880ac780 con 0x7f298c14e970 2023-12-04T05:38:39.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- 172.21.15.97:0/3103071796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 msgr2=0x7f298c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 --2- 172.21.15.97:0/3103071796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 0x7f298c06e150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f29880097f0 tx=0x7f298801c3a0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- 172.21.15.97:0/3103071796 shutdown_connections 2023-12-04T05:38:39.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 --2- 172.21.15.97:0/3103071796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c14e970 0x7f298c06e150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- 172.21.15.97:0/3103071796 >> 172.21.15.97:0/3103071796 conn(0x7f298c0c2970 msgr2=0x7f298c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- 172.21.15.97:0/3103071796 shutdown_connections 2023-12-04T05:38:39.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- 172.21.15.97:0/3103071796 wait complete. 2023-12-04T05:38:39.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 Processor -- start 2023-12-04T05:38:39.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.781+0000 7f2993432640 1 -- start start 2023-12-04T05:38:39.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 0x7f298c0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f298c06ca50 0x7f298c141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0abd10 con 0x7f298c14e970 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c5960 con 0x7f298c06ca50 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0bff90 con 0x7f298c06be00 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29911ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 0x7f298c0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58770/0 (socket says 172.21.15.97:58770) 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29909cd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f298c06ca50 0x7f298c141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29911ce640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 0x7f298c0bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:34616/0 (socket says 172.21.15.97:34616) 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 -- 172.21.15.97:0/2113983850 learned_addr learned my addr 172.21.15.97:0/2113983850 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 -- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 msgr2=0x7f298c0bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 0x7f298c0bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 -- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f298c06ca50 msgr2=0x7f298c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f298c06ca50 0x7f298c141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 -- 172.21.15.97:0/2113983850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009420 con 0x7f298c14e970 2023-12-04T05:38:39.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f29919cf640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f298400c730 tx=0x7f298400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984003b80 con 0x7f298c14e970 2023-12-04T05:38:39.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2984003ce0 con 0x7f298c14e970 2023-12-04T05:38:39.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400aa90 con 0x7f298c14e970 2023-12-04T05:38:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c1f09f0 con 0x7f298c14e970 2023-12-04T05:38:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c0c53a0 con 0x7f298c14e970 2023-12-04T05:38:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.785+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c0a9dd0 con 0x7f298c14e970 2023-12-04T05:38:39.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.789+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f298400abf0 con 0x7f298c14e970 2023-12-04T05:38:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.789+0000 7f2981ffb640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 0x7f2970068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.789+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2984084080 con 0x7f298c14e970 2023-12-04T05:38:39.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.789+0000 7f29911ce640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 0x7f2970068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:39.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.789+0000 7f29911ce640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 0x7f2970068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae000 tx=0x7f29880a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:39.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.793+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f298c0a9dd0 con 0x7f298c14e970 2023-12-04T05:38:39.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f298c0a9dd0 con 0x7f298c14e970 2023-12-04T05:38:39.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2981ffb640 1 -- 172.21.15.97:0/2113983850 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f298c0a9dd0 con 0x7f298c14e970 2023-12-04T05:38:39.978 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 msgr2=0x7f2970068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 0x7f2970068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae000 tx=0x7f29880a7000 comp rx=0 tx=0).stop 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 msgr2=0x7f298c142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f298400c730 tx=0x7f298400cbf0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 shutdown_connections 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29700668d0 0x7f2970068d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f298c14e970 0x7f298c142080 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f298c06ca50 0x7f298c141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 --2- 172.21.15.97:0/2113983850 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f298c06be00 0x7f298c0bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:39.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 >> 172.21.15.97:0/2113983850 conn(0x7f298c0c2970 msgr2=0x7f298c15bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:39.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 shutdown_connections 2023-12-04T05:38:39.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:39.973+0000 7f2993432640 1 -- 172.21.15.97:0/2113983850 wait complete. 2023-12-04T05:38:39.999 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:38:40.000 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:38:40.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.001 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42029sec preferred_lft 42029sec 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:38:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:40.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.014 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:38:40.074 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:38:40.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.077 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:40.135 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:40.136 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:40.136 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:38:40.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:38:40.136 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:38:40.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.228 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:38:40.285 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:38:40.285 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:38:40.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:38:40.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:40.349 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:40.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:40.404 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:40.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T05:38:40.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:40.550 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:40.550 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:40.564 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:40.565 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:40.565 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:38:40.565 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 0@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:38:40.565 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:38:40.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:38:40.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:40.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:40.590 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:38:40.648 INFO:teuthology.orchestra.run.smithi097.stdout:client5707 2023-12-04T05:38:40.648 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:40.648 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:40.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:38:40.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 Processor -- start 2023-12-04T05:38:40.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 -- start start 2023-12-04T05:38:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f657806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65780c4740 0x7f65780c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f65780c4c50 0x7f6578157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65781550f0 con 0x7f65780c4740 2023-12-04T05:38:40.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780c52b0 con 0x7f65780c4c50 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657d5d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780c5590 con 0x7f6578151cb0 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65780c4740 0x7f65780c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f65780c4740 0x7f65780c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58774/0 (socket says 172.21.15.97:58774) 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 -- 172.21.15.97:0/141972273 learned_addr learned my addr 172.21.15.97:0/141972273 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f657cdcf640 1 --2- 172.21.15.97:0/141972273 >> v2:172.21.15.143:3300/0 conn(0x7f65780c4c50 0x7f6578157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f6577fff640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f657806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 -- 172.21.15.97:0/141972273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 msgr2=0x7f657806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f657806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 -- 172.21.15.97:0/141972273 >> v2:172.21.15.143:3300/0 conn(0x7f65780c4c50 msgr2=0x7f6578157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 --2- 172.21.15.97:0/141972273 >> v2:172.21.15.143:3300/0 conn(0x7f65780c4c50 0x7f6578157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.885+0000 7f65777fe640 1 -- 172.21.15.97:0/141972273 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780c5870 con 0x7f65780c4740 2023-12-04T05:38:40.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f65777fe640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780c5d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f657808be70 tx=0x7f656c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9ca3322acc214e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f6576ffd640 1 -- 172.21.15.97:0/141972273 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c0ac620 con 0x7f65780c4740 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f6576ffd640 1 -- 172.21.15.97:0/141972273 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c0ac780 con 0x7f65780c4740 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f6576ffd640 1 -- 172.21.15.97:0/141972273 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c0acb10 con 0x7f65780c4740 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- 172.21.15.97:0/141972273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 msgr2=0x7f65780c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780c5d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f657808be70 tx=0x7f656c01c3e0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- 172.21.15.97:0/141972273 shutdown_connections 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 --2- 172.21.15.97:0/141972273 >> v2:172.21.15.143:3300/0 conn(0x7f65780c4c50 0x7f6578157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780c5d90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 --2- 172.21.15.97:0/141972273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f657806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- 172.21.15.97:0/141972273 >> 172.21.15.97:0/141972273 conn(0x7f65780ab8b0 msgr2=0x7f65780abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:40.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- 172.21.15.97:0/141972273 shutdown_connections 2023-12-04T05:38:40.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- 172.21.15.97:0/141972273 wait complete. 2023-12-04T05:38:40.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 Processor -- start 2023-12-04T05:38:40.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.889+0000 7f657d5d0640 1 -- start start 2023-12-04T05:38:40.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 0x7f65781485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f6578148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781558c0 con 0x7f65780c4740 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780aae40 con 0x7f65780c4c50 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780aa860 con 0x7f6578151cb0 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58782/0 (socket says 172.21.15.97:58782) 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 -- 172.21.15.97:0/3375233505 learned_addr learned my addr 172.21.15.97:0/3375233505 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f65777fe640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 0x7f65781485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657cdcf640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f6578148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 -- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 msgr2=0x7f6578148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f6578148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 -- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 msgr2=0x7f65781485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 0x7f65781485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:40.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 -- 172.21.15.97:0/3375233505 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0094d0 con 0x7f65780c4740 2023-12-04T05:38:40.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f65777fe640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 0x7f65781485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:40.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6577fff640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f656800d650 tx=0x7f656800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:40.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800b6c0 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800b820 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800bbb0 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6578155b10 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65780aa350 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657804e890 con 0x7f65780c4740 2023-12-04T05:38:40.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.893+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f656800bd10 con 0x7f65780c4740 2023-12-04T05:38:40.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.897+0000 7f6574ff9640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 0x7f6564068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:40.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.897+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65680847e0 con 0x7f65780c4740 2023-12-04T05:38:40.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.897+0000 7f65777fe640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 0x7f6564068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:40.902 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.897+0000 7f65777fe640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 0x7f6564068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f656c0ae000 tx=0x7f656c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:40.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:40.901+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6568051ac0 con 0x7f65780c4740 2023-12-04T05:38:41.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65780c95a0 con 0x7f65780c4740 2023-12-04T05:38:41.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f6574ff9640 1 -- 172.21.15.97:0/3375233505 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6568007380 con 0x7f65780c4740 2023-12-04T05:38:41.089 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:38:41.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 msgr2=0x7f6564068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 0x7f6564068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f656c0ae000 tx=0x7f656c0a7000 comp rx=0 tx=0).stop 2023-12-04T05:38:41.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 msgr2=0x7f65780a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f656800d650 tx=0x7f656800db10 comp rx=0 tx=0).stop 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 shutdown_connections 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f65640668d0 0x7f6564068d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6578151cb0 0x7f6578148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65780c4c50 0x7f65781485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 --2- 172.21.15.97:0/3375233505 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65780c4740 0x7f65780a9e10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 >> 172.21.15.97:0/3375233505 conn(0x7f65780ab8b0 msgr2=0x7f657814b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 shutdown_connections 2023-12-04T05:38:41.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.085+0000 7f657d5d0640 1 -- 172.21.15.97:0/3375233505 wait complete. 2023-12-04T05:38:41.110 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:38:41.111 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:41.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.111 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:38:41.122 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:38:41.122 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:41.123 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42021sec preferred_lft 42021sec 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:38:41.124 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:41.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.125 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:38:41.188 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:38:41.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.191 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:41.247 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:38:41.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:38:41.248 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:38:41.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.348 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:38:41.357 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:38:41.358 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:41.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.358 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:38:41.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:41.421 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:41.473 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:41.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:41.473 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:41.524 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-04T05:38:41.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.524 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:41.621 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:41.621 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:41.635 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:41.635 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:41.635 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:38:41.635 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:38:41.635 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:38:41.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:38:41.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.639 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:41.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:41.660 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:38:41.715 INFO:teuthology.orchestra.run.smithi143.stdout:client5943 2023-12-04T05:38:41.716 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:41.716 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:41.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-04T05:38:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.901+0000 7f865759d640 1 Processor -- start 2023-12-04T05:38:41.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.901+0000 7f865759d640 1 -- start start 2023-12-04T05:38:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.901+0000 7f865759d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 0x7f86501524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f865759d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f865006d210 0x7f865006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f865759d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500aa240 con 0x7f865006c440 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f865759d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865006c0c0 con 0x7f865006d210 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f865759d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500aa500 con 0x7f86500c1e70 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f865006d210 0x7f865006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8654b38640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f865006c440 0x7f86500a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60032/0 (socket says 172.21.15.97:60032) 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8654b38640 1 -- 172.21.15.97:0/4207398558 learned_addr learned my addr 172.21.15.97:0/4207398558 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:41.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 -- 172.21.15.97:0/4207398558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 msgr2=0x7f86501524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655339640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 0x7f86501524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 0x7f86501524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8647fff640 1 -- 172.21.15.97:0/4207398558 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227657451 0 0) 0x7f86500aa240 con 0x7f865006c440 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 -- 172.21.15.97:0/4207398558 >> v1:172.21.15.97:6789/0 conn(0x7f865006c440 legacy=0x7f86500a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 -- 172.21.15.97:0/4207398558 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500aa7e0 con 0x7f865006d210 2023-12-04T05:38:41.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655339640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 0x7f86501524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8655b3a640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f865006d210 0x7f865006d680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8648009d90 tx=0x7f864801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e0ad9a75c98d76 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8647fff640 1 -- 172.21.15.97:0/4207398558 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86480a59e0 con 0x7f865006d210 2023-12-04T05:38:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8647fff640 1 -- 172.21.15.97:0/4207398558 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86480a5b40 con 0x7f865006d210 2023-12-04T05:38:41.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.905+0000 7f8647fff640 1 -- 172.21.15.97:0/4207398558 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86480ad440 con 0x7f865006d210 2023-12-04T05:38:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- 172.21.15.97:0/4207398558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f865006d210 msgr2=0x7f865006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f865006d210 0x7f865006d680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8648009d90 tx=0x7f864801c920 comp rx=0 tx=0).stop 2023-12-04T05:38:41.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- 172.21.15.97:0/4207398558 shutdown_connections 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f865006d210 0x7f865006d680 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- 172.21.15.97:0/4207398558 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86500c1e70 0x7f86501524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- 172.21.15.97:0/4207398558 >> 172.21.15.97:0/4207398558 conn(0x7f86500c5e70 msgr2=0x7f86500c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- 172.21.15.97:0/4207398558 shutdown_connections 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- 172.21.15.97:0/4207398558 wait complete. 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 Processor -- start 2023-12-04T05:38:41.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- start start 2023-12-04T05:38:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f865006c440 0x7f86500c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f865006d210 0x7f86501510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501ed2b0 con 0x7f86500c1e70 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501ec9e0 con 0x7f865006d210 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f865759d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865014eef0 con 0x7f865006c440 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58806/0 (socket says 172.21.15.97:58806) 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 -- 172.21.15.97:0/4146410915 learned_addr learned my addr 172.21.15.97:0/4146410915 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655339640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f865006c440 0x7f86500c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8654b38640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f865006d210 0x7f86501510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 -- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f865006c440 msgr2=0x7f86500c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f865006c440 0x7f86500c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 -- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f865006d210 msgr2=0x7f86501510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f865006d210 0x7f86501510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:41.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.909+0000 7f8655b3a640 1 -- 172.21.15.97:0/4146410915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8648009a70 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8655b3a640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f864801afd0 tx=0x7f86480196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86480ade40 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86480b9450 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86480b97e0 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86501ecc60 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86500c69f0 con 0x7f86500c1e70 2023-12-04T05:38:41.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86501ed420 con 0x7f86500c1e70 2023-12-04T05:38:41.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f86480b9940 con 0x7f86500c1e70 2023-12-04T05:38:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 0x7f8634068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.913+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f864811fd60 con 0x7f86500c1e70 2023-12-04T05:38:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.917+0000 7f8655339640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 0x7f8634068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:41.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.917+0000 7f8655339640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 0x7f8634068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86500c4a50 tx=0x7f864c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:41.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:41.917+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86480ed0f0 con 0x7f86500c1e70 2023-12-04T05:38:42.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f8650068440 con 0x7f86500c1e70 2023-12-04T05:38:42.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f8645ffb640 1 -- 172.21.15.97:0/4146410915 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v17) v1 ==== 84+0+0 (secure 0 0 0) 0x7f86480f0710 con 0x7f86500c1e70 2023-12-04T05:38:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 msgr2=0x7f8634068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 0x7f8634068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86500c4a50 tx=0x7f864c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:42.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 msgr2=0x7f86501515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f864801afd0 tx=0x7f86480196c0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 shutdown_connections 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f86340668d0 0x7f8634068d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f86500c1e70 0x7f86501515e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f865006d210 0x7f86501510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 --2- 172.21.15.97:0/4146410915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f865006c440 0x7f86500c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 >> 172.21.15.97:0/4146410915 conn(0x7f86500c5e70 msgr2=0x7f8650148b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 shutdown_connections 2023-12-04T05:38:42.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.125+0000 7f865759d640 1 -- 172.21.15.97:0/4146410915 wait complete. 2023-12-04T05:38:42.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 Processor -- start 2023-12-04T05:38:42.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 -- start start 2023-12-04T05:38:42.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda00a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcda00a8460 0x7fcda00a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 0x7fcda0152900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda014ff90 con 0x7fcda00a8460 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda00a9770 con 0x7fcda0152490 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcda48c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0071730 con 0x7fcda014fbb0 2023-12-04T05:38:42.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcda00a8460 0x7fcda00a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcda00a8460 0x7fcda00a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58818/0 (socket says 172.21.15.97:58818) 2023-12-04T05:38:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 -- 172.21.15.97:0/1637029617 learned_addr learned my addr 172.21.15.97:0/1637029617 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9ed9d640 1 --2- 172.21.15.97:0/1637029617 >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 0x7fcda0152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9e59c640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda00a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 -- 172.21.15.97:0/1637029617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 msgr2=0x7fcda00a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda00a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 -- 172.21.15.97:0/1637029617 >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 msgr2=0x7fcda0152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 --2- 172.21.15.97:0/1637029617 >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 0x7fcda0152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9dd9b640 1 -- 172.21.15.97:0/1637029617 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0071a10 con 0x7fcda00a8460 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9ed9d640 1 --2- 172.21.15.97:0/1637029617 >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 0x7fcda0152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.285+0000 7fcd9e59c640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda00a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcd9dd9b640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda00a88e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcda006f8a0 tx=0x7fcd9401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487d3ef30b6bdc32 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcd9d59a640 1 -- 172.21.15.97:0/1637029617 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd940ab600 con 0x7fcda00a8460 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcd9d59a640 1 -- 172.21.15.97:0/1637029617 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd940a7050 con 0x7fcda00a8460 2023-12-04T05:38:42.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcd9d59a640 1 -- 172.21.15.97:0/1637029617 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd940ab980 con 0x7fcda00a8460 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 -- 172.21.15.97:0/1637029617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 msgr2=0x7fcda00a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda00a88e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcda006f8a0 tx=0x7fcd9401c3b0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 -- 172.21.15.97:0/1637029617 shutdown_connections 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 --2- 172.21.15.97:0/1637029617 >> v2:172.21.15.143:3300/0 conn(0x7fcda0152490 0x7fcda0152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda00a88e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 --2- 172.21.15.97:0/1637029617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda00a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 -- 172.21.15.97:0/1637029617 >> 172.21.15.97:0/1637029617 conn(0x7fcda00c2970 msgr2=0x7fcda00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 -- 172.21.15.97:0/1637029617 shutdown_connections 2023-12-04T05:38:42.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.289+0000 7fcda48c9640 1 -- 172.21.15.97:0/1637029617 wait complete. 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 Processor -- start 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- start start 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcda0152490 0x7fcda013c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01f1500 con 0x7fcda00a8460 2023-12-04T05:38:42.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda013dd80 con 0x7fcda0152490 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01f0fa0 con 0x7fcda014fbb0 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58832/0 (socket says 172.21.15.97:58832) 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 -- 172.21.15.97:0/3900015662 learned_addr learned my addr 172.21.15.97:0/3900015662 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 -- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 msgr2=0x7fcda01549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 -- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcda0152490 msgr2=0x7fcda013c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9ed9d640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcda0152490 0x7fcda013c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcda0152490 0x7fcda013c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 -- 172.21.15.97:0/3900015662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940094d0 con 0x7fcda00a8460 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd9e59c640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e840 tx=0x7fcd9000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90004030 con 0x7fcda00a8460 2023-12-04T05:38:42.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90004190 con 0x7fcda00a8460 2023-12-04T05:38:42.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90004520 con 0x7fcda00a8460 2023-12-04T05:38:42.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda01f1220 con 0x7fcda00a8460 2023-12-04T05:38:42.301 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda01403b0 con 0x7fcda00a8460 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.293+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda0068440 con 0x7fcda00a8460 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.297+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd9000c6d0 con 0x7fcda00a8460 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.297+0000 7fcd8effd640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 0x7fcd80068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.297+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd90083fe0 con 0x7fcda00a8460 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.297+0000 7fcd9dd9b640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 0x7fcd80068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.302 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.297+0000 7fcd9dd9b640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 0x7fcd80068dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd940ad000 tx=0x7fcd94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.301+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd90051250 con 0x7fcda00a8460 2023-12-04T05:38:42.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.449+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcda00c24d0 con 0x7fcda00a8460 2023-12-04T05:38:42.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcd8effd640 1 -- 172.21.15.97:0/3900015662 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16553 (secure 0 0 0) 0x7fcd90054870 con 0x7fcda00a8460 2023-12-04T05:38:42.456 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:42.457 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":50,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:30.330858+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:42.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 msgr2=0x7fcd80068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 0x7fcd80068dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd940ad000 tx=0x7fcd94008040 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 msgr2=0x7fcda013cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e840 tx=0x7fcd9000ed00 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 shutdown_connections 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd80066900 0x7fcd80068dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcda0152490 0x7fcda013c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcda014fbb0 0x7fcda01549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 --2- 172.21.15.97:0/3900015662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcda00a8460 0x7fcda013cbf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 >> 172.21.15.97:0/3900015662 conn(0x7fcda00c2970 msgr2=0x7fcda00c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 shutdown_connections 2023-12-04T05:38:42.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.453+0000 7fcda48c9640 1 -- 172.21.15.97:0/3900015662 wait complete. 2023-12-04T05:38:42.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:38:26.438302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:38:27.710828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:42.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:42.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 Processor -- start 2023-12-04T05:38:42.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 -- start start 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6c940c1360 0x7f6c940700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c94150bc0 con 0x7f6c9406c000 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c94154fd0 con 0x7f6c94154af0 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c994dd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c94151a70 con 0x7f6c940c1360 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c8a7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6c9406c000 0x7f6c94151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60036/0 (socket says 172.21.15.97:60036) 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c8a7fc640 1 -- 172.21.15.97:0/1002430130 learned_addr learned my addr 172.21.15.97:0/1002430130 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:42.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c92ffd640 1 --2- 172.21.15.97:0/1002430130 >> v2:172.21.15.143:3300/0 conn(0x7f6c940c1360 0x7f6c940700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912748608 0 0) 0x7f6c94150bc0 con 0x7f6c9406c000 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.613+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c80003530 con 0x7f6c9406c000 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892012185 0 0) 0x7f6c94154fd0 con 0x7f6c94154af0 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94150bc0 con 0x7f6c94154af0 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90878466 0 0) 0x7f6c80003530 con 0x7f6c9406c000 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 >> v2:172.21.15.143:3300/0 conn(0x7f6c940c1360 msgr2=0x7f6c940700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 --2- 172.21.15.97:0/1002430130 >> v2:172.21.15.143:3300/0 conn(0x7f6c940c1360 0x7f6c940700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 >> v1:172.21.15.143:6789/0 conn(0x7f6c94154af0 legacy=0x7f6c9414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94072160 con 0x7f6c9406c000 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f6c7c001680 con 0x7f6c9406c000 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 >> v1:172.21.15.97:6789/0 conn(0x7f6c9406c000 legacy=0x7f6c94151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c80003b60 0x7f6c80003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 0x7f6c80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800051e0 0x7f6c8000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94151a70 con 0x7f6c800047d0 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8000e320 con 0x7f6c800051e0 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8000e4e0 con 0x7f6c80003b60 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 0x7f6c80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c92ffd640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c80003b60 0x7f6c80003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c937fe640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800051e0 0x7f6c8000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 -- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c80003b60 msgr2=0x7f6c80003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c80003b60 0x7f6c80003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 -- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800051e0 msgr2=0x7f6c8000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800051e0 0x7f6c8000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 -- 172.21.15.97:0/1002430130 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80003530 con 0x7f6c800047d0 2023-12-04T05:38:42.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c937fe640 1 -- 172.21.15.97:0/1002430130 reap_dead start 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.617+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 0x7f6c80004c50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007fb0 tx=0x7f6c7c01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3039156928db08 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005ae0 con 0x7f6c800047d0 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c005c40 con 0x7f6c800047d0 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c927fc640 1 -- 172.21.15.97:0/1002430130 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0072b0 con 0x7f6c800047d0 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 msgr2=0x7f6c80004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 0x7f6c80004c50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c007fb0 tx=0x7f6c7c01cb00 comp rx=0 tx=0).stop 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- 172.21.15.97:0/1002430130 shutdown_connections 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1002430130 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c800047d0 0x7f6c80004c50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- 172.21.15.97:0/1002430130 >> 172.21.15.97:0/1002430130 conn(0x7f6c940c5e70 msgr2=0x7f6c940c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- 172.21.15.97:0/1002430130 shutdown_connections 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- 172.21.15.97:0/1002430130 wait complete. 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 Processor -- start 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- start start 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800047d0 0x7f6c94152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 0x7f6c94153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941540b0 con 0x7f6c941468c0 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9414b910 con 0x7f6c800047d0 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c994dd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94153e60 con 0x7f6c940a8a20 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58852/0 (socket says 172.21.15.97:58852) 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.621+0000 7f6c937fe640 1 -- 172.21.15.97:0/1327926247 learned_addr learned my addr 172.21.15.97:0/1327926247 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:42.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 0x7f6c94153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c92ffd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800047d0 0x7f6c94152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 -- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 msgr2=0x7f6c94153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 0x7f6c94153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 -- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800047d0 msgr2=0x7f6c94152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800047d0 0x7f6c94152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 -- 172.21.15.97:0/1327926247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9414b670 con 0x7f6c941468c0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8a7fc640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 0x7f6c94153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c937fe640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6c94154f00 tx=0x7f6c8c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0050d0 con 0x7f6c941468c0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c005230 con 0x7f6c941468c0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9414c110 con 0x7f6c941468c0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0067e0 con 0x7f6c941468c0 2023-12-04T05:38:42.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94153b80 con 0x7f6c941468c0 2023-12-04T05:38:42.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9414c300 con 0x7f6c941468c0 2023-12-04T05:38:42.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c8c006940 con 0x7f6c941468c0 2023-12-04T05:38:42.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 0x7f6c74068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c8c0833d0 con 0x7f6c941468c0 2023-12-04T05:38:42.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.625+0000 7f6c92ffd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 0x7f6c74068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.629+0000 7f6c92ffd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 0x7f6c74068dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c941df410 tx=0x7f6c8400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.629+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c8c0506b0 con 0x7f6c941468c0 2023-12-04T05:38:42.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.781+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c94068440 con 0x7f6c941468c0 2023-12-04T05:38:42.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.781+0000 7f6c8bfff640 1 -- 172.21.15.97:0/1327926247 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c8c053cd0 con 0x7f6c941468c0 2023-12-04T05:38:42.787 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:42.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 msgr2=0x7f6c74068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 0x7f6c74068dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6c941df410 tx=0x7f6c8400b040 comp rx=0 tx=0).stop 2023-12-04T05:38:42.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 msgr2=0x7f6c94146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6c94154f00 tx=0x7f6c8c00fc00 comp rx=0 tx=0).stop 2023-12-04T05:38:42.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 shutdown_connections 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6c74066900 0x7f6c74068dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c941468c0 0x7f6c94146d50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6c940a8a20 0x7f6c94153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 --2- 172.21.15.97:0/1327926247 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6c800047d0 0x7f6c94152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 >> 172.21.15.97:0/1327926247 conn(0x7f6c940c5e70 msgr2=0x7f6c9414dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 shutdown_connections 2023-12-04T05:38:42.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.785+0000 7f6c994dd640 1 -- 172.21.15.97:0/1327926247 wait complete. 2023-12-04T05:38:42.808 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:38:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 Processor -- start 2023-12-04T05:38:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 -- start start 2023-12-04T05:38:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fec640c1e70 0x7fec641524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec6406c440 0x7fec640a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec640aa240 con 0x7fec640a89a0 2023-12-04T05:38:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6406c0c0 con 0x7fec6406c440 2023-12-04T05:38:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec69bb8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec640aa500 con 0x7fec640c1e70 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec6406c440 0x7fec640a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fec6406c440 0x7fec640a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58866/0 (socket says 172.21.15.97:58866) 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 -- 172.21.15.97:0/1568298098 learned_addr learned my addr 172.21.15.97:0/1568298098 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec637fe640 1 --2- 172.21.15.97:0/1568298098 >> v2:172.21.15.143:3300/0 conn(0x7fec640c1e70 0x7fec641524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 -- 172.21.15.97:0/1568298098 >> v2:172.21.15.143:3300/0 conn(0x7fec640c1e70 msgr2=0x7fec641524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 --2- 172.21.15.97:0/1568298098 >> v2:172.21.15.143:3300/0 conn(0x7fec640c1e70 0x7fec641524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 -- 172.21.15.97:0/1568298098 >> v1:172.21.15.143:6789/0 conn(0x7fec640a89a0 legacy=0x7fec6406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.945+0000 7fec62ffd640 1 -- 172.21.15.97:0/1568298098 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640aa7e0 con 0x7fec6406c440 2023-12-04T05:38:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec62ffd640 1 --2- 172.21.15.97:0/1568298098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec6406c440 0x7fec640a8460 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec64072510 tx=0x7fec5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fb23c907e98282 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec627fc640 1 -- 172.21.15.97:0/1568298098 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580aa5f0 con 0x7fec6406c440 2023-12-04T05:38:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec627fc640 1 -- 172.21.15.97:0/1568298098 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580aa750 con 0x7fec6406c440 2023-12-04T05:38:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec627fc640 1 -- 172.21.15.97:0/1568298098 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580aaae0 con 0x7fec6406c440 2023-12-04T05:38:42.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- 172.21.15.97:0/1568298098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec6406c440 msgr2=0x7fec640a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 --2- 172.21.15.97:0/1568298098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec6406c440 0x7fec640a8460 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec64072510 tx=0x7fec5801c490 comp rx=0 tx=0).stop 2023-12-04T05:38:42.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- 172.21.15.97:0/1568298098 shutdown_connections 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 --2- 172.21.15.97:0/1568298098 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec6406c440 0x7fec640a8460 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 --2- 172.21.15.97:0/1568298098 >> v2:172.21.15.143:3300/0 conn(0x7fec640c1e70 0x7fec641524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- 172.21.15.97:0/1568298098 >> 172.21.15.97:0/1568298098 conn(0x7fec640c5e70 msgr2=0x7fec640c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- 172.21.15.97:0/1568298098 shutdown_connections 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- 172.21.15.97:0/1568298098 wait complete. 2023-12-04T05:38:42.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 Processor -- start 2023-12-04T05:38:42.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.949+0000 7fec69bb8640 1 -- start start 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec6406c440 0x7fec641ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 0x7fec641422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64140760 con 0x7fec640c1e70 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6413fd30 con 0x7fec640a89a0 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec641ef260 con 0x7fec6406c440 2023-12-04T05:38:42.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58872/0 (socket says 172.21.15.97:58872) 2023-12-04T05:38:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 -- 172.21.15.97:0/3051449061 learned_addr learned my addr 172.21.15.97:0/3051449061 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec637fe640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec6406c440 0x7fec641ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec62ffd640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 0x7fec641422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 -- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec6406c440 msgr2=0x7fec641ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec6406c440 0x7fec641ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 -- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 msgr2=0x7fec641422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 0x7fec641422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 -- 172.21.15.97:0/3051449061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580094d0 con 0x7fec640c1e70 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec62ffd640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 0x7fec641422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec63fff640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c780 tx=0x7fec5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c004b70 con 0x7fec640c1e70 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00ce90 con 0x7fec640c1e70 2023-12-04T05:38:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00a850 con 0x7fec640c1e70 2023-12-04T05:38:42.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec640c23d0 con 0x7fec640c1e70 2023-12-04T05:38:42.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec64143010 con 0x7fec640c1e70 2023-12-04T05:38:42.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.953+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64068440 con 0x7fec640c1e70 2023-12-04T05:38:42.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.957+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fec5c00a9b0 con 0x7fec640c1e70 2023-12-04T05:38:42.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.957+0000 7fec4bfff640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 0x7fec50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:42.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.957+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec5c0843f0 con 0x7fec640c1e70 2023-12-04T05:38:42.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.957+0000 7fec637fe640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 0x7fec50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:42.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.957+0000 7fec637fe640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 0x7fec50068d90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec6413bdc0 tx=0x7fec54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:42.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:42.961+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec5c051770 con 0x7fec640c1e70 2023-12-04T05:38:43.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec6406c220 con 0x7fec640c1e70 2023-12-04T05:38:43.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec4bfff640 1 -- 172.21.15.97:0/3051449061 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec5c054d90 con 0x7fec640c1e70 2023-12-04T05:38:43.117 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 msgr2=0x7fec50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 0x7fec50068d90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec6413bdc0 tx=0x7fec54008040 comp rx=0 tx=0).stop 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 msgr2=0x7fec6413a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c780 tx=0x7fec5c00cc40 comp rx=0 tx=0).stop 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 shutdown_connections 2023-12-04T05:38:43.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fec500668d0 0x7fec50068d90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fec640c1e70 0x7fec6413a430 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec640a89a0 0x7fec641422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 --2- 172.21.15.97:0/3051449061 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fec6406c440 0x7fec641ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 >> 172.21.15.97:0/3051449061 conn(0x7fec640c5e70 msgr2=0x7fec64148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 shutdown_connections 2023-12-04T05:38:43.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.113+0000 7fec69bb8640 1 -- 172.21.15.97:0/3051449061 wait complete. 2023-12-04T05:38:43.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:38:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 Processor -- start 2023-12-04T05:38:43.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 -- start start 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffac80c1e70 0x7ffac81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac806c440 0x7ffac80a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffac80a89a0 0x7ffac806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac806c0c0 con 0x7ffac80c1e70 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac80aa240 con 0x7ffac80a89a0 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffaccac9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80aa500 con 0x7ffac806c440 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffac80c1e70 0x7ffac81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ffac80c1e70 0x7ffac81524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58876/0 (socket says 172.21.15.97:58876) 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 -- 172.21.15.97:0/2635909443 learned_addr learned my addr 172.21.15.97:0/2635909443 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 -- 172.21.15.97:0/2635909443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac806c440 msgr2=0x7ffac80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 --2- 172.21.15.97:0/2635909443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac806c440 0x7ffac80a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 -- 172.21.15.97:0/2635909443 >> v2:172.21.15.143:3300/0 conn(0x7ffac80a89a0 msgr2=0x7ffac806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 --2- 172.21.15.97:0/2635909443 >> v2:172.21.15.143:3300/0 conn(0x7ffac80a89a0 0x7ffac806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.277+0000 7ffac659c640 1 -- 172.21.15.97:0/2635909443 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80aa7e0 con 0x7ffac80c1e70 2023-12-04T05:38:43.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffac659c640 1 --2- 172.21.15.97:0/2635909443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac81524e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ffac806be00 tx=0x7ffab801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a8aa4311e4ec1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffac5d9b640 1 -- 172.21.15.97:0/2635909443 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac806df60 con 0x7ffac80c1e70 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffac5d9b640 1 -- 172.21.15.97:0/2635909443 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab80a5820 con 0x7ffac80c1e70 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffac5d9b640 1 -- 172.21.15.97:0/2635909443 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80a5bb0 con 0x7ffac80c1e70 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 -- 172.21.15.97:0/2635909443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 msgr2=0x7ffac81524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 --2- 172.21.15.97:0/2635909443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac81524e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ffac806be00 tx=0x7ffab801c9a0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 -- 172.21.15.97:0/2635909443 shutdown_connections 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 --2- 172.21.15.97:0/2635909443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac806c440 0x7ffac80a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 --2- 172.21.15.97:0/2635909443 >> v2:172.21.15.143:3300/0 conn(0x7ffac80a89a0 0x7ffac806d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 --2- 172.21.15.97:0/2635909443 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac81524e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 -- 172.21.15.97:0/2635909443 >> 172.21.15.97:0/2635909443 conn(0x7ffac80c5e70 msgr2=0x7ffac80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 -- 172.21.15.97:0/2635909443 shutdown_connections 2023-12-04T05:38:43.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.281+0000 7ffaccac9640 1 -- 172.21.15.97:0/2635909443 wait complete. 2023-12-04T05:38:43.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 Processor -- start 2023-12-04T05:38:43.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- start start 2023-12-04T05:38:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 0x7ffac81ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80700b0 con 0x7ffac80c1e70 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80c38b0 con 0x7ffac806c440 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81406a0 con 0x7ffac80a89a0 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffabdd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 0x7ffac81ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:37438/0 (socket says 172.21.15.97:37438) 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac659c640 1 -- 172.21.15.97:0/856614804 learned_addr learned my addr 172.21.15.97:0/856614804 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58888/0 (socket says 172.21.15.97:58888) 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 -- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 msgr2=0x7ffac81ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 0x7ffac81ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 -- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 msgr2=0x7ffac8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 -- 172.21.15.97:0/856614804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8009b30 con 0x7ffac80c1e70 2023-12-04T05:38:43.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac659c640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffabdd9b640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 0x7ffac81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffac6d9d640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ffac000b3e0 tx=0x7ffac0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011830 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0011990 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011d20 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80c23d0 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.285+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac80c3ac0 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac8068440 con 0x7ffac80c1e70 2023-12-04T05:38:43.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffac001a400 con 0x7ffac80c1e70 2023-12-04T05:38:43.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffabf7fe640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 0x7ffaa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffac00843d0 con 0x7ffac80c1e70 2023-12-04T05:38:43.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffac659c640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 0x7ffaa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.289+0000 7ffac659c640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 0x7ffaa8068d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f90 tx=0x7ffab80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.293+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffac00516c0 con 0x7ffac80c1e70 2023-12-04T05:38:43.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.441+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffac8154350 con 0x7ffac80c1e70 2023-12-04T05:38:43.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffabf7fe640 1 -- 172.21.15.97:0/856614804 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffac0054ce0 con 0x7ffac80c1e70 2023-12-04T05:38:43.449 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 msgr2=0x7ffaa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 0x7ffaa8068d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f90 tx=0x7ffab80a7070 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 msgr2=0x7ffac815b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ffac000b3e0 tx=0x7ffac0009f90 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 shutdown_connections 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffaa80668d0 0x7ffaa8068d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffac80c1e70 0x7ffac815b4a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffac80a89a0 0x7ffac81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 --2- 172.21.15.97:0/856614804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffac806c440 0x7ffac8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 >> 172.21.15.97:0/856614804 conn(0x7ffac80c5e70 msgr2=0x7ffac806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 shutdown_connections 2023-12-04T05:38:43.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.445+0000 7ffaccac9640 1 -- 172.21.15.97:0/856614804 wait complete. 2023-12-04T05:38:43.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:38:43.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.601+0000 7f8d1993e640 1 Processor -- start 2023-12-04T05:38:43.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.601+0000 7f8d1993e640 1 -- start start 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d1993e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d14151e10 0x7f8d140c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d1993e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8d140a7290 0x7f8d140c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d1993e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d14157dc0 con 0x7f8d140c5d40 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d1993e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140c3cd0 con 0x7f8d14151e10 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d1993e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d141521f0 con 0x7f8d140a7290 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d14151e10 0x7f8d140c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8d14151e10 0x7f8d140c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58896/0 (socket says 172.21.15.97:58896) 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d0a7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8d140c5d40 0x7f8d14158550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60052/0 (socket says 172.21.15.97:60052) 2023-12-04T05:38:43.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2694343885 learned_addr learned my addr 172.21.15.97:0/2694343885 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d137fe640 1 --2- 172.21.15.97:0/2694343885 >> v2:172.21.15.143:3300/0 conn(0x7f8d140a7290 0x7f8d140c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2694343885 >> v2:172.21.15.143:3300/0 conn(0x7f8d140a7290 msgr2=0x7f8d140c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 --2- 172.21.15.97:0/2694343885 >> v2:172.21.15.143:3300/0 conn(0x7f8d140a7290 0x7f8d140c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2694343885 >> v1:172.21.15.97:6789/0 conn(0x7f8d140c5d40 legacy=0x7f8d14158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2694343885 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14158c60 con 0x7f8d14151e10 2023-12-04T05:38:43.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.605+0000 7f8d12ffd640 1 --2- 172.21.15.97:0/2694343885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d14151e10 0x7f8d140c1270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d14155780 tx=0x7f8d0401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260046181ff33537 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d127fc640 1 -- 172.21.15.97:0/2694343885 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04004230 con 0x7f8d14151e10 2023-12-04T05:38:43.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d127fc640 1 -- 172.21.15.97:0/2694343885 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d040a7050 con 0x7f8d14151e10 2023-12-04T05:38:43.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d127fc640 1 -- 172.21.15.97:0/2694343885 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04003620 con 0x7f8d14151e10 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- 172.21.15.97:0/2694343885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d14151e10 msgr2=0x7f8d140c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2694343885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d14151e10 0x7f8d140c1270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d14155780 tx=0x7f8d0401c440 comp rx=0 tx=0).stop 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- 172.21.15.97:0/2694343885 shutdown_connections 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2694343885 >> v2:172.21.15.143:3300/0 conn(0x7f8d140a7290 0x7f8d140c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2694343885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d14151e10 0x7f8d140c1270 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- 172.21.15.97:0/2694343885 >> 172.21.15.97:0/2694343885 conn(0x7f8d140c7e40 msgr2=0x7f8d140c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- 172.21.15.97:0/2694343885 shutdown_connections 2023-12-04T05:38:43.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- 172.21.15.97:0/2694343885 wait complete. 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 Processor -- start 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- start start 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d140c5d40 0x7f8d140acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 0x7f8d141536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1406b8c0 con 0x7f8d140a7290 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d141edef0 con 0x7f8d14151e10 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d1993e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1406f7e0 con 0x7f8d140c5d40 2023-12-04T05:38:43.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d12ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d12ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58908/0 (socket says 172.21.15.97:58908) 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.609+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2662788237 learned_addr learned my addr 172.21.15.97:0/2662788237 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d137fe640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 0x7f8d141536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d0a7fc640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d140c5d40 0x7f8d140acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d140c5d40 msgr2=0x7f8d140acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d140c5d40 0x7f8d140acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 msgr2=0x7f8d141536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 0x7f8d141536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 -- 172.21.15.97:0/2662788237 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040094d0 con 0x7f8d140a7290 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d137fe640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 0x7f8d141536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d12ffd640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d040ae040 tx=0x7f8d040191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04003bf0 con 0x7f8d140a7290 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04003d50 con 0x7f8d140a7290 2023-12-04T05:38:43.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040ab660 con 0x7f8d140a7290 2023-12-04T05:38:43.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d141ed650 con 0x7f8d140a7290 2023-12-04T05:38:43.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d141edc10 con 0x7f8d140a7290 2023-12-04T05:38:43.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d14068440 con 0x7f8d140a7290 2023-12-04T05:38:43.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.613+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8d040ab7c0 con 0x7f8d140a7290 2023-12-04T05:38:43.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.617+0000 7f8d10ff9640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 0x7f8cf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.617+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d0411e940 con 0x7f8d140a7290 2023-12-04T05:38:43.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.617+0000 7f8d0a7fc640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 0x7f8cf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.617+0000 7f8d0a7fc640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 0x7f8cf4068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d140a6f40 tx=0x7f8cfc005ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.621+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d040ebb70 con 0x7f8d140a7290 2023-12-04T05:38:43.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.769+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8d140c5660 con 0x7f8d140a7290 2023-12-04T05:38:43.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.769+0000 7f8d10ff9640 1 -- 172.21.15.97:0/2662788237 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7f8d040b9090 con 0x7f8d140a7290 2023-12-04T05:38:43.776 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:43.776 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:38:43.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 8, 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_metadata" 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 9, 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_data" 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:38:43.777 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:38:43.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 msgr2=0x7f8cf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 0x7f8cf4068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d140a6f40 tx=0x7f8cfc005ba0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 msgr2=0x7f8d141ecf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8d040ae040 tx=0x7f8d040191e0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 shutdown_connections 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8cf40668d0 0x7f8cf4068d90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d14151e10 0x7f8d141536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d140c5d40 0x7f8d140acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 --2- 172.21.15.97:0/2662788237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8d140a7290 0x7f8d141ecf50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 >> 172.21.15.97:0/2662788237 conn(0x7f8d140c7e40 msgr2=0x7f8d14158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 shutdown_connections 2023-12-04T05:38:43.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.773+0000 7f8d1993e640 1 -- 172.21.15.97:0/2662788237 wait complete. 2023-12-04T05:38:43.797 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-04T05:38:43.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-04T05:38:43.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 Processor -- start 2023-12-04T05:38:43.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 -- start start 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 0x7f8444152810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8444152d50 0x7f84440c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84440c05f0 con 0x7f84440c3570 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844414ee30 con 0x7f8444152d50 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f844a5f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8444152360 con 0x7f844414ea50 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f84437fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8444152d50 0x7f84440c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f8448b92640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f84440c3570 0x7f844406d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:60066/0 (socket says 172.21.15.97:60066) 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.933+0000 7f8448b92640 1 -- 172.21.15.97:0/7543694 learned_addr learned my addr 172.21.15.97:0/7543694 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8443fff640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 0x7f8444152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f84437fe640 1 -- 172.21.15.97:0/7543694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 msgr2=0x7f8444152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f84437fe640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 0x7f8444152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f84437fe640 1 -- 172.21.15.97:0/7543694 >> v1:172.21.15.97:6789/0 conn(0x7f84440c3570 legacy=0x7f844406d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f84437fe640 1 -- 172.21.15.97:0/7543694 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444151da0 con 0x7f8444152d50 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8442ffd640 1 -- 172.21.15.97:0/7543694 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085352842 0 0) 0x7f84440c05f0 con 0x7f84440c3570 2023-12-04T05:38:43.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8443fff640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 0x7f8444152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:43.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f84437fe640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f84440c1960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f84380097c0 tx=0x7f843801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d70be76341332a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8442ffd640 1 -- 172.21.15.97:0/7543694 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380ac620 con 0x7f8444152d50 2023-12-04T05:38:43.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8442ffd640 1 -- 172.21.15.97:0/7543694 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84380ac780 con 0x7f8444152d50 2023-12-04T05:38:43.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f8442ffd640 1 -- 172.21.15.97:0/7543694 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380acb10 con 0x7f8444152d50 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 -- 172.21.15.97:0/7543694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 msgr2=0x7f84440c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f84440c1960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f84380097c0 tx=0x7f843801c3c0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 -- 172.21.15.97:0/7543694 shutdown_connections 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f84440c1960 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 --2- 172.21.15.97:0/7543694 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f844414ea50 0x7f8444152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.937+0000 7f844a5f5640 1 -- 172.21.15.97:0/7543694 >> 172.21.15.97:0/7543694 conn(0x7f84440c2a50 msgr2=0x7f84440c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- 172.21.15.97:0/7543694 shutdown_connections 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- 172.21.15.97:0/7543694 wait complete. 2023-12-04T05:38:43.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 Processor -- start 2023-12-04T05:38:43.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- start start 2023-12-04T05:38:43.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 0x7f84440c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 0x7f844413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440c4e90 con 0x7f8444152d50 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84440715d0 con 0x7f844414ea50 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8444071010 con 0x7f84440c3570 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58918/0 (socket says 172.21.15.97:58918) 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 -- 172.21.15.97:0/1625508186 learned_addr learned my addr 172.21.15.97:0/1625508186 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f84437fe640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 0x7f844413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8443fff640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 0x7f84440c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 -- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 msgr2=0x7f84440c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 0x7f84440c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 -- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 msgr2=0x7f844413f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 0x7f844413f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:43.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 -- 172.21.15.97:0/1625508186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438009420 con 0x7f8444152d50 2023-12-04T05:38:43.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8443fff640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 0x7f84440c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:43.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f84437fe640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 0x7f844413f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:43.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8448b92640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c7e0 tx=0x7f843c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00a640 con 0x7f8444152d50 2023-12-04T05:38:43.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c00a7a0 con 0x7f8444152d50 2023-12-04T05:38:43.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8444152b70 con 0x7f8444152d50 2023-12-04T05:38:43.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.941+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00ab50 con 0x7f8444152d50 2023-12-04T05:38:43.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8444071260 con 0x7f8444152d50 2023-12-04T05:38:43.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8444071780 con 0x7f8444152d50 2023-12-04T05:38:43.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f843c00acb0 con 0x7f8444152d50 2023-12-04T05:38:43.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f8440ff9640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 0x7f8430068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:43.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f843c083ce0 con 0x7f8444152d50 2023-12-04T05:38:43.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f8443fff640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 0x7f8430068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:43.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.945+0000 7f8443fff640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 0x7f8430068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8434006fd0 tx=0x7f8434008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:43.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:43.949+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8444071780 con 0x7f8444152d50 2023-12-04T05:38:44.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:44.101+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8444071780 con 0x7f8444152d50 2023-12-04T05:38:45.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.001+0000 7f8440ff9640 1 -- 172.21.15.97:0/1625508186 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f8444071780 con 0x7f8444152d50 2023-12-04T05:38:45.008 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' created 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 msgr2=0x7f8430068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 0x7f8430068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8434006fd0 tx=0x7f8434008040 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 msgr2=0x7f844413fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c7e0 tx=0x7f843c00cca0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 shutdown_connections 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84300668d0 0x7f8430068d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8444152d50 0x7f844413fb40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f844414ea50 0x7f844413f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 --2- 172.21.15.97:0/1625508186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84440c3570 0x7f84440c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 >> 172.21.15.97:0/1625508186 conn(0x7f84440c2a50 msgr2=0x7f844406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 shutdown_connections 2023-12-04T05:38:45.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.005+0000 7f844a5f5640 1 -- 172.21.15.97:0/1625508186 wait complete. 2023-12-04T05:38:45.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:38:45.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 Processor -- start 2023-12-04T05:38:45.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 -- start start 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa16014e700 0x7fa1600c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1600bd720 0x7fa160158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600cad70 con 0x7fa160155160 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160158cd0 con 0x7fa1600bd720 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa1679c3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160155630 con 0x7fa16014e700 2023-12-04T05:38:45.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa165f60640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa1600bd720 0x7fa160158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:45.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa164f5e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa160155160 0x7fa160158080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41194/0 (socket says 172.21.15.97:41194) 2023-12-04T05:38:45.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa164f5e640 1 -- 172.21.15.97:0/1685065786 learned_addr learned my addr 172.21.15.97:0/1685065786 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:45.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa16575f640 1 --2- 172.21.15.97:0/1685065786 >> v2:172.21.15.143:3300/0 conn(0x7fa16014e700 0x7fa1600c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:45.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa165f60640 1 -- 172.21.15.97:0/1685065786 >> v2:172.21.15.143:3300/0 conn(0x7fa16014e700 msgr2=0x7fa1600c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:45.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa165f60640 1 --2- 172.21.15.97:0/1685065786 >> v2:172.21.15.143:3300/0 conn(0x7fa16014e700 0x7fa1600c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa165f60640 1 -- 172.21.15.97:0/1685065786 >> v1:172.21.15.97:6789/0 conn(0x7fa160155160 legacy=0x7fa160158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa165f60640 1 -- 172.21.15.97:0/1685065786 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600ca4d0 con 0x7fa1600bd720 2023-12-04T05:38:45.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.181+0000 7fa157fff640 1 -- 172.21.15.97:0/1685065786 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236050938 0 0) 0x7fa1600cad70 con 0x7fa160155160 2023-12-04T05:38:45.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa165f60640 1 --2- 172.21.15.97:0/1685065786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160158790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66348ed9f04c8a19 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:45.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa157fff640 1 -- 172.21.15.97:0/1685065786 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580a5880 con 0x7fa1600bd720 2023-12-04T05:38:45.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa157fff640 1 -- 172.21.15.97:0/1685065786 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1580a59e0 con 0x7fa1600bd720 2023-12-04T05:38:45.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa157fff640 1 -- 172.21.15.97:0/1685065786 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580a5d70 con 0x7fa1600bd720 2023-12-04T05:38:45.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 -- 172.21.15.97:0/1685065786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 msgr2=0x7fa160158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 --2- 172.21.15.97:0/1685065786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160158790 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15801c7c0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 -- 172.21.15.97:0/1685065786 shutdown_connections 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 --2- 172.21.15.97:0/1685065786 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160158790 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 --2- 172.21.15.97:0/1685065786 >> v2:172.21.15.143:3300/0 conn(0x7fa16014e700 0x7fa1600c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 -- 172.21.15.97:0/1685065786 >> 172.21.15.97:0/1685065786 conn(0x7fa160073720 msgr2=0x7fa160073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 -- 172.21.15.97:0/1685065786 shutdown_connections 2023-12-04T05:38:45.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.185+0000 7fa1679c3640 1 -- 172.21.15.97:0/1685065786 wait complete. 2023-12-04T05:38:45.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 Processor -- start 2023-12-04T05:38:45.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- start start 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa16014e700 0x7fa160148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa160155160 0x7fa1601ee560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601edc80 con 0x7fa1600bd720 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601ed0f0 con 0x7fa160155160 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601ee0a0 con 0x7fa16014e700 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53576/0 (socket says 172.21.15.97:53576) 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 -- 172.21.15.97:0/4044873378 learned_addr learned my addr 172.21.15.97:0/4044873378 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 -- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa16014e700 msgr2=0x7fa160148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa16014e700 0x7fa160148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 -- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa160155160 msgr2=0x7fa1601ee560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa160155160 0x7fa1601ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:45.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 -- 172.21.15.97:0/4044873378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158009a70 con 0x7fa1600bd720 2023-12-04T05:38:45.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa16575f640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00e960 tx=0x7fa15c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:45.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00ca00 con 0x7fa1600bd720 2023-12-04T05:38:45.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00cb60 con 0x7fa1600bd720 2023-12-04T05:38:45.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00ced0 con 0x7fa1600bd720 2023-12-04T05:38:45.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa160154570 con 0x7fa1600bd720 2023-12-04T05:38:45.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.189+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1601ed5c0 con 0x7fa1600bd720 2023-12-04T05:38:45.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1601edef0 con 0x7fa1600bd720 2023-12-04T05:38:45.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa15c013470 con 0x7fa1600bd720 2023-12-04T05:38:45.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa155ffb640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 0x7fa144068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:45.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fa15c0847e0 con 0x7fa1600bd720 2023-12-04T05:38:45.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa164f5e640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 0x7fa144068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:45.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.193+0000 7fa164f5e640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 0x7fa144068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa160157530 tx=0x7fa150007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:45.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.197+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa15c0518c0 con 0x7fa1600bd720 2023-12-04T05:38:45.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:45.353+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa160068440 con 0x7fa1600bd720 2023-12-04T05:38:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa155ffb640 1 -- 172.21.15.97:0/4044873378 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa15c054ee0 con 0x7fa1600bd720 2023-12-04T05:38:46.017 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' created 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 msgr2=0x7fa144068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 0x7fa144068d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa160157530 tx=0x7fa150007960 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 msgr2=0x7fa160144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00e960 tx=0x7fa15c00ee20 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 shutdown_connections 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa1440668d0 0x7fa144068d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa160155160 0x7fa1601ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa16014e700 0x7fa160148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 --2- 172.21.15.97:0/4044873378 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa1600bd720 0x7fa160144e00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 >> 172.21.15.97:0/4044873378 conn(0x7fa160073720 msgr2=0x7fa1600aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 shutdown_connections 2023-12-04T05:38:46.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.013+0000 7fa1679c3640 1 -- 172.21.15.97:0/4044873378 wait complete. 2023-12-04T05:38:46.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-04T05:38:46.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 Processor -- start 2023-12-04T05:38:46.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 -- start start 2023-12-04T05:38:46.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef78154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef780cac10 0x7fef78154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780ca780 con 0x7fef78151f10 2023-12-04T05:38:46.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef78158cc0 con 0x7fef780cac10 2023-12-04T05:38:46.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef7d65a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780c5700 con 0x7fef780c7f00 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef780cac10 0x7fef78154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fef780cac10 0x7fef78154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53584/0 (socket says 172.21.15.97:53584) 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 -- 172.21.15.97:0/856097815 learned_addr learned my addr 172.21.15.97:0/856097815 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef6e7fc640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef78154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 -- 172.21.15.97:0/856097815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 msgr2=0x7fef78154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef78154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 -- 172.21.15.97:0/856097815 >> v1:172.21.15.143:6789/0 conn(0x7fef78151f10 legacy=0x7fef780c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef777fe640 1 -- 172.21.15.97:0/856097815 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78158720 con 0x7fef780cac10 2023-12-04T05:38:46.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.201+0000 7fef767fc640 1 -- 172.21.15.97:0/856097815 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031958938 0 0) 0x7fef780ca780 con 0x7fef78151f10 2023-12-04T05:38:46.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef777fe640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef780cac10 0x7fef78154c60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef7001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce84e181b1d29d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:46.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef767fc640 1 -- 172.21.15.97:0/856097815 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700a5780 con 0x7fef780cac10 2023-12-04T05:38:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef767fc640 1 -- 172.21.15.97:0/856097815 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700a58e0 con 0x7fef780cac10 2023-12-04T05:38:46.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef767fc640 1 -- 172.21.15.97:0/856097815 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700a5c70 con 0x7fef780cac10 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 -- 172.21.15.97:0/856097815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef780cac10 msgr2=0x7fef78154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef780cac10 0x7fef78154c60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef7001c8c0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 -- 172.21.15.97:0/856097815 shutdown_connections 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef780cac10 0x7fef78154c60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 --2- 172.21.15.97:0/856097815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef78154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 -- 172.21.15.97:0/856097815 >> 172.21.15.97:0/856097815 conn(0x7fef78073950 msgr2=0x7fef78073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 -- 172.21.15.97:0/856097815 shutdown_connections 2023-12-04T05:38:46.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.205+0000 7fef7d65a640 1 -- 172.21.15.97:0/856097815 wait complete. 2023-12-04T05:38:46.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 Processor -- start 2023-12-04T05:38:46.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 -- start start 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef780c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef780cac10 0x7fef7814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781ed7f0 con 0x7fef78151f10 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78147e30 con 0x7fef780cac10 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef7d65a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef781ec8b0 con 0x7fef780c7f00 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53592/0 (socket says 172.21.15.97:53592) 2023-12-04T05:38:46.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 -- 172.21.15.97:0/3388586668 learned_addr learned my addr 172.21.15.97:0/3388586668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef6e7fc640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef780cac10 0x7fef7814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef76ffd640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef780c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 -- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 msgr2=0x7fef780c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef780c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 -- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef780cac10 msgr2=0x7fef7814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef780cac10 0x7fef7814b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 -- 172.21.15.97:0/3388586668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70009b30 con 0x7fef78151f10 2023-12-04T05:38:46.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef76ffd640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef780c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef777fe640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef70019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.209+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700b8470 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700b85d0 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700b8940 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef781ecb70 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef781ed130 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef78146fa0 con 0x7fef78151f10 2023-12-04T05:38:46.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef700b8aa0 con 0x7fef78151f10 2023-12-04T05:38:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef6ffff640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 0x7fef58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fef701200e0 con 0x7fef78151f10 2023-12-04T05:38:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.213+0000 7fef76ffd640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 0x7fef58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:46.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.217+0000 7fef76ffd640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 0x7fef58068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f70 tx=0x7fef68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:46.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.217+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef700ed2c0 con 0x7fef78151f10 2023-12-04T05:38:46.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:46.401+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fef78068440 con 0x7fef78151f10 2023-12-04T05:38:47.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.029+0000 7fef6ffff640 1 -- 172.21.15.97:0/3388586668 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7fef700f08e0 con 0x7fef78151f10 2023-12-04T05:38:47.036 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 10 and data pool 11 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.037+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 msgr2=0x7fef58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.037+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 0x7fef58068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f70 tx=0x7fef68009040 comp rx=0 tx=0).stop 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.037+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 msgr2=0x7fef781471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.037+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fef70009e50 tx=0x7fef70019660 comp rx=0 tx=0).stop 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 shutdown_connections 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fef580668d0 0x7fef58068d90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef78151f10 0x7fef781471a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef780cac10 0x7fef7814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 --2- 172.21.15.97:0/3388586668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef780c7f00 0x7fef780c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.041+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 >> 172.21.15.97:0/3388586668 conn(0x7fef78073950 msgr2=0x7fef78150970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.045+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 shutdown_connections 2023-12-04T05:38:47.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.045+0000 7fef7d65a640 1 -- 172.21.15.97:0/3388586668 wait complete. 2023-12-04T05:38:47.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:47.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 Processor -- start 2023-12-04T05:38:47.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 -- start start 2023-12-04T05:38:47.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9ecc0a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0a9770 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc071730 con 0x7f9ecc152490 2023-12-04T05:38:47.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ed0fc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc14ff90 con 0x7f9ecc0a8460 2023-12-04T05:38:47.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9eca59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9ecc14fbb0 0x7f9ecc0a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41204/0 (socket says 172.21.15.97:41204) 2023-12-04T05:38:47.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9eca59c640 1 -- 172.21.15.97:0/3586132522 learned_addr learned my addr 172.21.15.97:0/3586132522 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:47.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec1d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9ecc0a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558557399 0 0) 0x7f9ecc0a9770 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb8003530 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979424769 0 0) 0x7f9eb8003530 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 msgr2=0x7f9ecc0a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9ecc0a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 >> v1:172.21.15.143:6789/0 conn(0x7f9ecc152490 legacy=0x7f9ecc152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc071a10 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f9ebc001a00 con 0x7f9ecc14fbb0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 >> v1:172.21.15.97:6789/0 conn(0x7f9ecc14fbb0 legacy=0x7f9ecc0a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9eb80039b0 0x7f9eb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9eb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb8004d10 0x7f9eb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc14ff90 con 0x7f9eb80039b0 2023-12-04T05:38:47.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb800bb20 con 0x7f9eb8004d10 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb800bcb0 con 0x7f9ecc0a8460 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9eb80039b0 0x7f9eb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.217+0000 7f9ec1d9b640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9eb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9ecad9d640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb8004d10 0x7f9eb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 -- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 msgr2=0x7f9eb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ecc0a8460 0x7f9eb80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 -- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb8004d10 msgr2=0x7f9eb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9eb8004d10 0x7f9eb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 -- 172.21.15.97:0/3586132522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8003530 con 0x7f9eb80039b0 2023-12-04T05:38:47.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9eb80039b0 0x7f9eb8003d90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00a800 tx=0x7f9ebc01d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9028b504842b30 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ad630 con 0x7f9eb80039b0 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0a8070 con 0x7f9eb80039b0 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.221+0000 7f9ec9d9b640 1 -- 172.21.15.97:0/3586132522 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ad9f0 con 0x7f9eb80039b0 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3586132522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9eb80039b0 msgr2=0x7f9eb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3586132522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9eb80039b0 0x7f9eb8003d90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00a800 tx=0x7f9ebc01d290 comp rx=0 tx=0).stop 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ecad9d640 1 -- 172.21.15.97:0/3586132522 reap_dead start 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3586132522 shutdown_connections 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3586132522 >> 172.21.15.97:0/3586132522 conn(0x7f9ecc0c2970 msgr2=0x7f9ecc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3586132522 shutdown_connections 2023-12-04T05:38:47.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3586132522 wait complete. 2023-12-04T05:38:47.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 Processor -- start 2023-12-04T05:38:47.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- start start 2023-12-04T05:38:47.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9eb80039b0 0x7f9ecc15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc142220 0x7f9ecc1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c4310 con 0x7f9ecc06cf50 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc15cda0 con 0x7f9ecc142220 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ed0fc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1ecfa0 con 0x7f9eb80039b0 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53616/0 (socket says 172.21.15.97:53616) 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 -- 172.21.15.97:0/3024169239 learned_addr learned my addr 172.21.15.97:0/3024169239 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9eb80039b0 0x7f9ecc15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ecad9d640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc142220 0x7f9ecc1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 -- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9eb80039b0 msgr2=0x7f9ecc15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9eb80039b0 0x7f9ecc15c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 -- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc142220 msgr2=0x7f9ecc1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc142220 0x7f9ecc1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.225+0000 7f9ec1d9b640 1 -- 172.21.15.97:0/3024169239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc1ed280 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec1d9b640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40119d0 tx=0x7f9eb4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400fb50 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb400fcb0 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1ed560 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4014440 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1eda80 con 0x7f9ecc06cf50 2023-12-04T05:38:47.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc068440 con 0x7f9ecc06cf50 2023-12-04T05:38:47.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9eb40145a0 con 0x7f9ecc06cf50 2023-12-04T05:38:47.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 0x7f9eac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9eb4084e30 con 0x7f9ecc06cf50 2023-12-04T05:38:47.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.229+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 0x7f9eac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.233+0000 7f9eca59c640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 0x7f9eac068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0ad000 tx=0x7f9ebc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.233+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9eb4051e70 con 0x7f9ecc06cf50 2023-12-04T05:38:47.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.389+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ecc1ed6f0 con 0x7f9ecc06cf50 2023-12-04T05:38:47.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.389+0000 7f9ec37fe640 1 -- 172.21.15.97:0/3024169239 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20281 (secure 0 0 0) 0x7f9eb4022020 con 0x7f9ecc06cf50 2023-12-04T05:38:47.395 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:47.395 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:46.407664+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 msgr2=0x7f9eac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 0x7f9eac068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0ad000 tx=0x7f9ebc0a7000 comp rx=0 tx=0).stop 2023-12-04T05:38:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 msgr2=0x7f9ecc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40119d0 tx=0x7f9eb4011e90 comp rx=0 tx=0).stop 2023-12-04T05:38:47.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 shutdown_connections 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9eac0668d0 0x7f9eac068d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ecc142220 0x7f9ecc1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9ecc06cf50 0x7f9ecc06d3d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 --2- 172.21.15.97:0/3024169239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9eb80039b0 0x7f9ecc15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 >> 172.21.15.97:0/3024169239 conn(0x7f9ecc0c2970 msgr2=0x7f9ecc152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 shutdown_connections 2023-12-04T05:38:47.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.393+0000 7f9ed0fc4640 1 -- 172.21.15.97:0/3024169239 wait complete. 2023-12-04T05:38:47.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:47.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 Processor -- start 2023-12-04T05:38:47.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 -- start start 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73700c48b0 0x7f73700c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f737013dc20 0x7f73700c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700c9960 con 0x7f737013d1f0 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7370155120 con 0x7f737013dc20 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f7375357640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737013d920 con 0x7f73700c48b0 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f736effd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f737013d1f0 0x7f73700ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41216/0 (socket says 172.21.15.97:41216) 2023-12-04T05:38:47.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f736effd640 1 -- 172.21.15.97:0/1870576243 learned_addr learned my addr 172.21.15.97:0/1870576243 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:47.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f73667fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73700c48b0 0x7f73700c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.549+0000 7f736f7fe640 1 --2- 172.21.15.97:0/1870576243 >> v2:172.21.15.143:3300/0 conn(0x7f737013dc20 0x7f73700c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247806627 0 0) 0x7f73700c9960 con 0x7f737013d1f0 2023-12-04T05:38:47.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c003530 con 0x7f737013d1f0 2023-12-04T05:38:47.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960769246 0 0) 0x7f735c003530 con 0x7f737013d1f0 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73700c48b0 msgr2=0x7f73700c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73700c48b0 0x7f73700c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 >> v2:172.21.15.143:3300/0 conn(0x7f737013dc20 msgr2=0x7f73700c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 --2- 172.21.15.97:0/1870576243 >> v2:172.21.15.143:3300/0 conn(0x7f737013dc20 0x7f73700c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370154a60 con 0x7f737013d1f0 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f7360001a00 con 0x7f737013d1f0 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 >> v1:172.21.15.97:6789/0 conn(0x7f737013d1f0 legacy=0x7f73700ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c003980 0x7f735c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0047d0 0x7f735c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c005190 0x7f735c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370155120 con 0x7f735c003980 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737013d920 con 0x7f735c0047d0 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c00bfb0 con 0x7f735c005190 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736f7fe640 1 --2- 172.21.15.97:0/1870576243 >> v2:172.21.15.143:3300/0 conn(0x7f737013dc20 0x7f73700c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:47.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f73667fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73700c48b0 0x7f73700c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c003980 0x7f735c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f73667fc640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0047d0 0x7f735c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736f7fe640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c005190 0x7f735c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 -- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c005190 msgr2=0x7f735c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c005190 0x7f735c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 -- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0047d0 msgr2=0x7f735c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f735c0047d0 0x7f735c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.553+0000 7f736effd640 1 -- 172.21.15.97:0/1870576243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c003530 con 0x7f735c003980 2023-12-04T05:38:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f736effd640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c003980 0x7f735c003da0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f736000a860 tx=0x7f736001d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4857dbf1dfbaba server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600ad430 con 0x7f735c003980 2023-12-04T05:38:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73600a8070 con 0x7f735c003980 2023-12-04T05:38:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f736e7fc640 1 -- 172.21.15.97:0/1870576243 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600ad7f0 con 0x7f735c003980 2023-12-04T05:38:47.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- 172.21.15.97:0/1870576243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c003980 msgr2=0x7f735c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 --2- 172.21.15.97:0/1870576243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f735c003980 0x7f735c003da0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f736000a860 tx=0x7f736001d330 comp rx=0 tx=0).stop 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f736f7fe640 1 -- 172.21.15.97:0/1870576243 reap_dead start 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- 172.21.15.97:0/1870576243 shutdown_connections 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- 172.21.15.97:0/1870576243 >> 172.21.15.97:0/1870576243 conn(0x7f73700ac160 msgr2=0x7f73700c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- 172.21.15.97:0/1870576243 shutdown_connections 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- 172.21.15.97:0/1870576243 wait complete. 2023-12-04T05:38:47.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 Processor -- start 2023-12-04T05:38:47.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- start start 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c003980 0x7f73700c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7370151920 0x7f73701ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737013b2d0 con 0x7f73701513f0 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701311c0 con 0x7f7370151920 2023-12-04T05:38:47.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.557+0000 7f7375357640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73701ed800 con 0x7f735c003980 2023-12-04T05:38:47.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53634/0 (socket says 172.21.15.97:53634) 2023-12-04T05:38:47.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 -- 172.21.15.97:0/582352741 learned_addr learned my addr 172.21.15.97:0/582352741 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:47.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f736effd640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c003980 0x7f73700c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.565 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f736f7fe640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7370151920 0x7f73701ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 -- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c003980 msgr2=0x7f73700c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c003980 0x7f73700c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 -- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7370151920 msgr2=0x7f73701ee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7370151920 0x7f73701ee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 -- 172.21.15.97:0/582352741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700caed0 con 0x7f73701513f0 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f73667fc640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7358011630 tx=0x7f7358011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800f920 con 0x7f73701513f0 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800fa80 con 0x7f73701513f0 2023-12-04T05:38:47.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800fe10 con 0x7f73701513f0 2023-12-04T05:38:47.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73701319d0 con 0x7f73701513f0 2023-12-04T05:38:47.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73701316f0 con 0x7f73701513f0 2023-12-04T05:38:47.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73701ed990 con 0x7f73701513f0 2023-12-04T05:38:47.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7358015460 con 0x7f73701513f0 2023-12-04T05:38:47.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 0x7f7350068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.561+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7358084ea0 con 0x7f73701513f0 2023-12-04T05:38:47.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.565+0000 7f736effd640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 0x7f7350068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.565+0000 7f736effd640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 0x7f7350068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73600ad000 tx=0x7f7360001e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.565+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7358051ec0 con 0x7f73701513f0 2023-12-04T05:38:47.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.717+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7370068440 con 0x7f73701513f0 2023-12-04T05:38:47.724 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7367fff640 1 -- 172.21.15.97:0/582352741 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20281 (secure 0 0 0) 0x7f73580554e0 con 0x7f73701513f0 2023-12-04T05:38:47.725 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:47.725 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:46.407664+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:47.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 msgr2=0x7f7350068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 0x7f7350068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73600ad000 tx=0x7f7360001e00 comp rx=0 tx=0).stop 2023-12-04T05:38:47.726 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 msgr2=0x7f73701edc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7358011630 tx=0x7f7358011af0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 shutdown_connections 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73500668d0 0x7f7350068d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7370151920 0x7f73701ee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73701513f0 0x7f73701edc90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 --2- 172.21.15.97:0/582352741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f735c003980 0x7f73700c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 >> 172.21.15.97:0/582352741 conn(0x7f73700ac160 msgr2=0x7f737015a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 shutdown_connections 2023-12-04T05:38:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.721+0000 7f7375357640 1 -- 172.21.15.97:0/582352741 wait complete. 2023-12-04T05:38:47.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-04T05:38:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 Processor -- start 2023-12-04T05:38:47.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 -- start start 2023-12-04T05:38:47.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8740c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd874071ea0 0x7fd8740c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740c0960 con 0x7fd8740c4cc0 2023-12-04T05:38:47.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87406cde0 con 0x7fd874071ea0 2023-12-04T05:38:47.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87406c820 con 0x7fd8741544f0 2023-12-04T05:38:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd8740c4cc0 0x7fd874153de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41232/0 (socket says 172.21.15.97:41232) 2023-12-04T05:38:47.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd87259c640 1 -- 172.21.15.97:0/1551793562 learned_addr learned my addr 172.21.15.97:0/1551793562 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735718061 0 0) 0x7fd8740c0960 con 0x7fd8740c4cc0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003530 con 0x7fd8740c4cc0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd872d9d640 1 --2- 172.21.15.97:0/1551793562 >> v2:172.21.15.143:3300/0 conn(0x7fd874071ea0 0x7fd8740c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8740c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 871808365 0 0) 0x7fd860003530 con 0x7fd8740c4cc0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 msgr2=0x7fd8740c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8740c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 >> v2:172.21.15.143:3300/0 conn(0x7fd874071ea0 msgr2=0x7fd8740c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 --2- 172.21.15.97:0/1551793562 >> v2:172.21.15.143:3300/0 conn(0x7fd874071ea0 0x7fd8740c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.881+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87406cb00 con 0x7fd8740c4cc0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fd864001680 con 0x7fd8740c4cc0 2023-12-04T05:38:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 >> v1:172.21.15.97:6789/0 conn(0x7fd8740c4cc0 legacy=0x7fd874153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd860004d10 0x7fd860005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87406cde0 con 0x7fd860003980 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87406c820 con 0x7fd860004d10 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000bb20 con 0x7fd8741544f0 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd872d9d640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd860004d10 0x7fd860005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 -- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 msgr2=0x7fd8600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8741544f0 0x7fd8600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 -- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd860004d10 msgr2=0x7fd860005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd860004d10 0x7fd860005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 -- 172.21.15.97:0/1551793562 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003530 con 0x7fd860003980 2023-12-04T05:38:47.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd87259c640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003da0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c110 tx=0x7fd86401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e73f413436af970 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640058e0 con 0x7fd860003980 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864005a40 con 0x7fd860003980 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.885+0000 7fd871d9b640 1 -- 172.21.15.97:0/1551793562 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864005db0 con 0x7fd860003980 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- 172.21.15.97:0/1551793562 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 msgr2=0x7fd860003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 --2- 172.21.15.97:0/1551793562 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd860003da0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd86400c110 tx=0x7fd86401cba0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd872d9d640 1 -- 172.21.15.97:0/1551793562 reap_dead start 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- 172.21.15.97:0/1551793562 shutdown_connections 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- 172.21.15.97:0/1551793562 >> 172.21.15.97:0/1551793562 conn(0x7fd87406ad80 msgr2=0x7fd8740c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- 172.21.15.97:0/1551793562 shutdown_connections 2023-12-04T05:38:47.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- 172.21.15.97:0/1551793562 wait complete. 2023-12-04T05:38:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 Processor -- start 2023-12-04T05:38:47.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- start start 2023-12-04T05:38:47.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 0x7fd87414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 0x7fd87414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874153200 con 0x7fd860003980 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874150ab0 con 0x7fd874151830 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd874151220 con 0x7fd87414c430 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53662/0 (socket says 172.21.15.97:53662) 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 -- 172.21.15.97:0/1325344585 learned_addr learned my addr 172.21.15.97:0/1325344585 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 0x7fd87414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd872d9d640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 0x7fd87414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 -- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 msgr2=0x7fd87414c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 0x7fd87414c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 -- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 msgr2=0x7fd87414b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 0x7fd87414b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.889+0000 7fd87259c640 1 -- 172.21.15.97:0/1325344585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740a8690 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 0x7fd87414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd872d9d640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 0x7fd87414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd87259c640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd864007040 tx=0x7fd860005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640049f0 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864004b50 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874153430 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864001720 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd874150d00 con 0x7fd860003980 2023-12-04T05:38:47.899 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87406d3a0 con 0x7fd860003980 2023-12-04T05:38:47.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8640a5790 con 0x7fd860003980 2023-12-04T05:38:47.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:47.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.893+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd86411dfd0 con 0x7fd860003980 2023-12-04T05:38:47.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.897+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:47.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.897+0000 7fd869d9b640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd85c003730 tx=0x7fd85c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:47.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:47.897+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8640eaea0 con 0x7fd860003980 2023-12-04T05:38:48.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:48.085+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd87404e890 con 0x7fd860003980 2023-12-04T05:38:49.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.053+0000 7fd86b7fe640 1 -- 172.21.15.97:0/1325344585 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd8640ee4c0 con 0x7fd860003980 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 msgr2=0x7fd854068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd85c003730 tx=0x7fd85c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 msgr2=0x7fd87414abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd864007040 tx=0x7fd860005800 comp rx=0 tx=0).stop 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 shutdown_connections 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd854066900 0x7fd854068dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd87414c430 0x7fd87414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd874151830 0x7fd87414b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 --2- 172.21.15.97:0/1325344585 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd860003980 0x7fd87414abe0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 >> 172.21.15.97:0/1325344585 conn(0x7fd87406ad80 msgr2=0x7fd87414eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 shutdown_connections 2023-12-04T05:38:49.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.057+0000 7fd87359e640 1 -- 172.21.15.97:0/1325344585 wait complete. 2023-12-04T05:38:49.085 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:38:49.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-04T05:38:49.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 Processor -- start 2023-12-04T05:38:49.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 -- start start 2023-12-04T05:38:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8968156070 0x7f89680c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f89680c0db0 0x7f8968163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8968071380 con 0x7f896806e410 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896806cc20 con 0x7f8968156070 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f8970196640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896806cf00 con 0x7f89680c0db0 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8968156070 0x7f89680c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8968156070 0x7f89680c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53676/0 (socket says 172.21.15.97:53676) 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 -- 172.21.15.97:0/3261418154 learned_addr learned my addr 172.21.15.97:0/3261418154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:49.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896e733640 1 --2- 172.21.15.97:0/3261418154 >> v2:172.21.15.143:3300/0 conn(0x7f89680c0db0 0x7f8968163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 -- 172.21.15.97:0/3261418154 >> v2:172.21.15.143:3300/0 conn(0x7f89680c0db0 msgr2=0x7f8968163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 --2- 172.21.15.97:0/3261418154 >> v2:172.21.15.143:3300/0 conn(0x7f89680c0db0 0x7f8968163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 -- 172.21.15.97:0/3261418154 >> v1:172.21.15.143:6789/0 conn(0x7f896806e410 legacy=0x7f8968071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:49.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.225+0000 7f896df32640 1 -- 172.21.15.97:0/3261418154 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896815cbb0 con 0x7f8968156070 2023-12-04T05:38:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f896df32640 1 --2- 172.21.15.97:0/3261418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968156070 0x7f89680c0870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8968159a80 tx=0x7f896401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb410135e46ccf78 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f896cf30640 1 -- 172.21.15.97:0/3261418154 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89640ab650 con 0x7f8968156070 2023-12-04T05:38:49.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f896cf30640 1 -- 172.21.15.97:0/3261418154 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89640ab7b0 con 0x7f8968156070 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f896cf30640 1 -- 172.21.15.97:0/3261418154 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89640abb40 con 0x7f8968156070 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 -- 172.21.15.97:0/3261418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968156070 msgr2=0x7f89680c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 --2- 172.21.15.97:0/3261418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968156070 0x7f89680c0870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8968159a80 tx=0x7f896401c4c0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 -- 172.21.15.97:0/3261418154 shutdown_connections 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 --2- 172.21.15.97:0/3261418154 >> v2:172.21.15.143:3300/0 conn(0x7f89680c0db0 0x7f8968163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 --2- 172.21.15.97:0/3261418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968156070 0x7f89680c0870 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 -- 172.21.15.97:0/3261418154 >> 172.21.15.97:0/3261418154 conn(0x7f89680c5e70 msgr2=0x7f89680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 -- 172.21.15.97:0/3261418154 shutdown_connections 2023-12-04T05:38:49.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.229+0000 7f8970196640 1 -- 172.21.15.97:0/3261418154 wait complete. 2023-12-04T05:38:49.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 Processor -- start 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- start start 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f896806e410 0x7f89681f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 0x7f8968159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8968155210 con 0x7f89680c0db0 2023-12-04T05:38:49.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89681f5310 con 0x7f8968156070 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896815b490 con 0x7f896806e410 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53680/0 (socket says 172.21.15.97:53680) 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 -- 172.21.15.97:0/1143038044 learned_addr learned my addr 172.21.15.97:0/1143038044 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896df32640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f896806e410 0x7f89681f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.245 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896e733640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 0x7f8968159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 -- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f896806e410 msgr2=0x7f89681f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f896806e410 0x7f89681f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 -- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 msgr2=0x7f8968159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 0x7f8968159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 -- 172.21.15.97:0/1143038044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640094d0 con 0x7f89680c0db0 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896e733640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 0x7f8968159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f896d731640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f895800c410 tx=0x7f895800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958011790 con 0x7f89680c0db0 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89580118f0 con 0x7f89680c0db0 2023-12-04T05:38:49.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958011ca0 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896815b770 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89681f5840 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.233+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896815b900 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.237+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f895801c460 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.237+0000 7f895e7fc640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 0x7f894c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.237+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f89580844b0 con 0x7f89680c0db0 2023-12-04T05:38:49.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.237+0000 7f896df32640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 0x7f894c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.237+0000 7f896df32640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 0x7f894c068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89640af000 tx=0x7f89640b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:49.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.241+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89580512f0 con 0x7f89680c0db0 2023-12-04T05:38:49.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:49.421+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8968068440 con 0x7f89680c0db0 2023-12-04T05:38:50.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f895e7fc640 1 -- 172.21.15.97:0/1143038044 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8958054910 con 0x7f89680c0db0 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 msgr2=0x7f894c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 0x7f894c068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89640af000 tx=0x7f89640b6040 comp rx=0 tx=0).stop 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 msgr2=0x7f89680c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f895800c410 tx=0x7f895800c8d0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 shutdown_connections 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f894c0668d0 0x7f894c068d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8968156070 0x7f8968159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f89680c0db0 0x7f89680c5610 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 --2- 172.21.15.97:0/1143038044 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f896806e410 0x7f89681f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 >> 172.21.15.97:0/1143038044 conn(0x7f89680c5e70 msgr2=0x7f896814c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 shutdown_connections 2023-12-04T05:38:50.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.057+0000 7f8970196640 1 -- 172.21.15.97:0/1143038044 wait complete. 2023-12-04T05:38:50.082 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-04T05:38:50.085 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:38:50.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 Processor -- start 2023-12-04T05:38:50.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 -- start start 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35881547d0 con 0x7f3588158630 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3588158b80 con 0x7f3588151bf0 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f358e217640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880c4aa0 con 0x7f35880c7ef0 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3587fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3588158630 0x7f358815efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41244/0 (socket says 172.21.15.97:41244) 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3587fff640 1 -- 172.21.15.97:0/1267085508 learned_addr learned my addr 172.21.15.97:0/1267085508 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f35877fe640 1 --1- 172.21.15.97:0/1267085508 >> v1:172.21.15.143:6789/0 conn(0x7f3588151bf0 0x7f35880abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:43626/0 (socket says 172.21.15.97:43626) 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3586ffd640 1 --2- 172.21.15.97:0/1267085508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676712240 0 0) 0x7f3588158b80 con 0x7f3588151bf0 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003530 con 0x7f3588151bf0 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644573889 0 0) 0x7f35881547d0 con 0x7f3588158630 2023-12-04T05:38:50.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3586ffd640 1 -- 172.21.15.97:0/1267085508 >> v1:172.21.15.143:6789/0 conn(0x7f3588151bf0 legacy=0x7f35880abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3586ffd640 1 -- 172.21.15.97:0/1267085508 >> v1:172.21.15.97:6789/0 conn(0x7f3588158630 legacy=0x7f358815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.221+0000 7f3586ffd640 1 -- 172.21.15.97:0/1267085508 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880c4d40 con 0x7f35880c7ef0 2023-12-04T05:38:50.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f3586ffd640 1 --2- 172.21.15.97:0/1267085508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588154c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f357c0097f0 tx=0x7f357c01c080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b1887ec82c85c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a47b0 con 0x7f35880c7ef0 2023-12-04T05:38:50.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0a4910 con 0x7f35880c7ef0 2023-12-04T05:38:50.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f35867fc640 1 -- 172.21.15.97:0/1267085508 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a4c80 con 0x7f35880c7ef0 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 -- 172.21.15.97:0/1267085508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 msgr2=0x7f3588154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 --2- 172.21.15.97:0/1267085508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588154c60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f357c0097f0 tx=0x7f357c01c080 comp rx=0 tx=0).stop 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 -- 172.21.15.97:0/1267085508 shutdown_connections 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 --2- 172.21.15.97:0/1267085508 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588154c60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 -- 172.21.15.97:0/1267085508 >> 172.21.15.97:0/1267085508 conn(0x7f3588073550 msgr2=0x7f3588073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 -- 172.21.15.97:0/1267085508 shutdown_connections 2023-12-04T05:38:50.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.225+0000 7f358e217640 1 -- 172.21.15.97:0/1267085508 wait complete. 2023-12-04T05:38:50.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 Processor -- start 2023-12-04T05:38:50.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- start start 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3588151bf0 0x7f358814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358814b660 con 0x7f3588158630 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3588155a20 con 0x7f3588151bf0 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35881447a0 con 0x7f35880c7ef0 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53684/0 (socket says 172.21.15.97:53684) 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 -- 172.21.15.97:0/545850381 learned_addr learned my addr 172.21.15.97:0/545850381 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f35877fe640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3586ffd640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3588151bf0 0x7f358814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.236 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 -- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 msgr2=0x7f3588147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 -- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3588151bf0 msgr2=0x7f358814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3588151bf0 0x7f358814ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 -- 172.21.15.97:0/545850381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009420 con 0x7f3588158630 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f3587fff640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f358000c7d0 tx=0x7f358000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000a640 con 0x7f3588158630 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000a7a0 con 0x7f3588158630 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000ab90 con 0x7f3588158630 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358814b260 con 0x7f3588158630 2023-12-04T05:38:50.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.229+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35881ee5a0 con 0x7f3588158630 2023-12-04T05:38:50.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358814b7a0 con 0x7f3588158630 2023-12-04T05:38:50.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f358000acf0 con 0x7f3588158630 2023-12-04T05:38:50.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f356ffff640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 0x7f3574068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3580083d10 con 0x7f3588158630 2023-12-04T05:38:50.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f35877fe640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 0x7f3574068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.233+0000 7f35877fe640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 0x7f3574068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35780011f0 tx=0x7f3578007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.237+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f358814b7a0 con 0x7f3588158630 2023-12-04T05:38:50.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.421+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f358814b7a0 con 0x7f3588158630 2023-12-04T05:38:50.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.421+0000 7f356ffff640 1 -- 172.21.15.97:0/545850381 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6138 (secure 0 0 0) 0x7f358814b7a0 con 0x7f3588158630 2023-12-04T05:38:50.427 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:50.427 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:38:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 37 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 msgr2=0x7f3574068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 0x7f3574068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35780011f0 tx=0x7f3578007d40 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 msgr2=0x7f3588148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f358000c7d0 tx=0x7f358000cc90 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 shutdown_connections 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35740668d0 0x7f3574068d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3588158630 0x7f3588148a70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3588151bf0 0x7f358814ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 --2- 172.21.15.97:0/545850381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f35880c7ef0 0x7f3588147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 >> 172.21.15.97:0/545850381 conn(0x7f3588073550 msgr2=0x7f3588073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 shutdown_connections 2023-12-04T05:38:50.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.425+0000 7f358e217640 1 -- 172.21.15.97:0/545850381 wait complete. 2023-12-04T05:38:50.448 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 Processor -- start 2023-12-04T05:38:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 -- start start 2023-12-04T05:38:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7b4151bf0 0x7ff7b40abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff7b40c7ef0 0x7ff7b4154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b41547d0 con 0x7ff7b4158630 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b4158b80 con 0x7ff7b4151bf0 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7bc3c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b40c4aa0 con 0x7ff7b40c7ef0 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba160640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7ff7b4151bf0 0x7ff7b40abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba961640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff7b4158630 0x7ff7b40c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41260/0 (socket says 172.21.15.97:41260) 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba961640 1 -- 172.21.15.97:0/2201895519 learned_addr learned my addr 172.21.15.97:0/2201895519 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7b995f640 1 --2- 172.21.15.97:0/2201895519 >> v2:172.21.15.143:3300/0 conn(0x7ff7b40c7ef0 0x7ff7b4154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba160640 1 -- 172.21.15.97:0/2201895519 >> v2:172.21.15.143:3300/0 conn(0x7ff7b40c7ef0 msgr2=0x7ff7b4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba160640 1 --2- 172.21.15.97:0/2201895519 >> v2:172.21.15.143:3300/0 conn(0x7ff7b40c7ef0 0x7ff7b4154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba160640 1 -- 172.21.15.97:0/2201895519 >> v1:172.21.15.97:6789/0 conn(0x7ff7b4158630 legacy=0x7ff7b40c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.581+0000 7ff7ba160640 1 -- 172.21.15.97:0/2201895519 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b40c4d40 con 0x7ff7b4151bf0 2023-12-04T05:38:50.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7ba160640 1 --2- 172.21.15.97:0/2201895519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40abbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40acc00 tx=0x7ff7b001c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9244409b3769f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7b915e640 1 -- 172.21.15.97:0/2201895519 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00a5650 con 0x7ff7b4151bf0 2023-12-04T05:38:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7b915e640 1 -- 172.21.15.97:0/2201895519 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00a57b0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7b915e640 1 -- 172.21.15.97:0/2201895519 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00a5b40 con 0x7ff7b4151bf0 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/2201895519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 msgr2=0x7ff7b40abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/2201895519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40abbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40acc00 tx=0x7ff7b001c020 comp rx=0 tx=0).stop 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/2201895519 shutdown_connections 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/2201895519 >> v2:172.21.15.143:3300/0 conn(0x7ff7b40c7ef0 0x7ff7b4154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/2201895519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40abbb0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/2201895519 >> 172.21.15.97:0/2201895519 conn(0x7ff7b4073550 msgr2=0x7ff7b4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/2201895519 shutdown_connections 2023-12-04T05:38:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.585+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/2201895519 wait complete. 2023-12-04T05:38:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 Processor -- start 2023-12-04T05:38:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- start start 2023-12-04T05:38:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 0x7ff7b414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 0x7ff7b41ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40afcb0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b414fe80 con 0x7ff7b4158630 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40af6f0 con 0x7ff7b40c7ef0 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53706/0 (socket says 172.21.15.97:53706) 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 -- 172.21.15.97:0/1208140518 learned_addr learned my addr 172.21.15.97:0/1208140518 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7ba160640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 0x7ff7b414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7ba961640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 0x7ff7b41ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 -- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 msgr2=0x7ff7b414e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 0x7ff7b414e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 -- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 msgr2=0x7ff7b41ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 0x7ff7b41ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 -- 172.21.15.97:0/1208140518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009420 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7ba160640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 0x7ff7b414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7ba961640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 0x7ff7b41ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7b995f640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d5d0 tx=0x7ff7a400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4004240 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a40043a0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b40af9d0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4003840 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.589+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b4150160 con 0x7ff7b4151bf0 2023-12-04T05:38:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b4068440 con 0x7ff7b4151bf0 2023-12-04T05:38:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff7a40039a0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7aaffd640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 0x7ff798068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff7a4084880 con 0x7ff7b4151bf0 2023-12-04T05:38:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7ba160640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 0x7ff798068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.593+0000 7ff7ba160640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 0x7ff798068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00ae000 tx=0x7ff7b00b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.597+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7a40517f0 con 0x7ff7b4151bf0 2023-12-04T05:38:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.749+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b406c970 con 0x7ff7b4151bf0 2023-12-04T05:38:50.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.749+0000 7ff7aaffd640 1 -- 172.21.15.97:0/1208140518 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7ff7a4054e10 con 0x7ff7b4151bf0 2023-12-04T05:38:50.756 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:50.756 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 msgr2=0x7ff798068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 0x7ff798068d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00ae000 tx=0x7ff7b00b1040 comp rx=0 tx=0).stop 2023-12-04T05:38:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 msgr2=0x7ff7b40ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d5d0 tx=0x7ff7a400da90 comp rx=0 tx=0).stop 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 shutdown_connections 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff7980668d0 0x7ff798068d90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7b4158630 0x7ff7b41ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff7b4151bf0 0x7ff7b40ab8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 --2- 172.21.15.97:0/1208140518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff7b40c7ef0 0x7ff7b414e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 >> 172.21.15.97:0/1208140518 conn(0x7ff7b4073550 msgr2=0x7ff7b4153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 shutdown_connections 2023-12-04T05:38:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.753+0000 7ff7bc3c4640 1 -- 172.21.15.97:0/1208140518 wait complete. 2023-12-04T05:38:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:38:50.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 Processor -- start 2023-12-04T05:38:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 -- start start 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f33880c1880 0x7f33880c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3388155230 0x7f338815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338814b440 con 0x7f338806be00 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338806caf0 con 0x7f3388155230 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338e45a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388154670 con 0x7f33880c1880 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f338c9f7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3388155230 0x7f338815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f33877fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f338806be00 0x7f3388154b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41268/0 (socket says 172.21.15.97:41268) 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f33877fe640 1 -- 172.21.15.97:0/612429869 learned_addr learned my addr 172.21.15.97:0/612429869 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.909+0000 7f3387fff640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f33880c1880 0x7f33880c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338c9f7640 1 -- 172.21.15.97:0/612429869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f33880c1880 msgr2=0x7f33880c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338c9f7640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f33880c1880 0x7f33880c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338c9f7640 1 -- 172.21.15.97:0/612429869 >> v1:172.21.15.97:6789/0 conn(0x7f338806be00 legacy=0x7f3388154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338c9f7640 1 -- 172.21.15.97:0/612429869 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880c02a0 con 0x7f3388155230 2023-12-04T05:38:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f3386ffd640 1 -- 172.21.15.97:0/612429869 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485055866 0 0) 0x7f338814b440 con 0x7f338806be00 2023-12-04T05:38:50.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338c9f7640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3388155230 0x7f338815eee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f338001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32bc9d3f2f33c61 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f3386ffd640 1 -- 172.21.15.97:0/612429869 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800a5a10 con 0x7f3388155230 2023-12-04T05:38:50.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f3386ffd640 1 -- 172.21.15.97:0/612429869 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33800a5b70 con 0x7f3388155230 2023-12-04T05:38:50.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f3386ffd640 1 -- 172.21.15.97:0/612429869 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800ad440 con 0x7f3388155230 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 -- 172.21.15.97:0/612429869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3388155230 msgr2=0x7f338815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3388155230 0x7f338815eee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f338001c950 comp rx=0 tx=0).stop 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 -- 172.21.15.97:0/612429869 shutdown_connections 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3388155230 0x7f338815eee0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 --2- 172.21.15.97:0/612429869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f33880c1880 0x7f33880c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 -- 172.21.15.97:0/612429869 >> 172.21.15.97:0/612429869 conn(0x7f33880c2970 msgr2=0x7f33880c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 -- 172.21.15.97:0/612429869 shutdown_connections 2023-12-04T05:38:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.913+0000 7f338e45a640 1 -- 172.21.15.97:0/612429869 wait complete. 2023-12-04T05:38:50.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 Processor -- start 2023-12-04T05:38:50.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- start start 2023-12-04T05:38:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33880c1880 0x7f3388145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3388155230 0x7f33880a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388149db0 con 0x7f338806be00 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880a8590 con 0x7f33880c1880 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388144730 con 0x7f3388155230 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53720/0 (socket says 172.21.15.97:53720) 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 -- 172.21.15.97:0/329697069 learned_addr learned my addr 172.21.15.97:0/329697069 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338c9f7640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3388155230 0x7f33880a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f33877fe640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33880c1880 0x7f3388145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 -- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3388155230 msgr2=0x7f33880a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3388155230 0x7f33880a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 -- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33880c1880 msgr2=0x7f3388145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33880c1880 0x7f3388145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 -- 172.21.15.97:0/329697069 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009a70 con 0x7f338806be00 2023-12-04T05:38:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3387fff640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f337800e930 tx=0x7f337800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378009690 con 0x7f338806be00 2023-12-04T05:38:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337800ca00 con 0x7f338806be00 2023-12-04T05:38:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3388149ad0 con 0x7f338806be00 2023-12-04T05:38:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800cd70 con 0x7f338806be00 2023-12-04T05:38:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.917+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33881496b0 con 0x7f338806be00 2023-12-04T05:38:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3388149230 con 0x7f338806be00 2023-12-04T05:38:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3378013470 con 0x7f338806be00 2023-12-04T05:38:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f3384ff9640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 0x7f3374068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f33780848b0 con 0x7f338806be00 2023-12-04T05:38:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f33877fe640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 0x7f3374068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:50.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.921+0000 7f33877fe640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 0x7f3374068dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f33881f0d90 tx=0x7f337c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:50.925+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3388149230 con 0x7f338806be00 2023-12-04T05:38:51.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.073+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f338806e460 con 0x7f3374066900 2023-12-04T05:38:51.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.089+0000 7f3384ff9640 1 -- 172.21.15.97:0/329697069 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527849 (secure 0 0 0) 0x7f337c004c80 con 0x7f3374066900 2023-12-04T05:38:51.098 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 msgr2=0x7f3374068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 0x7f3374068dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f33881f0d90 tx=0x7f337c007d60 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 msgr2=0x7f33881efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f337800e930 tx=0x7f337800edf0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 shutdown_connections 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3374066900 0x7f3374068dc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3388155230 0x7f33880a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f33880c1880 0x7f3388145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 --2- 172.21.15.97:0/329697069 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f338806be00 0x7f33881efcd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 >> 172.21.15.97:0/329697069 conn(0x7f33880c2970 msgr2=0x7f3388153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 shutdown_connections 2023-12-04T05:38:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.093+0000 7f338e45a640 1 -- 172.21.15.97:0/329697069 wait complete. 2023-12-04T05:38:51.118 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-04T05:38:50.216818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230736,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743984,"statfs":{"total":773094113280,"available":772857839616,"internally_reserved":0,"allocated":6397952,"data_stored":3381566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.207335"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060838+0000","last_change":"2023-12-04T05:38:47.044643+0000","last_active":"2023-12-04T05:38:47.060838+0000","last_peered":"2023-12-04T05:38:47.060838+0000","last_clean":"2023-12-04T05:38:47.060838+0000","last_became_active":"2023-12-04T05:38:47.044378+0000","last_became_peered":"2023-12-04T05:38:47.044378+0000","last_unstale":"2023-12-04T05:38:47.060838+0000","last_undegraded":"2023-12-04T05:38:47.060838+0000","last_fullsized":"2023-12-04T05:38:47.060838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:00.327690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033669+0000","last_change":"2023-12-04T05:38:29.352962+0000","last_active":"2023-12-04T05:38:46.033669+0000","last_peered":"2023-12-04T05:38:46.033669+0000","last_clean":"2023-12-04T05:38:46.033669+0000","last_became_active":"2023-12-04T05:38:29.352682+0000","last_became_peered":"2023-12-04T05:38:29.352682+0000","last_unstale":"2023-12-04T05:38:46.033669+0000","last_undegraded":"2023-12-04T05:38:46.033669+0000","last_fullsized":"2023-12-04T05:38:46.033669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:46.992332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042752+0000","last_change":"2023-12-04T05:38:47.044070+0000","last_active":"2023-12-04T05:38:48.042752+0000","last_peered":"2023-12-04T05:38:48.042752+0000","last_clean":"2023-12-04T05:38:48.042752+0000","last_became_active":"2023-12-04T05:38:47.043820+0000","last_became_peered":"2023-12-04T05:38:47.043820+0000","last_unstale":"2023-12-04T05:38:48.042752+0000","last_undegraded":"2023-12-04T05:38:48.042752+0000","last_fullsized":"2023-12-04T05:38:48.042752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:51.848737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044403+0000","last_change":"2023-12-04T05:38:29.357484+0000","last_active":"2023-12-04T05:38:46.044403+0000","last_peered":"2023-12-04T05:38:46.044403+0000","last_clean":"2023-12-04T05:38:46.044403+0000","last_became_active":"2023-12-04T05:38:29.356776+0000","last_became_peered":"2023-12-04T05:38:29.356776+0000","last_unstale":"2023-12-04T05:38:46.044403+0000","last_undegraded":"2023-12-04T05:38:46.044403+0000","last_fullsized":"2023-12-04T05:38:46.044403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:18.360524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040559+0000","last_change":"2023-12-04T05:38:47.052013+0000","last_active":"2023-12-04T05:38:48.040559+0000","last_peered":"2023-12-04T05:38:48.040559+0000","last_clean":"2023-12-04T05:38:48.040559+0000","last_became_active":"2023-12-04T05:38:47.050564+0000","last_became_peered":"2023-12-04T05:38:47.050564+0000","last_unstale":"2023-12-04T05:38:48.040559+0000","last_undegraded":"2023-12-04T05:38:48.040559+0000","last_fullsized":"2023-12-04T05:38:48.040559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:18.297839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036342+0000","last_change":"2023-12-04T05:38:29.369361+0000","last_active":"2023-12-04T05:38:47.036342+0000","last_peered":"2023-12-04T05:38:47.036342+0000","last_clean":"2023-12-04T05:38:47.036342+0000","last_became_active":"2023-12-04T05:38:29.369066+0000","last_became_peered":"2023-12-04T05:38:29.369066+0000","last_unstale":"2023-12-04T05:38:47.036342+0000","last_undegraded":"2023-12-04T05:38:47.036342+0000","last_fullsized":"2023-12-04T05:38:47.036342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.044322+0000","last_change":"2023-12-04T05:38:47.041126+0000","last_active":"2023-12-04T05:38:47.044322+0000","last_peered":"2023-12-04T05:38:47.044322+0000","last_clean":"2023-12-04T05:38:47.044322+0000","last_became_active":"2023-12-04T05:38:47.039226+0000","last_became_peered":"2023-12-04T05:38:47.039226+0000","last_unstale":"2023-12-04T05:38:47.044322+0000","last_undegraded":"2023-12-04T05:38:47.044322+0000","last_fullsized":"2023-12-04T05:38:47.044322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:29.847962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037857+0000","last_change":"2023-12-04T05:38:29.352890+0000","last_active":"2023-12-04T05:38:46.037857+0000","last_peered":"2023-12-04T05:38:46.037857+0000","last_clean":"2023-12-04T05:38:46.037857+0000","last_became_active":"2023-12-04T05:38:29.352561+0000","last_became_peered":"2023-12-04T05:38:29.352561+0000","last_unstale":"2023-12-04T05:38:46.037857+0000","last_undegraded":"2023-12-04T05:38:46.037857+0000","last_fullsized":"2023-12-04T05:38:46.037857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:26.518247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.058635+0000","last_change":"2023-12-04T05:38:47.048639+0000","last_active":"2023-12-04T05:38:47.058635+0000","last_peered":"2023-12-04T05:38:47.058635+0000","last_clean":"2023-12-04T05:38:47.058635+0000","last_became_active":"2023-12-04T05:38:47.048309+0000","last_became_peered":"2023-12-04T05:38:47.048309+0000","last_unstale":"2023-12-04T05:38:47.058635+0000","last_undegraded":"2023-12-04T05:38:47.058635+0000","last_fullsized":"2023-12-04T05:38:47.058635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:03:28.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033112+0000","last_change":"2023-12-04T05:38:29.357624+0000","last_active":"2023-12-04T05:38:46.033112+0000","last_peered":"2023-12-04T05:38:46.033112+0000","last_clean":"2023-12-04T05:38:46.033112+0000","last_became_active":"2023-12-04T05:38:29.357119+0000","last_became_peered":"2023-12-04T05:38:29.357119+0000","last_unstale":"2023-12-04T05:38:46.033112+0000","last_undegraded":"2023-12-04T05:38:46.033112+0000","last_fullsized":"2023-12-04T05:38:46.033112+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:20.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.049651+0000","last_change":"2023-12-04T05:38:47.042033+0000","last_active":"2023-12-04T05:38:47.049651+0000","last_peered":"2023-12-04T05:38:47.049651+0000","last_clean":"2023-12-04T05:38:47.049651+0000","last_became_active":"2023-12-04T05:38:47.041721+0000","last_became_peered":"2023-12-04T05:38:47.041721+0000","last_unstale":"2023-12-04T05:38:47.049651+0000","last_undegraded":"2023-12-04T05:38:47.049651+0000","last_fullsized":"2023-12-04T05:38:47.049651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:58.747442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032466+0000","last_change":"2023-12-04T05:38:29.346548+0000","last_active":"2023-12-04T05:38:46.032466+0000","last_peered":"2023-12-04T05:38:46.032466+0000","last_clean":"2023-12-04T05:38:46.032466+0000","last_became_active":"2023-12-04T05:38:29.346283+0000","last_became_peered":"2023-12-04T05:38:29.346283+0000","last_unstale":"2023-12-04T05:38:46.032466+0000","last_undegraded":"2023-12-04T05:38:46.032466+0000","last_fullsized":"2023-12-04T05:38:46.032466+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060582+0000","last_change":"2023-12-04T05:38:47.054063+0000","last_active":"2023-12-04T05:38:47.060582+0000","last_peered":"2023-12-04T05:38:47.060582+0000","last_clean":"2023-12-04T05:38:47.060582+0000","last_became_active":"2023-12-04T05:38:47.053422+0000","last_became_peered":"2023-12-04T05:38:47.053422+0000","last_unstale":"2023-12-04T05:38:47.060582+0000","last_undegraded":"2023-12-04T05:38:47.060582+0000","last_fullsized":"2023-12-04T05:38:47.060582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:53.438652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025129+0000","last_change":"2023-12-04T05:38:29.357730+0000","last_active":"2023-12-04T05:38:47.025129+0000","last_peered":"2023-12-04T05:38:47.025129+0000","last_clean":"2023-12-04T05:38:47.025129+0000","last_became_active":"2023-12-04T05:38:29.357470+0000","last_became_peered":"2023-12-04T05:38:29.357470+0000","last_unstale":"2023-12-04T05:38:47.025129+0000","last_undegraded":"2023-12-04T05:38:47.025129+0000","last_fullsized":"2023-12-04T05:38:47.025129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:55.944927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037477+0000","last_change":"2023-12-04T05:38:47.031577+0000","last_active":"2023-12-04T05:38:47.037477+0000","last_peered":"2023-12-04T05:38:47.037477+0000","last_clean":"2023-12-04T05:38:47.037477+0000","last_became_active":"2023-12-04T05:38:47.031240+0000","last_became_peered":"2023-12-04T05:38:47.031240+0000","last_unstale":"2023-12-04T05:38:47.037477+0000","last_undegraded":"2023-12-04T05:38:47.037477+0000","last_fullsized":"2023-12-04T05:38:47.037477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:26.059926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036850+0000","last_change":"2023-12-04T05:38:29.344652+0000","last_active":"2023-12-04T05:38:46.036850+0000","last_peered":"2023-12-04T05:38:46.036850+0000","last_clean":"2023-12-04T05:38:46.036850+0000","last_became_active":"2023-12-04T05:38:29.344365+0000","last_became_peered":"2023-12-04T05:38:29.344365+0000","last_unstale":"2023-12-04T05:38:46.036850+0000","last_undegraded":"2023-12-04T05:38:46.036850+0000","last_fullsized":"2023-12-04T05:38:46.036850+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:23.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041786+0000","last_change":"2023-12-04T05:38:47.058476+0000","last_active":"2023-12-04T05:38:48.041786+0000","last_peered":"2023-12-04T05:38:48.041786+0000","last_clean":"2023-12-04T05:38:48.041786+0000","last_became_active":"2023-12-04T05:38:47.058014+0000","last_became_peered":"2023-12-04T05:38:47.058014+0000","last_unstale":"2023-12-04T05:38:48.041786+0000","last_undegraded":"2023-12-04T05:38:48.041786+0000","last_fullsized":"2023-12-04T05:38:48.041786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:58:51.518415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025969+0000","last_change":"2023-12-04T05:38:29.361093+0000","last_active":"2023-12-04T05:38:47.025969+0000","last_peered":"2023-12-04T05:38:47.025969+0000","last_clean":"2023-12-04T05:38:47.025969+0000","last_became_active":"2023-12-04T05:38:29.360800+0000","last_became_peered":"2023-12-04T05:38:29.360800+0000","last_unstale":"2023-12-04T05:38:47.025969+0000","last_undegraded":"2023-12-04T05:38:47.025969+0000","last_fullsized":"2023-12-04T05:38:47.025969+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:18.687515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042457+0000","last_change":"2023-12-04T05:38:47.048298+0000","last_active":"2023-12-04T05:38:48.042457+0000","last_peered":"2023-12-04T05:38:48.042457+0000","last_clean":"2023-12-04T05:38:48.042457+0000","last_became_active":"2023-12-04T05:38:47.048034+0000","last_became_peered":"2023-12-04T05:38:47.048034+0000","last_unstale":"2023-12-04T05:38:48.042457+0000","last_undegraded":"2023-12-04T05:38:48.042457+0000","last_fullsized":"2023-12-04T05:38:48.042457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:00:17.547825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025074+0000","last_change":"2023-12-04T05:38:29.353550+0000","last_active":"2023-12-04T05:38:47.025074+0000","last_peered":"2023-12-04T05:38:47.025074+0000","last_clean":"2023-12-04T05:38:47.025074+0000","last_became_active":"2023-12-04T05:38:29.353168+0000","last_became_peered":"2023-12-04T05:38:29.353168+0000","last_unstale":"2023-12-04T05:38:47.025074+0000","last_undegraded":"2023-12-04T05:38:47.025074+0000","last_fullsized":"2023-12-04T05:38:47.025074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:20.689218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063639+0000","last_change":"2023-12-04T05:38:47.061460+0000","last_active":"2023-12-04T05:38:47.063639+0000","last_peered":"2023-12-04T05:38:47.063639+0000","last_clean":"2023-12-04T05:38:47.063639+0000","last_became_active":"2023-12-04T05:38:47.060415+0000","last_became_peered":"2023-12-04T05:38:47.060415+0000","last_unstale":"2023-12-04T05:38:47.063639+0000","last_undegraded":"2023-12-04T05:38:47.063639+0000","last_fullsized":"2023-12-04T05:38:47.063639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:26.936192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023678+0000","last_change":"2023-12-04T05:38:29.357106+0000","last_active":"2023-12-04T05:38:47.023678+0000","last_peered":"2023-12-04T05:38:47.023678+0000","last_clean":"2023-12-04T05:38:47.023678+0000","last_became_active":"2023-12-04T05:38:29.356781+0000","last_became_peered":"2023-12-04T05:38:29.356781+0000","last_unstale":"2023-12-04T05:38:47.023678+0000","last_undegraded":"2023-12-04T05:38:47.023678+0000","last_fullsized":"2023-12-04T05:38:47.023678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:17.004052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041956+0000","last_change":"2023-12-04T05:38:47.040903+0000","last_active":"2023-12-04T05:38:48.041956+0000","last_peered":"2023-12-04T05:38:48.041956+0000","last_clean":"2023-12-04T05:38:48.041956+0000","last_became_active":"2023-12-04T05:38:47.039018+0000","last_became_peered":"2023-12-04T05:38:47.039018+0000","last_unstale":"2023-12-04T05:38:48.041956+0000","last_undegraded":"2023-12-04T05:38:48.041956+0000","last_fullsized":"2023-12-04T05:38:48.041956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037968+0000","last_change":"2023-12-04T05:38:29.358871+0000","last_active":"2023-12-04T05:38:46.037968+0000","last_peered":"2023-12-04T05:38:46.037968+0000","last_clean":"2023-12-04T05:38:46.037968+0000","last_became_active":"2023-12-04T05:38:29.358575+0000","last_became_peered":"2023-12-04T05:38:29.358575+0000","last_unstale":"2023-12-04T05:38:46.037968+0000","last_undegraded":"2023-12-04T05:38:46.037968+0000","last_fullsized":"2023-12-04T05:38:46.037968+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041015+0000","last_change":"2023-12-04T05:38:47.038571+0000","last_active":"2023-12-04T05:38:47.041015+0000","last_peered":"2023-12-04T05:38:47.041015+0000","last_clean":"2023-12-04T05:38:47.041015+0000","last_became_active":"2023-12-04T05:38:47.037718+0000","last_became_peered":"2023-12-04T05:38:47.037718+0000","last_unstale":"2023-12-04T05:38:47.041015+0000","last_undegraded":"2023-12-04T05:38:47.041015+0000","last_fullsized":"2023-12-04T05:38:47.041015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029781+0000","last_change":"2023-12-04T05:38:29.363316+0000","last_active":"2023-12-04T05:38:46.029781+0000","last_peered":"2023-12-04T05:38:46.029781+0000","last_clean":"2023-12-04T05:38:46.029781+0000","last_became_active":"2023-12-04T05:38:29.362949+0000","last_became_peered":"2023-12-04T05:38:29.362949+0000","last_unstale":"2023-12-04T05:38:46.029781+0000","last_undegraded":"2023-12-04T05:38:46.029781+0000","last_fullsized":"2023-12-04T05:38:46.029781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:35.750245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040677+0000","last_change":"2023-12-04T05:38:47.048032+0000","last_active":"2023-12-04T05:38:48.040677+0000","last_peered":"2023-12-04T05:38:48.040677+0000","last_clean":"2023-12-04T05:38:48.040677+0000","last_became_active":"2023-12-04T05:38:47.047158+0000","last_became_peered":"2023-12-04T05:38:47.047158+0000","last_unstale":"2023-12-04T05:38:48.040677+0000","last_undegraded":"2023-12-04T05:38:48.040677+0000","last_fullsized":"2023-12-04T05:38:48.040677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:03:28.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026543+0000","last_change":"2023-12-04T05:38:29.351970+0000","last_active":"2023-12-04T05:38:47.026543+0000","last_peered":"2023-12-04T05:38:47.026543+0000","last_clean":"2023-12-04T05:38:47.026543+0000","last_became_active":"2023-12-04T05:38:29.351547+0000","last_became_peered":"2023-12-04T05:38:29.351547+0000","last_unstale":"2023-12-04T05:38:47.026543+0000","last_undegraded":"2023-12-04T05:38:47.026543+0000","last_fullsized":"2023-12-04T05:38:47.026543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:22:28.844459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.049718+0000","last_change":"2023-12-04T05:38:47.045199+0000","last_active":"2023-12-04T05:38:47.049718+0000","last_peered":"2023-12-04T05:38:47.049718+0000","last_clean":"2023-12-04T05:38:47.049718+0000","last_became_active":"2023-12-04T05:38:47.041875+0000","last_became_peered":"2023-12-04T05:38:47.041875+0000","last_unstale":"2023-12-04T05:38:47.049718+0000","last_undegraded":"2023-12-04T05:38:47.049718+0000","last_fullsized":"2023-12-04T05:38:47.049718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:36.779373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025296+0000","last_change":"2023-12-04T05:38:29.349829+0000","last_active":"2023-12-04T05:38:47.025296+0000","last_peered":"2023-12-04T05:38:47.025296+0000","last_clean":"2023-12-04T05:38:47.025296+0000","last_became_active":"2023-12-04T05:38:29.349570+0000","last_became_peered":"2023-12-04T05:38:29.349570+0000","last_unstale":"2023-12-04T05:38:47.025296+0000","last_undegraded":"2023-12-04T05:38:47.025296+0000","last_fullsized":"2023-12-04T05:38:47.025296+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:42:30.244005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060743+0000","last_change":"2023-12-04T05:38:47.055938+0000","last_active":"2023-12-04T05:38:47.060743+0000","last_peered":"2023-12-04T05:38:47.060743+0000","last_clean":"2023-12-04T05:38:47.060743+0000","last_became_active":"2023-12-04T05:38:47.055630+0000","last_became_peered":"2023-12-04T05:38:47.055630+0000","last_unstale":"2023-12-04T05:38:47.060743+0000","last_undegraded":"2023-12-04T05:38:47.060743+0000","last_fullsized":"2023-12-04T05:38:47.060743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:24.893301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032207+0000","last_change":"2023-12-04T05:38:29.343672+0000","last_active":"2023-12-04T05:38:46.032207+0000","last_peered":"2023-12-04T05:38:46.032207+0000","last_clean":"2023-12-04T05:38:46.032207+0000","last_became_active":"2023-12-04T05:38:29.343378+0000","last_became_peered":"2023-12-04T05:38:29.343378+0000","last_unstale":"2023-12-04T05:38:46.032207+0000","last_undegraded":"2023-12-04T05:38:46.032207+0000","last_fullsized":"2023-12-04T05:38:46.032207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055349+0000","last_change":"2023-12-04T05:38:47.044202+0000","last_active":"2023-12-04T05:38:47.055349+0000","last_peered":"2023-12-04T05:38:47.055349+0000","last_clean":"2023-12-04T05:38:47.055349+0000","last_became_active":"2023-12-04T05:38:47.042606+0000","last_became_peered":"2023-12-04T05:38:47.042606+0000","last_unstale":"2023-12-04T05:38:47.055349+0000","last_undegraded":"2023-12-04T05:38:47.055349+0000","last_fullsized":"2023-12-04T05:38:47.055349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:00:17.547825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044430+0000","last_change":"2023-12-04T05:38:29.348038+0000","last_active":"2023-12-04T05:38:46.044430+0000","last_peered":"2023-12-04T05:38:46.044430+0000","last_clean":"2023-12-04T05:38:46.044430+0000","last_became_active":"2023-12-04T05:38:29.346419+0000","last_became_peered":"2023-12-04T05:38:29.346419+0000","last_unstale":"2023-12-04T05:38:46.044430+0000","last_undegraded":"2023-12-04T05:38:46.044430+0000","last_fullsized":"2023-12-04T05:38:46.044430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:28.971735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041076+0000","last_change":"2023-12-04T05:38:47.038915+0000","last_active":"2023-12-04T05:38:47.041076+0000","last_peered":"2023-12-04T05:38:47.041076+0000","last_clean":"2023-12-04T05:38:47.041076+0000","last_became_active":"2023-12-04T05:38:47.038661+0000","last_became_peered":"2023-12-04T05:38:47.038661+0000","last_unstale":"2023-12-04T05:38:47.041076+0000","last_undegraded":"2023-12-04T05:38:47.041076+0000","last_fullsized":"2023-12-04T05:38:47.041076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:21.234963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038312+0000","last_change":"2023-12-04T05:38:29.370721+0000","last_active":"2023-12-04T05:38:47.038312+0000","last_peered":"2023-12-04T05:38:47.038312+0000","last_clean":"2023-12-04T05:38:47.038312+0000","last_became_active":"2023-12-04T05:38:29.370199+0000","last_became_peered":"2023-12-04T05:38:29.370199+0000","last_unstale":"2023-12-04T05:38:47.038312+0000","last_undegraded":"2023-12-04T05:38:47.038312+0000","last_fullsized":"2023-12-04T05:38:47.038312+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061583+0000","last_change":"2023-12-04T05:38:47.052347+0000","last_active":"2023-12-04T05:38:47.061583+0000","last_peered":"2023-12-04T05:38:47.061583+0000","last_clean":"2023-12-04T05:38:47.061583+0000","last_became_active":"2023-12-04T05:38:47.052074+0000","last_became_peered":"2023-12-04T05:38:47.052074+0000","last_unstale":"2023-12-04T05:38:47.061583+0000","last_undegraded":"2023-12-04T05:38:47.061583+0000","last_fullsized":"2023-12-04T05:38:47.061583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:41.498013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033981+0000","last_change":"2023-12-04T05:38:29.355850+0000","last_active":"2023-12-04T05:38:46.033981+0000","last_peered":"2023-12-04T05:38:46.033981+0000","last_clean":"2023-12-04T05:38:46.033981+0000","last_became_active":"2023-12-04T05:38:29.355549+0000","last_became_peered":"2023-12-04T05:38:29.355549+0000","last_unstale":"2023-12-04T05:38:46.033981+0000","last_undegraded":"2023-12-04T05:38:46.033981+0000","last_fullsized":"2023-12-04T05:38:46.033981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:07.261586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042794+0000","last_change":"2023-12-04T05:38:47.040474+0000","last_active":"2023-12-04T05:38:48.042794+0000","last_peered":"2023-12-04T05:38:48.042794+0000","last_clean":"2023-12-04T05:38:48.042794+0000","last_became_active":"2023-12-04T05:38:47.040193+0000","last_became_peered":"2023-12-04T05:38:47.040193+0000","last_unstale":"2023-12-04T05:38:48.042794+0000","last_undegraded":"2023-12-04T05:38:48.042794+0000","last_fullsized":"2023-12-04T05:38:48.042794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:32:02.401449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040537+0000","last_change":"2023-12-04T05:38:29.345961+0000","last_active":"2023-12-04T05:38:46.040537+0000","last_peered":"2023-12-04T05:38:46.040537+0000","last_clean":"2023-12-04T05:38:46.040537+0000","last_became_active":"2023-12-04T05:38:29.345359+0000","last_became_peered":"2023-12-04T05:38:29.345359+0000","last_unstale":"2023-12-04T05:38:46.040537+0000","last_undegraded":"2023-12-04T05:38:46.040537+0000","last_fullsized":"2023-12-04T05:38:46.040537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:19.090966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042079+0000","last_change":"2023-12-04T05:38:47.055046+0000","last_active":"2023-12-04T05:38:48.042079+0000","last_peered":"2023-12-04T05:38:48.042079+0000","last_clean":"2023-12-04T05:38:48.042079+0000","last_became_active":"2023-12-04T05:38:47.054813+0000","last_became_peered":"2023-12-04T05:38:47.054813+0000","last_unstale":"2023-12-04T05:38:48.042079+0000","last_undegraded":"2023-12-04T05:38:48.042079+0000","last_fullsized":"2023-12-04T05:38:48.042079+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:10:17.726184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038570+0000","last_change":"2023-12-04T05:38:29.366491+0000","last_active":"2023-12-04T05:38:47.038570+0000","last_peered":"2023-12-04T05:38:47.038570+0000","last_clean":"2023-12-04T05:38:47.038570+0000","last_became_active":"2023-12-04T05:38:29.366202+0000","last_became_peered":"2023-12-04T05:38:29.366202+0000","last_unstale":"2023-12-04T05:38:47.038570+0000","last_undegraded":"2023-12-04T05:38:47.038570+0000","last_fullsized":"2023-12-04T05:38:47.038570+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040143+0000","last_change":"2023-12-04T05:38:47.056135+0000","last_active":"2023-12-04T05:38:48.040143+0000","last_peered":"2023-12-04T05:38:48.040143+0000","last_clean":"2023-12-04T05:38:48.040143+0000","last_became_active":"2023-12-04T05:38:47.055807+0000","last_became_peered":"2023-12-04T05:38:47.055807+0000","last_unstale":"2023-12-04T05:38:48.040143+0000","last_undegraded":"2023-12-04T05:38:48.040143+0000","last_fullsized":"2023-12-04T05:38:48.040143+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:25.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038299+0000","last_change":"2023-12-04T05:38:29.353157+0000","last_active":"2023-12-04T05:38:46.038299+0000","last_peered":"2023-12-04T05:38:46.038299+0000","last_clean":"2023-12-04T05:38:46.038299+0000","last_became_active":"2023-12-04T05:38:29.352879+0000","last_became_peered":"2023-12-04T05:38:29.352879+0000","last_unstale":"2023-12-04T05:38:46.038299+0000","last_undegraded":"2023-12-04T05:38:46.038299+0000","last_fullsized":"2023-12-04T05:38:46.038299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:02.199367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041695+0000","last_change":"2023-12-04T05:38:47.035763+0000","last_active":"2023-12-04T05:38:48.041695+0000","last_peered":"2023-12-04T05:38:48.041695+0000","last_clean":"2023-12-04T05:38:48.041695+0000","last_became_active":"2023-12-04T05:38:47.035456+0000","last_became_peered":"2023-12-04T05:38:47.035456+0000","last_unstale":"2023-12-04T05:38:48.041695+0000","last_undegraded":"2023-12-04T05:38:48.041695+0000","last_fullsized":"2023-12-04T05:38:48.041695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:43.944051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037613+0000","last_change":"2023-12-04T05:38:29.368754+0000","last_active":"2023-12-04T05:38:47.037613+0000","last_peered":"2023-12-04T05:38:47.037613+0000","last_clean":"2023-12-04T05:38:47.037613+0000","last_became_active":"2023-12-04T05:38:29.368261+0000","last_became_peered":"2023-12-04T05:38:29.368261+0000","last_unstale":"2023-12-04T05:38:47.037613+0000","last_undegraded":"2023-12-04T05:38:47.037613+0000","last_fullsized":"2023-12-04T05:38:47.037613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041329+0000","last_change":"2023-12-04T05:38:47.040938+0000","last_active":"2023-12-04T05:38:48.041329+0000","last_peered":"2023-12-04T05:38:48.041329+0000","last_clean":"2023-12-04T05:38:48.041329+0000","last_became_active":"2023-12-04T05:38:47.040644+0000","last_became_peered":"2023-12-04T05:38:47.040644+0000","last_unstale":"2023-12-04T05:38:48.041329+0000","last_undegraded":"2023-12-04T05:38:48.041329+0000","last_fullsized":"2023-12-04T05:38:48.041329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:50.832106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029004+0000","last_change":"2023-12-04T05:38:29.363152+0000","last_active":"2023-12-04T05:38:46.029004+0000","last_peered":"2023-12-04T05:38:46.029004+0000","last_clean":"2023-12-04T05:38:46.029004+0000","last_became_active":"2023-12-04T05:38:29.362819+0000","last_became_peered":"2023-12-04T05:38:29.362819+0000","last_unstale":"2023-12-04T05:38:46.029004+0000","last_undegraded":"2023-12-04T05:38:46.029004+0000","last_fullsized":"2023-12-04T05:38:46.029004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:09.247784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064840+0000","last_change":"2023-12-04T05:38:47.060243+0000","last_active":"2023-12-04T05:38:47.064840+0000","last_peered":"2023-12-04T05:38:47.064840+0000","last_clean":"2023-12-04T05:38:47.064840+0000","last_became_active":"2023-12-04T05:38:47.055180+0000","last_became_peered":"2023-12-04T05:38:47.055180+0000","last_unstale":"2023-12-04T05:38:47.064840+0000","last_undegraded":"2023-12-04T05:38:47.064840+0000","last_fullsized":"2023-12-04T05:38:47.064840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:25.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033813+0000","last_change":"2023-12-04T05:38:29.362074+0000","last_active":"2023-12-04T05:38:46.033813+0000","last_peered":"2023-12-04T05:38:46.033813+0000","last_clean":"2023-12-04T05:38:46.033813+0000","last_became_active":"2023-12-04T05:38:29.361714+0000","last_became_peered":"2023-12-04T05:38:29.361714+0000","last_unstale":"2023-12-04T05:38:46.033813+0000","last_undegraded":"2023-12-04T05:38:46.033813+0000","last_fullsized":"2023-12-04T05:38:46.033813+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:51.063339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041489+0000","last_change":"2023-12-04T05:38:47.040804+0000","last_active":"2023-12-04T05:38:48.041489+0000","last_peered":"2023-12-04T05:38:48.041489+0000","last_clean":"2023-12-04T05:38:48.041489+0000","last_became_active":"2023-12-04T05:38:47.040358+0000","last_became_peered":"2023-12-04T05:38:47.040358+0000","last_unstale":"2023-12-04T05:38:48.041489+0000","last_undegraded":"2023-12-04T05:38:48.041489+0000","last_fullsized":"2023-12-04T05:38:48.041489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:42.020777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039899+0000","last_change":"2023-12-04T05:38:29.361452+0000","last_active":"2023-12-04T05:38:46.039899+0000","last_peered":"2023-12-04T05:38:46.039899+0000","last_clean":"2023-12-04T05:38:46.039899+0000","last_became_active":"2023-12-04T05:38:29.361006+0000","last_became_peered":"2023-12-04T05:38:29.361006+0000","last_unstale":"2023-12-04T05:38:46.039899+0000","last_undegraded":"2023-12-04T05:38:46.039899+0000","last_fullsized":"2023-12-04T05:38:46.039899+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041521+0000","last_change":"2023-12-04T05:38:47.053495+0000","last_active":"2023-12-04T05:38:48.041521+0000","last_peered":"2023-12-04T05:38:48.041521+0000","last_clean":"2023-12-04T05:38:48.041521+0000","last_became_active":"2023-12-04T05:38:47.053200+0000","last_became_peered":"2023-12-04T05:38:47.053200+0000","last_unstale":"2023-12-04T05:38:48.041521+0000","last_undegraded":"2023-12-04T05:38:48.041521+0000","last_fullsized":"2023-12-04T05:38:48.041521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:51.355834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034739+0000","last_change":"2023-12-04T05:38:29.347468+0000","last_active":"2023-12-04T05:38:46.034739+0000","last_peered":"2023-12-04T05:38:46.034739+0000","last_clean":"2023-12-04T05:38:46.034739+0000","last_became_active":"2023-12-04T05:38:29.347197+0000","last_became_peered":"2023-12-04T05:38:29.347197+0000","last_unstale":"2023-12-04T05:38:46.034739+0000","last_undegraded":"2023-12-04T05:38:46.034739+0000","last_fullsized":"2023-12-04T05:38:46.034739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053403+0000","last_change":"2023-12-04T05:38:47.051437+0000","last_active":"2023-12-04T05:38:47.053403+0000","last_peered":"2023-12-04T05:38:47.053403+0000","last_clean":"2023-12-04T05:38:47.053403+0000","last_became_active":"2023-12-04T05:38:47.051043+0000","last_became_peered":"2023-12-04T05:38:47.051043+0000","last_unstale":"2023-12-04T05:38:47.053403+0000","last_undegraded":"2023-12-04T05:38:47.053403+0000","last_fullsized":"2023-12-04T05:38:47.053403+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:51.355834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033181+0000","last_change":"2023-12-04T05:38:29.356542+0000","last_active":"2023-12-04T05:38:46.033181+0000","last_peered":"2023-12-04T05:38:46.033181+0000","last_clean":"2023-12-04T05:38:46.033181+0000","last_became_active":"2023-12-04T05:38:29.356279+0000","last_became_peered":"2023-12-04T05:38:29.356279+0000","last_unstale":"2023-12-04T05:38:46.033181+0000","last_undegraded":"2023-12-04T05:38:46.033181+0000","last_fullsized":"2023-12-04T05:38:46.033181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:24:36.475992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.058703+0000","last_change":"2023-12-04T05:38:47.051333+0000","last_active":"2023-12-04T05:38:47.058703+0000","last_peered":"2023-12-04T05:38:47.058703+0000","last_clean":"2023-12-04T05:38:47.058703+0000","last_became_active":"2023-12-04T05:38:47.051032+0000","last_became_peered":"2023-12-04T05:38:47.051032+0000","last_unstale":"2023-12-04T05:38:47.058703+0000","last_undegraded":"2023-12-04T05:38:47.058703+0000","last_fullsized":"2023-12-04T05:38:47.058703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:50.832106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040224+0000","last_change":"2023-12-04T05:38:29.357772+0000","last_active":"2023-12-04T05:38:46.040224+0000","last_peered":"2023-12-04T05:38:46.040224+0000","last_clean":"2023-12-04T05:38:46.040224+0000","last_became_active":"2023-12-04T05:38:29.357471+0000","last_became_peered":"2023-12-04T05:38:29.357471+0000","last_unstale":"2023-12-04T05:38:46.040224+0000","last_undegraded":"2023-12-04T05:38:46.040224+0000","last_fullsized":"2023-12-04T05:38:46.040224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:00.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.054797+0000","last_change":"2023-12-04T05:38:47.049823+0000","last_active":"2023-12-04T05:38:47.054797+0000","last_peered":"2023-12-04T05:38:47.054797+0000","last_clean":"2023-12-04T05:38:47.054797+0000","last_became_active":"2023-12-04T05:38:47.049366+0000","last_became_peered":"2023-12-04T05:38:47.049366+0000","last_unstale":"2023-12-04T05:38:47.054797+0000","last_undegraded":"2023-12-04T05:38:47.054797+0000","last_fullsized":"2023-12-04T05:38:47.054797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:35.574285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.035579+0000","last_change":"2023-12-04T05:38:29.369540+0000","last_active":"2023-12-04T05:38:47.035579+0000","last_peered":"2023-12-04T05:38:47.035579+0000","last_clean":"2023-12-04T05:38:47.035579+0000","last_became_active":"2023-12-04T05:38:29.369243+0000","last_became_peered":"2023-12-04T05:38:29.369243+0000","last_unstale":"2023-12-04T05:38:47.035579+0000","last_undegraded":"2023-12-04T05:38:47.035579+0000","last_fullsized":"2023-12-04T05:38:47.035579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063120+0000","last_change":"2023-12-04T05:38:47.051949+0000","last_active":"2023-12-04T05:38:47.063120+0000","last_peered":"2023-12-04T05:38:47.063120+0000","last_clean":"2023-12-04T05:38:47.063120+0000","last_became_active":"2023-12-04T05:38:47.051654+0000","last_became_peered":"2023-12-04T05:38:47.051654+0000","last_unstale":"2023-12-04T05:38:47.063120+0000","last_undegraded":"2023-12-04T05:38:47.063120+0000","last_fullsized":"2023-12-04T05:38:47.063120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:35.003631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.031131+0000","last_change":"2023-12-04T05:38:29.351869+0000","last_active":"2023-12-04T05:38:46.031131+0000","last_peered":"2023-12-04T05:38:46.031131+0000","last_clean":"2023-12-04T05:38:46.031131+0000","last_became_active":"2023-12-04T05:38:29.350826+0000","last_became_peered":"2023-12-04T05:38:29.350826+0000","last_unstale":"2023-12-04T05:38:46.031131+0000","last_undegraded":"2023-12-04T05:38:46.031131+0000","last_fullsized":"2023-12-04T05:38:46.031131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:12.441421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.062995+0000","last_change":"2023-12-04T05:38:47.055160+0000","last_active":"2023-12-04T05:38:47.062995+0000","last_peered":"2023-12-04T05:38:47.062995+0000","last_clean":"2023-12-04T05:38:47.062995+0000","last_became_active":"2023-12-04T05:38:47.054566+0000","last_became_peered":"2023-12-04T05:38:47.054566+0000","last_unstale":"2023-12-04T05:38:47.062995+0000","last_undegraded":"2023-12-04T05:38:47.062995+0000","last_fullsized":"2023-12-04T05:38:47.062995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032345+0000","last_change":"2023-12-04T05:38:29.346210+0000","last_active":"2023-12-04T05:38:46.032345+0000","last_peered":"2023-12-04T05:38:46.032345+0000","last_clean":"2023-12-04T05:38:46.032345+0000","last_became_active":"2023-12-04T05:38:29.345870+0000","last_became_peered":"2023-12-04T05:38:29.345870+0000","last_unstale":"2023-12-04T05:38:46.032345+0000","last_undegraded":"2023-12-04T05:38:46.032345+0000","last_fullsized":"2023-12-04T05:38:46.032345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055289+0000","last_change":"2023-12-04T05:38:47.051346+0000","last_active":"2023-12-04T05:38:47.055289+0000","last_peered":"2023-12-04T05:38:47.055289+0000","last_clean":"2023-12-04T05:38:47.055289+0000","last_became_active":"2023-12-04T05:38:47.051089+0000","last_became_peered":"2023-12-04T05:38:47.051089+0000","last_unstale":"2023-12-04T05:38:47.055289+0000","last_undegraded":"2023-12-04T05:38:47.055289+0000","last_fullsized":"2023-12-04T05:38:47.055289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:46.703908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042039+0000","last_change":"2023-12-04T05:38:46.034627+0000","last_active":"2023-12-04T05:38:48.042039+0000","last_peered":"2023-12-04T05:38:48.042039+0000","last_clean":"2023-12-04T05:38:48.042039+0000","last_became_active":"2023-12-04T05:38:46.034332+0000","last_became_peered":"2023-12-04T05:38:46.034332+0000","last_unstale":"2023-12-04T05:38:48.042039+0000","last_undegraded":"2023-12-04T05:38:48.042039+0000","last_fullsized":"2023-12-04T05:38:48.042039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:45.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035543+0000","last_change":"2023-12-04T05:38:29.358811+0000","last_active":"2023-12-04T05:38:46.035543+0000","last_peered":"2023-12-04T05:38:46.035543+0000","last_clean":"2023-12-04T05:38:46.035543+0000","last_became_active":"2023-12-04T05:38:29.358559+0000","last_became_peered":"2023-12-04T05:38:29.358559+0000","last_unstale":"2023-12-04T05:38:46.035543+0000","last_undegraded":"2023-12-04T05:38:46.035543+0000","last_fullsized":"2023-12-04T05:38:46.035543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:40.775232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034920+0000","last_change":"2023-12-04T05:38:28.357084+0000","last_active":"2023-12-04T05:38:46.034920+0000","last_peered":"2023-12-04T05:38:46.034920+0000","last_clean":"2023-12-04T05:38:46.034920+0000","last_became_active":"2023-12-04T05:38:28.356727+0000","last_became_peered":"2023-12-04T05:38:28.356727+0000","last_unstale":"2023-12-04T05:38:46.034920+0000","last_undegraded":"2023-12-04T05:38:46.034920+0000","last_fullsized":"2023-12-04T05:38:46.034920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:17.923080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042023+0000","last_change":"2023-12-04T05:38:47.051546+0000","last_active":"2023-12-04T05:38:48.042023+0000","last_peered":"2023-12-04T05:38:48.042023+0000","last_clean":"2023-12-04T05:38:48.042023+0000","last_became_active":"2023-12-04T05:38:47.050899+0000","last_became_peered":"2023-12-04T05:38:47.050899+0000","last_unstale":"2023-12-04T05:38:48.042023+0000","last_undegraded":"2023-12-04T05:38:48.042023+0000","last_fullsized":"2023-12-04T05:38:48.042023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:19:24.832207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066286+0000","last_change":"2023-12-04T05:38:46.037437+0000","last_active":"2023-12-04T05:38:47.066286+0000","last_peered":"2023-12-04T05:38:47.066286+0000","last_clean":"2023-12-04T05:38:47.066286+0000","last_became_active":"2023-12-04T05:38:46.037063+0000","last_became_peered":"2023-12-04T05:38:46.037063+0000","last_unstale":"2023-12-04T05:38:47.066286+0000","last_undegraded":"2023-12-04T05:38:47.066286+0000","last_fullsized":"2023-12-04T05:38:47.066286+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:49.207656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024494+0000","last_change":"2023-12-04T05:38:29.362758+0000","last_active":"2023-12-04T05:38:47.024494+0000","last_peered":"2023-12-04T05:38:47.024494+0000","last_clean":"2023-12-04T05:38:47.024494+0000","last_became_active":"2023-12-04T05:38:29.362402+0000","last_became_peered":"2023-12-04T05:38:29.362402+0000","last_unstale":"2023-12-04T05:38:47.024494+0000","last_undegraded":"2023-12-04T05:38:47.024494+0000","last_fullsized":"2023-12-04T05:38:47.024494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:19.743112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044488+0000","last_change":"2023-12-04T05:38:28.347627+0000","last_active":"2023-12-04T05:38:46.044488+0000","last_peered":"2023-12-04T05:38:46.044488+0000","last_clean":"2023-12-04T05:38:46.044488+0000","last_became_active":"2023-12-04T05:38:28.345941+0000","last_became_peered":"2023-12-04T05:38:28.345941+0000","last_unstale":"2023-12-04T05:38:46.044488+0000","last_undegraded":"2023-12-04T05:38:46.044488+0000","last_fullsized":"2023-12-04T05:38:46.044488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:48.649051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041761+0000","last_change":"2023-12-04T05:38:47.061488+0000","last_active":"2023-12-04T05:38:48.041761+0000","last_peered":"2023-12-04T05:38:48.041761+0000","last_clean":"2023-12-04T05:38:48.041761+0000","last_became_active":"2023-12-04T05:38:47.056015+0000","last_became_peered":"2023-12-04T05:38:47.056015+0000","last_unstale":"2023-12-04T05:38:48.041761+0000","last_undegraded":"2023-12-04T05:38:48.041761+0000","last_fullsized":"2023-12-04T05:38:48.041761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:48:13.519500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040784+0000","last_change":"2023-12-04T05:38:46.050132+0000","last_active":"2023-12-04T05:38:48.040784+0000","last_peered":"2023-12-04T05:38:48.040784+0000","last_clean":"2023-12-04T05:38:48.040784+0000","last_became_active":"2023-12-04T05:38:46.049780+0000","last_became_peered":"2023-12-04T05:38:46.049780+0000","last_unstale":"2023-12-04T05:38:48.040784+0000","last_undegraded":"2023-12-04T05:38:48.040784+0000","last_fullsized":"2023-12-04T05:38:48.040784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:40.176030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033048+0000","last_change":"2023-12-04T05:38:29.360274+0000","last_active":"2023-12-04T05:38:46.033048+0000","last_peered":"2023-12-04T05:38:46.033048+0000","last_clean":"2023-12-04T05:38:46.033048+0000","last_became_active":"2023-12-04T05:38:29.359956+0000","last_became_peered":"2023-12-04T05:38:29.359956+0000","last_unstale":"2023-12-04T05:38:46.033048+0000","last_undegraded":"2023-12-04T05:38:46.033048+0000","last_fullsized":"2023-12-04T05:38:46.033048+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035098+0000","last_change":"2023-12-04T05:38:28.353084+0000","last_active":"2023-12-04T05:38:46.035098+0000","last_peered":"2023-12-04T05:38:46.035098+0000","last_clean":"2023-12-04T05:38:46.035098+0000","last_became_active":"2023-12-04T05:38:28.351122+0000","last_became_peered":"2023-12-04T05:38:28.351122+0000","last_unstale":"2023-12-04T05:38:46.035098+0000","last_undegraded":"2023-12-04T05:38:46.035098+0000","last_fullsized":"2023-12-04T05:38:46.035098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:42.125435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053426+0000","last_change":"2023-12-04T05:38:47.048355+0000","last_active":"2023-12-04T05:38:47.053426+0000","last_peered":"2023-12-04T05:38:47.053426+0000","last_clean":"2023-12-04T05:38:47.053426+0000","last_became_active":"2023-12-04T05:38:47.047130+0000","last_became_peered":"2023-12-04T05:38:47.047130+0000","last_unstale":"2023-12-04T05:38:47.053426+0000","last_undegraded":"2023-12-04T05:38:47.053426+0000","last_fullsized":"2023-12-04T05:38:47.053426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:38.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061176+0000","last_change":"2023-12-04T05:38:46.044400+0000","last_active":"2023-12-04T05:38:47.061176+0000","last_peered":"2023-12-04T05:38:47.061176+0000","last_clean":"2023-12-04T05:38:47.061176+0000","last_became_active":"2023-12-04T05:38:46.044069+0000","last_became_peered":"2023-12-04T05:38:46.044069+0000","last_unstale":"2023-12-04T05:38:47.061176+0000","last_undegraded":"2023-12-04T05:38:47.061176+0000","last_fullsized":"2023-12-04T05:38:47.061176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:33.968744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034918+0000","last_change":"2023-12-04T05:38:29.358876+0000","last_active":"2023-12-04T05:38:46.034918+0000","last_peered":"2023-12-04T05:38:46.034918+0000","last_clean":"2023-12-04T05:38:46.034918+0000","last_became_active":"2023-12-04T05:38:29.358607+0000","last_became_peered":"2023-12-04T05:38:29.358607+0000","last_unstale":"2023-12-04T05:38:46.034918+0000","last_undegraded":"2023-12-04T05:38:46.034918+0000","last_fullsized":"2023-12-04T05:38:46.034918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:49.658316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038059+0000","last_change":"2023-12-04T05:38:28.355795+0000","last_active":"2023-12-04T05:38:46.038059+0000","last_peered":"2023-12-04T05:38:46.038059+0000","last_clean":"2023-12-04T05:38:46.038059+0000","last_became_active":"2023-12-04T05:38:28.355356+0000","last_became_peered":"2023-12-04T05:38:28.355356+0000","last_unstale":"2023-12-04T05:38:46.038059+0000","last_undegraded":"2023-12-04T05:38:46.038059+0000","last_fullsized":"2023-12-04T05:38:46.038059+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:07.408506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045395+0000","last_change":"2023-12-04T05:38:47.037770+0000","last_active":"2023-12-04T05:38:47.045395+0000","last_peered":"2023-12-04T05:38:47.045395+0000","last_clean":"2023-12-04T05:38:47.045395+0000","last_became_active":"2023-12-04T05:38:47.037518+0000","last_became_peered":"2023-12-04T05:38:47.037518+0000","last_unstale":"2023-12-04T05:38:47.045395+0000","last_undegraded":"2023-12-04T05:38:47.045395+0000","last_fullsized":"2023-12-04T05:38:47.045395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:48:31.468352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041794+0000","last_change":"2023-12-04T05:38:46.040492+0000","last_active":"2023-12-04T05:38:48.041794+0000","last_peered":"2023-12-04T05:38:48.041794+0000","last_clean":"2023-12-04T05:38:48.041794+0000","last_became_active":"2023-12-04T05:38:46.036670+0000","last_became_peered":"2023-12-04T05:38:46.036670+0000","last_unstale":"2023-12-04T05:38:48.041794+0000","last_undegraded":"2023-12-04T05:38:48.041794+0000","last_fullsized":"2023-12-04T05:38:48.041794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:25.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038414+0000","last_change":"2023-12-04T05:38:29.355352+0000","last_active":"2023-12-04T05:38:46.038414+0000","last_peered":"2023-12-04T05:38:46.038414+0000","last_clean":"2023-12-04T05:38:46.038414+0000","last_became_active":"2023-12-04T05:38:29.353176+0000","last_became_peered":"2023-12-04T05:38:29.353176+0000","last_unstale":"2023-12-04T05:38:46.038414+0000","last_undegraded":"2023-12-04T05:38:46.038414+0000","last_fullsized":"2023-12-04T05:38:46.038414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:07:18.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027155+0000","last_change":"2023-12-04T05:38:28.351077+0000","last_active":"2023-12-04T05:38:47.027155+0000","last_peered":"2023-12-04T05:38:47.027155+0000","last_clean":"2023-12-04T05:38:47.027155+0000","last_became_active":"2023-12-04T05:38:28.350462+0000","last_became_peered":"2023-12-04T05:38:28.350462+0000","last_unstale":"2023-12-04T05:38:47.027155+0000","last_undegraded":"2023-12-04T05:38:47.027155+0000","last_fullsized":"2023-12-04T05:38:47.027155+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:19.679953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045629+0000","last_change":"2023-12-04T05:38:47.042523+0000","last_active":"2023-12-04T05:38:47.045629+0000","last_peered":"2023-12-04T05:38:47.045629+0000","last_clean":"2023-12-04T05:38:47.045629+0000","last_became_active":"2023-12-04T05:38:47.042259+0000","last_became_peered":"2023-12-04T05:38:47.042259+0000","last_unstale":"2023-12-04T05:38:47.045629+0000","last_undegraded":"2023-12-04T05:38:47.045629+0000","last_fullsized":"2023-12-04T05:38:47.045629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:24.041071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.032381+0000","last_change":"2023-12-04T05:38:46.037672+0000","last_active":"2023-12-04T05:38:47.032381+0000","last_peered":"2023-12-04T05:38:47.032381+0000","last_clean":"2023-12-04T05:38:47.032381+0000","last_became_active":"2023-12-04T05:38:46.037415+0000","last_became_peered":"2023-12-04T05:38:46.037415+0000","last_unstale":"2023-12-04T05:38:47.032381+0000","last_undegraded":"2023-12-04T05:38:47.032381+0000","last_fullsized":"2023-12-04T05:38:47.032381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:12.134853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039986+0000","last_change":"2023-12-04T05:38:29.345510+0000","last_active":"2023-12-04T05:38:46.039986+0000","last_peered":"2023-12-04T05:38:46.039986+0000","last_clean":"2023-12-04T05:38:46.039986+0000","last_became_active":"2023-12-04T05:38:29.345223+0000","last_became_peered":"2023-12-04T05:38:29.345223+0000","last_unstale":"2023-12-04T05:38:46.039986+0000","last_undegraded":"2023-12-04T05:38:46.039986+0000","last_fullsized":"2023-12-04T05:38:46.039986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:04.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032564+0000","last_change":"2023-12-04T05:38:28.351389+0000","last_active":"2023-12-04T05:38:46.032564+0000","last_peered":"2023-12-04T05:38:46.032564+0000","last_clean":"2023-12-04T05:38:46.032564+0000","last_became_active":"2023-12-04T05:38:28.350142+0000","last_became_peered":"2023-12-04T05:38:28.350142+0000","last_unstale":"2023-12-04T05:38:46.032564+0000","last_undegraded":"2023-12-04T05:38:46.032564+0000","last_fullsized":"2023-12-04T05:38:46.032564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:54.935662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.062975+0000","last_change":"2023-12-04T05:38:47.054975+0000","last_active":"2023-12-04T05:38:47.062975+0000","last_peered":"2023-12-04T05:38:47.062975+0000","last_clean":"2023-12-04T05:38:47.062975+0000","last_became_active":"2023-12-04T05:38:47.054131+0000","last_became_peered":"2023-12-04T05:38:47.054131+0000","last_unstale":"2023-12-04T05:38:47.062975+0000","last_undegraded":"2023-12-04T05:38:47.062975+0000","last_fullsized":"2023-12-04T05:38:47.062975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064791+0000","last_change":"2023-12-04T05:38:46.046456+0000","last_active":"2023-12-04T05:38:47.064791+0000","last_peered":"2023-12-04T05:38:47.064791+0000","last_clean":"2023-12-04T05:38:47.064791+0000","last_became_active":"2023-12-04T05:38:46.046137+0000","last_became_peered":"2023-12-04T05:38:46.046137+0000","last_unstale":"2023-12-04T05:38:47.064791+0000","last_undegraded":"2023-12-04T05:38:47.064791+0000","last_fullsized":"2023-12-04T05:38:47.064791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:44:39.342161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029098+0000","last_change":"2023-12-04T05:38:29.360246+0000","last_active":"2023-12-04T05:38:46.029098+0000","last_peered":"2023-12-04T05:38:46.029098+0000","last_clean":"2023-12-04T05:38:46.029098+0000","last_became_active":"2023-12-04T05:38:29.359538+0000","last_became_peered":"2023-12-04T05:38:29.359538+0000","last_unstale":"2023-12-04T05:38:46.029098+0000","last_undegraded":"2023-12-04T05:38:46.029098+0000","last_fullsized":"2023-12-04T05:38:46.029098+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:07.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034712+0000","last_change":"2023-12-04T05:38:28.350133+0000","last_active":"2023-12-04T05:38:46.034712+0000","last_peered":"2023-12-04T05:38:46.034712+0000","last_clean":"2023-12-04T05:38:46.034712+0000","last_became_active":"2023-12-04T05:38:28.349752+0000","last_became_peered":"2023-12-04T05:38:28.349752+0000","last_unstale":"2023-12-04T05:38:46.034712+0000","last_undegraded":"2023-12-04T05:38:46.034712+0000","last_fullsized":"2023-12-04T05:38:46.034712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:16.876613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041491+0000","last_change":"2023-12-04T05:38:47.043757+0000","last_active":"2023-12-04T05:38:48.041491+0000","last_peered":"2023-12-04T05:38:48.041491+0000","last_clean":"2023-12-04T05:38:48.041491+0000","last_became_active":"2023-12-04T05:38:47.042236+0000","last_became_peered":"2023-12-04T05:38:47.042236+0000","last_unstale":"2023-12-04T05:38:48.041491+0000","last_undegraded":"2023-12-04T05:38:48.041491+0000","last_fullsized":"2023-12-04T05:38:48.041491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:39:55.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066254+0000","last_change":"2023-12-04T05:38:46.038491+0000","last_active":"2023-12-04T05:38:47.066254+0000","last_peered":"2023-12-04T05:38:47.066254+0000","last_clean":"2023-12-04T05:38:47.066254+0000","last_became_active":"2023-12-04T05:38:46.038160+0000","last_became_peered":"2023-12-04T05:38:46.038160+0000","last_unstale":"2023-12-04T05:38:47.066254+0000","last_undegraded":"2023-12-04T05:38:47.066254+0000","last_fullsized":"2023-12-04T05:38:47.066254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:59.814941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038299+0000","last_change":"2023-12-04T05:38:29.349000+0000","last_active":"2023-12-04T05:38:46.038299+0000","last_peered":"2023-12-04T05:38:46.038299+0000","last_clean":"2023-12-04T05:38:46.038299+0000","last_became_active":"2023-12-04T05:38:29.348695+0000","last_became_peered":"2023-12-04T05:38:29.348695+0000","last_unstale":"2023-12-04T05:38:46.038299+0000","last_undegraded":"2023-12-04T05:38:46.038299+0000","last_fullsized":"2023-12-04T05:38:46.038299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:06.352663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024724+0000","last_change":"2023-12-04T05:38:28.350256+0000","last_active":"2023-12-04T05:38:47.024724+0000","last_peered":"2023-12-04T05:38:47.024724+0000","last_clean":"2023-12-04T05:38:47.024724+0000","last_became_active":"2023-12-04T05:38:28.349886+0000","last_became_peered":"2023-12-04T05:38:28.349886+0000","last_unstale":"2023-12-04T05:38:47.024724+0000","last_undegraded":"2023-12-04T05:38:47.024724+0000","last_fullsized":"2023-12-04T05:38:47.024724+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:35.559263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.042326+0000","last_change":"2023-12-04T05:38:47.033266+0000","last_active":"2023-12-04T05:38:47.042326+0000","last_peered":"2023-12-04T05:38:47.042326+0000","last_clean":"2023-12-04T05:38:47.042326+0000","last_became_active":"2023-12-04T05:38:47.032751+0000","last_became_peered":"2023-12-04T05:38:47.032751+0000","last_unstale":"2023-12-04T05:38:47.042326+0000","last_undegraded":"2023-12-04T05:38:47.042326+0000","last_fullsized":"2023-12-04T05:38:47.042326+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:44.419223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067104+0000","last_change":"2023-12-04T05:38:46.044154+0000","last_active":"2023-12-04T05:38:47.067104+0000","last_peered":"2023-12-04T05:38:47.067104+0000","last_clean":"2023-12-04T05:38:47.067104+0000","last_became_active":"2023-12-04T05:38:46.043802+0000","last_became_peered":"2023-12-04T05:38:46.043802+0000","last_unstale":"2023-12-04T05:38:47.067104+0000","last_undegraded":"2023-12-04T05:38:47.067104+0000","last_fullsized":"2023-12-04T05:38:47.067104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:09.033091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026323+0000","last_change":"2023-12-04T05:38:29.358064+0000","last_active":"2023-12-04T05:38:47.026323+0000","last_peered":"2023-12-04T05:38:47.026323+0000","last_clean":"2023-12-04T05:38:47.026323+0000","last_became_active":"2023-12-04T05:38:29.357794+0000","last_became_peered":"2023-12-04T05:38:29.357794+0000","last_unstale":"2023-12-04T05:38:47.026323+0000","last_undegraded":"2023-12-04T05:38:47.026323+0000","last_fullsized":"2023-12-04T05:38:47.026323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:18.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041326+0000","last_change":"2023-12-04T05:38:28.359951+0000","last_active":"2023-12-04T05:38:47.041326+0000","last_peered":"2023-12-04T05:38:47.041326+0000","last_clean":"2023-12-04T05:38:47.041326+0000","last_became_active":"2023-12-04T05:38:28.359676+0000","last_became_peered":"2023-12-04T05:38:28.359676+0000","last_unstale":"2023-12-04T05:38:47.041326+0000","last_undegraded":"2023-12-04T05:38:47.041326+0000","last_fullsized":"2023-12-04T05:38:47.041326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045136+0000","last_change":"2023-12-04T05:38:47.035979+0000","last_active":"2023-12-04T05:38:47.045136+0000","last_peered":"2023-12-04T05:38:47.045136+0000","last_clean":"2023-12-04T05:38:47.045136+0000","last_became_active":"2023-12-04T05:38:47.035700+0000","last_became_peered":"2023-12-04T05:38:47.035700+0000","last_unstale":"2023-12-04T05:38:47.045136+0000","last_undegraded":"2023-12-04T05:38:47.045136+0000","last_fullsized":"2023-12-04T05:38:47.045136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:47:13.960013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042581+0000","last_change":"2023-12-04T05:38:46.042225+0000","last_active":"2023-12-04T05:38:48.042581+0000","last_peered":"2023-12-04T05:38:48.042581+0000","last_clean":"2023-12-04T05:38:48.042581+0000","last_became_active":"2023-12-04T05:38:46.041921+0000","last_became_peered":"2023-12-04T05:38:46.041921+0000","last_unstale":"2023-12-04T05:38:48.042581+0000","last_undegraded":"2023-12-04T05:38:48.042581+0000","last_fullsized":"2023-12-04T05:38:48.042581+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:59.490141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040028+0000","last_change":"2023-12-04T05:38:29.367074+0000","last_active":"2023-12-04T05:38:47.040028+0000","last_peered":"2023-12-04T05:38:47.040028+0000","last_clean":"2023-12-04T05:38:47.040028+0000","last_became_active":"2023-12-04T05:38:29.366753+0000","last_became_peered":"2023-12-04T05:38:29.366753+0000","last_unstale":"2023-12-04T05:38:47.040028+0000","last_undegraded":"2023-12-04T05:38:47.040028+0000","last_fullsized":"2023-12-04T05:38:47.040028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044558+0000","last_change":"2023-12-04T05:38:28.356218+0000","last_active":"2023-12-04T05:38:46.044558+0000","last_peered":"2023-12-04T05:38:46.044558+0000","last_clean":"2023-12-04T05:38:46.044558+0000","last_became_active":"2023-12-04T05:38:28.355927+0000","last_became_peered":"2023-12-04T05:38:28.355927+0000","last_unstale":"2023-12-04T05:38:46.044558+0000","last_undegraded":"2023-12-04T05:38:46.044558+0000","last_fullsized":"2023-12-04T05:38:46.044558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:20.717537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064616+0000","last_change":"2023-12-04T05:38:47.061615+0000","last_active":"2023-12-04T05:38:47.064616+0000","last_peered":"2023-12-04T05:38:47.064616+0000","last_clean":"2023-12-04T05:38:47.064616+0000","last_became_active":"2023-12-04T05:38:47.061165+0000","last_became_peered":"2023-12-04T05:38:47.061165+0000","last_unstale":"2023-12-04T05:38:47.064616+0000","last_undegraded":"2023-12-04T05:38:47.064616+0000","last_fullsized":"2023-12-04T05:38:47.064616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:46:58.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041637+0000","last_change":"2023-12-04T05:38:46.044759+0000","last_active":"2023-12-04T05:38:48.041637+0000","last_peered":"2023-12-04T05:38:48.041637+0000","last_clean":"2023-12-04T05:38:48.041637+0000","last_became_active":"2023-12-04T05:38:46.044538+0000","last_became_peered":"2023-12-04T05:38:46.044538+0000","last_unstale":"2023-12-04T05:38:48.041637+0000","last_undegraded":"2023-12-04T05:38:48.041637+0000","last_fullsized":"2023-12-04T05:38:48.041637+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:49.207656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023906+0000","last_change":"2023-12-04T05:38:29.354032+0000","last_active":"2023-12-04T05:38:47.023906+0000","last_peered":"2023-12-04T05:38:47.023906+0000","last_clean":"2023-12-04T05:38:47.023906+0000","last_became_active":"2023-12-04T05:38:29.353619+0000","last_became_peered":"2023-12-04T05:38:29.353619+0000","last_unstale":"2023-12-04T05:38:47.023906+0000","last_undegraded":"2023-12-04T05:38:47.023906+0000","last_fullsized":"2023-12-04T05:38:47.023906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:05:21.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036632+0000","last_change":"2023-12-04T05:38:28.362801+0000","last_active":"2023-12-04T05:38:47.036632+0000","last_peered":"2023-12-04T05:38:47.036632+0000","last_clean":"2023-12-04T05:38:47.036632+0000","last_became_active":"2023-12-04T05:38:28.362494+0000","last_became_peered":"2023-12-04T05:38:28.362494+0000","last_unstale":"2023-12-04T05:38:47.036632+0000","last_undegraded":"2023-12-04T05:38:47.036632+0000","last_fullsized":"2023-12-04T05:38:47.036632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:17.678250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040686+0000","last_change":"2023-12-04T05:38:47.055571+0000","last_active":"2023-12-04T05:38:48.040686+0000","last_peered":"2023-12-04T05:38:48.040686+0000","last_clean":"2023-12-04T05:38:48.040686+0000","last_became_active":"2023-12-04T05:38:47.055305+0000","last_became_peered":"2023-12-04T05:38:47.055305+0000","last_unstale":"2023-12-04T05:38:48.040686+0000","last_undegraded":"2023-12-04T05:38:48.040686+0000","last_fullsized":"2023-12-04T05:38:48.040686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:57.127190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027416+0000","last_change":"2023-12-04T05:38:46.045108+0000","last_active":"2023-12-04T05:38:47.027416+0000","last_peered":"2023-12-04T05:38:47.027416+0000","last_clean":"2023-12-04T05:38:47.027416+0000","last_became_active":"2023-12-04T05:38:46.044842+0000","last_became_peered":"2023-12-04T05:38:46.044842+0000","last_unstale":"2023-12-04T05:38:47.027416+0000","last_undegraded":"2023-12-04T05:38:47.027416+0000","last_fullsized":"2023-12-04T05:38:47.027416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:33.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036433+0000","last_change":"2023-12-04T05:38:29.365812+0000","last_active":"2023-12-04T05:38:47.036433+0000","last_peered":"2023-12-04T05:38:47.036433+0000","last_clean":"2023-12-04T05:38:47.036433+0000","last_became_active":"2023-12-04T05:38:29.365171+0000","last_became_peered":"2023-12-04T05:38:29.365171+0000","last_unstale":"2023-12-04T05:38:47.036433+0000","last_undegraded":"2023-12-04T05:38:47.036433+0000","last_fullsized":"2023-12-04T05:38:47.036433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027978+0000","last_change":"2023-12-04T05:38:28.352009+0000","last_active":"2023-12-04T05:38:47.027978+0000","last_peered":"2023-12-04T05:38:47.027978+0000","last_clean":"2023-12-04T05:38:47.027978+0000","last_became_active":"2023-12-04T05:38:28.351727+0000","last_became_peered":"2023-12-04T05:38:28.351727+0000","last_unstale":"2023-12-04T05:38:47.027978+0000","last_undegraded":"2023-12-04T05:38:47.027978+0000","last_fullsized":"2023-12-04T05:38:47.027978+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:18.733847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045905+0000","last_change":"2023-12-04T05:38:47.041576+0000","last_active":"2023-12-04T05:38:47.045905+0000","last_peered":"2023-12-04T05:38:47.045905+0000","last_clean":"2023-12-04T05:38:47.045905+0000","last_became_active":"2023-12-04T05:38:47.041118+0000","last_became_peered":"2023-12-04T05:38:47.041118+0000","last_unstale":"2023-12-04T05:38:47.045905+0000","last_undegraded":"2023-12-04T05:38:47.045905+0000","last_fullsized":"2023-12-04T05:38:47.045905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045902+0000","last_change":"2023-12-04T05:38:46.048790+0000","last_active":"2023-12-04T05:38:47.045902+0000","last_peered":"2023-12-04T05:38:47.045902+0000","last_clean":"2023-12-04T05:38:47.045902+0000","last_became_active":"2023-12-04T05:38:46.048353+0000","last_became_peered":"2023-12-04T05:38:46.048353+0000","last_unstale":"2023-12-04T05:38:47.045902+0000","last_undegraded":"2023-12-04T05:38:47.045902+0000","last_fullsized":"2023-12-04T05:38:47.045902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:39:54.714560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037662+0000","last_change":"2023-12-04T05:38:29.359861+0000","last_active":"2023-12-04T05:38:46.037662+0000","last_peered":"2023-12-04T05:38:46.037662+0000","last_clean":"2023-12-04T05:38:46.037662+0000","last_became_active":"2023-12-04T05:38:29.359381+0000","last_became_peered":"2023-12-04T05:38:29.359381+0000","last_unstale":"2023-12-04T05:38:46.037662+0000","last_undegraded":"2023-12-04T05:38:46.037662+0000","last_fullsized":"2023-12-04T05:38:46.037662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040134+0000","last_change":"2023-12-04T05:38:28.358003+0000","last_active":"2023-12-04T05:38:46.040134+0000","last_peered":"2023-12-04T05:38:46.040134+0000","last_clean":"2023-12-04T05:38:46.040134+0000","last_became_active":"2023-12-04T05:38:28.357687+0000","last_became_peered":"2023-12-04T05:38:28.357687+0000","last_unstale":"2023-12-04T05:38:46.040134+0000","last_undegraded":"2023-12-04T05:38:46.040134+0000","last_fullsized":"2023-12-04T05:38:46.040134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:32.658162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064602+0000","last_change":"2023-12-04T05:38:47.062271+0000","last_active":"2023-12-04T05:38:47.064602+0000","last_peered":"2023-12-04T05:38:47.064602+0000","last_clean":"2023-12-04T05:38:47.064602+0000","last_became_active":"2023-12-04T05:38:47.062056+0000","last_became_peered":"2023-12-04T05:38:47.062056+0000","last_unstale":"2023-12-04T05:38:47.064602+0000","last_undegraded":"2023-12-04T05:38:47.064602+0000","last_fullsized":"2023-12-04T05:38:47.064602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:30.862782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040759+0000","last_change":"2023-12-04T05:38:46.041214+0000","last_active":"2023-12-04T05:38:48.040759+0000","last_peered":"2023-12-04T05:38:48.040759+0000","last_clean":"2023-12-04T05:38:48.040759+0000","last_became_active":"2023-12-04T05:38:46.040199+0000","last_became_peered":"2023-12-04T05:38:46.040199+0000","last_unstale":"2023-12-04T05:38:48.040759+0000","last_undegraded":"2023-12-04T05:38:48.040759+0000","last_fullsized":"2023-12-04T05:38:48.040759+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:43.411057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038650+0000","last_change":"2023-12-04T05:38:29.366087+0000","last_active":"2023-12-04T05:38:47.038650+0000","last_peered":"2023-12-04T05:38:47.038650+0000","last_clean":"2023-12-04T05:38:47.038650+0000","last_became_active":"2023-12-04T05:38:29.365734+0000","last_became_peered":"2023-12-04T05:38:29.365734+0000","last_unstale":"2023-12-04T05:38:47.038650+0000","last_undegraded":"2023-12-04T05:38:47.038650+0000","last_fullsized":"2023-12-04T05:38:47.038650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029537+0000","last_change":"2023-12-04T05:38:28.343022+0000","last_active":"2023-12-04T05:38:46.029537+0000","last_peered":"2023-12-04T05:38:46.029537+0000","last_clean":"2023-12-04T05:38:46.029537+0000","last_became_active":"2023-12-04T05:38:28.342601+0000","last_became_peered":"2023-12-04T05:38:28.342601+0000","last_unstale":"2023-12-04T05:38:46.029537+0000","last_undegraded":"2023-12-04T05:38:46.029537+0000","last_fullsized":"2023-12-04T05:38:46.029537+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040311+0000","last_change":"2023-12-04T05:38:47.052711+0000","last_active":"2023-12-04T05:38:48.040311+0000","last_peered":"2023-12-04T05:38:48.040311+0000","last_clean":"2023-12-04T05:38:48.040311+0000","last_became_active":"2023-12-04T05:38:47.052397+0000","last_became_peered":"2023-12-04T05:38:47.052397+0000","last_unstale":"2023-12-04T05:38:48.040311+0000","last_undegraded":"2023-12-04T05:38:48.040311+0000","last_fullsized":"2023-12-04T05:38:48.040311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:46.660143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042321+0000","last_change":"2023-12-04T05:38:46.042969+0000","last_active":"2023-12-04T05:38:48.042321+0000","last_peered":"2023-12-04T05:38:48.042321+0000","last_clean":"2023-12-04T05:38:48.042321+0000","last_became_active":"2023-12-04T05:38:46.041878+0000","last_became_peered":"2023-12-04T05:38:46.041878+0000","last_unstale":"2023-12-04T05:38:48.042321+0000","last_undegraded":"2023-12-04T05:38:48.042321+0000","last_fullsized":"2023-12-04T05:38:48.042321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:59.814941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024633+0000","last_change":"2023-12-04T05:38:29.359927+0000","last_active":"2023-12-04T05:38:47.024633+0000","last_peered":"2023-12-04T05:38:47.024633+0000","last_clean":"2023-12-04T05:38:47.024633+0000","last_became_active":"2023-12-04T05:38:29.359643+0000","last_became_peered":"2023-12-04T05:38:29.359643+0000","last_unstale":"2023-12-04T05:38:47.024633+0000","last_undegraded":"2023-12-04T05:38:47.024633+0000","last_fullsized":"2023-12-04T05:38:47.024633+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:11.572404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034793+0000","last_change":"2023-12-04T05:38:28.355765+0000","last_active":"2023-12-04T05:38:46.034793+0000","last_peered":"2023-12-04T05:38:46.034793+0000","last_clean":"2023-12-04T05:38:46.034793+0000","last_became_active":"2023-12-04T05:38:28.355180+0000","last_became_peered":"2023-12-04T05:38:28.355180+0000","last_unstale":"2023-12-04T05:38:46.034793+0000","last_undegraded":"2023-12-04T05:38:46.034793+0000","last_fullsized":"2023-12-04T05:38:46.034793+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:40.049769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.050775+0000","last_change":"2023-12-04T05:38:47.045045+0000","last_active":"2023-12-04T05:38:47.050775+0000","last_peered":"2023-12-04T05:38:47.050775+0000","last_clean":"2023-12-04T05:38:47.050775+0000","last_became_active":"2023-12-04T05:38:47.044776+0000","last_became_peered":"2023-12-04T05:38:47.044776+0000","last_unstale":"2023-12-04T05:38:47.050775+0000","last_undegraded":"2023-12-04T05:38:47.050775+0000","last_fullsized":"2023-12-04T05:38:47.050775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:39.415210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024963+0000","last_change":"2023-12-04T05:38:46.041307+0000","last_active":"2023-12-04T05:38:47.024963+0000","last_peered":"2023-12-04T05:38:47.024963+0000","last_clean":"2023-12-04T05:38:47.024963+0000","last_became_active":"2023-12-04T05:38:46.041026+0000","last_became_peered":"2023-12-04T05:38:46.041026+0000","last_unstale":"2023-12-04T05:38:47.024963+0000","last_undegraded":"2023-12-04T05:38:47.024963+0000","last_fullsized":"2023-12-04T05:38:47.024963+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:59.490141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037818+0000","last_change":"2023-12-04T05:38:29.369054+0000","last_active":"2023-12-04T05:38:47.037818+0000","last_peered":"2023-12-04T05:38:47.037818+0000","last_clean":"2023-12-04T05:38:47.037818+0000","last_became_active":"2023-12-04T05:38:29.368644+0000","last_became_peered":"2023-12-04T05:38:29.368644+0000","last_unstale":"2023-12-04T05:38:47.037818+0000","last_undegraded":"2023-12-04T05:38:47.037818+0000","last_fullsized":"2023-12-04T05:38:47.037818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038030+0000","last_change":"2023-12-04T05:38:28.356435+0000","last_active":"2023-12-04T05:38:47.038030+0000","last_peered":"2023-12-04T05:38:47.038030+0000","last_clean":"2023-12-04T05:38:47.038030+0000","last_became_active":"2023-12-04T05:38:28.356110+0000","last_became_peered":"2023-12-04T05:38:28.356110+0000","last_unstale":"2023-12-04T05:38:47.038030+0000","last_undegraded":"2023-12-04T05:38:47.038030+0000","last_fullsized":"2023-12-04T05:38:47.038030+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042518+0000","last_change":"2023-12-04T05:38:47.048484+0000","last_active":"2023-12-04T05:38:48.042518+0000","last_peered":"2023-12-04T05:38:48.042518+0000","last_clean":"2023-12-04T05:38:48.042518+0000","last_became_active":"2023-12-04T05:38:47.048203+0000","last_became_peered":"2023-12-04T05:38:47.048203+0000","last_unstale":"2023-12-04T05:38:48.042518+0000","last_undegraded":"2023-12-04T05:38:48.042518+0000","last_fullsized":"2023-12-04T05:38:48.042518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:34.871324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067680+0000","last_change":"2023-12-04T05:38:46.038283+0000","last_active":"2023-12-04T05:38:47.067680+0000","last_peered":"2023-12-04T05:38:47.067680+0000","last_clean":"2023-12-04T05:38:47.067680+0000","last_became_active":"2023-12-04T05:38:46.037978+0000","last_became_peered":"2023-12-04T05:38:46.037978+0000","last_unstale":"2023-12-04T05:38:47.067680+0000","last_undegraded":"2023-12-04T05:38:47.067680+0000","last_fullsized":"2023-12-04T05:38:47.067680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:29:06.338557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038322+0000","last_change":"2023-12-04T05:38:29.370474+0000","last_active":"2023-12-04T05:38:47.038322+0000","last_peered":"2023-12-04T05:38:47.038322+0000","last_clean":"2023-12-04T05:38:47.038322+0000","last_became_active":"2023-12-04T05:38:29.369734+0000","last_became_peered":"2023-12-04T05:38:29.369734+0000","last_unstale":"2023-12-04T05:38:47.038322+0000","last_undegraded":"2023-12-04T05:38:47.038322+0000","last_fullsized":"2023-12-04T05:38:47.038322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044652+0000","last_change":"2023-12-04T05:38:28.354536+0000","last_active":"2023-12-04T05:38:46.044652+0000","last_peered":"2023-12-04T05:38:46.044652+0000","last_clean":"2023-12-04T05:38:46.044652+0000","last_became_active":"2023-12-04T05:38:28.354124+0000","last_became_peered":"2023-12-04T05:38:28.354124+0000","last_unstale":"2023-12-04T05:38:46.044652+0000","last_undegraded":"2023-12-04T05:38:46.044652+0000","last_fullsized":"2023-12-04T05:38:46.044652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:27.391838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.046736+0000","last_change":"2023-12-04T05:38:47.044133+0000","last_active":"2023-12-04T05:38:47.046736+0000","last_peered":"2023-12-04T05:38:47.046736+0000","last_clean":"2023-12-04T05:38:47.046736+0000","last_became_active":"2023-12-04T05:38:47.043879+0000","last_became_peered":"2023-12-04T05:38:47.043879+0000","last_unstale":"2023-12-04T05:38:47.046736+0000","last_undegraded":"2023-12-04T05:38:47.046736+0000","last_fullsized":"2023-12-04T05:38:47.046736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:15.033994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041268+0000","last_change":"2023-12-04T05:38:46.046462+0000","last_active":"2023-12-04T05:38:48.041268+0000","last_peered":"2023-12-04T05:38:48.041268+0000","last_clean":"2023-12-04T05:38:48.041268+0000","last_became_active":"2023-12-04T05:38:46.046029+0000","last_became_peered":"2023-12-04T05:38:46.046029+0000","last_unstale":"2023-12-04T05:38:48.041268+0000","last_undegraded":"2023-12-04T05:38:48.041268+0000","last_fullsized":"2023-12-04T05:38:48.041268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:23.032904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.042011+0000","last_change":"2023-12-04T05:38:29.359106+0000","last_active":"2023-12-04T05:38:46.042011+0000","last_peered":"2023-12-04T05:38:46.042011+0000","last_clean":"2023-12-04T05:38:46.042011+0000","last_became_active":"2023-12-04T05:38:29.358391+0000","last_became_peered":"2023-12-04T05:38:29.358391+0000","last_unstale":"2023-12-04T05:38:46.042011+0000","last_undegraded":"2023-12-04T05:38:46.042011+0000","last_fullsized":"2023-12-04T05:38:46.042011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035639+0000","last_change":"2023-12-04T05:38:28.354825+0000","last_active":"2023-12-04T05:38:46.035639+0000","last_peered":"2023-12-04T05:38:46.035639+0000","last_clean":"2023-12-04T05:38:46.035639+0000","last_became_active":"2023-12-04T05:38:28.354518+0000","last_became_peered":"2023-12-04T05:38:28.354518+0000","last_unstale":"2023-12-04T05:38:46.035639+0000","last_undegraded":"2023-12-04T05:38:46.035639+0000","last_fullsized":"2023-12-04T05:38:46.035639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042323+0000","last_change":"2023-12-04T05:38:47.035245+0000","last_active":"2023-12-04T05:38:48.042323+0000","last_peered":"2023-12-04T05:38:48.042323+0000","last_clean":"2023-12-04T05:38:48.042323+0000","last_became_active":"2023-12-04T05:38:47.034901+0000","last_became_peered":"2023-12-04T05:38:47.034901+0000","last_unstale":"2023-12-04T05:38:48.042323+0000","last_undegraded":"2023-12-04T05:38:48.042323+0000","last_fullsized":"2023-12-04T05:38:48.042323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066643+0000","last_change":"2023-12-04T05:38:46.044207+0000","last_active":"2023-12-04T05:38:47.066643+0000","last_peered":"2023-12-04T05:38:47.066643+0000","last_clean":"2023-12-04T05:38:47.066643+0000","last_became_active":"2023-12-04T05:38:46.043922+0000","last_became_peered":"2023-12-04T05:38:46.043922+0000","last_unstale":"2023-12-04T05:38:47.066643+0000","last_undegraded":"2023-12-04T05:38:47.066643+0000","last_fullsized":"2023-12-04T05:38:47.066643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:50.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040612+0000","last_change":"2023-12-04T05:38:29.346154+0000","last_active":"2023-12-04T05:38:46.040612+0000","last_peered":"2023-12-04T05:38:46.040612+0000","last_clean":"2023-12-04T05:38:46.040612+0000","last_became_active":"2023-12-04T05:38:29.345711+0000","last_became_peered":"2023-12-04T05:38:29.345711+0000","last_unstale":"2023-12-04T05:38:46.040612+0000","last_undegraded":"2023-12-04T05:38:46.040612+0000","last_fullsized":"2023-12-04T05:38:46.040612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:17.288502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037933+0000","last_change":"2023-12-04T05:38:28.356962+0000","last_active":"2023-12-04T05:38:46.037933+0000","last_peered":"2023-12-04T05:38:46.037933+0000","last_clean":"2023-12-04T05:38:46.037933+0000","last_became_active":"2023-12-04T05:38:28.356599+0000","last_became_peered":"2023-12-04T05:38:28.356599+0000","last_unstale":"2023-12-04T05:38:46.037933+0000","last_undegraded":"2023-12-04T05:38:46.037933+0000","last_fullsized":"2023-12-04T05:38:46.037933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041115+0000","last_change":"2023-12-04T05:38:47.061230+0000","last_active":"2023-12-04T05:38:48.041115+0000","last_peered":"2023-12-04T05:38:48.041115+0000","last_clean":"2023-12-04T05:38:48.041115+0000","last_became_active":"2023-12-04T05:38:47.055736+0000","last_became_peered":"2023-12-04T05:38:47.055736+0000","last_unstale":"2023-12-04T05:38:48.041115+0000","last_undegraded":"2023-12-04T05:38:48.041115+0000","last_fullsized":"2023-12-04T05:38:48.041115+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:36:35.522329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042047+0000","last_change":"2023-12-04T05:38:46.036755+0000","last_active":"2023-12-04T05:38:48.042047+0000","last_peered":"2023-12-04T05:38:48.042047+0000","last_clean":"2023-12-04T05:38:48.042047+0000","last_became_active":"2023-12-04T05:38:46.036423+0000","last_became_peered":"2023-12-04T05:38:46.036423+0000","last_unstale":"2023-12-04T05:38:48.042047+0000","last_undegraded":"2023-12-04T05:38:48.042047+0000","last_fullsized":"2023-12-04T05:38:48.042047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:29:06.338557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036534+0000","last_change":"2023-12-04T05:38:29.365123+0000","last_active":"2023-12-04T05:38:47.036534+0000","last_peered":"2023-12-04T05:38:47.036534+0000","last_clean":"2023-12-04T05:38:47.036534+0000","last_became_active":"2023-12-04T05:38:29.364212+0000","last_became_peered":"2023-12-04T05:38:29.364212+0000","last_unstale":"2023-12-04T05:38:47.036534+0000","last_undegraded":"2023-12-04T05:38:47.036534+0000","last_fullsized":"2023-12-04T05:38:47.036534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033131+0000","last_change":"2023-12-04T05:38:28.350111+0000","last_active":"2023-12-04T05:38:46.033131+0000","last_peered":"2023-12-04T05:38:46.033131+0000","last_clean":"2023-12-04T05:38:46.033131+0000","last_became_active":"2023-12-04T05:38:28.349788+0000","last_became_peered":"2023-12-04T05:38:28.349788+0000","last_unstale":"2023-12-04T05:38:46.033131+0000","last_undegraded":"2023-12-04T05:38:46.033131+0000","last_fullsized":"2023-12-04T05:38:46.033131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063304+0000","last_change":"2023-12-04T05:38:47.055663+0000","last_active":"2023-12-04T05:38:47.063304+0000","last_peered":"2023-12-04T05:38:47.063304+0000","last_clean":"2023-12-04T05:38:47.063304+0000","last_became_active":"2023-12-04T05:38:47.052681+0000","last_became_peered":"2023-12-04T05:38:47.052681+0000","last_unstale":"2023-12-04T05:38:47.063304+0000","last_undegraded":"2023-12-04T05:38:47.063304+0000","last_fullsized":"2023-12-04T05:38:47.063304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:42:21.627585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045754+0000","last_change":"2023-12-04T05:38:46.046023+0000","last_active":"2023-12-04T05:38:47.045754+0000","last_peered":"2023-12-04T05:38:47.045754+0000","last_clean":"2023-12-04T05:38:47.045754+0000","last_became_active":"2023-12-04T05:38:46.045726+0000","last_became_peered":"2023-12-04T05:38:46.045726+0000","last_unstale":"2023-12-04T05:38:47.045754+0000","last_undegraded":"2023-12-04T05:38:47.045754+0000","last_fullsized":"2023-12-04T05:38:47.045754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:41.012611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037929+0000","last_change":"2023-12-04T05:38:29.359656+0000","last_active":"2023-12-04T05:38:46.037929+0000","last_peered":"2023-12-04T05:38:46.037929+0000","last_clean":"2023-12-04T05:38:46.037929+0000","last_became_active":"2023-12-04T05:38:29.358747+0000","last_became_peered":"2023-12-04T05:38:29.358747+0000","last_unstale":"2023-12-04T05:38:46.037929+0000","last_undegraded":"2023-12-04T05:38:46.037929+0000","last_fullsized":"2023-12-04T05:38:46.037929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:43.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040257+0000","last_change":"2023-12-04T05:38:28.357652+0000","last_active":"2023-12-04T05:38:46.040257+0000","last_peered":"2023-12-04T05:38:46.040257+0000","last_clean":"2023-12-04T05:38:46.040257+0000","last_became_active":"2023-12-04T05:38:28.357276+0000","last_became_peered":"2023-12-04T05:38:28.357276+0000","last_unstale":"2023-12-04T05:38:46.040257+0000","last_undegraded":"2023-12-04T05:38:46.040257+0000","last_fullsized":"2023-12-04T05:38:46.040257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:25.246379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061011+0000","last_change":"2023-12-04T05:38:47.046259+0000","last_active":"2023-12-04T05:38:47.061011+0000","last_peered":"2023-12-04T05:38:47.061011+0000","last_clean":"2023-12-04T05:38:47.061011+0000","last_became_active":"2023-12-04T05:38:47.045967+0000","last_became_peered":"2023-12-04T05:38:47.045967+0000","last_unstale":"2023-12-04T05:38:47.061011+0000","last_undegraded":"2023-12-04T05:38:47.061011+0000","last_fullsized":"2023-12-04T05:38:47.061011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:28:30.180664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028024+0000","last_change":"2023-12-04T05:38:46.047725+0000","last_active":"2023-12-04T05:38:47.028024+0000","last_peered":"2023-12-04T05:38:47.028024+0000","last_clean":"2023-12-04T05:38:47.028024+0000","last_became_active":"2023-12-04T05:38:46.046634+0000","last_became_peered":"2023-12-04T05:38:46.046634+0000","last_unstale":"2023-12-04T05:38:47.028024+0000","last_undegraded":"2023-12-04T05:38:47.028024+0000","last_fullsized":"2023-12-04T05:38:47.028024+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:21.184785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032788+0000","last_change":"2023-12-04T05:38:29.347237+0000","last_active":"2023-12-04T05:38:46.032788+0000","last_peered":"2023-12-04T05:38:46.032788+0000","last_clean":"2023-12-04T05:38:46.032788+0000","last_became_active":"2023-12-04T05:38:29.346964+0000","last_became_peered":"2023-12-04T05:38:29.346964+0000","last_unstale":"2023-12-04T05:38:46.032788+0000","last_undegraded":"2023-12-04T05:38:46.032788+0000","last_fullsized":"2023-12-04T05:38:46.032788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023013+0000","last_change":"2023-12-04T05:38:28.353652+0000","last_active":"2023-12-04T05:38:47.023013+0000","last_peered":"2023-12-04T05:38:47.023013+0000","last_clean":"2023-12-04T05:38:47.023013+0000","last_became_active":"2023-12-04T05:38:28.353358+0000","last_became_peered":"2023-12-04T05:38:28.353358+0000","last_unstale":"2023-12-04T05:38:47.023013+0000","last_undegraded":"2023-12-04T05:38:47.023013+0000","last_fullsized":"2023-12-04T05:38:47.023013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:15.125860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060964+0000","last_change":"2023-12-04T05:38:47.047659+0000","last_active":"2023-12-04T05:38:47.060964+0000","last_peered":"2023-12-04T05:38:47.060964+0000","last_clean":"2023-12-04T05:38:47.060964+0000","last_became_active":"2023-12-04T05:38:47.047357+0000","last_became_peered":"2023-12-04T05:38:47.047357+0000","last_unstale":"2023-12-04T05:38:47.060964+0000","last_undegraded":"2023-12-04T05:38:47.060964+0000","last_fullsized":"2023-12-04T05:38:47.060964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:18.238278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028478+0000","last_change":"2023-12-04T05:38:46.038439+0000","last_active":"2023-12-04T05:38:47.028478+0000","last_peered":"2023-12-04T05:38:47.028478+0000","last_clean":"2023-12-04T05:38:47.028478+0000","last_became_active":"2023-12-04T05:38:46.037805+0000","last_became_peered":"2023-12-04T05:38:46.037805+0000","last_unstale":"2023-12-04T05:38:47.028478+0000","last_undegraded":"2023-12-04T05:38:47.028478+0000","last_fullsized":"2023-12-04T05:38:47.028478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:00.997039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032225+0000","last_change":"2023-12-04T05:38:29.366166+0000","last_active":"2023-12-04T05:38:46.032225+0000","last_peered":"2023-12-04T05:38:46.032225+0000","last_clean":"2023-12-04T05:38:46.032225+0000","last_became_active":"2023-12-04T05:38:29.365434+0000","last_became_peered":"2023-12-04T05:38:29.365434+0000","last_unstale":"2023-12-04T05:38:46.032225+0000","last_undegraded":"2023-12-04T05:38:46.032225+0000","last_fullsized":"2023-12-04T05:38:46.032225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034532+0000","last_change":"2023-12-04T05:38:28.353323+0000","last_active":"2023-12-04T05:38:46.034532+0000","last_peered":"2023-12-04T05:38:46.034532+0000","last_clean":"2023-12-04T05:38:46.034532+0000","last_became_active":"2023-12-04T05:38:28.352993+0000","last_became_peered":"2023-12-04T05:38:28.352993+0000","last_unstale":"2023-12-04T05:38:46.034532+0000","last_undegraded":"2023-12-04T05:38:46.034532+0000","last_fullsized":"2023-12-04T05:38:46.034532+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:17.139808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041179+0000","last_change":"2023-12-04T05:38:47.056291+0000","last_active":"2023-12-04T05:38:48.041179+0000","last_peered":"2023-12-04T05:38:48.041179+0000","last_clean":"2023-12-04T05:38:48.041179+0000","last_became_active":"2023-12-04T05:38:47.055961+0000","last_became_peered":"2023-12-04T05:38:47.055961+0000","last_unstale":"2023-12-04T05:38:48.041179+0000","last_undegraded":"2023-12-04T05:38:48.041179+0000","last_fullsized":"2023-12-04T05:38:48.041179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:30:24.137437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.032567+0000","last_change":"2023-12-04T05:38:46.042014+0000","last_active":"2023-12-04T05:38:47.032567+0000","last_peered":"2023-12-04T05:38:47.032567+0000","last_clean":"2023-12-04T05:38:47.032567+0000","last_became_active":"2023-12-04T05:38:46.041731+0000","last_became_peered":"2023-12-04T05:38:46.041731+0000","last_unstale":"2023-12-04T05:38:47.032567+0000","last_undegraded":"2023-12-04T05:38:47.032567+0000","last_fullsized":"2023-12-04T05:38:47.032567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:39.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039983+0000","last_change":"2023-12-04T05:38:29.355646+0000","last_active":"2023-12-04T05:38:46.039983+0000","last_peered":"2023-12-04T05:38:46.039983+0000","last_clean":"2023-12-04T05:38:46.039983+0000","last_became_active":"2023-12-04T05:38:29.355239+0000","last_became_peered":"2023-12-04T05:38:29.355239+0000","last_unstale":"2023-12-04T05:38:46.039983+0000","last_undegraded":"2023-12-04T05:38:46.039983+0000","last_fullsized":"2023-12-04T05:38:46.039983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024574+0000","last_change":"2023-12-04T05:38:28.339404+0000","last_active":"2023-12-04T05:38:47.024574+0000","last_peered":"2023-12-04T05:38:47.024574+0000","last_clean":"2023-12-04T05:38:47.024574+0000","last_became_active":"2023-12-04T05:38:28.339126+0000","last_became_peered":"2023-12-04T05:38:28.339126+0000","last_unstale":"2023-12-04T05:38:47.024574+0000","last_undegraded":"2023-12-04T05:38:47.024574+0000","last_fullsized":"2023-12-04T05:38:47.024574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:09:54.445347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042190+0000","last_change":"2023-12-04T05:38:47.051727+0000","last_active":"2023-12-04T05:38:48.042190+0000","last_peered":"2023-12-04T05:38:48.042190+0000","last_clean":"2023-12-04T05:38:48.042190+0000","last_became_active":"2023-12-04T05:38:47.051215+0000","last_became_peered":"2023-12-04T05:38:47.051215+0000","last_unstale":"2023-12-04T05:38:48.042190+0000","last_undegraded":"2023-12-04T05:38:48.042190+0000","last_fullsized":"2023-12-04T05:38:48.042190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:12.855980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028461+0000","last_change":"2023-12-04T05:38:46.045967+0000","last_active":"2023-12-04T05:38:47.028461+0000","last_peered":"2023-12-04T05:38:47.028461+0000","last_clean":"2023-12-04T05:38:47.028461+0000","last_became_active":"2023-12-04T05:38:46.045594+0000","last_became_peered":"2023-12-04T05:38:46.045594+0000","last_unstale":"2023-12-04T05:38:47.028461+0000","last_undegraded":"2023-12-04T05:38:47.028461+0000","last_fullsized":"2023-12-04T05:38:47.028461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:35.040765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.041840+0000","last_change":"2023-12-04T05:38:29.359342+0000","last_active":"2023-12-04T05:38:46.041840+0000","last_peered":"2023-12-04T05:38:46.041840+0000","last_clean":"2023-12-04T05:38:46.041840+0000","last_became_active":"2023-12-04T05:38:29.358806+0000","last_became_peered":"2023-12-04T05:38:29.358806+0000","last_unstale":"2023-12-04T05:38:46.041840+0000","last_undegraded":"2023-12-04T05:38:46.041840+0000","last_fullsized":"2023-12-04T05:38:46.041840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035776+0000","last_change":"2023-12-04T05:38:28.351967+0000","last_active":"2023-12-04T05:38:46.035776+0000","last_peered":"2023-12-04T05:38:46.035776+0000","last_clean":"2023-12-04T05:38:46.035776+0000","last_became_active":"2023-12-04T05:38:28.350680+0000","last_became_peered":"2023-12-04T05:38:28.350680+0000","last_unstale":"2023-12-04T05:38:46.035776+0000","last_undegraded":"2023-12-04T05:38:46.035776+0000","last_fullsized":"2023-12-04T05:38:46.035776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:37.289509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040916+0000","last_change":"2023-12-04T05:38:47.037903+0000","last_active":"2023-12-04T05:38:47.040916+0000","last_peered":"2023-12-04T05:38:47.040916+0000","last_clean":"2023-12-04T05:38:47.040916+0000","last_became_active":"2023-12-04T05:38:47.037611+0000","last_became_peered":"2023-12-04T05:38:47.037611+0000","last_unstale":"2023-12-04T05:38:47.040916+0000","last_undegraded":"2023-12-04T05:38:47.040916+0000","last_fullsized":"2023-12-04T05:38:47.040916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:35.654657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066570+0000","last_change":"2023-12-04T05:38:46.044136+0000","last_active":"2023-12-04T05:38:47.066570+0000","last_peered":"2023-12-04T05:38:47.066570+0000","last_clean":"2023-12-04T05:38:47.066570+0000","last_became_active":"2023-12-04T05:38:46.043860+0000","last_became_peered":"2023-12-04T05:38:46.043860+0000","last_unstale":"2023-12-04T05:38:47.066570+0000","last_undegraded":"2023-12-04T05:38:47.066570+0000","last_fullsized":"2023-12-04T05:38:47.066570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:31.539287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023987+0000","last_change":"2023-12-04T05:38:29.355636+0000","last_active":"2023-12-04T05:38:47.023987+0000","last_peered":"2023-12-04T05:38:47.023987+0000","last_clean":"2023-12-04T05:38:47.023987+0000","last_became_active":"2023-12-04T05:38:29.354320+0000","last_became_peered":"2023-12-04T05:38:29.354320+0000","last_unstale":"2023-12-04T05:38:47.023987+0000","last_undegraded":"2023-12-04T05:38:47.023987+0000","last_fullsized":"2023-12-04T05:38:47.023987+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:36.568528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.030205+0000","last_change":"2023-12-04T05:38:28.338365+0000","last_active":"2023-12-04T05:38:46.030205+0000","last_peered":"2023-12-04T05:38:46.030205+0000","last_clean":"2023-12-04T05:38:46.030205+0000","last_became_active":"2023-12-04T05:38:28.337946+0000","last_became_peered":"2023-12-04T05:38:28.337946+0000","last_unstale":"2023-12-04T05:38:46.030205+0000","last_undegraded":"2023-12-04T05:38:46.030205+0000","last_fullsized":"2023-12-04T05:38:46.030205+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:22.800341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.050460+0000","last_change":"2023-12-04T05:38:47.043988+0000","last_active":"2023-12-04T05:38:47.050460+0000","last_peered":"2023-12-04T05:38:47.050460+0000","last_clean":"2023-12-04T05:38:47.050460+0000","last_became_active":"2023-12-04T05:38:47.043701+0000","last_became_peered":"2023-12-04T05:38:47.043701+0000","last_unstale":"2023-12-04T05:38:47.050460+0000","last_undegraded":"2023-12-04T05:38:47.050460+0000","last_fullsized":"2023-12-04T05:38:47.050460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:58.463639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.046771+0000","last_change":"2023-12-04T05:38:46.042777+0000","last_active":"2023-12-04T05:38:47.046771+0000","last_peered":"2023-12-04T05:38:47.046771+0000","last_clean":"2023-12-04T05:38:47.046771+0000","last_became_active":"2023-12-04T05:38:46.042511+0000","last_became_peered":"2023-12-04T05:38:46.042511+0000","last_unstale":"2023-12-04T05:38:47.046771+0000","last_undegraded":"2023-12-04T05:38:47.046771+0000","last_fullsized":"2023-12-04T05:38:47.046771+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:42.935885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035011+0000","last_change":"2023-12-04T05:38:29.352860+0000","last_active":"2023-12-04T05:38:46.035011+0000","last_peered":"2023-12-04T05:38:46.035011+0000","last_clean":"2023-12-04T05:38:46.035011+0000","last_became_active":"2023-12-04T05:38:29.352511+0000","last_became_peered":"2023-12-04T05:38:29.352511+0000","last_unstale":"2023-12-04T05:38:46.035011+0000","last_undegraded":"2023-12-04T05:38:46.035011+0000","last_fullsized":"2023-12-04T05:38:46.035011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:21.726802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038176+0000","last_change":"2023-12-04T05:38:28.350094+0000","last_active":"2023-12-04T05:38:46.038176+0000","last_peered":"2023-12-04T05:38:46.038176+0000","last_clean":"2023-12-04T05:38:46.038176+0000","last_became_active":"2023-12-04T05:38:28.349731+0000","last_became_peered":"2023-12-04T05:38:28.349731+0000","last_unstale":"2023-12-04T05:38:46.038176+0000","last_undegraded":"2023-12-04T05:38:46.038176+0000","last_fullsized":"2023-12-04T05:38:46.038176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:07.362253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041672+0000","last_change":"2023-12-04T05:38:47.047772+0000","last_active":"2023-12-04T05:38:48.041672+0000","last_peered":"2023-12-04T05:38:48.041672+0000","last_clean":"2023-12-04T05:38:48.041672+0000","last_became_active":"2023-12-04T05:38:47.047488+0000","last_became_peered":"2023-12-04T05:38:47.047488+0000","last_unstale":"2023-12-04T05:38:48.041672+0000","last_undegraded":"2023-12-04T05:38:48.041672+0000","last_fullsized":"2023-12-04T05:38:48.041672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:44.419223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040603+0000","last_change":"2023-12-04T05:38:46.040812+0000","last_active":"2023-12-04T05:38:48.040603+0000","last_peered":"2023-12-04T05:38:48.040603+0000","last_clean":"2023-12-04T05:38:48.040603+0000","last_became_active":"2023-12-04T05:38:46.040528+0000","last_became_peered":"2023-12-04T05:38:46.040528+0000","last_unstale":"2023-12-04T05:38:48.040603+0000","last_undegraded":"2023-12-04T05:38:48.040603+0000","last_fullsized":"2023-12-04T05:38:48.040603+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:33.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.041026+0000","last_change":"2023-12-04T05:38:29.350276+0000","last_active":"2023-12-04T05:38:46.041026+0000","last_peered":"2023-12-04T05:38:46.041026+0000","last_clean":"2023-12-04T05:38:46.041026+0000","last_became_active":"2023-12-04T05:38:29.350015+0000","last_became_peered":"2023-12-04T05:38:29.350015+0000","last_unstale":"2023-12-04T05:38:46.041026+0000","last_undegraded":"2023-12-04T05:38:46.041026+0000","last_fullsized":"2023-12-04T05:38:46.041026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:07.900096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023074+0000","last_change":"2023-12-04T05:38:28.353620+0000","last_active":"2023-12-04T05:38:47.023074+0000","last_peered":"2023-12-04T05:38:47.023074+0000","last_clean":"2023-12-04T05:38:47.023074+0000","last_became_active":"2023-12-04T05:38:28.353260+0000","last_became_peered":"2023-12-04T05:38:28.353260+0000","last_unstale":"2023-12-04T05:38:47.023074+0000","last_undegraded":"2023-12-04T05:38:47.023074+0000","last_fullsized":"2023-12-04T05:38:47.023074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:12.165110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066280+0000","last_change":"2023-12-04T05:38:47.061834+0000","last_active":"2023-12-04T05:38:47.066280+0000","last_peered":"2023-12-04T05:38:47.066280+0000","last_clean":"2023-12-04T05:38:47.066280+0000","last_became_active":"2023-12-04T05:38:47.061553+0000","last_became_peered":"2023-12-04T05:38:47.061553+0000","last_unstale":"2023-12-04T05:38:47.066280+0000","last_undegraded":"2023-12-04T05:38:47.066280+0000","last_fullsized":"2023-12-04T05:38:47.066280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:36.620752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024906+0000","last_change":"2023-12-04T05:38:46.047636+0000","last_active":"2023-12-04T05:38:47.024906+0000","last_peered":"2023-12-04T05:38:47.024906+0000","last_clean":"2023-12-04T05:38:47.024906+0000","last_became_active":"2023-12-04T05:38:46.046984+0000","last_became_peered":"2023-12-04T05:38:46.046984+0000","last_unstale":"2023-12-04T05:38:47.024906+0000","last_undegraded":"2023-12-04T05:38:47.024906+0000","last_fullsized":"2023-12-04T05:38:47.024906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:43.198488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038738+0000","last_change":"2023-12-04T05:38:29.366519+0000","last_active":"2023-12-04T05:38:47.038738+0000","last_peered":"2023-12-04T05:38:47.038738+0000","last_clean":"2023-12-04T05:38:47.038738+0000","last_became_active":"2023-12-04T05:38:29.366308+0000","last_became_peered":"2023-12-04T05:38:29.366308+0000","last_unstale":"2023-12-04T05:38:47.038738+0000","last_undegraded":"2023-12-04T05:38:47.038738+0000","last_fullsized":"2023-12-04T05:38:47.038738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026640+0000","last_change":"2023-12-04T05:38:28.350853+0000","last_active":"2023-12-04T05:38:47.026640+0000","last_peered":"2023-12-04T05:38:47.026640+0000","last_clean":"2023-12-04T05:38:47.026640+0000","last_became_active":"2023-12-04T05:38:28.350557+0000","last_became_peered":"2023-12-04T05:38:28.350557+0000","last_unstale":"2023-12-04T05:38:47.026640+0000","last_undegraded":"2023-12-04T05:38:47.026640+0000","last_fullsized":"2023-12-04T05:38:47.026640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053581+0000","last_change":"2023-12-04T05:38:47.048321+0000","last_active":"2023-12-04T05:38:47.053581+0000","last_peered":"2023-12-04T05:38:47.053581+0000","last_clean":"2023-12-04T05:38:47.053581+0000","last_became_active":"2023-12-04T05:38:47.047410+0000","last_became_peered":"2023-12-04T05:38:47.047410+0000","last_unstale":"2023-12-04T05:38:47.053581+0000","last_undegraded":"2023-12-04T05:38:47.053581+0000","last_fullsized":"2023-12-04T05:38:47.053581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:00.580400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.034593+0000","last_change":"2023-12-04T05:38:46.042707+0000","last_active":"2023-12-04T05:38:47.034593+0000","last_peered":"2023-12-04T05:38:47.034593+0000","last_clean":"2023-12-04T05:38:47.034593+0000","last_became_active":"2023-12-04T05:38:46.042437+0000","last_became_peered":"2023-12-04T05:38:46.042437+0000","last_unstale":"2023-12-04T05:38:47.034593+0000","last_undegraded":"2023-12-04T05:38:47.034593+0000","last_fullsized":"2023-12-04T05:38:47.034593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:32.815366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.022807+0000","last_change":"2023-12-04T05:38:29.348446+0000","last_active":"2023-12-04T05:38:47.022807+0000","last_peered":"2023-12-04T05:38:47.022807+0000","last_clean":"2023-12-04T05:38:47.022807+0000","last_became_active":"2023-12-04T05:38:29.348081+0000","last_became_peered":"2023-12-04T05:38:29.348081+0000","last_unstale":"2023-12-04T05:38:47.022807+0000","last_undegraded":"2023-12-04T05:38:47.022807+0000","last_fullsized":"2023-12-04T05:38:47.022807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:33.662249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.022860+0000","last_change":"2023-12-04T05:38:28.346850+0000","last_active":"2023-12-04T05:38:47.022860+0000","last_peered":"2023-12-04T05:38:47.022860+0000","last_clean":"2023-12-04T05:38:47.022860+0000","last_became_active":"2023-12-04T05:38:28.346605+0000","last_became_peered":"2023-12-04T05:38:28.346605+0000","last_unstale":"2023-12-04T05:38:47.022860+0000","last_undegraded":"2023-12-04T05:38:47.022860+0000","last_fullsized":"2023-12-04T05:38:47.022860+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:22.166638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055755+0000","last_change":"2023-12-04T05:38:47.044153+0000","last_active":"2023-12-04T05:38:47.055755+0000","last_peered":"2023-12-04T05:38:47.055755+0000","last_clean":"2023-12-04T05:38:47.055755+0000","last_became_active":"2023-12-04T05:38:47.043323+0000","last_became_peered":"2023-12-04T05:38:47.043323+0000","last_unstale":"2023-12-04T05:38:47.055755+0000","last_undegraded":"2023-12-04T05:38:47.055755+0000","last_fullsized":"2023-12-04T05:38:47.055755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:55.987182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041822+0000","last_change":"2023-12-04T05:38:46.039603+0000","last_active":"2023-12-04T05:38:48.041822+0000","last_peered":"2023-12-04T05:38:48.041822+0000","last_clean":"2023-12-04T05:38:48.041822+0000","last_became_active":"2023-12-04T05:38:46.039339+0000","last_became_peered":"2023-12-04T05:38:46.039339+0000","last_unstale":"2023-12-04T05:38:48.041822+0000","last_undegraded":"2023-12-04T05:38:48.041822+0000","last_fullsized":"2023-12-04T05:38:48.041822+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:57.739275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038386+0000","last_change":"2023-12-04T05:38:29.348990+0000","last_active":"2023-12-04T05:38:46.038386+0000","last_peered":"2023-12-04T05:38:46.038386+0000","last_clean":"2023-12-04T05:38:46.038386+0000","last_became_active":"2023-12-04T05:38:29.348709+0000","last_became_peered":"2023-12-04T05:38:29.348709+0000","last_unstale":"2023-12-04T05:38:46.038386+0000","last_undegraded":"2023-12-04T05:38:46.038386+0000","last_fullsized":"2023-12-04T05:38:46.038386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:17.966249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036949+0000","last_change":"2023-12-04T05:38:28.358626+0000","last_active":"2023-12-04T05:38:46.036949+0000","last_peered":"2023-12-04T05:38:46.036949+0000","last_clean":"2023-12-04T05:38:46.036949+0000","last_became_active":"2023-12-04T05:38:28.358311+0000","last_became_peered":"2023-12-04T05:38:28.358311+0000","last_unstale":"2023-12-04T05:38:46.036949+0000","last_undegraded":"2023-12-04T05:38:46.036949+0000","last_fullsized":"2023-12-04T05:38:46.036949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:23.323105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.059443+0000","last_change":"2023-12-04T05:38:47.044533+0000","last_active":"2023-12-04T05:38:47.059443+0000","last_peered":"2023-12-04T05:38:47.059443+0000","last_clean":"2023-12-04T05:38:47.059443+0000","last_became_active":"2023-12-04T05:38:47.044259+0000","last_became_peered":"2023-12-04T05:38:47.044259+0000","last_unstale":"2023-12-04T05:38:47.059443+0000","last_undegraded":"2023-12-04T05:38:47.059443+0000","last_fullsized":"2023-12-04T05:38:47.059443+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:12.855980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067666+0000","last_change":"2023-12-04T05:38:46.037415+0000","last_active":"2023-12-04T05:38:47.067666+0000","last_peered":"2023-12-04T05:38:47.067666+0000","last_clean":"2023-12-04T05:38:47.067666+0000","last_became_active":"2023-12-04T05:38:46.037075+0000","last_became_peered":"2023-12-04T05:38:46.037075+0000","last_unstale":"2023-12-04T05:38:47.067666+0000","last_undegraded":"2023-12-04T05:38:47.067666+0000","last_fullsized":"2023-12-04T05:38:47.067666+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:32:01.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036863+0000","last_change":"2023-12-04T05:38:29.345465+0000","last_active":"2023-12-04T05:38:46.036863+0000","last_peered":"2023-12-04T05:38:46.036863+0000","last_clean":"2023-12-04T05:38:46.036863+0000","last_became_active":"2023-12-04T05:38:29.345189+0000","last_became_peered":"2023-12-04T05:38:29.345189+0000","last_unstale":"2023-12-04T05:38:46.036863+0000","last_undegraded":"2023-12-04T05:38:46.036863+0000","last_fullsized":"2023-12-04T05:38:46.036863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:03.546556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029232+0000","last_change":"2023-12-04T05:38:28.351607+0000","last_active":"2023-12-04T05:38:46.029232+0000","last_peered":"2023-12-04T05:38:46.029232+0000","last_clean":"2023-12-04T05:38:46.029232+0000","last_became_active":"2023-12-04T05:38:28.351286+0000","last_became_peered":"2023-12-04T05:38:28.351286+0000","last_unstale":"2023-12-04T05:38:46.029232+0000","last_undegraded":"2023-12-04T05:38:46.029232+0000","last_fullsized":"2023-12-04T05:38:46.029232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:39:41.882728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040463+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:47.040463+0000","last_peered":"2023-12-04T05:38:47.040463+0000","last_clean":"2023-12-04T05:38:47.040463+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:47.040463+0000","last_undegraded":"2023-12-04T05:38:47.040463+0000","last_fullsized":"2023-12-04T05:38:47.040463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":864669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":273617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.77100000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.753}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.88200000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":274267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.63}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.755},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":276702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.78500000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82799999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85499999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.91200000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.84299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.87}]},{"osd":5,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":1.167,"15min":1.167},"last":0.94299999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":1.196,"15min":1.196},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":1.075}]},{"osd":7,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.016},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96699999999999997,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":273693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.87},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.89700000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":275193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.46400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.44}]},{"osd":1,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.4130000000000003,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82999999999999996,"15min":0.81699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.3710000000000004,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.96299999999999997,"15min":0.97099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":5.4889999999999999,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.218,"5min":4.218,"15min":4.218},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":275843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":867582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.71499999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:51.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:38:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.297+0000 7fa9c41b8640 1 Processor -- start 2023-12-04T05:38:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.297+0000 7fa9c41b8640 1 -- start start 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c41b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9bc0c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c41b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0707c0 con 0x7fa9bc071390 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c41b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc159470 con 0x7fa9bc071e10 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c41b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc06dd10 con 0x7fa9bc0c1880 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa9bc071390 0x7fa9bc163370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41284/0 (socket says 172.21.15.97:41284) 2023-12-04T05:38:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 -- 172.21.15.97:0/4231287763 learned_addr learned my addr 172.21.15.97:0/4231287763 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9bc0c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486211498 0 0) 0x7fa9bc0707c0 con 0x7fa9bc071390 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a8003530 con 0x7fa9bc071390 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569529308 0 0) 0x7fa9bc159470 con 0x7fa9bc071e10 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9bc0707c0 con 0x7fa9bc071e10 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416774665 0 0) 0x7fa9a8003530 con 0x7fa9bc071390 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 msgr2=0x7fa9bc0c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9bc0c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 >> v1:172.21.15.143:6789/0 conn(0x7fa9bc071e10 legacy=0x7fa9bc06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc159750 con 0x7fa9bc071390 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fa9b4001a00 con 0x7fa9bc071390 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 >> v1:172.21.15.97:6789/0 conn(0x7fa9bc071390 legacy=0x7fa9bc163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9a8003b40 0x7fa9a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9a8004d10 0x7fa9a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a800ba40 con 0x7fa9a8004d10 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a800bb80 con 0x7fa9a8003b40 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a800bd40 con 0x7fa9bc0c1880 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9a8004d10 0x7fa9a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9a8003b40 0x7fa9a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c1753640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 -- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 msgr2=0x7fa9a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc0c1880 0x7fa9a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 -- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9a8003b40 msgr2=0x7fa9a8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9a8003b40 0x7fa9a8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.301+0000 7fa9c2755640 1 -- 172.21.15.97:0/4231287763 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8003530 con 0x7fa9a8004d10 2023-12-04T05:38:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c2755640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9a8004d10 0x7fa9a8005190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400a710 tx=0x7fa9b401f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad6af79bddca20c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40ac610 con 0x7fa9a8004d10 2023-12-04T05:38:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b40ac770 con 0x7fa9a8004d10 2023-12-04T05:38:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c0f52640 1 -- 172.21.15.97:0/4231287763 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40acb60 con 0x7fa9a8004d10 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 -- 172.21.15.97:0/4231287763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9a8004d10 msgr2=0x7fa9a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/4231287763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9a8004d10 0x7fa9a8005190 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400a710 tx=0x7fa9b401f960 comp rx=0 tx=0).stop 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c2755640 1 -- 172.21.15.97:0/4231287763 reap_dead start 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 -- 172.21.15.97:0/4231287763 shutdown_connections 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 -- 172.21.15.97:0/4231287763 >> 172.21.15.97:0/4231287763 conn(0x7fa9bc0c2970 msgr2=0x7fa9bc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 -- 172.21.15.97:0/4231287763 shutdown_connections 2023-12-04T05:38:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.305+0000 7fa9c41b8640 1 -- 172.21.15.97:0/4231287763 wait complete. 2023-12-04T05:38:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 Processor -- start 2023-12-04T05:38:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- start start 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 0x7fa9bc1f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 0x7fa9bc0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0ab3b0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc1f2120 con 0x7fa9bc155e30 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc1f2400 con 0x7fa9bc148c70 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53748/0 (socket says 172.21.15.97:53748) 2023-12-04T05:38:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 -- 172.21.15.97:0/846650860 learned_addr learned my addr 172.21.15.97:0/846650860 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 0x7fa9bc1f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c1753640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 0x7fa9bc0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 -- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 msgr2=0x7fa9bc1f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 0x7fa9bc1f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 -- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 msgr2=0x7fa9bc0a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 0x7fa9bc0a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 -- 172.21.15.97:0/846650860 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0ab600 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c1753640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 0x7fa9bc0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 0x7fa9bc1f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:51.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c2755640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4020200 tx=0x7fa9a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40ac610 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b40011d0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc0ab8e0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40ace40 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc0aa740 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.309+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc1f25c0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.313+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa9b40be410 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.313+0000 7fa9b27fc640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 0x7fa9a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.313+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9b41229d0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.313+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 0x7fa9a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.313+0000 7fa9c1f54640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 0x7fa9a0068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009be0 tx=0x7fa9b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.317+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9bc1f25c0 con 0x7fa9bc1f1bb0 2023-12-04T05:38:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.465+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9bc06c510 con 0x7fa9a00668d0 2023-12-04T05:38:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.477+0000 7fa9b27fc640 1 -- 172.21.15.97:0/846650860 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527849 (secure 0 0 0) 0x7fa9b8014bb0 con 0x7fa9a00668d0 2023-12-04T05:38:51.488 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:38:51.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 msgr2=0x7fa9a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 0x7fa9a0068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009be0 tx=0x7fa9b8008040 comp rx=0 tx=0).stop 2023-12-04T05:38:51.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 msgr2=0x7fa9bc0a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4020200 tx=0x7fa9a8005800 comp rx=0 tx=0).stop 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 shutdown_connections 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9a00668d0 0x7fa9a0068d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9bc1f1bb0 0x7fa9bc0a9b40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9bc155e30 0x7fa9bc0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 --2- 172.21.15.97:0/846650860 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9bc148c70 0x7fa9bc1f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 >> 172.21.15.97:0/846650860 conn(0x7fa9bc0c2970 msgr2=0x7fa9bc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 shutdown_connections 2023-12-04T05:38:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.481+0000 7fa9c41b8640 1 -- 172.21.15.97:0/846650860 wait complete. 2023-12-04T05:38:51.506 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-04T05:38:50.216818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":290,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230736,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743984,"statfs":{"total":773094113280,"available":772857839616,"internally_reserved":0,"allocated":6397952,"data_stored":3381566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.207335"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060838+0000","last_change":"2023-12-04T05:38:47.044643+0000","last_active":"2023-12-04T05:38:47.060838+0000","last_peered":"2023-12-04T05:38:47.060838+0000","last_clean":"2023-12-04T05:38:47.060838+0000","last_became_active":"2023-12-04T05:38:47.044378+0000","last_became_peered":"2023-12-04T05:38:47.044378+0000","last_unstale":"2023-12-04T05:38:47.060838+0000","last_undegraded":"2023-12-04T05:38:47.060838+0000","last_fullsized":"2023-12-04T05:38:47.060838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:00.327690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033669+0000","last_change":"2023-12-04T05:38:29.352962+0000","last_active":"2023-12-04T05:38:46.033669+0000","last_peered":"2023-12-04T05:38:46.033669+0000","last_clean":"2023-12-04T05:38:46.033669+0000","last_became_active":"2023-12-04T05:38:29.352682+0000","last_became_peered":"2023-12-04T05:38:29.352682+0000","last_unstale":"2023-12-04T05:38:46.033669+0000","last_undegraded":"2023-12-04T05:38:46.033669+0000","last_fullsized":"2023-12-04T05:38:46.033669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:05:46.992332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042752+0000","last_change":"2023-12-04T05:38:47.044070+0000","last_active":"2023-12-04T05:38:48.042752+0000","last_peered":"2023-12-04T05:38:48.042752+0000","last_clean":"2023-12-04T05:38:48.042752+0000","last_became_active":"2023-12-04T05:38:47.043820+0000","last_became_peered":"2023-12-04T05:38:47.043820+0000","last_unstale":"2023-12-04T05:38:48.042752+0000","last_undegraded":"2023-12-04T05:38:48.042752+0000","last_fullsized":"2023-12-04T05:38:48.042752+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:51.848737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044403+0000","last_change":"2023-12-04T05:38:29.357484+0000","last_active":"2023-12-04T05:38:46.044403+0000","last_peered":"2023-12-04T05:38:46.044403+0000","last_clean":"2023-12-04T05:38:46.044403+0000","last_became_active":"2023-12-04T05:38:29.356776+0000","last_became_peered":"2023-12-04T05:38:29.356776+0000","last_unstale":"2023-12-04T05:38:46.044403+0000","last_undegraded":"2023-12-04T05:38:46.044403+0000","last_fullsized":"2023-12-04T05:38:46.044403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:18.360524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040559+0000","last_change":"2023-12-04T05:38:47.052013+0000","last_active":"2023-12-04T05:38:48.040559+0000","last_peered":"2023-12-04T05:38:48.040559+0000","last_clean":"2023-12-04T05:38:48.040559+0000","last_became_active":"2023-12-04T05:38:47.050564+0000","last_became_peered":"2023-12-04T05:38:47.050564+0000","last_unstale":"2023-12-04T05:38:48.040559+0000","last_undegraded":"2023-12-04T05:38:48.040559+0000","last_fullsized":"2023-12-04T05:38:48.040559+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:18.297839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036342+0000","last_change":"2023-12-04T05:38:29.369361+0000","last_active":"2023-12-04T05:38:47.036342+0000","last_peered":"2023-12-04T05:38:47.036342+0000","last_clean":"2023-12-04T05:38:47.036342+0000","last_became_active":"2023-12-04T05:38:29.369066+0000","last_became_peered":"2023-12-04T05:38:29.369066+0000","last_unstale":"2023-12-04T05:38:47.036342+0000","last_undegraded":"2023-12-04T05:38:47.036342+0000","last_fullsized":"2023-12-04T05:38:47.036342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.044322+0000","last_change":"2023-12-04T05:38:47.041126+0000","last_active":"2023-12-04T05:38:47.044322+0000","last_peered":"2023-12-04T05:38:47.044322+0000","last_clean":"2023-12-04T05:38:47.044322+0000","last_became_active":"2023-12-04T05:38:47.039226+0000","last_became_peered":"2023-12-04T05:38:47.039226+0000","last_unstale":"2023-12-04T05:38:47.044322+0000","last_undegraded":"2023-12-04T05:38:47.044322+0000","last_fullsized":"2023-12-04T05:38:47.044322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:29.847962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037857+0000","last_change":"2023-12-04T05:38:29.352890+0000","last_active":"2023-12-04T05:38:46.037857+0000","last_peered":"2023-12-04T05:38:46.037857+0000","last_clean":"2023-12-04T05:38:46.037857+0000","last_became_active":"2023-12-04T05:38:29.352561+0000","last_became_peered":"2023-12-04T05:38:29.352561+0000","last_unstale":"2023-12-04T05:38:46.037857+0000","last_undegraded":"2023-12-04T05:38:46.037857+0000","last_fullsized":"2023-12-04T05:38:46.037857+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:26.518247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.058635+0000","last_change":"2023-12-04T05:38:47.048639+0000","last_active":"2023-12-04T05:38:47.058635+0000","last_peered":"2023-12-04T05:38:47.058635+0000","last_clean":"2023-12-04T05:38:47.058635+0000","last_became_active":"2023-12-04T05:38:47.048309+0000","last_became_peered":"2023-12-04T05:38:47.048309+0000","last_unstale":"2023-12-04T05:38:47.058635+0000","last_undegraded":"2023-12-04T05:38:47.058635+0000","last_fullsized":"2023-12-04T05:38:47.058635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:03:28.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033112+0000","last_change":"2023-12-04T05:38:29.357624+0000","last_active":"2023-12-04T05:38:46.033112+0000","last_peered":"2023-12-04T05:38:46.033112+0000","last_clean":"2023-12-04T05:38:46.033112+0000","last_became_active":"2023-12-04T05:38:29.357119+0000","last_became_peered":"2023-12-04T05:38:29.357119+0000","last_unstale":"2023-12-04T05:38:46.033112+0000","last_undegraded":"2023-12-04T05:38:46.033112+0000","last_fullsized":"2023-12-04T05:38:46.033112+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:20.150003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.049651+0000","last_change":"2023-12-04T05:38:47.042033+0000","last_active":"2023-12-04T05:38:47.049651+0000","last_peered":"2023-12-04T05:38:47.049651+0000","last_clean":"2023-12-04T05:38:47.049651+0000","last_became_active":"2023-12-04T05:38:47.041721+0000","last_became_peered":"2023-12-04T05:38:47.041721+0000","last_unstale":"2023-12-04T05:38:47.049651+0000","last_undegraded":"2023-12-04T05:38:47.049651+0000","last_fullsized":"2023-12-04T05:38:47.049651+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:58.747442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032466+0000","last_change":"2023-12-04T05:38:29.346548+0000","last_active":"2023-12-04T05:38:46.032466+0000","last_peered":"2023-12-04T05:38:46.032466+0000","last_clean":"2023-12-04T05:38:46.032466+0000","last_became_active":"2023-12-04T05:38:29.346283+0000","last_became_peered":"2023-12-04T05:38:29.346283+0000","last_unstale":"2023-12-04T05:38:46.032466+0000","last_undegraded":"2023-12-04T05:38:46.032466+0000","last_fullsized":"2023-12-04T05:38:46.032466+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060582+0000","last_change":"2023-12-04T05:38:47.054063+0000","last_active":"2023-12-04T05:38:47.060582+0000","last_peered":"2023-12-04T05:38:47.060582+0000","last_clean":"2023-12-04T05:38:47.060582+0000","last_became_active":"2023-12-04T05:38:47.053422+0000","last_became_peered":"2023-12-04T05:38:47.053422+0000","last_unstale":"2023-12-04T05:38:47.060582+0000","last_undegraded":"2023-12-04T05:38:47.060582+0000","last_fullsized":"2023-12-04T05:38:47.060582+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:53.438652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025129+0000","last_change":"2023-12-04T05:38:29.357730+0000","last_active":"2023-12-04T05:38:47.025129+0000","last_peered":"2023-12-04T05:38:47.025129+0000","last_clean":"2023-12-04T05:38:47.025129+0000","last_became_active":"2023-12-04T05:38:29.357470+0000","last_became_peered":"2023-12-04T05:38:29.357470+0000","last_unstale":"2023-12-04T05:38:47.025129+0000","last_undegraded":"2023-12-04T05:38:47.025129+0000","last_fullsized":"2023-12-04T05:38:47.025129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:55.944927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037477+0000","last_change":"2023-12-04T05:38:47.031577+0000","last_active":"2023-12-04T05:38:47.037477+0000","last_peered":"2023-12-04T05:38:47.037477+0000","last_clean":"2023-12-04T05:38:47.037477+0000","last_became_active":"2023-12-04T05:38:47.031240+0000","last_became_peered":"2023-12-04T05:38:47.031240+0000","last_unstale":"2023-12-04T05:38:47.037477+0000","last_undegraded":"2023-12-04T05:38:47.037477+0000","last_fullsized":"2023-12-04T05:38:47.037477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:26.059926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036850+0000","last_change":"2023-12-04T05:38:29.344652+0000","last_active":"2023-12-04T05:38:46.036850+0000","last_peered":"2023-12-04T05:38:46.036850+0000","last_clean":"2023-12-04T05:38:46.036850+0000","last_became_active":"2023-12-04T05:38:29.344365+0000","last_became_peered":"2023-12-04T05:38:29.344365+0000","last_unstale":"2023-12-04T05:38:46.036850+0000","last_undegraded":"2023-12-04T05:38:46.036850+0000","last_fullsized":"2023-12-04T05:38:46.036850+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:23.495789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041786+0000","last_change":"2023-12-04T05:38:47.058476+0000","last_active":"2023-12-04T05:38:48.041786+0000","last_peered":"2023-12-04T05:38:48.041786+0000","last_clean":"2023-12-04T05:38:48.041786+0000","last_became_active":"2023-12-04T05:38:47.058014+0000","last_became_peered":"2023-12-04T05:38:47.058014+0000","last_unstale":"2023-12-04T05:38:48.041786+0000","last_undegraded":"2023-12-04T05:38:48.041786+0000","last_fullsized":"2023-12-04T05:38:48.041786+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:58:51.518415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025969+0000","last_change":"2023-12-04T05:38:29.361093+0000","last_active":"2023-12-04T05:38:47.025969+0000","last_peered":"2023-12-04T05:38:47.025969+0000","last_clean":"2023-12-04T05:38:47.025969+0000","last_became_active":"2023-12-04T05:38:29.360800+0000","last_became_peered":"2023-12-04T05:38:29.360800+0000","last_unstale":"2023-12-04T05:38:47.025969+0000","last_undegraded":"2023-12-04T05:38:47.025969+0000","last_fullsized":"2023-12-04T05:38:47.025969+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:18.687515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042457+0000","last_change":"2023-12-04T05:38:47.048298+0000","last_active":"2023-12-04T05:38:48.042457+0000","last_peered":"2023-12-04T05:38:48.042457+0000","last_clean":"2023-12-04T05:38:48.042457+0000","last_became_active":"2023-12-04T05:38:47.048034+0000","last_became_peered":"2023-12-04T05:38:47.048034+0000","last_unstale":"2023-12-04T05:38:48.042457+0000","last_undegraded":"2023-12-04T05:38:48.042457+0000","last_fullsized":"2023-12-04T05:38:48.042457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:00:17.547825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025074+0000","last_change":"2023-12-04T05:38:29.353550+0000","last_active":"2023-12-04T05:38:47.025074+0000","last_peered":"2023-12-04T05:38:47.025074+0000","last_clean":"2023-12-04T05:38:47.025074+0000","last_became_active":"2023-12-04T05:38:29.353168+0000","last_became_peered":"2023-12-04T05:38:29.353168+0000","last_unstale":"2023-12-04T05:38:47.025074+0000","last_undegraded":"2023-12-04T05:38:47.025074+0000","last_fullsized":"2023-12-04T05:38:47.025074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:20.689218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063639+0000","last_change":"2023-12-04T05:38:47.061460+0000","last_active":"2023-12-04T05:38:47.063639+0000","last_peered":"2023-12-04T05:38:47.063639+0000","last_clean":"2023-12-04T05:38:47.063639+0000","last_became_active":"2023-12-04T05:38:47.060415+0000","last_became_peered":"2023-12-04T05:38:47.060415+0000","last_unstale":"2023-12-04T05:38:47.063639+0000","last_undegraded":"2023-12-04T05:38:47.063639+0000","last_fullsized":"2023-12-04T05:38:47.063639+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:26.936192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023678+0000","last_change":"2023-12-04T05:38:29.357106+0000","last_active":"2023-12-04T05:38:47.023678+0000","last_peered":"2023-12-04T05:38:47.023678+0000","last_clean":"2023-12-04T05:38:47.023678+0000","last_became_active":"2023-12-04T05:38:29.356781+0000","last_became_peered":"2023-12-04T05:38:29.356781+0000","last_unstale":"2023-12-04T05:38:47.023678+0000","last_undegraded":"2023-12-04T05:38:47.023678+0000","last_fullsized":"2023-12-04T05:38:47.023678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:17.004052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041956+0000","last_change":"2023-12-04T05:38:47.040903+0000","last_active":"2023-12-04T05:38:48.041956+0000","last_peered":"2023-12-04T05:38:48.041956+0000","last_clean":"2023-12-04T05:38:48.041956+0000","last_became_active":"2023-12-04T05:38:47.039018+0000","last_became_peered":"2023-12-04T05:38:47.039018+0000","last_unstale":"2023-12-04T05:38:48.041956+0000","last_undegraded":"2023-12-04T05:38:48.041956+0000","last_fullsized":"2023-12-04T05:38:48.041956+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037968+0000","last_change":"2023-12-04T05:38:29.358871+0000","last_active":"2023-12-04T05:38:46.037968+0000","last_peered":"2023-12-04T05:38:46.037968+0000","last_clean":"2023-12-04T05:38:46.037968+0000","last_became_active":"2023-12-04T05:38:29.358575+0000","last_became_peered":"2023-12-04T05:38:29.358575+0000","last_unstale":"2023-12-04T05:38:46.037968+0000","last_undegraded":"2023-12-04T05:38:46.037968+0000","last_fullsized":"2023-12-04T05:38:46.037968+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041015+0000","last_change":"2023-12-04T05:38:47.038571+0000","last_active":"2023-12-04T05:38:47.041015+0000","last_peered":"2023-12-04T05:38:47.041015+0000","last_clean":"2023-12-04T05:38:47.041015+0000","last_became_active":"2023-12-04T05:38:47.037718+0000","last_became_peered":"2023-12-04T05:38:47.037718+0000","last_unstale":"2023-12-04T05:38:47.041015+0000","last_undegraded":"2023-12-04T05:38:47.041015+0000","last_fullsized":"2023-12-04T05:38:47.041015+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029781+0000","last_change":"2023-12-04T05:38:29.363316+0000","last_active":"2023-12-04T05:38:46.029781+0000","last_peered":"2023-12-04T05:38:46.029781+0000","last_clean":"2023-12-04T05:38:46.029781+0000","last_became_active":"2023-12-04T05:38:29.362949+0000","last_became_peered":"2023-12-04T05:38:29.362949+0000","last_unstale":"2023-12-04T05:38:46.029781+0000","last_undegraded":"2023-12-04T05:38:46.029781+0000","last_fullsized":"2023-12-04T05:38:46.029781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:42:35.750245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040677+0000","last_change":"2023-12-04T05:38:47.048032+0000","last_active":"2023-12-04T05:38:48.040677+0000","last_peered":"2023-12-04T05:38:48.040677+0000","last_clean":"2023-12-04T05:38:48.040677+0000","last_became_active":"2023-12-04T05:38:47.047158+0000","last_became_peered":"2023-12-04T05:38:47.047158+0000","last_unstale":"2023-12-04T05:38:48.040677+0000","last_undegraded":"2023-12-04T05:38:48.040677+0000","last_fullsized":"2023-12-04T05:38:48.040677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:03:28.098551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026543+0000","last_change":"2023-12-04T05:38:29.351970+0000","last_active":"2023-12-04T05:38:47.026543+0000","last_peered":"2023-12-04T05:38:47.026543+0000","last_clean":"2023-12-04T05:38:47.026543+0000","last_became_active":"2023-12-04T05:38:29.351547+0000","last_became_peered":"2023-12-04T05:38:29.351547+0000","last_unstale":"2023-12-04T05:38:47.026543+0000","last_undegraded":"2023-12-04T05:38:47.026543+0000","last_fullsized":"2023-12-04T05:38:47.026543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:22:28.844459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.049718+0000","last_change":"2023-12-04T05:38:47.045199+0000","last_active":"2023-12-04T05:38:47.049718+0000","last_peered":"2023-12-04T05:38:47.049718+0000","last_clean":"2023-12-04T05:38:47.049718+0000","last_became_active":"2023-12-04T05:38:47.041875+0000","last_became_peered":"2023-12-04T05:38:47.041875+0000","last_unstale":"2023-12-04T05:38:47.049718+0000","last_undegraded":"2023-12-04T05:38:47.049718+0000","last_fullsized":"2023-12-04T05:38:47.049718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:36.779373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.025296+0000","last_change":"2023-12-04T05:38:29.349829+0000","last_active":"2023-12-04T05:38:47.025296+0000","last_peered":"2023-12-04T05:38:47.025296+0000","last_clean":"2023-12-04T05:38:47.025296+0000","last_became_active":"2023-12-04T05:38:29.349570+0000","last_became_peered":"2023-12-04T05:38:29.349570+0000","last_unstale":"2023-12-04T05:38:47.025296+0000","last_undegraded":"2023-12-04T05:38:47.025296+0000","last_fullsized":"2023-12-04T05:38:47.025296+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:42:30.244005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060743+0000","last_change":"2023-12-04T05:38:47.055938+0000","last_active":"2023-12-04T05:38:47.060743+0000","last_peered":"2023-12-04T05:38:47.060743+0000","last_clean":"2023-12-04T05:38:47.060743+0000","last_became_active":"2023-12-04T05:38:47.055630+0000","last_became_peered":"2023-12-04T05:38:47.055630+0000","last_unstale":"2023-12-04T05:38:47.060743+0000","last_undegraded":"2023-12-04T05:38:47.060743+0000","last_fullsized":"2023-12-04T05:38:47.060743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:24.893301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032207+0000","last_change":"2023-12-04T05:38:29.343672+0000","last_active":"2023-12-04T05:38:46.032207+0000","last_peered":"2023-12-04T05:38:46.032207+0000","last_clean":"2023-12-04T05:38:46.032207+0000","last_became_active":"2023-12-04T05:38:29.343378+0000","last_became_peered":"2023-12-04T05:38:29.343378+0000","last_unstale":"2023-12-04T05:38:46.032207+0000","last_undegraded":"2023-12-04T05:38:46.032207+0000","last_fullsized":"2023-12-04T05:38:46.032207+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055349+0000","last_change":"2023-12-04T05:38:47.044202+0000","last_active":"2023-12-04T05:38:47.055349+0000","last_peered":"2023-12-04T05:38:47.055349+0000","last_clean":"2023-12-04T05:38:47.055349+0000","last_became_active":"2023-12-04T05:38:47.042606+0000","last_became_peered":"2023-12-04T05:38:47.042606+0000","last_unstale":"2023-12-04T05:38:47.055349+0000","last_undegraded":"2023-12-04T05:38:47.055349+0000","last_fullsized":"2023-12-04T05:38:47.055349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:00:17.547825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044430+0000","last_change":"2023-12-04T05:38:29.348038+0000","last_active":"2023-12-04T05:38:46.044430+0000","last_peered":"2023-12-04T05:38:46.044430+0000","last_clean":"2023-12-04T05:38:46.044430+0000","last_became_active":"2023-12-04T05:38:29.346419+0000","last_became_peered":"2023-12-04T05:38:29.346419+0000","last_unstale":"2023-12-04T05:38:46.044430+0000","last_undegraded":"2023-12-04T05:38:46.044430+0000","last_fullsized":"2023-12-04T05:38:46.044430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:28.971735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041076+0000","last_change":"2023-12-04T05:38:47.038915+0000","last_active":"2023-12-04T05:38:47.041076+0000","last_peered":"2023-12-04T05:38:47.041076+0000","last_clean":"2023-12-04T05:38:47.041076+0000","last_became_active":"2023-12-04T05:38:47.038661+0000","last_became_peered":"2023-12-04T05:38:47.038661+0000","last_unstale":"2023-12-04T05:38:47.041076+0000","last_undegraded":"2023-12-04T05:38:47.041076+0000","last_fullsized":"2023-12-04T05:38:47.041076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:21.234963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038312+0000","last_change":"2023-12-04T05:38:29.370721+0000","last_active":"2023-12-04T05:38:47.038312+0000","last_peered":"2023-12-04T05:38:47.038312+0000","last_clean":"2023-12-04T05:38:47.038312+0000","last_became_active":"2023-12-04T05:38:29.370199+0000","last_became_peered":"2023-12-04T05:38:29.370199+0000","last_unstale":"2023-12-04T05:38:47.038312+0000","last_undegraded":"2023-12-04T05:38:47.038312+0000","last_fullsized":"2023-12-04T05:38:47.038312+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061583+0000","last_change":"2023-12-04T05:38:47.052347+0000","last_active":"2023-12-04T05:38:47.061583+0000","last_peered":"2023-12-04T05:38:47.061583+0000","last_clean":"2023-12-04T05:38:47.061583+0000","last_became_active":"2023-12-04T05:38:47.052074+0000","last_became_peered":"2023-12-04T05:38:47.052074+0000","last_unstale":"2023-12-04T05:38:47.061583+0000","last_undegraded":"2023-12-04T05:38:47.061583+0000","last_fullsized":"2023-12-04T05:38:47.061583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:41.498013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033981+0000","last_change":"2023-12-04T05:38:29.355850+0000","last_active":"2023-12-04T05:38:46.033981+0000","last_peered":"2023-12-04T05:38:46.033981+0000","last_clean":"2023-12-04T05:38:46.033981+0000","last_became_active":"2023-12-04T05:38:29.355549+0000","last_became_peered":"2023-12-04T05:38:29.355549+0000","last_unstale":"2023-12-04T05:38:46.033981+0000","last_undegraded":"2023-12-04T05:38:46.033981+0000","last_fullsized":"2023-12-04T05:38:46.033981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:06:07.261586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042794+0000","last_change":"2023-12-04T05:38:47.040474+0000","last_active":"2023-12-04T05:38:48.042794+0000","last_peered":"2023-12-04T05:38:48.042794+0000","last_clean":"2023-12-04T05:38:48.042794+0000","last_became_active":"2023-12-04T05:38:47.040193+0000","last_became_peered":"2023-12-04T05:38:47.040193+0000","last_unstale":"2023-12-04T05:38:48.042794+0000","last_undegraded":"2023-12-04T05:38:48.042794+0000","last_fullsized":"2023-12-04T05:38:48.042794+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:32:02.401449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040537+0000","last_change":"2023-12-04T05:38:29.345961+0000","last_active":"2023-12-04T05:38:46.040537+0000","last_peered":"2023-12-04T05:38:46.040537+0000","last_clean":"2023-12-04T05:38:46.040537+0000","last_became_active":"2023-12-04T05:38:29.345359+0000","last_became_peered":"2023-12-04T05:38:29.345359+0000","last_unstale":"2023-12-04T05:38:46.040537+0000","last_undegraded":"2023-12-04T05:38:46.040537+0000","last_fullsized":"2023-12-04T05:38:46.040537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:15:19.090966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042079+0000","last_change":"2023-12-04T05:38:47.055046+0000","last_active":"2023-12-04T05:38:48.042079+0000","last_peered":"2023-12-04T05:38:48.042079+0000","last_clean":"2023-12-04T05:38:48.042079+0000","last_became_active":"2023-12-04T05:38:47.054813+0000","last_became_peered":"2023-12-04T05:38:47.054813+0000","last_unstale":"2023-12-04T05:38:48.042079+0000","last_undegraded":"2023-12-04T05:38:48.042079+0000","last_fullsized":"2023-12-04T05:38:48.042079+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:10:17.726184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038570+0000","last_change":"2023-12-04T05:38:29.366491+0000","last_active":"2023-12-04T05:38:47.038570+0000","last_peered":"2023-12-04T05:38:47.038570+0000","last_clean":"2023-12-04T05:38:47.038570+0000","last_became_active":"2023-12-04T05:38:29.366202+0000","last_became_peered":"2023-12-04T05:38:29.366202+0000","last_unstale":"2023-12-04T05:38:47.038570+0000","last_undegraded":"2023-12-04T05:38:47.038570+0000","last_fullsized":"2023-12-04T05:38:47.038570+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040143+0000","last_change":"2023-12-04T05:38:47.056135+0000","last_active":"2023-12-04T05:38:48.040143+0000","last_peered":"2023-12-04T05:38:48.040143+0000","last_clean":"2023-12-04T05:38:48.040143+0000","last_became_active":"2023-12-04T05:38:47.055807+0000","last_became_peered":"2023-12-04T05:38:47.055807+0000","last_unstale":"2023-12-04T05:38:48.040143+0000","last_undegraded":"2023-12-04T05:38:48.040143+0000","last_fullsized":"2023-12-04T05:38:48.040143+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:25.588503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038299+0000","last_change":"2023-12-04T05:38:29.353157+0000","last_active":"2023-12-04T05:38:46.038299+0000","last_peered":"2023-12-04T05:38:46.038299+0000","last_clean":"2023-12-04T05:38:46.038299+0000","last_became_active":"2023-12-04T05:38:29.352879+0000","last_became_peered":"2023-12-04T05:38:29.352879+0000","last_unstale":"2023-12-04T05:38:46.038299+0000","last_undegraded":"2023-12-04T05:38:46.038299+0000","last_fullsized":"2023-12-04T05:38:46.038299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:02.199367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041695+0000","last_change":"2023-12-04T05:38:47.035763+0000","last_active":"2023-12-04T05:38:48.041695+0000","last_peered":"2023-12-04T05:38:48.041695+0000","last_clean":"2023-12-04T05:38:48.041695+0000","last_became_active":"2023-12-04T05:38:47.035456+0000","last_became_peered":"2023-12-04T05:38:47.035456+0000","last_unstale":"2023-12-04T05:38:48.041695+0000","last_undegraded":"2023-12-04T05:38:48.041695+0000","last_fullsized":"2023-12-04T05:38:48.041695+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:43.944051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037613+0000","last_change":"2023-12-04T05:38:29.368754+0000","last_active":"2023-12-04T05:38:47.037613+0000","last_peered":"2023-12-04T05:38:47.037613+0000","last_clean":"2023-12-04T05:38:47.037613+0000","last_became_active":"2023-12-04T05:38:29.368261+0000","last_became_peered":"2023-12-04T05:38:29.368261+0000","last_unstale":"2023-12-04T05:38:47.037613+0000","last_undegraded":"2023-12-04T05:38:47.037613+0000","last_fullsized":"2023-12-04T05:38:47.037613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041329+0000","last_change":"2023-12-04T05:38:47.040938+0000","last_active":"2023-12-04T05:38:48.041329+0000","last_peered":"2023-12-04T05:38:48.041329+0000","last_clean":"2023-12-04T05:38:48.041329+0000","last_became_active":"2023-12-04T05:38:47.040644+0000","last_became_peered":"2023-12-04T05:38:47.040644+0000","last_unstale":"2023-12-04T05:38:48.041329+0000","last_undegraded":"2023-12-04T05:38:48.041329+0000","last_fullsized":"2023-12-04T05:38:48.041329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:50.832106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029004+0000","last_change":"2023-12-04T05:38:29.363152+0000","last_active":"2023-12-04T05:38:46.029004+0000","last_peered":"2023-12-04T05:38:46.029004+0000","last_clean":"2023-12-04T05:38:46.029004+0000","last_became_active":"2023-12-04T05:38:29.362819+0000","last_became_peered":"2023-12-04T05:38:29.362819+0000","last_unstale":"2023-12-04T05:38:46.029004+0000","last_undegraded":"2023-12-04T05:38:46.029004+0000","last_fullsized":"2023-12-04T05:38:46.029004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:46:09.247784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064840+0000","last_change":"2023-12-04T05:38:47.060243+0000","last_active":"2023-12-04T05:38:47.064840+0000","last_peered":"2023-12-04T05:38:47.064840+0000","last_clean":"2023-12-04T05:38:47.064840+0000","last_became_active":"2023-12-04T05:38:47.055180+0000","last_became_peered":"2023-12-04T05:38:47.055180+0000","last_unstale":"2023-12-04T05:38:47.064840+0000","last_undegraded":"2023-12-04T05:38:47.064840+0000","last_fullsized":"2023-12-04T05:38:47.064840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:57:25.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033813+0000","last_change":"2023-12-04T05:38:29.362074+0000","last_active":"2023-12-04T05:38:46.033813+0000","last_peered":"2023-12-04T05:38:46.033813+0000","last_clean":"2023-12-04T05:38:46.033813+0000","last_became_active":"2023-12-04T05:38:29.361714+0000","last_became_peered":"2023-12-04T05:38:29.361714+0000","last_unstale":"2023-12-04T05:38:46.033813+0000","last_undegraded":"2023-12-04T05:38:46.033813+0000","last_fullsized":"2023-12-04T05:38:46.033813+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:51.063339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041489+0000","last_change":"2023-12-04T05:38:47.040804+0000","last_active":"2023-12-04T05:38:48.041489+0000","last_peered":"2023-12-04T05:38:48.041489+0000","last_clean":"2023-12-04T05:38:48.041489+0000","last_became_active":"2023-12-04T05:38:47.040358+0000","last_became_peered":"2023-12-04T05:38:47.040358+0000","last_unstale":"2023-12-04T05:38:48.041489+0000","last_undegraded":"2023-12-04T05:38:48.041489+0000","last_fullsized":"2023-12-04T05:38:48.041489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:42.020777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039899+0000","last_change":"2023-12-04T05:38:29.361452+0000","last_active":"2023-12-04T05:38:46.039899+0000","last_peered":"2023-12-04T05:38:46.039899+0000","last_clean":"2023-12-04T05:38:46.039899+0000","last_became_active":"2023-12-04T05:38:29.361006+0000","last_became_peered":"2023-12-04T05:38:29.361006+0000","last_unstale":"2023-12-04T05:38:46.039899+0000","last_undegraded":"2023-12-04T05:38:46.039899+0000","last_fullsized":"2023-12-04T05:38:46.039899+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:18.932345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041521+0000","last_change":"2023-12-04T05:38:47.053495+0000","last_active":"2023-12-04T05:38:48.041521+0000","last_peered":"2023-12-04T05:38:48.041521+0000","last_clean":"2023-12-04T05:38:48.041521+0000","last_became_active":"2023-12-04T05:38:47.053200+0000","last_became_peered":"2023-12-04T05:38:47.053200+0000","last_unstale":"2023-12-04T05:38:48.041521+0000","last_undegraded":"2023-12-04T05:38:48.041521+0000","last_fullsized":"2023-12-04T05:38:48.041521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:51.355834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034739+0000","last_change":"2023-12-04T05:38:29.347468+0000","last_active":"2023-12-04T05:38:46.034739+0000","last_peered":"2023-12-04T05:38:46.034739+0000","last_clean":"2023-12-04T05:38:46.034739+0000","last_became_active":"2023-12-04T05:38:29.347197+0000","last_became_peered":"2023-12-04T05:38:29.347197+0000","last_unstale":"2023-12-04T05:38:46.034739+0000","last_undegraded":"2023-12-04T05:38:46.034739+0000","last_fullsized":"2023-12-04T05:38:46.034739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053403+0000","last_change":"2023-12-04T05:38:47.051437+0000","last_active":"2023-12-04T05:38:47.053403+0000","last_peered":"2023-12-04T05:38:47.053403+0000","last_clean":"2023-12-04T05:38:47.053403+0000","last_became_active":"2023-12-04T05:38:47.051043+0000","last_became_peered":"2023-12-04T05:38:47.051043+0000","last_unstale":"2023-12-04T05:38:47.053403+0000","last_undegraded":"2023-12-04T05:38:47.053403+0000","last_fullsized":"2023-12-04T05:38:47.053403+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:51.355834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033181+0000","last_change":"2023-12-04T05:38:29.356542+0000","last_active":"2023-12-04T05:38:46.033181+0000","last_peered":"2023-12-04T05:38:46.033181+0000","last_clean":"2023-12-04T05:38:46.033181+0000","last_became_active":"2023-12-04T05:38:29.356279+0000","last_became_peered":"2023-12-04T05:38:29.356279+0000","last_unstale":"2023-12-04T05:38:46.033181+0000","last_undegraded":"2023-12-04T05:38:46.033181+0000","last_fullsized":"2023-12-04T05:38:46.033181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:24:36.475992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.058703+0000","last_change":"2023-12-04T05:38:47.051333+0000","last_active":"2023-12-04T05:38:47.058703+0000","last_peered":"2023-12-04T05:38:47.058703+0000","last_clean":"2023-12-04T05:38:47.058703+0000","last_became_active":"2023-12-04T05:38:47.051032+0000","last_became_peered":"2023-12-04T05:38:47.051032+0000","last_unstale":"2023-12-04T05:38:47.058703+0000","last_undegraded":"2023-12-04T05:38:47.058703+0000","last_fullsized":"2023-12-04T05:38:47.058703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:50.832106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040224+0000","last_change":"2023-12-04T05:38:29.357772+0000","last_active":"2023-12-04T05:38:46.040224+0000","last_peered":"2023-12-04T05:38:46.040224+0000","last_clean":"2023-12-04T05:38:46.040224+0000","last_became_active":"2023-12-04T05:38:29.357471+0000","last_became_peered":"2023-12-04T05:38:29.357471+0000","last_unstale":"2023-12-04T05:38:46.040224+0000","last_undegraded":"2023-12-04T05:38:46.040224+0000","last_fullsized":"2023-12-04T05:38:46.040224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:00.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.054797+0000","last_change":"2023-12-04T05:38:47.049823+0000","last_active":"2023-12-04T05:38:47.054797+0000","last_peered":"2023-12-04T05:38:47.054797+0000","last_clean":"2023-12-04T05:38:47.054797+0000","last_became_active":"2023-12-04T05:38:47.049366+0000","last_became_peered":"2023-12-04T05:38:47.049366+0000","last_unstale":"2023-12-04T05:38:47.054797+0000","last_undegraded":"2023-12-04T05:38:47.054797+0000","last_fullsized":"2023-12-04T05:38:47.054797+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:35.574285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.035579+0000","last_change":"2023-12-04T05:38:29.369540+0000","last_active":"2023-12-04T05:38:47.035579+0000","last_peered":"2023-12-04T05:38:47.035579+0000","last_clean":"2023-12-04T05:38:47.035579+0000","last_became_active":"2023-12-04T05:38:29.369243+0000","last_became_peered":"2023-12-04T05:38:29.369243+0000","last_unstale":"2023-12-04T05:38:47.035579+0000","last_undegraded":"2023-12-04T05:38:47.035579+0000","last_fullsized":"2023-12-04T05:38:47.035579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:42.809900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063120+0000","last_change":"2023-12-04T05:38:47.051949+0000","last_active":"2023-12-04T05:38:47.063120+0000","last_peered":"2023-12-04T05:38:47.063120+0000","last_clean":"2023-12-04T05:38:47.063120+0000","last_became_active":"2023-12-04T05:38:47.051654+0000","last_became_peered":"2023-12-04T05:38:47.051654+0000","last_unstale":"2023-12-04T05:38:47.063120+0000","last_undegraded":"2023-12-04T05:38:47.063120+0000","last_fullsized":"2023-12-04T05:38:47.063120+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:35.003631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.031131+0000","last_change":"2023-12-04T05:38:29.351869+0000","last_active":"2023-12-04T05:38:46.031131+0000","last_peered":"2023-12-04T05:38:46.031131+0000","last_clean":"2023-12-04T05:38:46.031131+0000","last_became_active":"2023-12-04T05:38:29.350826+0000","last_became_peered":"2023-12-04T05:38:29.350826+0000","last_unstale":"2023-12-04T05:38:46.031131+0000","last_undegraded":"2023-12-04T05:38:46.031131+0000","last_fullsized":"2023-12-04T05:38:46.031131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:12.441421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.062995+0000","last_change":"2023-12-04T05:38:47.055160+0000","last_active":"2023-12-04T05:38:47.062995+0000","last_peered":"2023-12-04T05:38:47.062995+0000","last_clean":"2023-12-04T05:38:47.062995+0000","last_became_active":"2023-12-04T05:38:47.054566+0000","last_became_peered":"2023-12-04T05:38:47.054566+0000","last_unstale":"2023-12-04T05:38:47.062995+0000","last_undegraded":"2023-12-04T05:38:47.062995+0000","last_fullsized":"2023-12-04T05:38:47.062995+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032345+0000","last_change":"2023-12-04T05:38:29.346210+0000","last_active":"2023-12-04T05:38:46.032345+0000","last_peered":"2023-12-04T05:38:46.032345+0000","last_clean":"2023-12-04T05:38:46.032345+0000","last_became_active":"2023-12-04T05:38:29.345870+0000","last_became_peered":"2023-12-04T05:38:29.345870+0000","last_unstale":"2023-12-04T05:38:46.032345+0000","last_undegraded":"2023-12-04T05:38:46.032345+0000","last_fullsized":"2023-12-04T05:38:46.032345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:34.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055289+0000","last_change":"2023-12-04T05:38:47.051346+0000","last_active":"2023-12-04T05:38:47.055289+0000","last_peered":"2023-12-04T05:38:47.055289+0000","last_clean":"2023-12-04T05:38:47.055289+0000","last_became_active":"2023-12-04T05:38:47.051089+0000","last_became_peered":"2023-12-04T05:38:47.051089+0000","last_unstale":"2023-12-04T05:38:47.055289+0000","last_undegraded":"2023-12-04T05:38:47.055289+0000","last_fullsized":"2023-12-04T05:38:47.055289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:46.703908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042039+0000","last_change":"2023-12-04T05:38:46.034627+0000","last_active":"2023-12-04T05:38:48.042039+0000","last_peered":"2023-12-04T05:38:48.042039+0000","last_clean":"2023-12-04T05:38:48.042039+0000","last_became_active":"2023-12-04T05:38:46.034332+0000","last_became_peered":"2023-12-04T05:38:46.034332+0000","last_unstale":"2023-12-04T05:38:48.042039+0000","last_undegraded":"2023-12-04T05:38:48.042039+0000","last_fullsized":"2023-12-04T05:38:48.042039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:45.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035543+0000","last_change":"2023-12-04T05:38:29.358811+0000","last_active":"2023-12-04T05:38:46.035543+0000","last_peered":"2023-12-04T05:38:46.035543+0000","last_clean":"2023-12-04T05:38:46.035543+0000","last_became_active":"2023-12-04T05:38:29.358559+0000","last_became_peered":"2023-12-04T05:38:29.358559+0000","last_unstale":"2023-12-04T05:38:46.035543+0000","last_undegraded":"2023-12-04T05:38:46.035543+0000","last_fullsized":"2023-12-04T05:38:46.035543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:40.775232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034920+0000","last_change":"2023-12-04T05:38:28.357084+0000","last_active":"2023-12-04T05:38:46.034920+0000","last_peered":"2023-12-04T05:38:46.034920+0000","last_clean":"2023-12-04T05:38:46.034920+0000","last_became_active":"2023-12-04T05:38:28.356727+0000","last_became_peered":"2023-12-04T05:38:28.356727+0000","last_unstale":"2023-12-04T05:38:46.034920+0000","last_undegraded":"2023-12-04T05:38:46.034920+0000","last_fullsized":"2023-12-04T05:38:46.034920+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:17.923080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042023+0000","last_change":"2023-12-04T05:38:47.051546+0000","last_active":"2023-12-04T05:38:48.042023+0000","last_peered":"2023-12-04T05:38:48.042023+0000","last_clean":"2023-12-04T05:38:48.042023+0000","last_became_active":"2023-12-04T05:38:47.050899+0000","last_became_peered":"2023-12-04T05:38:47.050899+0000","last_unstale":"2023-12-04T05:38:48.042023+0000","last_undegraded":"2023-12-04T05:38:48.042023+0000","last_fullsized":"2023-12-04T05:38:48.042023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:19:24.832207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066286+0000","last_change":"2023-12-04T05:38:46.037437+0000","last_active":"2023-12-04T05:38:47.066286+0000","last_peered":"2023-12-04T05:38:47.066286+0000","last_clean":"2023-12-04T05:38:47.066286+0000","last_became_active":"2023-12-04T05:38:46.037063+0000","last_became_peered":"2023-12-04T05:38:46.037063+0000","last_unstale":"2023-12-04T05:38:47.066286+0000","last_undegraded":"2023-12-04T05:38:47.066286+0000","last_fullsized":"2023-12-04T05:38:47.066286+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:49.207656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024494+0000","last_change":"2023-12-04T05:38:29.362758+0000","last_active":"2023-12-04T05:38:47.024494+0000","last_peered":"2023-12-04T05:38:47.024494+0000","last_clean":"2023-12-04T05:38:47.024494+0000","last_became_active":"2023-12-04T05:38:29.362402+0000","last_became_peered":"2023-12-04T05:38:29.362402+0000","last_unstale":"2023-12-04T05:38:47.024494+0000","last_undegraded":"2023-12-04T05:38:47.024494+0000","last_fullsized":"2023-12-04T05:38:47.024494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:19.743112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044488+0000","last_change":"2023-12-04T05:38:28.347627+0000","last_active":"2023-12-04T05:38:46.044488+0000","last_peered":"2023-12-04T05:38:46.044488+0000","last_clean":"2023-12-04T05:38:46.044488+0000","last_became_active":"2023-12-04T05:38:28.345941+0000","last_became_peered":"2023-12-04T05:38:28.345941+0000","last_unstale":"2023-12-04T05:38:46.044488+0000","last_undegraded":"2023-12-04T05:38:46.044488+0000","last_fullsized":"2023-12-04T05:38:46.044488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:48.649051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041761+0000","last_change":"2023-12-04T05:38:47.061488+0000","last_active":"2023-12-04T05:38:48.041761+0000","last_peered":"2023-12-04T05:38:48.041761+0000","last_clean":"2023-12-04T05:38:48.041761+0000","last_became_active":"2023-12-04T05:38:47.056015+0000","last_became_peered":"2023-12-04T05:38:47.056015+0000","last_unstale":"2023-12-04T05:38:48.041761+0000","last_undegraded":"2023-12-04T05:38:48.041761+0000","last_fullsized":"2023-12-04T05:38:48.041761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:48:13.519500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040784+0000","last_change":"2023-12-04T05:38:46.050132+0000","last_active":"2023-12-04T05:38:48.040784+0000","last_peered":"2023-12-04T05:38:48.040784+0000","last_clean":"2023-12-04T05:38:48.040784+0000","last_became_active":"2023-12-04T05:38:46.049780+0000","last_became_peered":"2023-12-04T05:38:46.049780+0000","last_unstale":"2023-12-04T05:38:48.040784+0000","last_undegraded":"2023-12-04T05:38:48.040784+0000","last_fullsized":"2023-12-04T05:38:48.040784+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:40.176030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033048+0000","last_change":"2023-12-04T05:38:29.360274+0000","last_active":"2023-12-04T05:38:46.033048+0000","last_peered":"2023-12-04T05:38:46.033048+0000","last_clean":"2023-12-04T05:38:46.033048+0000","last_became_active":"2023-12-04T05:38:29.359956+0000","last_became_peered":"2023-12-04T05:38:29.359956+0000","last_unstale":"2023-12-04T05:38:46.033048+0000","last_undegraded":"2023-12-04T05:38:46.033048+0000","last_fullsized":"2023-12-04T05:38:46.033048+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035098+0000","last_change":"2023-12-04T05:38:28.353084+0000","last_active":"2023-12-04T05:38:46.035098+0000","last_peered":"2023-12-04T05:38:46.035098+0000","last_clean":"2023-12-04T05:38:46.035098+0000","last_became_active":"2023-12-04T05:38:28.351122+0000","last_became_peered":"2023-12-04T05:38:28.351122+0000","last_unstale":"2023-12-04T05:38:46.035098+0000","last_undegraded":"2023-12-04T05:38:46.035098+0000","last_fullsized":"2023-12-04T05:38:46.035098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:42.125435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053426+0000","last_change":"2023-12-04T05:38:47.048355+0000","last_active":"2023-12-04T05:38:47.053426+0000","last_peered":"2023-12-04T05:38:47.053426+0000","last_clean":"2023-12-04T05:38:47.053426+0000","last_became_active":"2023-12-04T05:38:47.047130+0000","last_became_peered":"2023-12-04T05:38:47.047130+0000","last_unstale":"2023-12-04T05:38:47.053426+0000","last_undegraded":"2023-12-04T05:38:47.053426+0000","last_fullsized":"2023-12-04T05:38:47.053426+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:38.423256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061176+0000","last_change":"2023-12-04T05:38:46.044400+0000","last_active":"2023-12-04T05:38:47.061176+0000","last_peered":"2023-12-04T05:38:47.061176+0000","last_clean":"2023-12-04T05:38:47.061176+0000","last_became_active":"2023-12-04T05:38:46.044069+0000","last_became_peered":"2023-12-04T05:38:46.044069+0000","last_unstale":"2023-12-04T05:38:47.061176+0000","last_undegraded":"2023-12-04T05:38:47.061176+0000","last_fullsized":"2023-12-04T05:38:47.061176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:33.968744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034918+0000","last_change":"2023-12-04T05:38:29.358876+0000","last_active":"2023-12-04T05:38:46.034918+0000","last_peered":"2023-12-04T05:38:46.034918+0000","last_clean":"2023-12-04T05:38:46.034918+0000","last_became_active":"2023-12-04T05:38:29.358607+0000","last_became_peered":"2023-12-04T05:38:29.358607+0000","last_unstale":"2023-12-04T05:38:46.034918+0000","last_undegraded":"2023-12-04T05:38:46.034918+0000","last_fullsized":"2023-12-04T05:38:46.034918+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:49.658316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038059+0000","last_change":"2023-12-04T05:38:28.355795+0000","last_active":"2023-12-04T05:38:46.038059+0000","last_peered":"2023-12-04T05:38:46.038059+0000","last_clean":"2023-12-04T05:38:46.038059+0000","last_became_active":"2023-12-04T05:38:28.355356+0000","last_became_peered":"2023-12-04T05:38:28.355356+0000","last_unstale":"2023-12-04T05:38:46.038059+0000","last_undegraded":"2023-12-04T05:38:46.038059+0000","last_fullsized":"2023-12-04T05:38:46.038059+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:07.408506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045395+0000","last_change":"2023-12-04T05:38:47.037770+0000","last_active":"2023-12-04T05:38:47.045395+0000","last_peered":"2023-12-04T05:38:47.045395+0000","last_clean":"2023-12-04T05:38:47.045395+0000","last_became_active":"2023-12-04T05:38:47.037518+0000","last_became_peered":"2023-12-04T05:38:47.037518+0000","last_unstale":"2023-12-04T05:38:47.045395+0000","last_undegraded":"2023-12-04T05:38:47.045395+0000","last_fullsized":"2023-12-04T05:38:47.045395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:48:31.468352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041794+0000","last_change":"2023-12-04T05:38:46.040492+0000","last_active":"2023-12-04T05:38:48.041794+0000","last_peered":"2023-12-04T05:38:48.041794+0000","last_clean":"2023-12-04T05:38:48.041794+0000","last_became_active":"2023-12-04T05:38:46.036670+0000","last_became_peered":"2023-12-04T05:38:46.036670+0000","last_unstale":"2023-12-04T05:38:48.041794+0000","last_undegraded":"2023-12-04T05:38:48.041794+0000","last_fullsized":"2023-12-04T05:38:48.041794+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:25.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038414+0000","last_change":"2023-12-04T05:38:29.355352+0000","last_active":"2023-12-04T05:38:46.038414+0000","last_peered":"2023-12-04T05:38:46.038414+0000","last_clean":"2023-12-04T05:38:46.038414+0000","last_became_active":"2023-12-04T05:38:29.353176+0000","last_became_peered":"2023-12-04T05:38:29.353176+0000","last_unstale":"2023-12-04T05:38:46.038414+0000","last_undegraded":"2023-12-04T05:38:46.038414+0000","last_fullsized":"2023-12-04T05:38:46.038414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:07:18.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027155+0000","last_change":"2023-12-04T05:38:28.351077+0000","last_active":"2023-12-04T05:38:47.027155+0000","last_peered":"2023-12-04T05:38:47.027155+0000","last_clean":"2023-12-04T05:38:47.027155+0000","last_became_active":"2023-12-04T05:38:28.350462+0000","last_became_peered":"2023-12-04T05:38:28.350462+0000","last_unstale":"2023-12-04T05:38:47.027155+0000","last_undegraded":"2023-12-04T05:38:47.027155+0000","last_fullsized":"2023-12-04T05:38:47.027155+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:36:19.679953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045629+0000","last_change":"2023-12-04T05:38:47.042523+0000","last_active":"2023-12-04T05:38:47.045629+0000","last_peered":"2023-12-04T05:38:47.045629+0000","last_clean":"2023-12-04T05:38:47.045629+0000","last_became_active":"2023-12-04T05:38:47.042259+0000","last_became_peered":"2023-12-04T05:38:47.042259+0000","last_unstale":"2023-12-04T05:38:47.045629+0000","last_undegraded":"2023-12-04T05:38:47.045629+0000","last_fullsized":"2023-12-04T05:38:47.045629+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:24.041071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.032381+0000","last_change":"2023-12-04T05:38:46.037672+0000","last_active":"2023-12-04T05:38:47.032381+0000","last_peered":"2023-12-04T05:38:47.032381+0000","last_clean":"2023-12-04T05:38:47.032381+0000","last_became_active":"2023-12-04T05:38:46.037415+0000","last_became_peered":"2023-12-04T05:38:46.037415+0000","last_unstale":"2023-12-04T05:38:47.032381+0000","last_undegraded":"2023-12-04T05:38:47.032381+0000","last_fullsized":"2023-12-04T05:38:47.032381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:12.134853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039986+0000","last_change":"2023-12-04T05:38:29.345510+0000","last_active":"2023-12-04T05:38:46.039986+0000","last_peered":"2023-12-04T05:38:46.039986+0000","last_clean":"2023-12-04T05:38:46.039986+0000","last_became_active":"2023-12-04T05:38:29.345223+0000","last_became_peered":"2023-12-04T05:38:29.345223+0000","last_unstale":"2023-12-04T05:38:46.039986+0000","last_undegraded":"2023-12-04T05:38:46.039986+0000","last_fullsized":"2023-12-04T05:38:46.039986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:04.504544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032564+0000","last_change":"2023-12-04T05:38:28.351389+0000","last_active":"2023-12-04T05:38:46.032564+0000","last_peered":"2023-12-04T05:38:46.032564+0000","last_clean":"2023-12-04T05:38:46.032564+0000","last_became_active":"2023-12-04T05:38:28.350142+0000","last_became_peered":"2023-12-04T05:38:28.350142+0000","last_unstale":"2023-12-04T05:38:46.032564+0000","last_undegraded":"2023-12-04T05:38:46.032564+0000","last_fullsized":"2023-12-04T05:38:46.032564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:14:54.935662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.062975+0000","last_change":"2023-12-04T05:38:47.054975+0000","last_active":"2023-12-04T05:38:47.062975+0000","last_peered":"2023-12-04T05:38:47.062975+0000","last_clean":"2023-12-04T05:38:47.062975+0000","last_became_active":"2023-12-04T05:38:47.054131+0000","last_became_peered":"2023-12-04T05:38:47.054131+0000","last_unstale":"2023-12-04T05:38:47.062975+0000","last_undegraded":"2023-12-04T05:38:47.062975+0000","last_fullsized":"2023-12-04T05:38:47.062975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064791+0000","last_change":"2023-12-04T05:38:46.046456+0000","last_active":"2023-12-04T05:38:47.064791+0000","last_peered":"2023-12-04T05:38:47.064791+0000","last_clean":"2023-12-04T05:38:47.064791+0000","last_became_active":"2023-12-04T05:38:46.046137+0000","last_became_peered":"2023-12-04T05:38:46.046137+0000","last_unstale":"2023-12-04T05:38:47.064791+0000","last_undegraded":"2023-12-04T05:38:47.064791+0000","last_fullsized":"2023-12-04T05:38:47.064791+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:44:39.342161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029098+0000","last_change":"2023-12-04T05:38:29.360246+0000","last_active":"2023-12-04T05:38:46.029098+0000","last_peered":"2023-12-04T05:38:46.029098+0000","last_clean":"2023-12-04T05:38:46.029098+0000","last_became_active":"2023-12-04T05:38:29.359538+0000","last_became_peered":"2023-12-04T05:38:29.359538+0000","last_unstale":"2023-12-04T05:38:46.029098+0000","last_undegraded":"2023-12-04T05:38:46.029098+0000","last_fullsized":"2023-12-04T05:38:46.029098+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:07.204894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034712+0000","last_change":"2023-12-04T05:38:28.350133+0000","last_active":"2023-12-04T05:38:46.034712+0000","last_peered":"2023-12-04T05:38:46.034712+0000","last_clean":"2023-12-04T05:38:46.034712+0000","last_became_active":"2023-12-04T05:38:28.349752+0000","last_became_peered":"2023-12-04T05:38:28.349752+0000","last_unstale":"2023-12-04T05:38:46.034712+0000","last_undegraded":"2023-12-04T05:38:46.034712+0000","last_fullsized":"2023-12-04T05:38:46.034712+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:27:16.876613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041491+0000","last_change":"2023-12-04T05:38:47.043757+0000","last_active":"2023-12-04T05:38:48.041491+0000","last_peered":"2023-12-04T05:38:48.041491+0000","last_clean":"2023-12-04T05:38:48.041491+0000","last_became_active":"2023-12-04T05:38:47.042236+0000","last_became_peered":"2023-12-04T05:38:47.042236+0000","last_unstale":"2023-12-04T05:38:48.041491+0000","last_undegraded":"2023-12-04T05:38:48.041491+0000","last_fullsized":"2023-12-04T05:38:48.041491+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:39:55.722726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066254+0000","last_change":"2023-12-04T05:38:46.038491+0000","last_active":"2023-12-04T05:38:47.066254+0000","last_peered":"2023-12-04T05:38:47.066254+0000","last_clean":"2023-12-04T05:38:47.066254+0000","last_became_active":"2023-12-04T05:38:46.038160+0000","last_became_peered":"2023-12-04T05:38:46.038160+0000","last_unstale":"2023-12-04T05:38:47.066254+0000","last_undegraded":"2023-12-04T05:38:47.066254+0000","last_fullsized":"2023-12-04T05:38:47.066254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:59.814941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038299+0000","last_change":"2023-12-04T05:38:29.349000+0000","last_active":"2023-12-04T05:38:46.038299+0000","last_peered":"2023-12-04T05:38:46.038299+0000","last_clean":"2023-12-04T05:38:46.038299+0000","last_became_active":"2023-12-04T05:38:29.348695+0000","last_became_peered":"2023-12-04T05:38:29.348695+0000","last_unstale":"2023-12-04T05:38:46.038299+0000","last_undegraded":"2023-12-04T05:38:46.038299+0000","last_fullsized":"2023-12-04T05:38:46.038299+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:06.352663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024724+0000","last_change":"2023-12-04T05:38:28.350256+0000","last_active":"2023-12-04T05:38:47.024724+0000","last_peered":"2023-12-04T05:38:47.024724+0000","last_clean":"2023-12-04T05:38:47.024724+0000","last_became_active":"2023-12-04T05:38:28.349886+0000","last_became_peered":"2023-12-04T05:38:28.349886+0000","last_unstale":"2023-12-04T05:38:47.024724+0000","last_undegraded":"2023-12-04T05:38:47.024724+0000","last_fullsized":"2023-12-04T05:38:47.024724+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:35.559263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.042326+0000","last_change":"2023-12-04T05:38:47.033266+0000","last_active":"2023-12-04T05:38:47.042326+0000","last_peered":"2023-12-04T05:38:47.042326+0000","last_clean":"2023-12-04T05:38:47.042326+0000","last_became_active":"2023-12-04T05:38:47.032751+0000","last_became_peered":"2023-12-04T05:38:47.032751+0000","last_unstale":"2023-12-04T05:38:47.042326+0000","last_undegraded":"2023-12-04T05:38:47.042326+0000","last_fullsized":"2023-12-04T05:38:47.042326+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:44.419223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067104+0000","last_change":"2023-12-04T05:38:46.044154+0000","last_active":"2023-12-04T05:38:47.067104+0000","last_peered":"2023-12-04T05:38:47.067104+0000","last_clean":"2023-12-04T05:38:47.067104+0000","last_became_active":"2023-12-04T05:38:46.043802+0000","last_became_peered":"2023-12-04T05:38:46.043802+0000","last_unstale":"2023-12-04T05:38:47.067104+0000","last_undegraded":"2023-12-04T05:38:47.067104+0000","last_fullsized":"2023-12-04T05:38:47.067104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:09.033091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026323+0000","last_change":"2023-12-04T05:38:29.358064+0000","last_active":"2023-12-04T05:38:47.026323+0000","last_peered":"2023-12-04T05:38:47.026323+0000","last_clean":"2023-12-04T05:38:47.026323+0000","last_became_active":"2023-12-04T05:38:29.357794+0000","last_became_peered":"2023-12-04T05:38:29.357794+0000","last_unstale":"2023-12-04T05:38:47.026323+0000","last_undegraded":"2023-12-04T05:38:47.026323+0000","last_fullsized":"2023-12-04T05:38:47.026323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:18.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.041326+0000","last_change":"2023-12-04T05:38:28.359951+0000","last_active":"2023-12-04T05:38:47.041326+0000","last_peered":"2023-12-04T05:38:47.041326+0000","last_clean":"2023-12-04T05:38:47.041326+0000","last_became_active":"2023-12-04T05:38:28.359676+0000","last_became_peered":"2023-12-04T05:38:28.359676+0000","last_unstale":"2023-12-04T05:38:47.041326+0000","last_undegraded":"2023-12-04T05:38:47.041326+0000","last_fullsized":"2023-12-04T05:38:47.041326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045136+0000","last_change":"2023-12-04T05:38:47.035979+0000","last_active":"2023-12-04T05:38:47.045136+0000","last_peered":"2023-12-04T05:38:47.045136+0000","last_clean":"2023-12-04T05:38:47.045136+0000","last_became_active":"2023-12-04T05:38:47.035700+0000","last_became_peered":"2023-12-04T05:38:47.035700+0000","last_unstale":"2023-12-04T05:38:47.045136+0000","last_undegraded":"2023-12-04T05:38:47.045136+0000","last_fullsized":"2023-12-04T05:38:47.045136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:47:13.960013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042581+0000","last_change":"2023-12-04T05:38:46.042225+0000","last_active":"2023-12-04T05:38:48.042581+0000","last_peered":"2023-12-04T05:38:48.042581+0000","last_clean":"2023-12-04T05:38:48.042581+0000","last_became_active":"2023-12-04T05:38:46.041921+0000","last_became_peered":"2023-12-04T05:38:46.041921+0000","last_unstale":"2023-12-04T05:38:48.042581+0000","last_undegraded":"2023-12-04T05:38:48.042581+0000","last_fullsized":"2023-12-04T05:38:48.042581+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:59.490141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040028+0000","last_change":"2023-12-04T05:38:29.367074+0000","last_active":"2023-12-04T05:38:47.040028+0000","last_peered":"2023-12-04T05:38:47.040028+0000","last_clean":"2023-12-04T05:38:47.040028+0000","last_became_active":"2023-12-04T05:38:29.366753+0000","last_became_peered":"2023-12-04T05:38:29.366753+0000","last_unstale":"2023-12-04T05:38:47.040028+0000","last_undegraded":"2023-12-04T05:38:47.040028+0000","last_fullsized":"2023-12-04T05:38:47.040028+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:32.527415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044558+0000","last_change":"2023-12-04T05:38:28.356218+0000","last_active":"2023-12-04T05:38:46.044558+0000","last_peered":"2023-12-04T05:38:46.044558+0000","last_clean":"2023-12-04T05:38:46.044558+0000","last_became_active":"2023-12-04T05:38:28.355927+0000","last_became_peered":"2023-12-04T05:38:28.355927+0000","last_unstale":"2023-12-04T05:38:46.044558+0000","last_undegraded":"2023-12-04T05:38:46.044558+0000","last_fullsized":"2023-12-04T05:38:46.044558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:20.717537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064616+0000","last_change":"2023-12-04T05:38:47.061615+0000","last_active":"2023-12-04T05:38:47.064616+0000","last_peered":"2023-12-04T05:38:47.064616+0000","last_clean":"2023-12-04T05:38:47.064616+0000","last_became_active":"2023-12-04T05:38:47.061165+0000","last_became_peered":"2023-12-04T05:38:47.061165+0000","last_unstale":"2023-12-04T05:38:47.064616+0000","last_undegraded":"2023-12-04T05:38:47.064616+0000","last_fullsized":"2023-12-04T05:38:47.064616+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:46:58.769124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041637+0000","last_change":"2023-12-04T05:38:46.044759+0000","last_active":"2023-12-04T05:38:48.041637+0000","last_peered":"2023-12-04T05:38:48.041637+0000","last_clean":"2023-12-04T05:38:48.041637+0000","last_became_active":"2023-12-04T05:38:46.044538+0000","last_became_peered":"2023-12-04T05:38:46.044538+0000","last_unstale":"2023-12-04T05:38:48.041637+0000","last_undegraded":"2023-12-04T05:38:48.041637+0000","last_fullsized":"2023-12-04T05:38:48.041637+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:00:49.207656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023906+0000","last_change":"2023-12-04T05:38:29.354032+0000","last_active":"2023-12-04T05:38:47.023906+0000","last_peered":"2023-12-04T05:38:47.023906+0000","last_clean":"2023-12-04T05:38:47.023906+0000","last_became_active":"2023-12-04T05:38:29.353619+0000","last_became_peered":"2023-12-04T05:38:29.353619+0000","last_unstale":"2023-12-04T05:38:47.023906+0000","last_undegraded":"2023-12-04T05:38:47.023906+0000","last_fullsized":"2023-12-04T05:38:47.023906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:05:21.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036632+0000","last_change":"2023-12-04T05:38:28.362801+0000","last_active":"2023-12-04T05:38:47.036632+0000","last_peered":"2023-12-04T05:38:47.036632+0000","last_clean":"2023-12-04T05:38:47.036632+0000","last_became_active":"2023-12-04T05:38:28.362494+0000","last_became_peered":"2023-12-04T05:38:28.362494+0000","last_unstale":"2023-12-04T05:38:47.036632+0000","last_undegraded":"2023-12-04T05:38:47.036632+0000","last_fullsized":"2023-12-04T05:38:47.036632+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:17.678250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040686+0000","last_change":"2023-12-04T05:38:47.055571+0000","last_active":"2023-12-04T05:38:48.040686+0000","last_peered":"2023-12-04T05:38:48.040686+0000","last_clean":"2023-12-04T05:38:48.040686+0000","last_became_active":"2023-12-04T05:38:47.055305+0000","last_became_peered":"2023-12-04T05:38:47.055305+0000","last_unstale":"2023-12-04T05:38:48.040686+0000","last_undegraded":"2023-12-04T05:38:48.040686+0000","last_fullsized":"2023-12-04T05:38:48.040686+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:57.127190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027416+0000","last_change":"2023-12-04T05:38:46.045108+0000","last_active":"2023-12-04T05:38:47.027416+0000","last_peered":"2023-12-04T05:38:47.027416+0000","last_clean":"2023-12-04T05:38:47.027416+0000","last_became_active":"2023-12-04T05:38:46.044842+0000","last_became_peered":"2023-12-04T05:38:46.044842+0000","last_unstale":"2023-12-04T05:38:47.027416+0000","last_undegraded":"2023-12-04T05:38:47.027416+0000","last_fullsized":"2023-12-04T05:38:47.027416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:33.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036433+0000","last_change":"2023-12-04T05:38:29.365812+0000","last_active":"2023-12-04T05:38:47.036433+0000","last_peered":"2023-12-04T05:38:47.036433+0000","last_clean":"2023-12-04T05:38:47.036433+0000","last_became_active":"2023-12-04T05:38:29.365171+0000","last_became_peered":"2023-12-04T05:38:29.365171+0000","last_unstale":"2023-12-04T05:38:47.036433+0000","last_undegraded":"2023-12-04T05:38:47.036433+0000","last_fullsized":"2023-12-04T05:38:47.036433+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:00:44.316798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.027978+0000","last_change":"2023-12-04T05:38:28.352009+0000","last_active":"2023-12-04T05:38:47.027978+0000","last_peered":"2023-12-04T05:38:47.027978+0000","last_clean":"2023-12-04T05:38:47.027978+0000","last_became_active":"2023-12-04T05:38:28.351727+0000","last_became_peered":"2023-12-04T05:38:28.351727+0000","last_unstale":"2023-12-04T05:38:47.027978+0000","last_undegraded":"2023-12-04T05:38:47.027978+0000","last_fullsized":"2023-12-04T05:38:47.027978+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:56:18.733847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045905+0000","last_change":"2023-12-04T05:38:47.041576+0000","last_active":"2023-12-04T05:38:47.045905+0000","last_peered":"2023-12-04T05:38:47.045905+0000","last_clean":"2023-12-04T05:38:47.045905+0000","last_became_active":"2023-12-04T05:38:47.041118+0000","last_became_peered":"2023-12-04T05:38:47.041118+0000","last_unstale":"2023-12-04T05:38:47.045905+0000","last_undegraded":"2023-12-04T05:38:47.045905+0000","last_fullsized":"2023-12-04T05:38:47.045905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:46.089511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045902+0000","last_change":"2023-12-04T05:38:46.048790+0000","last_active":"2023-12-04T05:38:47.045902+0000","last_peered":"2023-12-04T05:38:47.045902+0000","last_clean":"2023-12-04T05:38:47.045902+0000","last_became_active":"2023-12-04T05:38:46.048353+0000","last_became_peered":"2023-12-04T05:38:46.048353+0000","last_unstale":"2023-12-04T05:38:47.045902+0000","last_undegraded":"2023-12-04T05:38:47.045902+0000","last_fullsized":"2023-12-04T05:38:47.045902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:39:54.714560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037662+0000","last_change":"2023-12-04T05:38:29.359861+0000","last_active":"2023-12-04T05:38:46.037662+0000","last_peered":"2023-12-04T05:38:46.037662+0000","last_clean":"2023-12-04T05:38:46.037662+0000","last_became_active":"2023-12-04T05:38:29.359381+0000","last_became_peered":"2023-12-04T05:38:29.359381+0000","last_unstale":"2023-12-04T05:38:46.037662+0000","last_undegraded":"2023-12-04T05:38:46.037662+0000","last_fullsized":"2023-12-04T05:38:46.037662+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:59:12.159554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040134+0000","last_change":"2023-12-04T05:38:28.358003+0000","last_active":"2023-12-04T05:38:46.040134+0000","last_peered":"2023-12-04T05:38:46.040134+0000","last_clean":"2023-12-04T05:38:46.040134+0000","last_became_active":"2023-12-04T05:38:28.357687+0000","last_became_peered":"2023-12-04T05:38:28.357687+0000","last_unstale":"2023-12-04T05:38:46.040134+0000","last_undegraded":"2023-12-04T05:38:46.040134+0000","last_fullsized":"2023-12-04T05:38:46.040134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:38:32.658162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.064602+0000","last_change":"2023-12-04T05:38:47.062271+0000","last_active":"2023-12-04T05:38:47.064602+0000","last_peered":"2023-12-04T05:38:47.064602+0000","last_clean":"2023-12-04T05:38:47.064602+0000","last_became_active":"2023-12-04T05:38:47.062056+0000","last_became_peered":"2023-12-04T05:38:47.062056+0000","last_unstale":"2023-12-04T05:38:47.064602+0000","last_undegraded":"2023-12-04T05:38:47.064602+0000","last_fullsized":"2023-12-04T05:38:47.064602+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:30.862782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040759+0000","last_change":"2023-12-04T05:38:46.041214+0000","last_active":"2023-12-04T05:38:48.040759+0000","last_peered":"2023-12-04T05:38:48.040759+0000","last_clean":"2023-12-04T05:38:48.040759+0000","last_became_active":"2023-12-04T05:38:46.040199+0000","last_became_peered":"2023-12-04T05:38:46.040199+0000","last_unstale":"2023-12-04T05:38:48.040759+0000","last_undegraded":"2023-12-04T05:38:48.040759+0000","last_fullsized":"2023-12-04T05:38:48.040759+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:43.411057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038650+0000","last_change":"2023-12-04T05:38:29.366087+0000","last_active":"2023-12-04T05:38:47.038650+0000","last_peered":"2023-12-04T05:38:47.038650+0000","last_clean":"2023-12-04T05:38:47.038650+0000","last_became_active":"2023-12-04T05:38:29.365734+0000","last_became_peered":"2023-12-04T05:38:29.365734+0000","last_unstale":"2023-12-04T05:38:47.038650+0000","last_undegraded":"2023-12-04T05:38:47.038650+0000","last_fullsized":"2023-12-04T05:38:47.038650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029537+0000","last_change":"2023-12-04T05:38:28.343022+0000","last_active":"2023-12-04T05:38:46.029537+0000","last_peered":"2023-12-04T05:38:46.029537+0000","last_clean":"2023-12-04T05:38:46.029537+0000","last_became_active":"2023-12-04T05:38:28.342601+0000","last_became_peered":"2023-12-04T05:38:28.342601+0000","last_unstale":"2023-12-04T05:38:46.029537+0000","last_undegraded":"2023-12-04T05:38:46.029537+0000","last_fullsized":"2023-12-04T05:38:46.029537+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:48:19.725584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040311+0000","last_change":"2023-12-04T05:38:47.052711+0000","last_active":"2023-12-04T05:38:48.040311+0000","last_peered":"2023-12-04T05:38:48.040311+0000","last_clean":"2023-12-04T05:38:48.040311+0000","last_became_active":"2023-12-04T05:38:47.052397+0000","last_became_peered":"2023-12-04T05:38:47.052397+0000","last_unstale":"2023-12-04T05:38:48.040311+0000","last_undegraded":"2023-12-04T05:38:48.040311+0000","last_fullsized":"2023-12-04T05:38:48.040311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:45:46.660143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042321+0000","last_change":"2023-12-04T05:38:46.042969+0000","last_active":"2023-12-04T05:38:48.042321+0000","last_peered":"2023-12-04T05:38:48.042321+0000","last_clean":"2023-12-04T05:38:48.042321+0000","last_became_active":"2023-12-04T05:38:46.041878+0000","last_became_peered":"2023-12-04T05:38:46.041878+0000","last_unstale":"2023-12-04T05:38:48.042321+0000","last_undegraded":"2023-12-04T05:38:48.042321+0000","last_fullsized":"2023-12-04T05:38:48.042321+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:59.814941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024633+0000","last_change":"2023-12-04T05:38:29.359927+0000","last_active":"2023-12-04T05:38:47.024633+0000","last_peered":"2023-12-04T05:38:47.024633+0000","last_clean":"2023-12-04T05:38:47.024633+0000","last_became_active":"2023-12-04T05:38:29.359643+0000","last_became_peered":"2023-12-04T05:38:29.359643+0000","last_unstale":"2023-12-04T05:38:47.024633+0000","last_undegraded":"2023-12-04T05:38:47.024633+0000","last_fullsized":"2023-12-04T05:38:47.024633+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:11.572404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034793+0000","last_change":"2023-12-04T05:38:28.355765+0000","last_active":"2023-12-04T05:38:46.034793+0000","last_peered":"2023-12-04T05:38:46.034793+0000","last_clean":"2023-12-04T05:38:46.034793+0000","last_became_active":"2023-12-04T05:38:28.355180+0000","last_became_peered":"2023-12-04T05:38:28.355180+0000","last_unstale":"2023-12-04T05:38:46.034793+0000","last_undegraded":"2023-12-04T05:38:46.034793+0000","last_fullsized":"2023-12-04T05:38:46.034793+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:40.049769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.050775+0000","last_change":"2023-12-04T05:38:47.045045+0000","last_active":"2023-12-04T05:38:47.050775+0000","last_peered":"2023-12-04T05:38:47.050775+0000","last_clean":"2023-12-04T05:38:47.050775+0000","last_became_active":"2023-12-04T05:38:47.044776+0000","last_became_peered":"2023-12-04T05:38:47.044776+0000","last_unstale":"2023-12-04T05:38:47.050775+0000","last_undegraded":"2023-12-04T05:38:47.050775+0000","last_fullsized":"2023-12-04T05:38:47.050775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:39.415210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024963+0000","last_change":"2023-12-04T05:38:46.041307+0000","last_active":"2023-12-04T05:38:47.024963+0000","last_peered":"2023-12-04T05:38:47.024963+0000","last_clean":"2023-12-04T05:38:47.024963+0000","last_became_active":"2023-12-04T05:38:46.041026+0000","last_became_peered":"2023-12-04T05:38:46.041026+0000","last_unstale":"2023-12-04T05:38:47.024963+0000","last_undegraded":"2023-12-04T05:38:47.024963+0000","last_fullsized":"2023-12-04T05:38:47.024963+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:14:59.490141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.037818+0000","last_change":"2023-12-04T05:38:29.369054+0000","last_active":"2023-12-04T05:38:47.037818+0000","last_peered":"2023-12-04T05:38:47.037818+0000","last_clean":"2023-12-04T05:38:47.037818+0000","last_became_active":"2023-12-04T05:38:29.368644+0000","last_became_peered":"2023-12-04T05:38:29.368644+0000","last_unstale":"2023-12-04T05:38:47.037818+0000","last_undegraded":"2023-12-04T05:38:47.037818+0000","last_fullsized":"2023-12-04T05:38:47.037818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:17.182917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038030+0000","last_change":"2023-12-04T05:38:28.356435+0000","last_active":"2023-12-04T05:38:47.038030+0000","last_peered":"2023-12-04T05:38:47.038030+0000","last_clean":"2023-12-04T05:38:47.038030+0000","last_became_active":"2023-12-04T05:38:28.356110+0000","last_became_peered":"2023-12-04T05:38:28.356110+0000","last_unstale":"2023-12-04T05:38:47.038030+0000","last_undegraded":"2023-12-04T05:38:47.038030+0000","last_fullsized":"2023-12-04T05:38:47.038030+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042518+0000","last_change":"2023-12-04T05:38:47.048484+0000","last_active":"2023-12-04T05:38:48.042518+0000","last_peered":"2023-12-04T05:38:48.042518+0000","last_clean":"2023-12-04T05:38:48.042518+0000","last_became_active":"2023-12-04T05:38:47.048203+0000","last_became_peered":"2023-12-04T05:38:47.048203+0000","last_unstale":"2023-12-04T05:38:48.042518+0000","last_undegraded":"2023-12-04T05:38:48.042518+0000","last_fullsized":"2023-12-04T05:38:48.042518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:34.871324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067680+0000","last_change":"2023-12-04T05:38:46.038283+0000","last_active":"2023-12-04T05:38:47.067680+0000","last_peered":"2023-12-04T05:38:47.067680+0000","last_clean":"2023-12-04T05:38:47.067680+0000","last_became_active":"2023-12-04T05:38:46.037978+0000","last_became_peered":"2023-12-04T05:38:46.037978+0000","last_unstale":"2023-12-04T05:38:47.067680+0000","last_undegraded":"2023-12-04T05:38:47.067680+0000","last_fullsized":"2023-12-04T05:38:47.067680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:29:06.338557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038322+0000","last_change":"2023-12-04T05:38:29.370474+0000","last_active":"2023-12-04T05:38:47.038322+0000","last_peered":"2023-12-04T05:38:47.038322+0000","last_clean":"2023-12-04T05:38:47.038322+0000","last_became_active":"2023-12-04T05:38:29.369734+0000","last_became_peered":"2023-12-04T05:38:29.369734+0000","last_unstale":"2023-12-04T05:38:47.038322+0000","last_undegraded":"2023-12-04T05:38:47.038322+0000","last_fullsized":"2023-12-04T05:38:47.038322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.044652+0000","last_change":"2023-12-04T05:38:28.354536+0000","last_active":"2023-12-04T05:38:46.044652+0000","last_peered":"2023-12-04T05:38:46.044652+0000","last_clean":"2023-12-04T05:38:46.044652+0000","last_became_active":"2023-12-04T05:38:28.354124+0000","last_became_peered":"2023-12-04T05:38:28.354124+0000","last_unstale":"2023-12-04T05:38:46.044652+0000","last_undegraded":"2023-12-04T05:38:46.044652+0000","last_fullsized":"2023-12-04T05:38:46.044652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:14:27.391838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.046736+0000","last_change":"2023-12-04T05:38:47.044133+0000","last_active":"2023-12-04T05:38:47.046736+0000","last_peered":"2023-12-04T05:38:47.046736+0000","last_clean":"2023-12-04T05:38:47.046736+0000","last_became_active":"2023-12-04T05:38:47.043879+0000","last_became_peered":"2023-12-04T05:38:47.043879+0000","last_unstale":"2023-12-04T05:38:47.046736+0000","last_undegraded":"2023-12-04T05:38:47.046736+0000","last_fullsized":"2023-12-04T05:38:47.046736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:15.033994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041268+0000","last_change":"2023-12-04T05:38:46.046462+0000","last_active":"2023-12-04T05:38:48.041268+0000","last_peered":"2023-12-04T05:38:48.041268+0000","last_clean":"2023-12-04T05:38:48.041268+0000","last_became_active":"2023-12-04T05:38:46.046029+0000","last_became_peered":"2023-12-04T05:38:46.046029+0000","last_unstale":"2023-12-04T05:38:48.041268+0000","last_undegraded":"2023-12-04T05:38:48.041268+0000","last_fullsized":"2023-12-04T05:38:48.041268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:23.032904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.042011+0000","last_change":"2023-12-04T05:38:29.359106+0000","last_active":"2023-12-04T05:38:46.042011+0000","last_peered":"2023-12-04T05:38:46.042011+0000","last_clean":"2023-12-04T05:38:46.042011+0000","last_became_active":"2023-12-04T05:38:29.358391+0000","last_became_peered":"2023-12-04T05:38:29.358391+0000","last_unstale":"2023-12-04T05:38:46.042011+0000","last_undegraded":"2023-12-04T05:38:46.042011+0000","last_fullsized":"2023-12-04T05:38:46.042011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035639+0000","last_change":"2023-12-04T05:38:28.354825+0000","last_active":"2023-12-04T05:38:46.035639+0000","last_peered":"2023-12-04T05:38:46.035639+0000","last_clean":"2023-12-04T05:38:46.035639+0000","last_became_active":"2023-12-04T05:38:28.354518+0000","last_became_peered":"2023-12-04T05:38:28.354518+0000","last_unstale":"2023-12-04T05:38:46.035639+0000","last_undegraded":"2023-12-04T05:38:46.035639+0000","last_fullsized":"2023-12-04T05:38:46.035639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:25.508983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042323+0000","last_change":"2023-12-04T05:38:47.035245+0000","last_active":"2023-12-04T05:38:48.042323+0000","last_peered":"2023-12-04T05:38:48.042323+0000","last_clean":"2023-12-04T05:38:48.042323+0000","last_became_active":"2023-12-04T05:38:47.034901+0000","last_became_peered":"2023-12-04T05:38:47.034901+0000","last_unstale":"2023-12-04T05:38:48.042323+0000","last_undegraded":"2023-12-04T05:38:48.042323+0000","last_fullsized":"2023-12-04T05:38:48.042323+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:40:41.184196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066643+0000","last_change":"2023-12-04T05:38:46.044207+0000","last_active":"2023-12-04T05:38:47.066643+0000","last_peered":"2023-12-04T05:38:47.066643+0000","last_clean":"2023-12-04T05:38:47.066643+0000","last_became_active":"2023-12-04T05:38:46.043922+0000","last_became_peered":"2023-12-04T05:38:46.043922+0000","last_unstale":"2023-12-04T05:38:47.066643+0000","last_undegraded":"2023-12-04T05:38:47.066643+0000","last_fullsized":"2023-12-04T05:38:47.066643+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:04:50.840570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040612+0000","last_change":"2023-12-04T05:38:29.346154+0000","last_active":"2023-12-04T05:38:46.040612+0000","last_peered":"2023-12-04T05:38:46.040612+0000","last_clean":"2023-12-04T05:38:46.040612+0000","last_became_active":"2023-12-04T05:38:29.345711+0000","last_became_peered":"2023-12-04T05:38:29.345711+0000","last_unstale":"2023-12-04T05:38:46.040612+0000","last_undegraded":"2023-12-04T05:38:46.040612+0000","last_fullsized":"2023-12-04T05:38:46.040612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:17.288502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037933+0000","last_change":"2023-12-04T05:38:28.356962+0000","last_active":"2023-12-04T05:38:46.037933+0000","last_peered":"2023-12-04T05:38:46.037933+0000","last_clean":"2023-12-04T05:38:46.037933+0000","last_became_active":"2023-12-04T05:38:28.356599+0000","last_became_peered":"2023-12-04T05:38:28.356599+0000","last_unstale":"2023-12-04T05:38:46.037933+0000","last_undegraded":"2023-12-04T05:38:46.037933+0000","last_fullsized":"2023-12-04T05:38:46.037933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041115+0000","last_change":"2023-12-04T05:38:47.061230+0000","last_active":"2023-12-04T05:38:48.041115+0000","last_peered":"2023-12-04T05:38:48.041115+0000","last_clean":"2023-12-04T05:38:48.041115+0000","last_became_active":"2023-12-04T05:38:47.055736+0000","last_became_peered":"2023-12-04T05:38:47.055736+0000","last_unstale":"2023-12-04T05:38:48.041115+0000","last_undegraded":"2023-12-04T05:38:48.041115+0000","last_fullsized":"2023-12-04T05:38:48.041115+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:36:35.522329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042047+0000","last_change":"2023-12-04T05:38:46.036755+0000","last_active":"2023-12-04T05:38:48.042047+0000","last_peered":"2023-12-04T05:38:48.042047+0000","last_clean":"2023-12-04T05:38:48.042047+0000","last_became_active":"2023-12-04T05:38:46.036423+0000","last_became_peered":"2023-12-04T05:38:46.036423+0000","last_unstale":"2023-12-04T05:38:48.042047+0000","last_undegraded":"2023-12-04T05:38:48.042047+0000","last_fullsized":"2023-12-04T05:38:48.042047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:29:06.338557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.036534+0000","last_change":"2023-12-04T05:38:29.365123+0000","last_active":"2023-12-04T05:38:47.036534+0000","last_peered":"2023-12-04T05:38:47.036534+0000","last_clean":"2023-12-04T05:38:47.036534+0000","last_became_active":"2023-12-04T05:38:29.364212+0000","last_became_peered":"2023-12-04T05:38:29.364212+0000","last_unstale":"2023-12-04T05:38:47.036534+0000","last_undegraded":"2023-12-04T05:38:47.036534+0000","last_fullsized":"2023-12-04T05:38:47.036534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.033131+0000","last_change":"2023-12-04T05:38:28.350111+0000","last_active":"2023-12-04T05:38:46.033131+0000","last_peered":"2023-12-04T05:38:46.033131+0000","last_clean":"2023-12-04T05:38:46.033131+0000","last_became_active":"2023-12-04T05:38:28.349788+0000","last_became_peered":"2023-12-04T05:38:28.349788+0000","last_unstale":"2023-12-04T05:38:46.033131+0000","last_undegraded":"2023-12-04T05:38:46.033131+0000","last_fullsized":"2023-12-04T05:38:46.033131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:13.849781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.063304+0000","last_change":"2023-12-04T05:38:47.055663+0000","last_active":"2023-12-04T05:38:47.063304+0000","last_peered":"2023-12-04T05:38:47.063304+0000","last_clean":"2023-12-04T05:38:47.063304+0000","last_became_active":"2023-12-04T05:38:47.052681+0000","last_became_peered":"2023-12-04T05:38:47.052681+0000","last_unstale":"2023-12-04T05:38:47.063304+0000","last_undegraded":"2023-12-04T05:38:47.063304+0000","last_fullsized":"2023-12-04T05:38:47.063304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:42:21.627585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.045754+0000","last_change":"2023-12-04T05:38:46.046023+0000","last_active":"2023-12-04T05:38:47.045754+0000","last_peered":"2023-12-04T05:38:47.045754+0000","last_clean":"2023-12-04T05:38:47.045754+0000","last_became_active":"2023-12-04T05:38:46.045726+0000","last_became_peered":"2023-12-04T05:38:46.045726+0000","last_unstale":"2023-12-04T05:38:47.045754+0000","last_undegraded":"2023-12-04T05:38:47.045754+0000","last_fullsized":"2023-12-04T05:38:47.045754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:41.012611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.037929+0000","last_change":"2023-12-04T05:38:29.359656+0000","last_active":"2023-12-04T05:38:46.037929+0000","last_peered":"2023-12-04T05:38:46.037929+0000","last_clean":"2023-12-04T05:38:46.037929+0000","last_became_active":"2023-12-04T05:38:29.358747+0000","last_became_peered":"2023-12-04T05:38:29.358747+0000","last_unstale":"2023-12-04T05:38:46.037929+0000","last_undegraded":"2023-12-04T05:38:46.037929+0000","last_fullsized":"2023-12-04T05:38:46.037929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:10:43.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.040257+0000","last_change":"2023-12-04T05:38:28.357652+0000","last_active":"2023-12-04T05:38:46.040257+0000","last_peered":"2023-12-04T05:38:46.040257+0000","last_clean":"2023-12-04T05:38:46.040257+0000","last_became_active":"2023-12-04T05:38:28.357276+0000","last_became_peered":"2023-12-04T05:38:28.357276+0000","last_unstale":"2023-12-04T05:38:46.040257+0000","last_undegraded":"2023-12-04T05:38:46.040257+0000","last_fullsized":"2023-12-04T05:38:46.040257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:25.246379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.061011+0000","last_change":"2023-12-04T05:38:47.046259+0000","last_active":"2023-12-04T05:38:47.061011+0000","last_peered":"2023-12-04T05:38:47.061011+0000","last_clean":"2023-12-04T05:38:47.061011+0000","last_became_active":"2023-12-04T05:38:47.045967+0000","last_became_peered":"2023-12-04T05:38:47.045967+0000","last_unstale":"2023-12-04T05:38:47.061011+0000","last_undegraded":"2023-12-04T05:38:47.061011+0000","last_fullsized":"2023-12-04T05:38:47.061011+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:28:30.180664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028024+0000","last_change":"2023-12-04T05:38:46.047725+0000","last_active":"2023-12-04T05:38:47.028024+0000","last_peered":"2023-12-04T05:38:47.028024+0000","last_clean":"2023-12-04T05:38:47.028024+0000","last_became_active":"2023-12-04T05:38:46.046634+0000","last_became_peered":"2023-12-04T05:38:46.046634+0000","last_unstale":"2023-12-04T05:38:47.028024+0000","last_undegraded":"2023-12-04T05:38:47.028024+0000","last_fullsized":"2023-12-04T05:38:47.028024+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:31:21.184785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032788+0000","last_change":"2023-12-04T05:38:29.347237+0000","last_active":"2023-12-04T05:38:46.032788+0000","last_peered":"2023-12-04T05:38:46.032788+0000","last_clean":"2023-12-04T05:38:46.032788+0000","last_became_active":"2023-12-04T05:38:29.346964+0000","last_became_peered":"2023-12-04T05:38:29.346964+0000","last_unstale":"2023-12-04T05:38:46.032788+0000","last_undegraded":"2023-12-04T05:38:46.032788+0000","last_fullsized":"2023-12-04T05:38:46.032788+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:31:44.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023013+0000","last_change":"2023-12-04T05:38:28.353652+0000","last_active":"2023-12-04T05:38:47.023013+0000","last_peered":"2023-12-04T05:38:47.023013+0000","last_clean":"2023-12-04T05:38:47.023013+0000","last_became_active":"2023-12-04T05:38:28.353358+0000","last_became_peered":"2023-12-04T05:38:28.353358+0000","last_unstale":"2023-12-04T05:38:47.023013+0000","last_undegraded":"2023-12-04T05:38:47.023013+0000","last_fullsized":"2023-12-04T05:38:47.023013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:15.125860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.060964+0000","last_change":"2023-12-04T05:38:47.047659+0000","last_active":"2023-12-04T05:38:47.060964+0000","last_peered":"2023-12-04T05:38:47.060964+0000","last_clean":"2023-12-04T05:38:47.060964+0000","last_became_active":"2023-12-04T05:38:47.047357+0000","last_became_peered":"2023-12-04T05:38:47.047357+0000","last_unstale":"2023-12-04T05:38:47.060964+0000","last_undegraded":"2023-12-04T05:38:47.060964+0000","last_fullsized":"2023-12-04T05:38:47.060964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:18.238278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028478+0000","last_change":"2023-12-04T05:38:46.038439+0000","last_active":"2023-12-04T05:38:47.028478+0000","last_peered":"2023-12-04T05:38:47.028478+0000","last_clean":"2023-12-04T05:38:47.028478+0000","last_became_active":"2023-12-04T05:38:46.037805+0000","last_became_peered":"2023-12-04T05:38:46.037805+0000","last_unstale":"2023-12-04T05:38:47.028478+0000","last_undegraded":"2023-12-04T05:38:47.028478+0000","last_fullsized":"2023-12-04T05:38:47.028478+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:01:00.997039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.032225+0000","last_change":"2023-12-04T05:38:29.366166+0000","last_active":"2023-12-04T05:38:46.032225+0000","last_peered":"2023-12-04T05:38:46.032225+0000","last_clean":"2023-12-04T05:38:46.032225+0000","last_became_active":"2023-12-04T05:38:29.365434+0000","last_became_peered":"2023-12-04T05:38:29.365434+0000","last_unstale":"2023-12-04T05:38:46.032225+0000","last_undegraded":"2023-12-04T05:38:46.032225+0000","last_fullsized":"2023-12-04T05:38:46.032225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:27:29.015501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.034532+0000","last_change":"2023-12-04T05:38:28.353323+0000","last_active":"2023-12-04T05:38:46.034532+0000","last_peered":"2023-12-04T05:38:46.034532+0000","last_clean":"2023-12-04T05:38:46.034532+0000","last_became_active":"2023-12-04T05:38:28.352993+0000","last_became_peered":"2023-12-04T05:38:28.352993+0000","last_unstale":"2023-12-04T05:38:46.034532+0000","last_undegraded":"2023-12-04T05:38:46.034532+0000","last_fullsized":"2023-12-04T05:38:46.034532+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:17.139808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041179+0000","last_change":"2023-12-04T05:38:47.056291+0000","last_active":"2023-12-04T05:38:48.041179+0000","last_peered":"2023-12-04T05:38:48.041179+0000","last_clean":"2023-12-04T05:38:48.041179+0000","last_became_active":"2023-12-04T05:38:47.055961+0000","last_became_peered":"2023-12-04T05:38:47.055961+0000","last_unstale":"2023-12-04T05:38:48.041179+0000","last_undegraded":"2023-12-04T05:38:48.041179+0000","last_fullsized":"2023-12-04T05:38:48.041179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:30:24.137437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.032567+0000","last_change":"2023-12-04T05:38:46.042014+0000","last_active":"2023-12-04T05:38:47.032567+0000","last_peered":"2023-12-04T05:38:47.032567+0000","last_clean":"2023-12-04T05:38:47.032567+0000","last_became_active":"2023-12-04T05:38:46.041731+0000","last_became_peered":"2023-12-04T05:38:46.041731+0000","last_unstale":"2023-12-04T05:38:47.032567+0000","last_undegraded":"2023-12-04T05:38:47.032567+0000","last_fullsized":"2023-12-04T05:38:47.032567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:39.856144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.039983+0000","last_change":"2023-12-04T05:38:29.355646+0000","last_active":"2023-12-04T05:38:46.039983+0000","last_peered":"2023-12-04T05:38:46.039983+0000","last_clean":"2023-12-04T05:38:46.039983+0000","last_became_active":"2023-12-04T05:38:29.355239+0000","last_became_peered":"2023-12-04T05:38:29.355239+0000","last_unstale":"2023-12-04T05:38:46.039983+0000","last_undegraded":"2023-12-04T05:38:46.039983+0000","last_fullsized":"2023-12-04T05:38:46.039983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:38.298774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024574+0000","last_change":"2023-12-04T05:38:28.339404+0000","last_active":"2023-12-04T05:38:47.024574+0000","last_peered":"2023-12-04T05:38:47.024574+0000","last_clean":"2023-12-04T05:38:47.024574+0000","last_became_active":"2023-12-04T05:38:28.339126+0000","last_became_peered":"2023-12-04T05:38:28.339126+0000","last_unstale":"2023-12-04T05:38:47.024574+0000","last_undegraded":"2023-12-04T05:38:47.024574+0000","last_fullsized":"2023-12-04T05:38:47.024574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:09:54.445347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.042190+0000","last_change":"2023-12-04T05:38:47.051727+0000","last_active":"2023-12-04T05:38:48.042190+0000","last_peered":"2023-12-04T05:38:48.042190+0000","last_clean":"2023-12-04T05:38:48.042190+0000","last_became_active":"2023-12-04T05:38:47.051215+0000","last_became_peered":"2023-12-04T05:38:47.051215+0000","last_unstale":"2023-12-04T05:38:48.042190+0000","last_undegraded":"2023-12-04T05:38:48.042190+0000","last_fullsized":"2023-12-04T05:38:48.042190+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:12.855980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.028461+0000","last_change":"2023-12-04T05:38:46.045967+0000","last_active":"2023-12-04T05:38:47.028461+0000","last_peered":"2023-12-04T05:38:47.028461+0000","last_clean":"2023-12-04T05:38:47.028461+0000","last_became_active":"2023-12-04T05:38:46.045594+0000","last_became_peered":"2023-12-04T05:38:46.045594+0000","last_unstale":"2023-12-04T05:38:47.028461+0000","last_undegraded":"2023-12-04T05:38:47.028461+0000","last_fullsized":"2023-12-04T05:38:47.028461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:21:35.040765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.041840+0000","last_change":"2023-12-04T05:38:29.359342+0000","last_active":"2023-12-04T05:38:46.041840+0000","last_peered":"2023-12-04T05:38:46.041840+0000","last_clean":"2023-12-04T05:38:46.041840+0000","last_became_active":"2023-12-04T05:38:29.358806+0000","last_became_peered":"2023-12-04T05:38:29.358806+0000","last_unstale":"2023-12-04T05:38:46.041840+0000","last_undegraded":"2023-12-04T05:38:46.041840+0000","last_fullsized":"2023-12-04T05:38:46.041840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:59:59.859418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035776+0000","last_change":"2023-12-04T05:38:28.351967+0000","last_active":"2023-12-04T05:38:46.035776+0000","last_peered":"2023-12-04T05:38:46.035776+0000","last_clean":"2023-12-04T05:38:46.035776+0000","last_became_active":"2023-12-04T05:38:28.350680+0000","last_became_peered":"2023-12-04T05:38:28.350680+0000","last_unstale":"2023-12-04T05:38:46.035776+0000","last_undegraded":"2023-12-04T05:38:46.035776+0000","last_fullsized":"2023-12-04T05:38:46.035776+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:37.289509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040916+0000","last_change":"2023-12-04T05:38:47.037903+0000","last_active":"2023-12-04T05:38:47.040916+0000","last_peered":"2023-12-04T05:38:47.040916+0000","last_clean":"2023-12-04T05:38:47.040916+0000","last_became_active":"2023-12-04T05:38:47.037611+0000","last_became_peered":"2023-12-04T05:38:47.037611+0000","last_unstale":"2023-12-04T05:38:47.040916+0000","last_undegraded":"2023-12-04T05:38:47.040916+0000","last_fullsized":"2023-12-04T05:38:47.040916+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:35.654657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066570+0000","last_change":"2023-12-04T05:38:46.044136+0000","last_active":"2023-12-04T05:38:47.066570+0000","last_peered":"2023-12-04T05:38:47.066570+0000","last_clean":"2023-12-04T05:38:47.066570+0000","last_became_active":"2023-12-04T05:38:46.043860+0000","last_became_peered":"2023-12-04T05:38:46.043860+0000","last_unstale":"2023-12-04T05:38:47.066570+0000","last_undegraded":"2023-12-04T05:38:47.066570+0000","last_fullsized":"2023-12-04T05:38:47.066570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:06:31.539287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023987+0000","last_change":"2023-12-04T05:38:29.355636+0000","last_active":"2023-12-04T05:38:47.023987+0000","last_peered":"2023-12-04T05:38:47.023987+0000","last_clean":"2023-12-04T05:38:47.023987+0000","last_became_active":"2023-12-04T05:38:29.354320+0000","last_became_peered":"2023-12-04T05:38:29.354320+0000","last_unstale":"2023-12-04T05:38:47.023987+0000","last_undegraded":"2023-12-04T05:38:47.023987+0000","last_fullsized":"2023-12-04T05:38:47.023987+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:34:36.568528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.030205+0000","last_change":"2023-12-04T05:38:28.338365+0000","last_active":"2023-12-04T05:38:46.030205+0000","last_peered":"2023-12-04T05:38:46.030205+0000","last_clean":"2023-12-04T05:38:46.030205+0000","last_became_active":"2023-12-04T05:38:28.337946+0000","last_became_peered":"2023-12-04T05:38:28.337946+0000","last_unstale":"2023-12-04T05:38:46.030205+0000","last_undegraded":"2023-12-04T05:38:46.030205+0000","last_fullsized":"2023-12-04T05:38:46.030205+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:40:22.800341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.050460+0000","last_change":"2023-12-04T05:38:47.043988+0000","last_active":"2023-12-04T05:38:47.050460+0000","last_peered":"2023-12-04T05:38:47.050460+0000","last_clean":"2023-12-04T05:38:47.050460+0000","last_became_active":"2023-12-04T05:38:47.043701+0000","last_became_peered":"2023-12-04T05:38:47.043701+0000","last_unstale":"2023-12-04T05:38:47.050460+0000","last_undegraded":"2023-12-04T05:38:47.050460+0000","last_fullsized":"2023-12-04T05:38:47.050460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:56:58.463639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.046771+0000","last_change":"2023-12-04T05:38:46.042777+0000","last_active":"2023-12-04T05:38:47.046771+0000","last_peered":"2023-12-04T05:38:47.046771+0000","last_clean":"2023-12-04T05:38:47.046771+0000","last_became_active":"2023-12-04T05:38:46.042511+0000","last_became_peered":"2023-12-04T05:38:46.042511+0000","last_unstale":"2023-12-04T05:38:47.046771+0000","last_undegraded":"2023-12-04T05:38:47.046771+0000","last_fullsized":"2023-12-04T05:38:47.046771+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:27:42.935885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.035011+0000","last_change":"2023-12-04T05:38:29.352860+0000","last_active":"2023-12-04T05:38:46.035011+0000","last_peered":"2023-12-04T05:38:46.035011+0000","last_clean":"2023-12-04T05:38:46.035011+0000","last_became_active":"2023-12-04T05:38:29.352511+0000","last_became_peered":"2023-12-04T05:38:29.352511+0000","last_unstale":"2023-12-04T05:38:46.035011+0000","last_undegraded":"2023-12-04T05:38:46.035011+0000","last_fullsized":"2023-12-04T05:38:46.035011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:54:21.726802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038176+0000","last_change":"2023-12-04T05:38:28.350094+0000","last_active":"2023-12-04T05:38:46.038176+0000","last_peered":"2023-12-04T05:38:46.038176+0000","last_clean":"2023-12-04T05:38:46.038176+0000","last_became_active":"2023-12-04T05:38:28.349731+0000","last_became_peered":"2023-12-04T05:38:28.349731+0000","last_unstale":"2023-12-04T05:38:46.038176+0000","last_undegraded":"2023-12-04T05:38:46.038176+0000","last_fullsized":"2023-12-04T05:38:46.038176+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:47:07.362253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041672+0000","last_change":"2023-12-04T05:38:47.047772+0000","last_active":"2023-12-04T05:38:48.041672+0000","last_peered":"2023-12-04T05:38:48.041672+0000","last_clean":"2023-12-04T05:38:48.041672+0000","last_became_active":"2023-12-04T05:38:47.047488+0000","last_became_peered":"2023-12-04T05:38:47.047488+0000","last_unstale":"2023-12-04T05:38:48.041672+0000","last_undegraded":"2023-12-04T05:38:48.041672+0000","last_fullsized":"2023-12-04T05:38:48.041672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:44.419223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.040603+0000","last_change":"2023-12-04T05:38:46.040812+0000","last_active":"2023-12-04T05:38:48.040603+0000","last_peered":"2023-12-04T05:38:48.040603+0000","last_clean":"2023-12-04T05:38:48.040603+0000","last_became_active":"2023-12-04T05:38:46.040528+0000","last_became_peered":"2023-12-04T05:38:46.040528+0000","last_unstale":"2023-12-04T05:38:48.040603+0000","last_undegraded":"2023-12-04T05:38:48.040603+0000","last_fullsized":"2023-12-04T05:38:48.040603+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:29:33.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.041026+0000","last_change":"2023-12-04T05:38:29.350276+0000","last_active":"2023-12-04T05:38:46.041026+0000","last_peered":"2023-12-04T05:38:46.041026+0000","last_clean":"2023-12-04T05:38:46.041026+0000","last_became_active":"2023-12-04T05:38:29.350015+0000","last_became_peered":"2023-12-04T05:38:29.350015+0000","last_unstale":"2023-12-04T05:38:46.041026+0000","last_undegraded":"2023-12-04T05:38:46.041026+0000","last_fullsized":"2023-12-04T05:38:46.041026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:33:07.900096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.023074+0000","last_change":"2023-12-04T05:38:28.353620+0000","last_active":"2023-12-04T05:38:47.023074+0000","last_peered":"2023-12-04T05:38:47.023074+0000","last_clean":"2023-12-04T05:38:47.023074+0000","last_became_active":"2023-12-04T05:38:28.353260+0000","last_became_peered":"2023-12-04T05:38:28.353260+0000","last_unstale":"2023-12-04T05:38:47.023074+0000","last_undegraded":"2023-12-04T05:38:47.023074+0000","last_fullsized":"2023-12-04T05:38:47.023074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:10:12.165110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.066280+0000","last_change":"2023-12-04T05:38:47.061834+0000","last_active":"2023-12-04T05:38:47.066280+0000","last_peered":"2023-12-04T05:38:47.066280+0000","last_clean":"2023-12-04T05:38:47.066280+0000","last_became_active":"2023-12-04T05:38:47.061553+0000","last_became_peered":"2023-12-04T05:38:47.061553+0000","last_unstale":"2023-12-04T05:38:47.066280+0000","last_undegraded":"2023-12-04T05:38:47.066280+0000","last_fullsized":"2023-12-04T05:38:47.066280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:52:36.620752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.024906+0000","last_change":"2023-12-04T05:38:46.047636+0000","last_active":"2023-12-04T05:38:47.024906+0000","last_peered":"2023-12-04T05:38:47.024906+0000","last_clean":"2023-12-04T05:38:47.024906+0000","last_became_active":"2023-12-04T05:38:46.046984+0000","last_became_peered":"2023-12-04T05:38:46.046984+0000","last_unstale":"2023-12-04T05:38:47.024906+0000","last_undegraded":"2023-12-04T05:38:47.024906+0000","last_fullsized":"2023-12-04T05:38:47.024906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:43.198488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.038738+0000","last_change":"2023-12-04T05:38:29.366519+0000","last_active":"2023-12-04T05:38:47.038738+0000","last_peered":"2023-12-04T05:38:47.038738+0000","last_clean":"2023-12-04T05:38:47.038738+0000","last_became_active":"2023-12-04T05:38:29.366308+0000","last_became_peered":"2023-12-04T05:38:29.366308+0000","last_unstale":"2023-12-04T05:38:47.038738+0000","last_undegraded":"2023-12-04T05:38:47.038738+0000","last_fullsized":"2023-12-04T05:38:47.038738+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:26.730816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.026640+0000","last_change":"2023-12-04T05:38:28.350853+0000","last_active":"2023-12-04T05:38:47.026640+0000","last_peered":"2023-12-04T05:38:47.026640+0000","last_clean":"2023-12-04T05:38:47.026640+0000","last_became_active":"2023-12-04T05:38:28.350557+0000","last_became_peered":"2023-12-04T05:38:28.350557+0000","last_unstale":"2023-12-04T05:38:47.026640+0000","last_undegraded":"2023-12-04T05:38:47.026640+0000","last_fullsized":"2023-12-04T05:38:47.026640+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:47:15.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.053581+0000","last_change":"2023-12-04T05:38:47.048321+0000","last_active":"2023-12-04T05:38:47.053581+0000","last_peered":"2023-12-04T05:38:47.053581+0000","last_clean":"2023-12-04T05:38:47.053581+0000","last_became_active":"2023-12-04T05:38:47.047410+0000","last_became_peered":"2023-12-04T05:38:47.047410+0000","last_unstale":"2023-12-04T05:38:47.053581+0000","last_undegraded":"2023-12-04T05:38:47.053581+0000","last_fullsized":"2023-12-04T05:38:47.053581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:40:00.580400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.034593+0000","last_change":"2023-12-04T05:38:46.042707+0000","last_active":"2023-12-04T05:38:47.034593+0000","last_peered":"2023-12-04T05:38:47.034593+0000","last_clean":"2023-12-04T05:38:47.034593+0000","last_became_active":"2023-12-04T05:38:46.042437+0000","last_became_peered":"2023-12-04T05:38:46.042437+0000","last_unstale":"2023-12-04T05:38:47.034593+0000","last_undegraded":"2023-12-04T05:38:47.034593+0000","last_fullsized":"2023-12-04T05:38:47.034593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:07:32.815366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.022807+0000","last_change":"2023-12-04T05:38:29.348446+0000","last_active":"2023-12-04T05:38:47.022807+0000","last_peered":"2023-12-04T05:38:47.022807+0000","last_clean":"2023-12-04T05:38:47.022807+0000","last_became_active":"2023-12-04T05:38:29.348081+0000","last_became_peered":"2023-12-04T05:38:29.348081+0000","last_unstale":"2023-12-04T05:38:47.022807+0000","last_undegraded":"2023-12-04T05:38:47.022807+0000","last_fullsized":"2023-12-04T05:38:47.022807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:06:33.662249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.022860+0000","last_change":"2023-12-04T05:38:28.346850+0000","last_active":"2023-12-04T05:38:47.022860+0000","last_peered":"2023-12-04T05:38:47.022860+0000","last_clean":"2023-12-04T05:38:47.022860+0000","last_became_active":"2023-12-04T05:38:28.346605+0000","last_became_peered":"2023-12-04T05:38:28.346605+0000","last_unstale":"2023-12-04T05:38:47.022860+0000","last_undegraded":"2023-12-04T05:38:47.022860+0000","last_fullsized":"2023-12-04T05:38:47.022860+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:01:22.166638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.055755+0000","last_change":"2023-12-04T05:38:47.044153+0000","last_active":"2023-12-04T05:38:47.055755+0000","last_peered":"2023-12-04T05:38:47.055755+0000","last_clean":"2023-12-04T05:38:47.055755+0000","last_became_active":"2023-12-04T05:38:47.043323+0000","last_became_peered":"2023-12-04T05:38:47.043323+0000","last_unstale":"2023-12-04T05:38:47.055755+0000","last_undegraded":"2023-12-04T05:38:47.055755+0000","last_fullsized":"2023-12-04T05:38:47.055755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:16:55.987182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-04T05:38:48.041822+0000","last_change":"2023-12-04T05:38:46.039603+0000","last_active":"2023-12-04T05:38:48.041822+0000","last_peered":"2023-12-04T05:38:48.041822+0000","last_clean":"2023-12-04T05:38:48.041822+0000","last_became_active":"2023-12-04T05:38:46.039339+0000","last_became_peered":"2023-12-04T05:38:46.039339+0000","last_unstale":"2023-12-04T05:38:48.041822+0000","last_undegraded":"2023-12-04T05:38:48.041822+0000","last_fullsized":"2023-12-04T05:38:48.041822+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:32:57.739275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.038386+0000","last_change":"2023-12-04T05:38:29.348990+0000","last_active":"2023-12-04T05:38:46.038386+0000","last_peered":"2023-12-04T05:38:46.038386+0000","last_clean":"2023-12-04T05:38:46.038386+0000","last_became_active":"2023-12-04T05:38:29.348709+0000","last_became_peered":"2023-12-04T05:38:29.348709+0000","last_unstale":"2023-12-04T05:38:46.038386+0000","last_undegraded":"2023-12-04T05:38:46.038386+0000","last_fullsized":"2023-12-04T05:38:46.038386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:03:17.966249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036949+0000","last_change":"2023-12-04T05:38:28.358626+0000","last_active":"2023-12-04T05:38:46.036949+0000","last_peered":"2023-12-04T05:38:46.036949+0000","last_clean":"2023-12-04T05:38:46.036949+0000","last_became_active":"2023-12-04T05:38:28.358311+0000","last_became_peered":"2023-12-04T05:38:28.358311+0000","last_unstale":"2023-12-04T05:38:46.036949+0000","last_undegraded":"2023-12-04T05:38:46.036949+0000","last_fullsized":"2023-12-04T05:38:46.036949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:23:23.323105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.059443+0000","last_change":"2023-12-04T05:38:47.044533+0000","last_active":"2023-12-04T05:38:47.059443+0000","last_peered":"2023-12-04T05:38:47.059443+0000","last_clean":"2023-12-04T05:38:47.059443+0000","last_became_active":"2023-12-04T05:38:47.044259+0000","last_became_peered":"2023-12-04T05:38:47.044259+0000","last_unstale":"2023-12-04T05:38:47.059443+0000","last_undegraded":"2023-12-04T05:38:47.059443+0000","last_fullsized":"2023-12-04T05:38:47.059443+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:46.009139+0000","last_clean_scrub_stamp":"2023-12-04T05:38:46.009139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:12.855980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.067666+0000","last_change":"2023-12-04T05:38:46.037415+0000","last_active":"2023-12-04T05:38:47.067666+0000","last_peered":"2023-12-04T05:38:47.067666+0000","last_clean":"2023-12-04T05:38:47.067666+0000","last_became_active":"2023-12-04T05:38:46.037075+0000","last_became_peered":"2023-12-04T05:38:46.037075+0000","last_unstale":"2023-12-04T05:38:47.067666+0000","last_undegraded":"2023-12-04T05:38:47.067666+0000","last_fullsized":"2023-12-04T05:38:47.067666+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:45.000972+0000","last_clean_scrub_stamp":"2023-12-04T05:38:45.000972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:32:01.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.036863+0000","last_change":"2023-12-04T05:38:29.345465+0000","last_active":"2023-12-04T05:38:46.036863+0000","last_peered":"2023-12-04T05:38:46.036863+0000","last_clean":"2023-12-04T05:38:46.036863+0000","last_became_active":"2023-12-04T05:38:29.345189+0000","last_became_peered":"2023-12-04T05:38:29.345189+0000","last_unstale":"2023-12-04T05:38:46.036863+0000","last_undegraded":"2023-12-04T05:38:46.036863+0000","last_fullsized":"2023-12-04T05:38:46.036863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:28.320731+0000","last_clean_scrub_stamp":"2023-12-04T05:38:28.320731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:49:03.546556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-04T05:38:46.029232+0000","last_change":"2023-12-04T05:38:28.351607+0000","last_active":"2023-12-04T05:38:46.029232+0000","last_peered":"2023-12-04T05:38:46.029232+0000","last_clean":"2023-12-04T05:38:46.029232+0000","last_became_active":"2023-12-04T05:38:28.351286+0000","last_became_peered":"2023-12-04T05:38:28.351286+0000","last_unstale":"2023-12-04T05:38:46.029232+0000","last_undegraded":"2023-12-04T05:38:46.029232+0000","last_fullsized":"2023-12-04T05:38:46.029232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:38:27.311466+0000","last_clean_scrub_stamp":"2023-12-04T05:38:27.311466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:39:41.882728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-04T05:38:47.040463+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:38:47.040463+0000","last_peered":"2023-12-04T05:38:47.040463+0000","last_clean":"2023-12-04T05:38:47.040463+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:38:47.040463+0000","last_undegraded":"2023-12-04T05:38:47.040463+0000","last_fullsized":"2023-12-04T05:38:47.040463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1245184,"data_stored":864669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.78400000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":273617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68700000000000006}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.77100000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.753}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.88200000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":274267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73999999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.63}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.755},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":651264,"data_stored":276702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.78500000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82799999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85499999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.91200000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.84299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.87}]},{"osd":5,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":1.167,"15min":1.167},"last":0.94299999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":1.196,"15min":1.196},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":1.075}]},{"osd":7,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.016},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96699999999999997,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.036}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":273693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82599999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.87},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.81399999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.89700000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.80000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":275193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.46400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.44}]},{"osd":1,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.4130000000000003,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.39100000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.622},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82999999999999996,"15min":0.81699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.3710000000000004,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.96299999999999997,"15min":0.97099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":5.4889999999999999,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.218,"5min":4.218,"15min":4.218},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":275843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.64100000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":867582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.40600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.78800000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.71499999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.70199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:38:51.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:38:51.516 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-04T05:38:51.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.685+0000 7f4a14b1d640 1 Processor -- start 2023-12-04T05:38:51.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.685+0000 7f4a14b1d640 1 -- start start 2023-12-04T05:38:51.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a14b1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a1014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a14b1d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a10154fe0 0x7f4a1015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a14b1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a10154640 con 0x7f4a1014f790 2023-12-04T05:38:51.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a14b1d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100c0bd0 con 0x7f4a10154fe0 2023-12-04T05:38:51.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a14b1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1014ef10 con 0x7f4a1014eb30 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a10154fe0 0x7f4a1015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0e59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a1014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a05d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f4a1014f790 0x7f4a101548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:43646/0 (socket says 172.21.15.97:43646) 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4a10154fe0 0x7f4a1015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:47082/0 (socket says 172.21.15.97:47082) 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a05d9b640 1 -- 172.21.15.97:0/1798783968 learned_addr learned my addr 172.21.15.97:0/1798783968 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 msgr2=0x7f4a1014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 --2- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a1014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/1798783968 >> v1:172.21.15.143:6789/0 conn(0x7f4a1014f790 legacy=0x7f4a101548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/1798783968 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a101535a0 con 0x7f4a10154fe0 2023-12-04T05:38:51.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.689+0000 7f4a0dd9b640 1 -- 172.21.15.97:0/1798783968 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441066448 0 0) 0x7f4a10154640 con 0x7f4a1014f790 2023-12-04T05:38:51.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a0ed9d640 1 --2- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a10154fe0 0x7f4a1015bc60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a080097c0 tx=0x7f4a0801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83c1b53c35f5093 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a0dd9b640 1 -- 172.21.15.97:0/1798783968 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080ab650 con 0x7f4a10154fe0 2023-12-04T05:38:51.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a0dd9b640 1 -- 172.21.15.97:0/1798783968 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a080ab7b0 con 0x7f4a10154fe0 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a0dd9b640 1 -- 172.21.15.97:0/1798783968 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080abb40 con 0x7f4a10154fe0 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a10154fe0 msgr2=0x7f4a1015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a10154fe0 0x7f4a1015bc60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a080097c0 tx=0x7f4a0801c450 comp rx=0 tx=0).stop 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- 172.21.15.97:0/1798783968 shutdown_connections 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a10154fe0 0x7f4a1015bc60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/1798783968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a1014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- 172.21.15.97:0/1798783968 >> 172.21.15.97:0/1798783968 conn(0x7f4a100c5e70 msgr2=0x7f4a100c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- 172.21.15.97:0/1798783968 shutdown_connections 2023-12-04T05:38:51.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- 172.21.15.97:0/1798783968 wait complete. 2023-12-04T05:38:51.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 Processor -- start 2023-12-04T05:38:51.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.693+0000 7f4a14b1d640 1 -- start start 2023-12-04T05:38:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a10071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1014f790 0x7f4a101415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101ed720 con 0x7f4a10154fe0 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10142070 con 0x7f4a1014f790 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10152030 con 0x7f4a1014eb30 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53758/0 (socket says 172.21.15.97:53758) 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/2439662496 learned_addr learned my addr 172.21.15.97:0/2439662496 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a05d9b640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1014f790 0x7f4a101415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0e59c640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a10071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 msgr2=0x7f4a10071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a10071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1014f790 msgr2=0x7f4a101415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1014f790 0x7f4a101415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 -- 172.21.15.97:0/2439662496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009420 con 0x7f4a10154fe0 2023-12-04T05:38:51.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a0ed9d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4a0801ab00 tx=0x7f4a080191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080abd30 con 0x7f4a10154fe0 2023-12-04T05:38:51.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a080bf450 con 0x7f4a10154fe0 2023-12-04T05:38:51.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080bf800 con 0x7f4a10154fe0 2023-12-04T05:38:51.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a101ecdf0 con 0x7f4a10154fe0 2023-12-04T05:38:51.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a101ed3b0 con 0x7f4a10154fe0 2023-12-04T05:38:51.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10068440 con 0x7f4a10154fe0 2023-12-04T05:38:51.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.697+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4a080bf960 con 0x7f4a10154fe0 2023-12-04T05:38:51.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.701+0000 7f4a077fe640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 0x7f49f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:51.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.701+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4a0811f5e0 con 0x7f4a10154fe0 2023-12-04T05:38:51.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.701+0000 7f4a0e59c640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 0x7f49f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:51.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.701+0000 7f4a0e59c640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 0x7f49f0068d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4a000074a0 tx=0x7f4a0000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:51.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.705+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a080ec650 con 0x7f4a10154fe0 2023-12-04T05:38:51.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.905+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f4a101ed860 con 0x7f4a10154fe0 2023-12-04T05:38:51.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.905+0000 7f4a077fe640 1 -- 172.21.15.97:0/2439662496 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v18) v1 ==== 185+0+142 (secure 0 0 0) 0x7f4a080efc70 con 0x7f4a10154fe0 2023-12-04T05:38:51.912 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-12-04T05:38:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ== 2023-12-04T05:38:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:38:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:38:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.1 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 msgr2=0x7f49f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 0x7f49f0068d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4a000074a0 tx=0x7f4a0000b040 comp rx=0 tx=0).stop 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 msgr2=0x7f4a10141b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4a0801ab00 tx=0x7f4a080191f0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.915 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 shutdown_connections 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f49f00668d0 0x7f49f0068d90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4a10154fe0 0x7f4a10141b30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1014f790 0x7f4a101415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 --2- 172.21.15.97:0/2439662496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a1014eb30 0x7f4a10071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 >> 172.21.15.97:0/2439662496 conn(0x7f4a100c5e70 msgr2=0x7f4a100bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:51.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 shutdown_connections 2023-12-04T05:38:51.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:51.909+0000 7f4a14b1d640 1 -- 172.21.15.97:0/2439662496 wait complete. 2023-12-04T05:38:51.934 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:51.934 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:51.944 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:51.944 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:51.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:52.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.129+0000 7fd1a13b8640 1 Processor -- start 2023-12-04T05:38:52.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.129+0000 7fd1a13b8640 1 -- start start 2023-12-04T05:38:52.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd19c0c5d40 0x7fd19c158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd19c0a7290 0x7fd19c0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0c3cd0 con 0x7fd19c0a7290 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c157dc0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1a13b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1521f0 con 0x7fd19c151e10 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd19c0a7290 0x7fd19c0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd19c0a7290 0x7fd19c0c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53762/0 (socket says 172.21.15.97:53762) 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 -- 172.21.15.97:0/264335501 learned_addr learned my addr 172.21.15.97:0/264335501 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd1927fc640 1 --2- 172.21.15.97:0/264335501 >> v2:172.21.15.143:3300/0 conn(0x7fd19c0c5d40 0x7fd19c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19affd640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 -- 172.21.15.97:0/264335501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 msgr2=0x7fd19c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 -- 172.21.15.97:0/264335501 >> v2:172.21.15.143:3300/0 conn(0x7fd19c0c5d40 msgr2=0x7fd19c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 --2- 172.21.15.97:0/264335501 >> v2:172.21.15.143:3300/0 conn(0x7fd19c0c5d40 0x7fd19c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.133+0000 7fd19b7fe640 1 -- 172.21.15.97:0/264335501 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0704a0 con 0x7fd19c0a7290 2023-12-04T05:38:52.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd19b7fe640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0a7290 0x7fd19c0c4800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd19c071de0 tx=0x7fd19401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b281015e1d004376 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd19a7fc640 1 -- 172.21.15.97:0/264335501 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940ac640 con 0x7fd19c0a7290 2023-12-04T05:38:52.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd19a7fc640 1 -- 172.21.15.97:0/264335501 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1940ac7a0 con 0x7fd19c0a7290 2023-12-04T05:38:52.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd19a7fc640 1 -- 172.21.15.97:0/264335501 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940acb30 con 0x7fd19c0a7290 2023-12-04T05:38:52.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- 172.21.15.97:0/264335501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0a7290 msgr2=0x7fd19c0c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0a7290 0x7fd19c0c4800 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd19c071de0 tx=0x7fd19401c440 comp rx=0 tx=0).stop 2023-12-04T05:38:52.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- 172.21.15.97:0/264335501 shutdown_connections 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0a7290 0x7fd19c0c4800 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/264335501 >> v2:172.21.15.143:3300/0 conn(0x7fd19c0c5d40 0x7fd19c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/264335501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- 172.21.15.97:0/264335501 >> 172.21.15.97:0/264335501 conn(0x7fd19c0c7e40 msgr2=0x7fd19c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- 172.21.15.97:0/264335501 shutdown_connections 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- 172.21.15.97:0/264335501 wait complete. 2023-12-04T05:38:52.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 Processor -- start 2023-12-04T05:38:52.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- start start 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd19c0a7290 0x7fd19c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c1ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1f1360 con 0x7fd19c0c5d40 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1f0ed0 con 0x7fd19c0a7290 2023-12-04T05:38:52.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.137+0000 7fd1a13b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1f05a0 con 0x7fd19c151e10 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53764/0 (socket says 172.21.15.97:53764) 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd19affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd19c0a7290 0x7fd19c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 -- 172.21.15.97:0/1910143510 learned_addr learned my addr 172.21.15.97:0/1910143510 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd19b7fe640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c1ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 -- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 msgr2=0x7fd19c1ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c1ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 -- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd19c0a7290 msgr2=0x7fd19c06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd19c0a7290 0x7fd19c06f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 -- 172.21.15.97:0/1910143510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940094d0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1927fc640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d800 tx=0x7fd18400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400b6c0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18400b820 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c1f0880 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400bb90 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c0ac840 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c068440 con 0x7fd19c0c5d40 2023-12-04T05:38:52.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.141+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd18400bcf0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.145+0000 7fd193fff640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 0x7fd17c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.145+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd184084ac0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.145+0000 7fd19affd640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 0x7fd17c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.145+0000 7fd19affd640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 0x7fd17c068dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd19c155bb0 tx=0x7fd18c009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.149+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd184051ac0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.305+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd19c0c5660 con 0x7fd19c0c5d40 2023-12-04T05:38:52.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd193fff640 1 -- 172.21.15.97:0/1910143510 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7fd1840550e0 con 0x7fd19c0c5d40 2023-12-04T05:38:52.313 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:52.313 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:52.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 msgr2=0x7fd17c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 0x7fd17c068dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd19c155bb0 tx=0x7fd18c009830 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 msgr2=0x7fd19c1ece90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d800 tx=0x7fd18400dcc0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 shutdown_connections 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd17c066900 0x7fd17c068dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd19c151e10 0x7fd19c1ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd19c0c5d40 0x7fd19c1ece90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 --2- 172.21.15.97:0/1910143510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd19c0a7290 0x7fd19c06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 >> 172.21.15.97:0/1910143510 conn(0x7fd19c0c7e40 msgr2=0x7fd19c150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 shutdown_connections 2023-12-04T05:38:52.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.309+0000 7fd1a13b8640 1 -- 172.21.15.97:0/1910143510 wait complete. 2023-12-04T05:38:52.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:38:26.438302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:38:27.710828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:38:44.148875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:38:45.405294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:52.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:52.459 INFO:tasks.ceph.mds.c.smithi097.stderr:2023-12-04T05:38:52.453+0000 7f7ffe4ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:38:52.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 Processor -- start 2023-12-04T05:38:52.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 -- start start 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3ecc14e7a0 0x7f3ecc0bf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0c2250 con 0x7f3ecc070340 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc1547e0 con 0x7f3ecc157b30 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ed21f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc06c770 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecaffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3ecc070340 0x7f3ecc154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41294/0 (socket says 172.21.15.97:41294) 2023-12-04T05:38:52.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecaffd640 1 -- 172.21.15.97:0/566126238 learned_addr learned my addr 172.21.15.97:0/566126238 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecb7fe640 1 --2- 172.21.15.97:0/566126238 >> v2:172.21.15.143:3300/0 conn(0x7f3ecc14e7a0 0x7f3ecc0bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3eca7fc640 1 -- 172.21.15.97:0/566126238 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135851437 0 0) 0x7f3ecc0c2250 con 0x7f3ecc070340 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3eca7fc640 1 -- 172.21.15.97:0/566126238 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb4003530 con 0x7f3ecc070340 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/566126238 >> v1:172.21.15.143:6789/0 conn(0x7f3ecc157b30 legacy=0x7f3ecc15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/566126238 >> v1:172.21.15.97:6789/0 conn(0x7f3ecc070340 legacy=0x7f3ecc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.473+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/566126238 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0c24a0 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ecb7fe640 1 --2- 172.21.15.97:0/566126238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc0bf590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0097c0 tx=0x7f3ebc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4dd68263482b47 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3eca7fc640 1 -- 172.21.15.97:0/566126238 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0ab600 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3eca7fc640 1 -- 172.21.15.97:0/566126238 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0a7050 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3eca7fc640 1 -- 172.21.15.97:0/566126238 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0ab980 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 -- 172.21.15.97:0/566126238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc14e7a0 msgr2=0x7f3ecc0bf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/566126238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc0bf590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0097c0 tx=0x7f3ebc01c3f0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 -- 172.21.15.97:0/566126238 shutdown_connections 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/566126238 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc0bf590 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 -- 172.21.15.97:0/566126238 >> 172.21.15.97:0/566126238 conn(0x7f3ecc0c62a0 msgr2=0x7f3ecc0c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 -- 172.21.15.97:0/566126238 shutdown_connections 2023-12-04T05:38:52.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.477+0000 7f3ed21f8640 1 -- 172.21.15.97:0/566126238 wait complete. 2023-12-04T05:38:52.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 Processor -- start 2023-12-04T05:38:52.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- start start 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ecc157b30 0x7f3ecc150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc1518f0 0x7f3ecc151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1eddb0 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1ee2e0 con 0x7f3ecc1518f0 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0aa770 con 0x7f3ecc157b30 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53774/0 (socket says 172.21.15.97:53774) 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/4055689413 learned_addr learned my addr 172.21.15.97:0/4055689413 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecaffd640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ecc157b30 0x7f3ecc150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecbfff640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc1518f0 0x7f3ecc151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ecc157b30 msgr2=0x7f3ecc150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ecc157b30 0x7f3ecc150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc1518f0 msgr2=0x7f3ecc151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc1518f0 0x7f3ecc151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 -- 172.21.15.97:0/4055689413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc009420 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ecb7fe640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc01a020 tx=0x7f3ebc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0b4400 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0b4560 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0b4910 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc0abbd0 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.481+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc1ee000 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc068440 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ebc0b2040 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3eb3fff640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 0x7f3eb8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ebc11e650 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3ecaffd640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 0x7f3eb8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.485+0000 7f3ecaffd640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 0x7f3eb8068dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc14c230 tx=0x7f3ec0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.489+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ebc0eb520 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.641+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ecc0c2030 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.641+0000 7f3eb3fff640 1 -- 172.21.15.97:0/4055689413 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ebc0eeb40 con 0x7f3ecc14e7a0 2023-12-04T05:38:52.705 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 msgr2=0x7f3eb8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 0x7f3eb8068dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc14c230 tx=0x7f3ec0009040 comp rx=0 tx=0).stop 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 msgr2=0x7f3ecc14dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc01a020 tx=0x7f3ebc019190 comp rx=0 tx=0).stop 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 shutdown_connections 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3eb8066900 0x7f3eb8068dc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ecc1518f0 0x7f3ecc151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3ecc157b30 0x7f3ecc150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 --2- 172.21.15.97:0/4055689413 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3ecc14e7a0 0x7f3ecc14dab0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 >> 172.21.15.97:0/4055689413 conn(0x7f3ecc0c62a0 msgr2=0x7f3ecc154c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:52.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 shutdown_connections 2023-12-04T05:38:52.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.645+0000 7f3ed21f8640 1 -- 172.21.15.97:0/4055689413 wait complete. 2023-12-04T05:38:52.708 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:38:52.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.841+0000 7f576d972640 1 Processor -- start 2023-12-04T05:38:52.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f576d972640 1 -- start start 2023-12-04T05:38:52.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f576d972640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57680c7f00 0x7f5768154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f576d972640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680ca780 con 0x7f57680cac10 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f576d972640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5768158720 con 0x7f5768151f10 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f576d972640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5768158cc0 con 0x7f57680c7f00 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57680c7f00 0x7f5768154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f57680c7f00 0x7f5768154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53778/0 (socket says 172.21.15.97:53778) 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 -- 172.21.15.97:0/226827797 learned_addr learned my addr 172.21.15.97:0/226827797 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:52.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 -- 172.21.15.97:0/226827797 >> v1:172.21.15.143:6789/0 conn(0x7f5768151f10 legacy=0x7f57680c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:52.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 -- 172.21.15.97:0/226827797 >> v1:172.21.15.97:6789/0 conn(0x7f57680cac10 legacy=0x7f576815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f57667fc640 1 -- 172.21.15.97:0/226827797 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680bd830 con 0x7f57680c7f00 2023-12-04T05:38:52.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.845+0000 7f5765ffb640 1 -- 172.21.15.97:0/226827797 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896999694 0 0) 0x7f57680ca780 con 0x7f57680cac10 2023-12-04T05:38:52.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f57667fc640 1 --2- 172.21.15.97:0/226827797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f5768154720 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f575c009870 tx=0x7f575c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a61de3e35049648 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f5765ffb640 1 -- 172.21.15.97:0/226827797 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0ab600 con 0x7f57680c7f00 2023-12-04T05:38:52.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f5765ffb640 1 -- 172.21.15.97:0/226827797 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0a7050 con 0x7f57680c7f00 2023-12-04T05:38:52.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f5765ffb640 1 -- 172.21.15.97:0/226827797 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0ab980 con 0x7f57680c7f00 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- 172.21.15.97:0/226827797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 msgr2=0x7f5768154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 --2- 172.21.15.97:0/226827797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f5768154720 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f575c009870 tx=0x7f575c01c3e0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- 172.21.15.97:0/226827797 shutdown_connections 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 --2- 172.21.15.97:0/226827797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f5768154720 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- 172.21.15.97:0/226827797 >> 172.21.15.97:0/226827797 conn(0x7f5768073950 msgr2=0x7f5768073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- 172.21.15.97:0/226827797 shutdown_connections 2023-12-04T05:38:52.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- 172.21.15.97:0/226827797 wait complete. 2023-12-04T05:38:52.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 Processor -- start 2023-12-04T05:38:52.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.849+0000 7f576d972640 1 -- start start 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57680cac10 0x7f57681445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5768151f10 0x7f57680ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c08a0 con 0x7f57680c7f00 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c0b80 con 0x7f57680cac10 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680bea20 con 0x7f5768151f10 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53792/0 (socket says 172.21.15.97:53792) 2023-12-04T05:38:52.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 -- 172.21.15.97:0/2413264702 learned_addr learned my addr 172.21.15.97:0/2413264702 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:52.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 -- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5768151f10 msgr2=0x7f57680ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5768151f10 0x7f57680ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 -- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57680cac10 msgr2=0x7f57681445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57680cac10 0x7f57681445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 -- 172.21.15.97:0/2413264702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0094d0 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f5766ffd640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f575800c450 tx=0x7f575800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758012830 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580129b0 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758012d60 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680bed00 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768144b10 con 0x7f57680c7f00 2023-12-04T05:38:52.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680bf220 con 0x7f57680c7f00 2023-12-04T05:38:52.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.853+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f575801c460 con 0x7f57680c7f00 2023-12-04T05:38:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.857+0000 7f574ffff640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 0x7f5754068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.857+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5758084570 con 0x7f57680c7f00 2023-12-04T05:38:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.857+0000 7f57667fc640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 0x7f5754068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.857+0000 7f57667fc640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 0x7f5754068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f575c0ad000 tx=0x7f575c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:52.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:52.861+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57680bf220 con 0x7f57680c7f00 2023-12-04T05:38:53.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57680bf220 con 0x7f57680c7f00 2023-12-04T05:38:53.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f574ffff640 1 -- 172.21.15.97:0/2413264702 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57680bf220 con 0x7f57680c7f00 2023-12-04T05:38:53.013 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 msgr2=0x7f5754068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 0x7f5754068dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f575c0ad000 tx=0x7f575c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 msgr2=0x7f57681f04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f575800c450 tx=0x7f575800c910 comp rx=0 tx=0).stop 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 shutdown_connections 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5754066900 0x7f5754068dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5768151f10 0x7f57680ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f57680cac10 0x7f57681445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 --2- 172.21.15.97:0/2413264702 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f57680c7f00 0x7f57681f04e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 >> 172.21.15.97:0/2413264702 conn(0x7f5768073950 msgr2=0x7f57680a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 shutdown_connections 2023-12-04T05:38:53.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.009+0000 7f576d972640 1 -- 172.21.15.97:0/2413264702 wait complete. 2023-12-04T05:38:53.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:38:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 Processor -- start 2023-12-04T05:38:53.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 -- start start 2023-12-04T05:38:53.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f15bc14e3f0 0x7f15bc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc150bc0 con 0x7f15bc06c000 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc154fd0 con 0x7f15bc0c1360 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c271d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc151a70 con 0x7f15bc14e3f0 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15c0cba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f15bc14e3f0 0x7f15bc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15bb7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f15bc06c000 0x7f15bc14dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41310/0 (socket says 172.21.15.97:41310) 2023-12-04T05:38:53.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.173+0000 7f15bb7fe640 1 -- 172.21.15.97:0/3674409891 learned_addr learned my addr 172.21.15.97:0/3674409891 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c0cba640 1 -- 172.21.15.97:0/3674409891 >> v1:172.21.15.143:6789/0 conn(0x7f15bc0c1360 legacy=0x7f15bc151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c0cba640 1 -- 172.21.15.97:0/3674409891 >> v1:172.21.15.97:6789/0 conn(0x7f15bc06c000 legacy=0x7f15bc14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15baffd640 1 -- 172.21.15.97:0/3674409891 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777306574 0 0) 0x7f15bc150bc0 con 0x7f15bc06c000 2023-12-04T05:38:53.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c0cba640 1 -- 172.21.15.97:0/3674409891 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc072160 con 0x7f15bc14e3f0 2023-12-04T05:38:53.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c0cba640 1 --2- 172.21.15.97:0/3674409891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc0700b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009d90 tx=0x7f15b401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc194dfbf23be0b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15baffd640 1 -- 172.21.15.97:0/3674409891 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40a5830 con 0x7f15bc14e3f0 2023-12-04T05:38:53.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15baffd640 1 -- 172.21.15.97:0/3674409891 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40a5990 con 0x7f15bc14e3f0 2023-12-04T05:38:53.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15baffd640 1 -- 172.21.15.97:0/3674409891 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40a5d20 con 0x7f15bc14e3f0 2023-12-04T05:38:53.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c271d640 1 -- 172.21.15.97:0/3674409891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 msgr2=0x7f15bc0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c271d640 1 --2- 172.21.15.97:0/3674409891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc0700b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009d90 tx=0x7f15b401c880 comp rx=0 tx=0).stop 2023-12-04T05:38:53.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c271d640 1 -- 172.21.15.97:0/3674409891 shutdown_connections 2023-12-04T05:38:53.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c271d640 1 --2- 172.21.15.97:0/3674409891 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc0700b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.177+0000 7f15c271d640 1 -- 172.21.15.97:0/3674409891 >> 172.21.15.97:0/3674409891 conn(0x7f15bc0c5e70 msgr2=0x7f15bc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- 172.21.15.97:0/3674409891 shutdown_connections 2023-12-04T05:38:53.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- 172.21.15.97:0/3674409891 wait complete. 2023-12-04T05:38:53.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 Processor -- start 2023-12-04T05:38:53.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- start start 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15bc06c000 0x7f15bc148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15bc0c1360 0x7f15bc1edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc150ab0 con 0x7f15bc14e3f0 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1ed800 con 0x7f15bc06c000 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c271d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1ed4f0 con 0x7f15bc0c1360 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53800/0 (socket says 172.21.15.97:53800) 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 -- 172.21.15.97:0/1070323161 learned_addr learned my addr 172.21.15.97:0/1070323161 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15bbfff640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15bc06c000 0x7f15bc148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15bb7fe640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15bc0c1360 0x7f15bc1edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 -- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15bc0c1360 msgr2=0x7f15bc1edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15bc0c1360 0x7f15bc1edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 -- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15bc06c000 msgr2=0x7f15bc148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15bc06c000 0x7f15bc148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.181+0000 7f15c0cba640 1 -- 172.21.15.97:0/1070323161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009a70 con 0x7f15bc14e3f0 2023-12-04T05:38:53.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15c0cba640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f15b401cd60 tx=0x7f15b4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ad650 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40ad7b0 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc145f50 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40adb20 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc1507d0 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc1ed940 con 0x7f15bc14e3f0 2023-12-04T05:38:53.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15b40adc80 con 0x7f15bc14e3f0 2023-12-04T05:38:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 0x7f15a8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15b411f870 con 0x7f15bc14e3f0 2023-12-04T05:38:53.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.185+0000 7f15bbfff640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 0x7f15a8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.189+0000 7f15bbfff640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 0x7f15a8068dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fd0 tx=0x7f15ac007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.189+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15bc1ed940 con 0x7f15bc14e3f0 2023-12-04T05:38:53.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.341+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15bc1ed940 con 0x7f15bc14e3f0 2023-12-04T05:38:53.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.341+0000 7f15b8ff9640 1 -- 172.21.15.97:0/1070323161 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15bc1ed940 con 0x7f15bc14e3f0 2023-12-04T05:38:53.348 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 msgr2=0x7f15a8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 0x7f15a8068dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fd0 tx=0x7f15ac007e40 comp rx=0 tx=0).stop 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 msgr2=0x7f15bc1385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f15b401cd60 tx=0x7f15b4019620 comp rx=0 tx=0).stop 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 shutdown_connections 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a8066900 0x7f15a8068dc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15bc14e3f0 0x7f15bc1385d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15bc0c1360 0x7f15bc1edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 --2- 172.21.15.97:0/1070323161 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15bc06c000 0x7f15bc148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 >> 172.21.15.97:0/1070323161 conn(0x7f15bc0c5e70 msgr2=0x7f15bc0bfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 shutdown_connections 2023-12-04T05:38:53.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.345+0000 7f15c271d640 1 -- 172.21.15.97:0/1070323161 wait complete. 2023-12-04T05:38:53.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:38:53.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 Processor -- start 2023-12-04T05:38:53.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 -- start start 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faad014eb30 0x7faad014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faad014f790 0x7faad01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad0154640 con 0x7faad0154e10 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad00c0bd0 con 0x7faad014eb30 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faad54fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad014ef10 con 0x7faad014f790 2023-12-04T05:38:53.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faaceffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7faad014eb30 0x7faad014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faacf7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7faad0154e10 0x7faad0151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:41322/0 (socket says 172.21.15.97:41322) 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.509+0000 7faacf7fe640 1 -- 172.21.15.97:0/4055622157 learned_addr learned my addr 172.21.15.97:0/4055622157 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faac67fc640 1 --2- 172.21.15.97:0/4055622157 >> v2:172.21.15.143:3300/0 conn(0x7faad014f790 0x7faad01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faaceffd640 1 -- 172.21.15.97:0/4055622157 >> v2:172.21.15.143:3300/0 conn(0x7faad014f790 msgr2=0x7faad01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faace7fc640 1 -- 172.21.15.97:0/4055622157 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060175271 0 0) 0x7faad0154640 con 0x7faad0154e10 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faaceffd640 1 --2- 172.21.15.97:0/4055622157 >> v2:172.21.15.143:3300/0 conn(0x7faad014f790 0x7faad01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faaceffd640 1 -- 172.21.15.97:0/4055622157 >> v1:172.21.15.97:6789/0 conn(0x7faad0154e10 legacy=0x7faad0151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faaceffd640 1 -- 172.21.15.97:0/4055622157 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad01535a0 con 0x7faad014eb30 2023-12-04T05:38:53.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faaceffd640 1 --2- 172.21.15.97:0/4055622157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad014eb30 0x7faad014f250 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faad006e7f0 tx=0x7faac001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc09b915d4c349f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faace7fc640 1 -- 172.21.15.97:0/4055622157 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00ab600 con 0x7faad014eb30 2023-12-04T05:38:53.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faace7fc640 1 -- 172.21.15.97:0/4055622157 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac00a7050 con 0x7faad014eb30 2023-12-04T05:38:53.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.513+0000 7faace7fc640 1 -- 172.21.15.97:0/4055622157 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00ab980 con 0x7faad014eb30 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- 172.21.15.97:0/4055622157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad014eb30 msgr2=0x7faad014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- 172.21.15.97:0/4055622157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad014eb30 0x7faad014f250 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faad006e7f0 tx=0x7faac001c430 comp rx=0 tx=0).stop 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- 172.21.15.97:0/4055622157 shutdown_connections 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- 172.21.15.97:0/4055622157 >> v2:172.21.15.143:3300/0 conn(0x7faad014f790 0x7faad01548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- 172.21.15.97:0/4055622157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad014eb30 0x7faad014f250 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- 172.21.15.97:0/4055622157 >> 172.21.15.97:0/4055622157 conn(0x7faad00c5e70 msgr2=0x7faad00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- 172.21.15.97:0/4055622157 shutdown_connections 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- 172.21.15.97:0/4055622157 wait complete. 2023-12-04T05:38:53.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 Processor -- start 2023-12-04T05:38:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- start start 2023-12-04T05:38:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad014eb30 0x7faad0144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faad014f790 0x7faad0145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00bc560 con 0x7faad0154e10 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00c4380 con 0x7faad014eb30 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faad54fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad00bbd00 con 0x7faad014f790 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53828/0 (socket says 172.21.15.97:53828) 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 -- 172.21.15.97:0/2951683347 learned_addr learned my addr 172.21.15.97:0/2951683347 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faaceffd640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad014eb30 0x7faad0144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faac67fc640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faad014f790 0x7faad0145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 -- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faad014f790 msgr2=0x7faad0145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faad014f790 0x7faad0145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 -- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad014eb30 msgr2=0x7faad0144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad014eb30 0x7faad0144ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 -- 172.21.15.97:0/2951683347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009420 con 0x7faad0154e10 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.517+0000 7faacf7fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faac800c700 tx=0x7faac800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800ce10 con 0x7faad0154e10 2023-12-04T05:38:53.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac800a640 con 0x7faad0154e10 2023-12-04T05:38:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad014fd20 con 0x7faad0154e10 2023-12-04T05:38:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac800aa70 con 0x7faad0154e10 2023-12-04T05:38:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad00bc280 con 0x7faad0154e10 2023-12-04T05:38:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad0068440 con 0x7faad0154e10 2023-12-04T05:38:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faac800abd0 con 0x7faad0154e10 2023-12-04T05:38:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 0x7faab0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faac8083de0 con 0x7faad0154e10 2023-12-04T05:38:53.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faaceffd640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 0x7faab0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.521+0000 7faaceffd640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 0x7faab0068dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faad00c6bc0 tx=0x7faac00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.525+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faac8050d60 con 0x7faad0154e10 2023-12-04T05:38:53.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7faad00a8ac0 con 0x7faad0154e10 2023-12-04T05:38:53.681 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faac7fff640 1 -- 172.21.15.97:0/2951683347 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7faac8018020 con 0x7faad0154e10 2023-12-04T05:38:53.681 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 msgr2=0x7faab0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 0x7faab0068dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faad00c6bc0 tx=0x7faac00a6000 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 msgr2=0x7faad01ee7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faac800c700 tx=0x7faac800cbc0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 shutdown_connections 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faab0066900 0x7faab0068dc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faad0154e10 0x7faad01ee7b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faad014f790 0x7faad0145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 --2- 172.21.15.97:0/2951683347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faad014eb30 0x7faad0144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 >> 172.21.15.97:0/2951683347 conn(0x7faad00c5e70 msgr2=0x7faad014b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 shutdown_connections 2023-12-04T05:38:53.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.677+0000 7faad54fe640 1 -- 172.21.15.97:0/2951683347 wait complete. 2023-12-04T05:38:53.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:38:53.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 Processor -- start 2023-12-04T05:38:53.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 -- start start 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f666014f960 0x7f66601548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6660154e10 0x7f666015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6660154640 con 0x7f666014eb30 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66600c0bd0 con 0x7f666014f960 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f6666c6b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666014ef10 con 0x7f6660154e10 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f665ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f666014f960 0x7f66601548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f665ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f666014f960 0x7f66601548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53836/0 (socket says 172.21.15.97:53836) 2023-12-04T05:38:53.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.837+0000 7f665ffff640 1 -- 172.21.15.97:0/3408770263 learned_addr learned my addr 172.21.15.97:0/3408770263 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6665208640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6660154e10 0x7f666015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665ffff640 1 -- 172.21.15.97:0/3408770263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6660154e10 msgr2=0x7f666015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665ffff640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6660154e10 0x7f666015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665ffff640 1 -- 172.21.15.97:0/3408770263 >> v1:172.21.15.143:6789/0 conn(0x7f666014eb30 legacy=0x7f666014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:53.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665ffff640 1 -- 172.21.15.97:0/3408770263 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66601535a0 con 0x7f666014f960 2023-12-04T05:38:53.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665ffff640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f666014f960 0x7f66601548d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f664c009870 tx=0x7f664c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baac9e504aebc171 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665f7fe640 1 -- 172.21.15.97:0/3408770263 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0ac600 con 0x7f666014f960 2023-12-04T05:38:53.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665f7fe640 1 -- 172.21.15.97:0/3408770263 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c0a8050 con 0x7f666014f960 2023-12-04T05:38:53.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f665f7fe640 1 -- 172.21.15.97:0/3408770263 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0ac980 con 0x7f666014f960 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 -- 172.21.15.97:0/3408770263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f666014f960 msgr2=0x7f66601548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f666014f960 0x7f66601548d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f664c009870 tx=0x7f664c01c4d0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 -- 172.21.15.97:0/3408770263 shutdown_connections 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6660154e10 0x7f666015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3408770263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f666014f960 0x7f66601548d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.841+0000 7f6666c6b640 1 -- 172.21.15.97:0/3408770263 >> 172.21.15.97:0/3408770263 conn(0x7f66600c5e70 msgr2=0x7f66600c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:53.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- 172.21.15.97:0/3408770263 shutdown_connections 2023-12-04T05:38:53.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- 172.21.15.97:0/3408770263 wait complete. 2023-12-04T05:38:53.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 Processor -- start 2023-12-04T05:38:53.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- start start 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 0x7f6660071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f666014f960 0x7f666013e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66600c5b50 con 0x7f6660154e10 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66600a9460 con 0x7f666014eb30 2023-12-04T05:38:53.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6666c6b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66600a9740 con 0x7f666014f960 2023-12-04T05:38:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:53852/0 (socket says 172.21.15.97:53852) 2023-12-04T05:38:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 -- 172.21.15.97:0/3808085510 learned_addr learned my addr 172.21.15.97:0/3808085510 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6664a07640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 0x7f6660071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f665ffff640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f666014f960 0x7f666013e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 -- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f666014f960 msgr2=0x7f666013e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f666014f960 0x7f666013e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 -- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 msgr2=0x7f6660071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 0x7f6660071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 -- 172.21.15.97:0/3808085510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0094d0 con 0x7f6660154e10 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6664a07640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 0x7f6660071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.845+0000 7f6665208640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6658007e60 tx=0x7f665800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658014420 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66580145a0 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658014950 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66600a9a20 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66600718a0 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6660068440 con 0x7f6660154e10 2023-12-04T05:38:53.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6658014ab0 con 0x7f6660154e10 2023-12-04T05:38:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 0x7f6644068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6658084ff0 con 0x7f6660154e10 2023-12-04T05:38:53.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f6664a07640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 0x7f6644068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:53.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.849+0000 7f6664a07640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 0x7f6644068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6654003ec0 tx=0x7f6654009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:53.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:53.853+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6658051f20 con 0x7f6660154e10 2023-12-04T05:38:54.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.001+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f66600a8ac0 con 0x7f6660154e10 2023-12-04T05:38:54.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.001+0000 7f665d7fa640 1 -- 172.21.15.97:0/3808085510 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6658055540 con 0x7f6660154e10 2023-12-04T05:38:54.008 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 msgr2=0x7f6644068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 0x7f6644068d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6654003ec0 tx=0x7f6654009040 comp rx=0 tx=0).stop 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 msgr2=0x7f66601f0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6658007e60 tx=0x7f665800e4b0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 shutdown_connections 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f66440668d0 0x7f6644068d90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6660154e10 0x7f66601f0a10 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f666014f960 0x7f666013e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 --2- 172.21.15.97:0/3808085510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f666014eb30 0x7f6660071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 >> 172.21.15.97:0/3808085510 conn(0x7f66600c5e70 msgr2=0x7f666014cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:54.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 shutdown_connections 2023-12-04T05:38:54.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.005+0000 7f6666c6b640 1 -- 172.21.15.97:0/3808085510 wait complete. 2023-12-04T05:38:54.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:38:54.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 Processor -- start 2023-12-04T05:38:54.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 -- start start 2023-12-04T05:38:54.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb40bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9bb406dea0 0x7f9bb40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 0x7f9bb40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb406da10 con 0x7f9bb406dea0 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb406d120 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bbb279640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb406d3c0 con 0x7f9bb4071920 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bb8814640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9bb406dea0 0x7f9bb40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bb8814640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9bb406dea0 0x7f9bb40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42234/0 (socket says 172.21.15.97:42234) 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bb8814640 1 -- 172.21.15.97:0/172029661 learned_addr learned my addr 172.21.15.97:0/172029661 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bb9015640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb40bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.165+0000 7f9bb9816640 1 --2- 172.21.15.97:0/172029661 >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 0x7f9bb40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 -- 172.21.15.97:0/172029661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 msgr2=0x7f9bb40bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb40bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 -- 172.21.15.97:0/172029661 >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 msgr2=0x7f9bb40705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 --2- 172.21.15.97:0/172029661 >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 0x7f9bb40705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 -- 172.21.15.97:0/172029661 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb406d6a0 con 0x7f9bb406dea0 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb9015640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb40bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:54.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb9816640 1 --2- 172.21.15.97:0/172029661 >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 0x7f9bb40705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:54.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bb8814640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb406dea0 0x7f9bb40700b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c5e00 tx=0x7f9ba401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fda3a99a115558 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9babfff640 1 -- 172.21.15.97:0/172029661 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40ab600 con 0x7f9bb406dea0 2023-12-04T05:38:54.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9babfff640 1 -- 172.21.15.97:0/172029661 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba40a7050 con 0x7f9bb406dea0 2023-12-04T05:38:54.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9babfff640 1 -- 172.21.15.97:0/172029661 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40ab980 con 0x7f9bb406dea0 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 -- 172.21.15.97:0/172029661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb406dea0 msgr2=0x7f9bb40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb406dea0 0x7f9bb40700b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40c5e00 tx=0x7f9ba401c500 comp rx=0 tx=0).stop 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 -- 172.21.15.97:0/172029661 shutdown_connections 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 --2- 172.21.15.97:0/172029661 >> v2:172.21.15.143:3300/0 conn(0x7f9bb40bf7e0 0x7f9bb40705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb406dea0 0x7f9bb40700b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 --2- 172.21.15.97:0/172029661 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb40bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.169+0000 7f9bbb279640 1 -- 172.21.15.97:0/172029661 >> 172.21.15.97:0/172029661 conn(0x7f9bb40c5e70 msgr2=0x7f9bb40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:54.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- 172.21.15.97:0/172029661 shutdown_connections 2023-12-04T05:38:54.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- 172.21.15.97:0/172029661 wait complete. 2023-12-04T05:38:54.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 Processor -- start 2023-12-04T05:38:54.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- start start 2023-12-04T05:38:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bb406dea0 0x7f9bb41f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb41f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4159ed0 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4159a40 con 0x7f9bb406dea0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bbb279640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415d7a0 con 0x7f9bb4071920 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42236/0 (socket says 172.21.15.97:42236) 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 -- 172.21.15.97:0/4017843384 learned_addr learned my addr 172.21.15.97:0/4017843384 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb8814640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb41f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9015640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bb406dea0 0x7f9bb41f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 -- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 msgr2=0x7f9bb41f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb41f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 -- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bb406dea0 msgr2=0x7f9bb41f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bb406dea0 0x7f9bb41f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 -- 172.21.15.97:0/4017843384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40094d0 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9bb9816640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007e70 tx=0x7f9bac00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.173+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac003ba0 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb4159740 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00de80 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb415df30 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb4068440 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9bac004030 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9ba9ffb640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 0x7f9b98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9bac084950 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9bb9015640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 0x7f9b98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.177+0000 7f9bb9015640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 0x7f9b98068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4152180 tx=0x7f9bb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.181+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bac0518e0 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9bb4159b80 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9ba9ffb640 1 -- 172.21.15.97:0/4017843384 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9bac054f00 con 0x7f9bb40bf7e0 2023-12-04T05:38:54.350 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:38:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 msgr2=0x7f9b98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 0x7f9b98068d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4152180 tx=0x7f9bb0008040 comp rx=0 tx=0).stop 2023-12-04T05:38:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 msgr2=0x7f9bb413a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9bac007e70 tx=0x7f9bac00d4a0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 shutdown_connections 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b980668d0 0x7f9b98068d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9bb40bf7e0 0x7f9bb413a330 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bb4071920 0x7f9bb41f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 --2- 172.21.15.97:0/4017843384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bb406dea0 0x7f9bb41f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 >> 172.21.15.97:0/4017843384 conn(0x7f9bb40c5e70 msgr2=0x7f9bb41574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 shutdown_connections 2023-12-04T05:38:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.345+0000 7f9bbb279640 1 -- 172.21.15.97:0/4017843384 wait complete. 2023-12-04T05:38:54.371 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:38:54.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.371 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:54.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:38:54.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.402 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:38:54.453 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:54.454 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:54.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:38:54.505 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:38:54.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 Processor -- start 2023-12-04T05:38:54.641 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 -- start start 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb2f406be00 0x7fb2f406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f4152300 con 0x7fb2f406ca50 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f4071580 con 0x7fb2f414e970 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fbe17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f414ed50 con 0x7fb2f406be00 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fa3b4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb2f406ca50 0x7fb2f40c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33892/0 (socket says 172.21.15.97:33892) 2023-12-04T05:38:54.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2fa3b4640 1 -- 172.21.15.97:0/422332429 learned_addr learned my addr 172.21.15.97:0/422332429 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f93b2640 1 --2- 172.21.15.97:0/422332429 >> v2:172.21.15.143:3300/0 conn(0x7fb2f406be00 0x7fb2f406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244743457 0 0) 0x7fb2ec0014a0 con 0x7fb2f406ca50 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0005740 con 0x7fb2f406ca50 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096620157 0 0) 0x7fb2f4071580 con 0x7fb2f414e970 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec0014a0 con 0x7fb2f414e970 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956994461 0 0) 0x7fb2e0005740 con 0x7fb2f406ca50 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f93b2640 1 -- 172.21.15.97:0/422332429 >> v1:172.21.15.143:6789/0 conn(0x7fb2f414e970 legacy=0x7fb2f4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f93b2640 1 -- 172.21.15.97:0/422332429 >> v1:172.21.15.97:6789/0 conn(0x7fb2f406ca50 legacy=0x7fb2f40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.637+0000 7fb2f93b2640 1 -- 172.21.15.97:0/422332429 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4151d60 con 0x7fb2f406be00 2023-12-04T05:38:54.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2f93b2640 1 --2- 172.21.15.97:0/422332429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f406e150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40097c0 tx=0x7fb2e401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ccde1476e07fbe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec001b90 con 0x7fb2f406be00 2023-12-04T05:38:54.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e40a7050 con 0x7fb2f406be00 2023-12-04T05:38:54.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2f8bb1640 1 -- 172.21.15.97:0/422332429 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40ab400 con 0x7fb2f406be00 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 -- 172.21.15.97:0/422332429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 msgr2=0x7fb2f406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/422332429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f406e150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40097c0 tx=0x7fb2e401c310 comp rx=0 tx=0).stop 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 -- 172.21.15.97:0/422332429 shutdown_connections 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/422332429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f406e150 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 -- 172.21.15.97:0/422332429 >> 172.21.15.97:0/422332429 conn(0x7fb2f40c2970 msgr2=0x7fb2f40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 -- 172.21.15.97:0/422332429 shutdown_connections 2023-12-04T05:38:54.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.641+0000 7fb2fbe17640 1 -- 172.21.15.97:0/422332429 wait complete. 2023-12-04T05:38:54.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 Processor -- start 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- start start 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f4141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f414e970 0x7fb2f41ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f40c56a0 con 0x7fb2f406ca50 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f41f09a0 con 0x7fb2f406be00 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4141540 con 0x7fb2f414e970 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42238/0 (socket says 172.21.15.97:42238) 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 -- 172.21.15.97:0/617418937 learned_addr learned my addr 172.21.15.97:0/617418937 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f9bb3640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f4141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fa3b4640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f414e970 0x7fb2f41ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 -- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f414e970 msgr2=0x7fb2f41ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f414e970 0x7fb2f41ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 -- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 msgr2=0x7fb2f4141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f4141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 -- 172.21.15.97:0/617418937 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4009420 con 0x7fb2f406ca50 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2f93b2640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4018f20 tx=0x7fb2e40190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40b4410 con 0x7fb2f406ca50 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e40b4590 con 0x7fb2f406ca50 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f40c58f0 con 0x7fb2f406ca50 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40b4940 con 0x7fb2f406ca50 2023-12-04T05:38:54.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.645+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f40bfa40 con 0x7fb2f406ca50 2023-12-04T05:38:54.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f41f0ea0 con 0x7fb2f406ca50 2023-12-04T05:38:54.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2e40b2040 con 0x7fb2f406ca50 2023-12-04T05:38:54.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2ea7fc640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 0x7fb2d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:54.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb2e411e6c0 con 0x7fb2f406ca50 2023-12-04T05:38:54.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2f9bb3640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 0x7fb2d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:54.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.649+0000 7fb2f9bb3640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 0x7fb2d8068d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00011f0 tx=0x7fb2f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:54.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.653+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2f41f0ea0 con 0x7fb2f406ca50 2023-12-04T05:38:54.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.833+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2f41f0ea0 con 0x7fb2f406ca50 2023-12-04T05:38:54.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.833+0000 7fb2ea7fc640 1 -- 172.21.15.97:0/617418937 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7fb2f41f0ea0 con 0x7fb2f406ca50 2023-12-04T05:38:54.839 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:38:54.839 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:38:54.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 msgr2=0x7fb2d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 0x7fb2d8068d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00011f0 tx=0x7fb2f0009040 comp rx=0 tx=0).stop 2023-12-04T05:38:54.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 msgr2=0x7fb2f40bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:54.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4018f20 tx=0x7fb2e40190b0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 shutdown_connections 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb2d80668d0 0x7fb2d8068d90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f414e970 0x7fb2f41ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2f406ca50 0x7fb2f40bf500 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 --2- 172.21.15.97:0/617418937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f406be00 0x7fb2f4141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 >> 172.21.15.97:0/617418937 conn(0x7fb2f40c2970 msgr2=0x7fb2f414d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 shutdown_connections 2023-12-04T05:38:54.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:54.837+0000 7fb2fbe17640 1 -- 172.21.15.97:0/617418937 wait complete. 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:38:54.861 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:54.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.861 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:38:54.873 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42007sec preferred_lft 42007sec 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.874 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:54.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.876 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:38:54.936 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:38:54.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.939 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:38:54.996 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:38:54.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:38:54.998 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:38:55.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:55.102 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:38:55.111 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:38:55.111 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:55.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:55.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:38:55.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:55.181 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:55.232 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:38:55.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:55.232 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:55.283 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-04T05:38:55.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:55.284 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:55.378 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:55.378 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:55.391 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:38:55.391 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:38:55.391 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:38:55.391 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:38:55.391 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:38:55.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:38:55.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:55.395 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:38:55.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:55.416 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:38:55.484 INFO:teuthology.orchestra.run.smithi143.stdout:client6126 2023-12-04T05:38:55.484 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:38:55.485 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:55.540 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-04T05:38:55.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 Processor -- start 2023-12-04T05:38:55.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 -- start start 2023-12-04T05:38:55.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdb880c1e70 0x7fdb881524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb8806c440 0x7fdb880a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb880aa240 con 0x7fdb880a89a0 2023-12-04T05:38:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8806c0c0 con 0x7fdb880c1e70 2023-12-04T05:38:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb90679640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb880aa500 con 0x7fdb8806c440 2023-12-04T05:38:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdb880c1e70 0x7fdb881524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8dc14640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb8806c440 0x7fdb880a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdb880c1e70 0x7fdb881524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:50404/0 (socket says 172.21.15.97:50404) 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 -- 172.21.15.97:0/1976165773 learned_addr learned my addr 172.21.15.97:0/1976165773 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8ec16640 1 --1- 172.21.15.97:0/1976165773 >> v1:172.21.15.143:6789/0 conn(0x7fdb880a89a0 0x7fdb8806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:57942/0 (socket says 172.21.15.97:57942) 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 -- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb8806c440 msgr2=0x7fdb880a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 --2- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb8806c440 0x7fdb880a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 -- 172.21.15.97:0/1976165773 >> v1:172.21.15.143:6789/0 conn(0x7fdb880a89a0 legacy=0x7fdb8806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.681+0000 7fdb8e415640 1 -- 172.21.15.97:0/1976165773 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880aa7e0 con 0x7fdb880c1e70 2023-12-04T05:38:55.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb8e415640 1 --2- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881524e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb8401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50c986327a16c1b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:55.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb8d413640 1 -- 172.21.15.97:0/1976165773 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840a95f0 con 0x7fdb880c1e70 2023-12-04T05:38:55.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb8d413640 1 -- 172.21.15.97:0/1976165773 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb840a9750 con 0x7fdb880c1e70 2023-12-04T05:38:55.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb8d413640 1 -- 172.21.15.97:0/1976165773 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840a9ae0 con 0x7fdb880c1e70 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 -- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 msgr2=0x7fdb881524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 --2- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881524e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009870 tx=0x7fdb8401c510 comp rx=0 tx=0).stop 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 -- 172.21.15.97:0/1976165773 shutdown_connections 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 --2- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb8806c440 0x7fdb880a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 --2- 172.21.15.97:0/1976165773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881524e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 -- 172.21.15.97:0/1976165773 >> 172.21.15.97:0/1976165773 conn(0x7fdb880c5e70 msgr2=0x7fdb880c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:55.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 -- 172.21.15.97:0/1976165773 shutdown_connections 2023-12-04T05:38:55.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.685+0000 7fdb90679640 1 -- 172.21.15.97:0/1976165773 wait complete. 2023-12-04T05:38:55.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 Processor -- start 2023-12-04T05:38:55.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- start start 2023-12-04T05:38:55.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb880a89a0 0x7fdb88145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8814d490 con 0x7fdb8806c440 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8814d6e0 con 0x7fdb880c1e70 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8814d9c0 con 0x7fdb880a89a0 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42244/0 (socket says 172.21.15.97:42244) 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 -- 172.21.15.97:0/2342802848 learned_addr learned my addr 172.21.15.97:0/2342802848 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8dc14640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb880a89a0 0x7fdb88145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8ec16640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 -- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb880a89a0 msgr2=0x7fdb88145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb880a89a0 0x7fdb88145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 -- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 msgr2=0x7fdb881ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 -- 172.21.15.97:0/2342802848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb840094d0 con 0x7fdb8806c440 2023-12-04T05:38:55.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb8e415640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdb840ab040 tx=0x7fdb8401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840bc650 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb840bc7b0 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb880c23d0 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840bcb60 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.689+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb881f0da0 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb881f0920 con 0x7fdb8806c440 2023-12-04T05:38:55.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdb840bccc0 con 0x7fdb8806c440 2023-12-04T05:38:55.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb7effd640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 0x7fdb6c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:55.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdb8411f190 con 0x7fdb8806c440 2023-12-04T05:38:55.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb8dc14640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 0x7fdb6c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:55.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.693+0000 7fdb8dc14640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 0x7fdb6c068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdb880c3440 tx=0x7fdb78009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:55.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.697+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb881f0920 con 0x7fdb8806c440 2023-12-04T05:38:55.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.897+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fdb881f0920 con 0x7fdb8806c440 2023-12-04T05:38:55.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.901+0000 7fdb7effd640 1 -- 172.21.15.97:0/2342802848 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v19) v1 ==== 291+0+0 (secure 0 0 0) 0x7fdb881f0920 con 0x7fdb8806c440 2023-12-04T05:38:55.907 INFO:teuthology.orchestra.run.smithi097.stderr:added key for client.testuser 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 msgr2=0x7fdb6c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 0x7fdb6c068d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdb880c3440 tx=0x7fdb78009190 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 msgr2=0x7fdb88156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdb840ab040 tx=0x7fdb8401ad50 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 shutdown_connections 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdb6c0668d0 0x7fdb6c068d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb880c1e70 0x7fdb881ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb880a89a0 0x7fdb88145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 --2- 172.21.15.97:0/2342802848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb8806c440 0x7fdb88156070 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 >> 172.21.15.97:0/2342802848 conn(0x7fdb880c5e70 msgr2=0x7fdb88151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:55.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 shutdown_connections 2023-12-04T05:38:55.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:55.905+0000 7fdb90679640 1 -- 172.21.15.97:0/2342802848 wait complete. 2023-12-04T05:38:55.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-04T05:38:56.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 Processor -- start 2023-12-04T05:38:56.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 -- start start 2023-12-04T05:38:56.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f19cc14eb30 0x7f19cc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14f790 0x7f19cc1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc154640 con 0x7f19cc154e10 2023-12-04T05:38:56.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc0c0bd0 con 0x7f19cc14eb30 2023-12-04T05:38:56.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d3a9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc14ef10 con 0x7f19cc14f790 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.061+0000 7f19d1836640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f19cc14eb30 0x7f19cc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f19cc14eb30 0x7f19cc14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42254/0 (socket says 172.21.15.97:42254) 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 -- 172.21.15.97:0/255296787 learned_addr learned my addr 172.21.15.97:0/255296787 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1035640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14f790 0x7f19cc1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 -- 172.21.15.97:0/255296787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14f790 msgr2=0x7f19cc1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d0834640 1 -- 172.21.15.97:0/255296787 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995373436 0 0) 0x7f19cc154640 con 0x7f19cc154e10 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14f790 0x7f19cc1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 -- 172.21.15.97:0/255296787 >> v1:172.21.15.143:6789/0 conn(0x7f19cc154e10 legacy=0x7f19cc151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 -- 172.21.15.97:0/255296787 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc1535a0 con 0x7f19cc14eb30 2023-12-04T05:38:56.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d1836640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14eb30 0x7f19cc14f250 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06366d1da5cf76b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d0834640 1 -- 172.21.15.97:0/255296787 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80ab620 con 0x7f19cc14eb30 2023-12-04T05:38:56.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d0834640 1 -- 172.21.15.97:0/255296787 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80ab780 con 0x7f19cc14eb30 2023-12-04T05:38:56.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.065+0000 7f19d0834640 1 -- 172.21.15.97:0/255296787 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80abb10 con 0x7f19cc14eb30 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- 172.21.15.97:0/255296787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14eb30 msgr2=0x7f19cc14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14eb30 0x7f19cc14f250 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c801c510 comp rx=0 tx=0).stop 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- 172.21.15.97:0/255296787 shutdown_connections 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14f790 0x7f19cc1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/255296787 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14eb30 0x7f19cc14f250 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- 172.21.15.97:0/255296787 >> 172.21.15.97:0/255296787 conn(0x7f19cc0c5e70 msgr2=0x7f19cc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- 172.21.15.97:0/255296787 shutdown_connections 2023-12-04T05:38:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- 172.21.15.97:0/255296787 wait complete. 2023-12-04T05:38:56.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 Processor -- start 2023-12-04T05:38:56.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- start start 2023-12-04T05:38:56.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14eb30 0x7f19cc0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19cc154e10 0x7f19cc143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0a93f0 con 0x7f19cc14f790 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0aa510 con 0x7f19cc154e10 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d3a9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc1411a0 con 0x7f19cc14eb30 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42256/0 (socket says 172.21.15.97:42256) 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 -- 172.21.15.97:0/2228596432 learned_addr learned my addr 172.21.15.97:0/2228596432 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1836640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14eb30 0x7f19cc0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d2037640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19cc154e10 0x7f19cc143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 -- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14eb30 msgr2=0x7f19cc0aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14eb30 0x7f19cc0aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 -- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19cc154e10 msgr2=0x7f19cc143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19cc154e10 0x7f19cc143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.069+0000 7f19d1035640 1 -- 172.21.15.97:0/2228596432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80094d0 con 0x7f19cc14f790 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19d1035640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc009690 con 0x7f19cc14f790 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00ca00 con 0x7f19cc14f790 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc140900 con 0x7f19cc14f790 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00cd70 con 0x7f19cc14f790 2023-12-04T05:38:56.078 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc140ec0 con 0x7f19cc14f790 2023-12-04T05:38:56.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc0a9560 con 0x7f19cc14f790 2023-12-04T05:38:56.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19bc013470 con 0x7f19cc14f790 2023-12-04T05:38:56.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 0x7f19b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19bc084950 con 0x7f19cc14f790 2023-12-04T05:38:56.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.073+0000 7f19d1836640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 0x7f19b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.077+0000 7f19d1836640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 0x7f19b0068dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f19c80af000 tx=0x7f19c80b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.083 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.077+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19bc051990 con 0x7f19cc14f790 2023-12-04T05:38:56.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.277+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f19cc068440 con 0x7f19cc14f790 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.277+0000 7f19c27fc640 1 -- 172.21.15.97:0/2228596432 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v19) v1 ==== 85+0+245 (secure 0 0 0) 0x7f19bc017110 con 0x7f19cc14f790 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stdout:[client.testuser] 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg== 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-04T05:38:56.284 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 msgr2=0x7f19b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 0x7f19b0068dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f19c80af000 tx=0x7f19c80b6040 comp rx=0 tx=0).stop 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 msgr2=0x7f19cc0bf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00edf0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 shutdown_connections 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f19b0066900 0x7f19b0068dc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f19cc154e10 0x7f19cc143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f19cc14f790 0x7f19cc0bf2a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 --2- 172.21.15.97:0/2228596432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f19cc14eb30 0x7f19cc0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 >> 172.21.15.97:0/2228596432 conn(0x7f19cc0c5e70 msgr2=0x7f19cc0c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 shutdown_connections 2023-12-04T05:38:56.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.281+0000 7f19d3a9a640 1 -- 172.21.15.97:0/2228596432 wait complete. 2023-12-04T05:38:56.305 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:38:56.314 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.VZS3dm14Qd 2023-12-04T05:38:56.315 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:56.315 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/tmp/tmp.VZS3dm14Qd 2023-12-04T05:38:56.368 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:56.368 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:56.420 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:56.420 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:56.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:38:56.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 Processor -- start 2023-12-04T05:38:56.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 -- start start 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d180c7ef0 0x7f1d18154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d181551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d181547d0 con 0x7f1d18151bf0 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d18158b80 con 0x7f1d180c7ef0 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d1dd2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180c4aa0 con 0x7f1d18158630 2023-12-04T05:38:56.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d180c7ef0 0x7f1d18154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d177fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1d18151bf0 0x7f1d180abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33904/0 (socket says 172.21.15.97:33904) 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d180c7ef0 0x7f1d18154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42268/0 (socket says 172.21.15.97:42268) 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d177fe640 1 -- 172.21.15.97:0/4001230510 learned_addr learned my addr 172.21.15.97:0/4001230510 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d17fff640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d181551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 -- 172.21.15.97:0/4001230510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 msgr2=0x7f1d181551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d181551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 -- 172.21.15.97:0/4001230510 >> v1:172.21.15.97:6789/0 conn(0x7f1d18151bf0 legacy=0x7f1d180abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d16ffd640 1 -- 172.21.15.97:0/4001230510 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180c4d40 con 0x7f1d180c7ef0 2023-12-04T05:38:56.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.649+0000 7f1d167fc640 1 -- 172.21.15.97:0/4001230510 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901594565 0 0) 0x7f1d181547d0 con 0x7f1d18151bf0 2023-12-04T05:38:56.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d16ffd640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18154c60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0097c0 tx=0x7f1d0c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3add1d4929e7d36d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d167fc640 1 -- 172.21.15.97:0/4001230510 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0a4780 con 0x7f1d180c7ef0 2023-12-04T05:38:56.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d167fc640 1 -- 172.21.15.97:0/4001230510 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0a48e0 con 0x7f1d180c7ef0 2023-12-04T05:38:56.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d167fc640 1 -- 172.21.15.97:0/4001230510 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0a4c70 con 0x7f1d180c7ef0 2023-12-04T05:38:56.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/4001230510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 msgr2=0x7f1d18154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18154c60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0097c0 tx=0x7f1d0c01c040 comp rx=0 tx=0).stop 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/4001230510 shutdown_connections 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d181551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/4001230510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18154c60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/4001230510 >> 172.21.15.97:0/4001230510 conn(0x7f1d18073550 msgr2=0x7f1d18073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/4001230510 shutdown_connections 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/4001230510 wait complete. 2023-12-04T05:38:56.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.653+0000 7f1d1dd2a640 1 Processor -- start 2023-12-04T05:38:56.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- start start 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d18151bf0 0x7f1d1814ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d18156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1814e890 con 0x7f1d180c7ef0 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d181ed5d0 con 0x7f1d18151bf0 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18156160 con 0x7f1d18158630 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42282/0 (socket says 172.21.15.97:42282) 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 -- 172.21.15.97:0/850209965 learned_addr learned my addr 172.21.15.97:0/850209965 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d16ffd640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d18151bf0 0x7f1d1814ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d17fff640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d18156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 -- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 msgr2=0x7f1d18156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d18156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 -- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d18151bf0 msgr2=0x7f1d1814ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d18151bf0 0x7f1d1814ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 -- 172.21.15.97:0/850209965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c009420 con 0x7f1d180c7ef0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d17fff640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d18156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d177fe640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c480 tx=0x7f1d0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080074e0 con 0x7f1d180c7ef0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08007660 con 0x7f1d180c7ef0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d18149f90 con 0x7f1d180c7ef0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08004a30 con 0x7f1d180c7ef0 2023-12-04T05:38:56.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1814f610 con 0x7f1d180c7ef0 2023-12-04T05:38:56.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.657+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d18068440 con 0x7f1d180c7ef0 2023-12-04T05:38:56.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.661+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d08004b90 con 0x7f1d180c7ef0 2023-12-04T05:38:56.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.661+0000 7f1cfffff640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 0x7f1d04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.661+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1d080839c0 con 0x7f1d180c7ef0 2023-12-04T05:38:56.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.661+0000 7f1d16ffd640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 0x7f1d04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.666 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.661+0000 7f1d16ffd640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 0x7f1d04068d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0ae000 tx=0x7f1d0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.669 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.665+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d08054320 con 0x7f1d180c7ef0 2023-12-04T05:38:56.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d1806c970 con 0x7f1d180c7ef0 2023-12-04T05:38:56.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1cfffff640 1 -- 172.21.15.97:0/850209965 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7f1d08018090 con 0x7f1d180c7ef0 2023-12-04T05:38:56.822 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:38:56.822 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 msgr2=0x7f1d04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 0x7f1d04068d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0ae000 tx=0x7f1d0c008040 comp rx=0 tx=0).stop 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 msgr2=0x7f1d18149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c480 tx=0x7f1d0800c940 comp rx=0 tx=0).stop 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 shutdown_connections 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d040668d0 0x7f1d04068d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d18158630 0x7f1d18156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d18151bf0 0x7f1d1814ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 --2- 172.21.15.97:0/850209965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d180c7ef0 0x7f1d18149a50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 >> 172.21.15.97:0/850209965 conn(0x7f1d18073550 msgr2=0x7f1d1815e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:56.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 shutdown_connections 2023-12-04T05:38:56.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.817+0000 7f1d1dd2a640 1 -- 172.21.15.97:0/850209965 wait complete. 2023-12-04T05:38:56.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:38:26.438302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:38:27.710828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:38:44.148875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:38:45.405294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:38:56.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:38:56.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 Processor -- start 2023-12-04T05:38:56.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 -- start start 2023-12-04T05:38:56.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17c40c1360 0x7f17c40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17c4154af0 0x7f17c414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c4150bc0 con 0x7f17c406c000 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c4154fd0 con 0x7f17c40c1360 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c8bd8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c4151a70 con 0x7f17c4154af0 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.977+0000 7f17c259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17c40c1360 0x7f17c40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17c40c1360 0x7f17c40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42284/0 (socket says 172.21.15.97:42284) 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 -- 172.21.15.97:0/4237108738 learned_addr learned my addr 172.21.15.97:0/4237108738 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c2d9d640 1 --2- 172.21.15.97:0/4237108738 >> v2:172.21.15.143:3300/0 conn(0x7f17c4154af0 0x7f17c414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 -- 172.21.15.97:0/4237108738 >> v2:172.21.15.143:3300/0 conn(0x7f17c4154af0 msgr2=0x7f17c414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 --2- 172.21.15.97:0/4237108738 >> v2:172.21.15.143:3300/0 conn(0x7f17c4154af0 0x7f17c414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 -- 172.21.15.97:0/4237108738 >> v1:172.21.15.143:6789/0 conn(0x7f17c406c000 legacy=0x7f17c4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 -- 172.21.15.97:0/4237108738 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4072160 con 0x7f17c40c1360 2023-12-04T05:38:56.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c259c640 1 --2- 172.21.15.97:0/4237108738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c40c1360 0x7f17c40700b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a8460 tx=0x7f17b401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4d8eb54a727d99 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c1d9b640 1 -- 172.21.15.97:0/4237108738 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40a56f0 con 0x7f17c40c1360 2023-12-04T05:38:56.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c1d9b640 1 -- 172.21.15.97:0/4237108738 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40a5850 con 0x7f17c40c1360 2023-12-04T05:38:56.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.981+0000 7f17c1d9b640 1 -- 172.21.15.97:0/4237108738 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40a5be0 con 0x7f17c40c1360 2023-12-04T05:38:56.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- 172.21.15.97:0/4237108738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c40c1360 msgr2=0x7f17c40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/4237108738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c40c1360 0x7f17c40700b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a8460 tx=0x7f17b401c940 comp rx=0 tx=0).stop 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- 172.21.15.97:0/4237108738 shutdown_connections 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/4237108738 >> v2:172.21.15.143:3300/0 conn(0x7f17c4154af0 0x7f17c414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/4237108738 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c40c1360 0x7f17c40700b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- 172.21.15.97:0/4237108738 >> 172.21.15.97:0/4237108738 conn(0x7f17c40c5e70 msgr2=0x7f17c40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- 172.21.15.97:0/4237108738 shutdown_connections 2023-12-04T05:38:56.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- 172.21.15.97:0/4237108738 wait complete. 2023-12-04T05:38:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 Processor -- start 2023-12-04T05:38:56.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- start start 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17c40c1360 0x7f17c4152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17c4154af0 0x7f17c4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4148e20 con 0x7f17c406c000 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4154060 con 0x7f17c4154af0 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c8bd8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4153d80 con 0x7f17c40c1360 2023-12-04T05:38:56.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42292/0 (socket says 172.21.15.97:42292) 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 -- 172.21.15.97:0/3999996197 learned_addr learned my addr 172.21.15.97:0/3999996197 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c2d9d640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17c4154af0 0x7f17c4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17b9d9b640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17c40c1360 0x7f17c4152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 -- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17c40c1360 msgr2=0x7f17c4152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17c40c1360 0x7f17c4152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 -- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17c4154af0 msgr2=0x7f17c4159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17c4154af0 0x7f17c4159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.985+0000 7f17c259c640 1 -- 172.21.15.97:0/3999996197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009b30 con 0x7f17c406c000 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17c259c640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f17b401a570 tx=0x7f17b40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40b8670 con 0x7f17c406c000 2023-12-04T05:38:56.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40b87f0 con 0x7f17c406c000 2023-12-04T05:38:56.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40b8ba0 con 0x7f17c406c000 2023-12-04T05:38:56.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4152160 con 0x7f17c406c000 2023-12-04T05:38:56.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4152720 con 0x7f17c406c000 2023-12-04T05:38:56.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4068440 con 0x7f17c406c000 2023-12-04T05:38:56.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f17b40b8d00 con 0x7f17c406c000 2023-12-04T05:38:56.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 0x7f17a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:56.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f17b411fcd0 con 0x7f17c406c000 2023-12-04T05:38:56.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.989+0000 7f17b9d9b640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 0x7f17a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:56.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.993+0000 7f17b9d9b640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 0x7f17a4068d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17c4148330 tx=0x7f17ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:56.993+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17b40eccc0 con 0x7f17c406c000 2023-12-04T05:38:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.145+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17c40c2430 con 0x7f17c406c000 2023-12-04T05:38:57.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17bb7fe640 1 -- 172.21.15.97:0/3999996197 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17b40f02e0 con 0x7f17c406c000 2023-12-04T05:38:57.152 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 msgr2=0x7f17a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 0x7f17a4068d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17c4148330 tx=0x7f17ac009040 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 msgr2=0x7f17c41536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f17b401a570 tx=0x7f17b40196e0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 shutdown_connections 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17a40668d0 0x7f17a4068d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17c4154af0 0x7f17c4159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17c40c1360 0x7f17c4152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 --2- 172.21.15.97:0/3999996197 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17c406c000 0x7f17c41536f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 >> 172.21.15.97:0/3999996197 conn(0x7f17c40c5e70 msgr2=0x7f17c4071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 shutdown_connections 2023-12-04T05:38:57.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.149+0000 7f17c8bd8640 1 -- 172.21.15.97:0/3999996197 wait complete. 2023-12-04T05:38:57.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:38:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.309+0000 7f313ec32640 1 Processor -- start 2023-12-04T05:38:57.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.309+0000 7f313ec32640 1 -- start start 2023-12-04T05:38:57.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313ec32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f313806c000 0x7f31380700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313ec32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 0x7f313814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313ec32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3138150bc0 con 0x7f31380c1360 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313ec32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3138154fd0 con 0x7f313806c000 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313ec32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3138151a70 con 0x7f3138154af0 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f313806c000 0x7f31380700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313d1cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 0x7f313814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f313806c000 0x7f31380700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:50456/0 (socket says 172.21.15.97:50456) 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313c9ce640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f31380c1360 0x7f3138151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:57970/0 (socket says 172.21.15.97:57970) 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 -- 172.21.15.97:0/872405009 learned_addr learned my addr 172.21.15.97:0/872405009 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:57.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f313d1cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 0x7f313814dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:41038/0 (socket says 172.21.15.97:41038) 2023-12-04T05:38:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 -- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 msgr2=0x7f313814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 --2- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 0x7f313814dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 -- 172.21.15.97:0/872405009 >> v1:172.21.15.143:6789/0 conn(0x7f31380c1360 legacy=0x7f3138151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.313+0000 7f3137fff640 1 -- 172.21.15.97:0/872405009 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138072160 con 0x7f313806c000 2023-12-04T05:38:57.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f3137fff640 1 --2- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313806c000 0x7f31380700b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f312400bb10 tx=0x7f312401eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ecae761bb1076c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f31377fe640 1 -- 172.21.15.97:0/872405009 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240a7b40 con 0x7f313806c000 2023-12-04T05:38:57.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f31377fe640 1 -- 172.21.15.97:0/872405009 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31240a7ca0 con 0x7f313806c000 2023-12-04T05:38:57.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f31377fe640 1 -- 172.21.15.97:0/872405009 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240af660 con 0x7f313806c000 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313806c000 msgr2=0x7f31380700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313806c000 0x7f31380700b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f312400bb10 tx=0x7f312401eb80 comp rx=0 tx=0).stop 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- 172.21.15.97:0/872405009 shutdown_connections 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3138154af0 0x7f313814dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- 172.21.15.97:0/872405009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f313806c000 0x7f31380700b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- 172.21.15.97:0/872405009 >> 172.21.15.97:0/872405009 conn(0x7f31380c5e70 msgr2=0x7f31380c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- 172.21.15.97:0/872405009 shutdown_connections 2023-12-04T05:38:57.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- 172.21.15.97:0/872405009 wait complete. 2023-12-04T05:38:57.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 Processor -- start 2023-12-04T05:38:57.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- start start 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313806c000 0x7f31380c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31380c1360 0x7f31380c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380aa750 con 0x7f3138154af0 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381e9d60 con 0x7f31380c1360 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313ec32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31381ea000 con 0x7f313806c000 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.317+0000 7f313d1cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42302/0 (socket says 172.21.15.97:42302) 2023-12-04T05:38:57.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 -- 172.21.15.97:0/2334608232 learned_addr learned my addr 172.21.15.97:0/2334608232 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:57.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f3137fff640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31380c1360 0x7f31380c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313c9ce640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313806c000 0x7f31380c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 -- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313806c000 msgr2=0x7f31380c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313806c000 0x7f31380c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 -- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31380c1360 msgr2=0x7f31380c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31380c1360 0x7f31380c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 -- 172.21.15.97:0/2334608232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312400b770 con 0x7f3138154af0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313d1cf640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f313000efc0 tx=0x7f313000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130009b20 con 0x7f3138154af0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000f040 con 0x7f3138154af0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300146c0 con 0x7f3138154af0 2023-12-04T05:38:57.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31381ea2e0 con 0x7f3138154af0 2023-12-04T05:38:57.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381ea8a0 con 0x7f3138154af0 2023-12-04T05:38:57.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31381eaa90 con 0x7f3138154af0 2023-12-04T05:38:57.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3130014820 con 0x7f3138154af0 2023-12-04T05:38:57.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 0x7f311c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.321+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3130085360 con 0x7f3138154af0 2023-12-04T05:38:57.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.325+0000 7f313c9ce640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 0x7f311c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.325+0000 7f313c9ce640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 0x7f311c068dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f312c000f70 tx=0x7f312c007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.325+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3130052380 con 0x7f3138154af0 2023-12-04T05:38:57.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3138068440 con 0x7f3138154af0 2023-12-04T05:38:57.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f31357fa640 1 -- 172.21.15.97:0/2334608232 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3130009e60 con 0x7f3138154af0 2023-12-04T05:38:57.482 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 msgr2=0x7f311c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 0x7f311c068dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f312c000f70 tx=0x7f312c007e50 comp rx=0 tx=0).stop 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 msgr2=0x7f31380c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f313000efc0 tx=0x7f313000c490 comp rx=0 tx=0).stop 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 shutdown_connections 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f311c066900 0x7f311c068dc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3138154af0 0x7f31380c5880 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31380c1360 0x7f31380c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 --2- 172.21.15.97:0/2334608232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f313806c000 0x7f31380c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.477+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 >> 172.21.15.97:0/2334608232 conn(0x7f31380c5e70 msgr2=0x7f31380663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.481+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 shutdown_connections 2023-12-04T05:38:57.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.481+0000 7f313ec32640 1 -- 172.21.15.97:0/2334608232 wait complete. 2023-12-04T05:38:57.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:38:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.637+0000 7f18a30f5640 1 Processor -- start 2023-12-04T05:38:57.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.637+0000 7f18a30f5640 1 -- start start 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a30f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f189c1544f0 0x7f189c0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a30f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c0c0960 con 0x7f189c0c4cc0 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a30f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c06c820 con 0x7f189c071ea0 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a30f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c06cde0 con 0x7f189c1544f0 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a20f3640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f189c0c4cc0 0x7f189c153de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33918/0 (socket says 172.21.15.97:33918) 2023-12-04T05:38:57.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a20f3640 1 -- 172.21.15.97:0/2580461128 learned_addr learned my addr 172.21.15.97:0/2580461128 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 --2- 172.21.15.97:0/2580461128 >> v2:172.21.15.143:3300/0 conn(0x7f189c1544f0 0x7f189c0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076223782 0 0) 0x7f189c0c0960 con 0x7f189c0c4cc0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888005740 con 0x7f189c0c4cc0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 756148086 0 0) 0x7f1888005740 con 0x7f189c0c4cc0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 >> v2:172.21.15.143:3300/0 conn(0x7f189c1544f0 msgr2=0x7f189c0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 --2- 172.21.15.97:0/2580461128 >> v2:172.21.15.143:3300/0 conn(0x7f189c1544f0 0x7f189c0c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 >> v1:172.21.15.143:6789/0 conn(0x7f189c071ea0 legacy=0x7f189c0c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c06cb00 con 0x7f189c0c4cc0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f1898001680 con 0x7f189c0c4cc0 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 >> v1:172.21.15.97:6789/0 conn(0x7f189c0c4cc0 legacy=0x7f189c153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1888005be0 0x7f1888006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f18880069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1888007280 0x7f188800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c06cde0 con 0x7f1888005be0 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888010590 con 0x7f1888006540 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1888010700 con 0x7f1888007280 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a20f3640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1888005be0 0x7f1888006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f18880069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a28f4640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1888007280 0x7f188800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 -- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1888007280 msgr2=0x7f188800ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1888007280 0x7f188800ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 -- 172.21.15.97:0/2580461128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1888005be0 msgr2=0x7f1888006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1888005be0 0x7f1888006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a18f2640 1 -- 172.21.15.97:0/2580461128 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888005740 con 0x7f1888006540 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a20f3640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1888005be0 0x7f1888006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:57.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.641+0000 7f18a28f4640 1 -- 172.21.15.97:0/2580461128 reap_dead start 2023-12-04T05:38:57.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a18f2640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f18880069e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f188c009ae0 tx=0x7f188c01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=388685e3ad671d30 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0a6450 con 0x7f1888006540 2023-12-04T05:38:57.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0a65b0 con 0x7f1888006540 2023-12-04T05:38:57.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a10f1640 1 -- 172.21.15.97:0/2580461128 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0a6960 con 0x7f1888006540 2023-12-04T05:38:57.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 -- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 msgr2=0x7f18880069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f18880069e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f188c009ae0 tx=0x7f188c01ca70 comp rx=0 tx=0).stop 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 -- 172.21.15.97:0/2580461128 shutdown_connections 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 --2- 172.21.15.97:0/2580461128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f18880069e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 -- 172.21.15.97:0/2580461128 >> 172.21.15.97:0/2580461128 conn(0x7f189c06ad80 msgr2=0x7f189c0c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 -- 172.21.15.97:0/2580461128 shutdown_connections 2023-12-04T05:38:57.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.645+0000 7f18a30f5640 1 -- 172.21.15.97:0/2580461128 wait complete. 2023-12-04T05:38:57.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 Processor -- start 2023-12-04T05:38:57.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- start start 2023-12-04T05:38:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 0x7f189c0a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f189c14f690 0x7f189c1e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0a9c00 con 0x7f189c1485a0 2023-12-04T05:38:57.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0aaa00 con 0x7f1888006540 2023-12-04T05:38:57.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0aaf10 con 0x7f189c14f690 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:50488/0 (socket says 172.21.15.97:50488) 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 -- 172.21.15.97:0/3899289745 learned_addr learned my addr 172.21.15.97:0/3899289745 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a18f2640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 0x7f189c0a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a28f4640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f189c14f690 0x7f189c1e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 -- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f189c14f690 msgr2=0x7f189c1e9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f189c14f690 0x7f189c1e9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 -- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 msgr2=0x7f189c0a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 0x7f189c0a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 -- 172.21.15.97:0/3899289745 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c1e9190 con 0x7f1888006540 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a18f2640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 0x7f189c0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a20f3640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1898007290 tx=0x7f1898007750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800f8c0 con 0x7f1888006540 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800fa20 con 0x7f1888006540 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c0aac30 con 0x7f1888006540 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800fd90 con 0x7f1888006540 2023-12-04T05:38:57.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c1ea070 con 0x7f1888006540 2023-12-04T05:38:57.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.649+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c06d3a0 con 0x7f1888006540 2023-12-04T05:38:57.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.653+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f189801d460 con 0x7f1888006540 2023-12-04T05:38:57.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.653+0000 7f1892ffd640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 0x7f1880068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.653+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f18980845e0 con 0x7f1888006540 2023-12-04T05:38:57.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.653+0000 7f18a18f2640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 0x7f1880068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.653+0000 7f18a18f2640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 0x7f1880068dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f188c0ad000 tx=0x7f188c0b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.657+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1898051600 con 0x7f1888006540 2023-12-04T05:38:57.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.809+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f189c0a8ea0 con 0x7f1888006540 2023-12-04T05:38:57.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f1892ffd640 1 -- 172.21.15.97:0/3899289745 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f189c0a8ea0 con 0x7f1888006540 2023-12-04T05:38:57.817 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:57.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 msgr2=0x7f1880068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 0x7f1880068dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f188c0ad000 tx=0x7f188c0b2040 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 msgr2=0x7f189c1df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1898007290 tx=0x7f1898007750 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 shutdown_connections 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1880066900 0x7f1880068dc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f189c14f690 0x7f189c1e9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f189c1485a0 0x7f189c0a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 --2- 172.21.15.97:0/3899289745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1888006540 0x7f189c1df480 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 >> 172.21.15.97:0/3899289745 conn(0x7f189c06ad80 msgr2=0x7f189c151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 shutdown_connections 2023-12-04T05:38:57.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.813+0000 7f18a30f5640 1 -- 172.21.15.97:0/3899289745 wait complete. 2023-12-04T05:38:57.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:38:57.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 Processor -- start 2023-12-04T05:38:57.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 -- start start 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efc0814f960 0x7efc081548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08154640 con 0x7efc0814eb30 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0814ef10 con 0x7efc08154e10 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc0e09a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc080c0bd0 con 0x7efc0814f960 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc077fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efc0814eb30 0x7efc0814f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33928/0 (socket says 172.21.15.97:33928) 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc077fe640 1 -- 172.21.15.97:0/1215011497 learned_addr learned my addr 172.21.15.97:0/1215011497 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:57.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc06ffd640 1 --2- 172.21.15.97:0/1215011497 >> v2:172.21.15.97:3300/0 conn(0x7efc0814f960 0x7efc081548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc06ffd640 1 -- 172.21.15.97:0/1215011497 >> v1:172.21.15.143:6789/0 conn(0x7efc08154e10 legacy=0x7efc0815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc06ffd640 1 -- 172.21.15.97:0/1215011497 >> v1:172.21.15.97:6789/0 conn(0x7efc0814eb30 legacy=0x7efc0814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.973+0000 7efc06ffd640 1 -- 172.21.15.97:0/1215011497 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc081535a0 con 0x7efc0814f960 2023-12-04T05:38:57.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc06ffd640 1 --2- 172.21.15.97:0/1215011497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814f960 0x7efc081548d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d75ddbb14c81da server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc067fc640 1 -- 172.21.15.97:0/1215011497 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0ad660 con 0x7efc0814f960 2023-12-04T05:38:57.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc067fc640 1 -- 172.21.15.97:0/1215011497 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc0ad7c0 con 0x7efc0814f960 2023-12-04T05:38:57.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc067fc640 1 -- 172.21.15.97:0/1215011497 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0adb50 con 0x7efc0814f960 2023-12-04T05:38:57.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 -- 172.21.15.97:0/1215011497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814f960 msgr2=0x7efc081548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 --2- 172.21.15.97:0/1215011497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814f960 0x7efc081548d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097c0 tx=0x7efbfc01c450 comp rx=0 tx=0).stop 2023-12-04T05:38:57.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 -- 172.21.15.97:0/1215011497 shutdown_connections 2023-12-04T05:38:57.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 --2- 172.21.15.97:0/1215011497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814f960 0x7efc081548d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 -- 172.21.15.97:0/1215011497 >> 172.21.15.97:0/1215011497 conn(0x7efc080c5e70 msgr2=0x7efc080c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:57.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 -- 172.21.15.97:0/1215011497 shutdown_connections 2023-12-04T05:38:57.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 -- 172.21.15.97:0/1215011497 wait complete. 2023-12-04T05:38:57.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.977+0000 7efc0e09a640 1 Processor -- start 2023-12-04T05:38:57.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- start start 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc0814f960 0x7efc08071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc08154e10 0x7efc080a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080a97d0 con 0x7efc0814eb30 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080aae80 con 0x7efc0814f960 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08152110 con 0x7efc08154e10 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42352/0 (socket says 172.21.15.97:42352) 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 -- 172.21.15.97:0/724411055 learned_addr learned my addr 172.21.15.97:0/724411055 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 -- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc08154e10 msgr2=0x7efc080a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc08154e10 0x7efc080a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 -- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc0814f960 msgr2=0x7efc08071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc0814f960 0x7efc08071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 -- 172.21.15.97:0/724411055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc009420 con 0x7efc0814eb30 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc077fe640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c500 tx=0x7efbf800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8005cf0 con 0x7efc0814eb30 2023-12-04T05:38:57.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf8005e50 con 0x7efc0814eb30 2023-12-04T05:38:57.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80072f0 con 0x7efc0814eb30 2023-12-04T05:38:57.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08150c30 con 0x7efc0814eb30 2023-12-04T05:38:57.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc08151e30 con 0x7efc0814eb30 2023-12-04T05:38:57.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.981+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc080a9a40 con 0x7efc0814eb30 2023-12-04T05:38:57.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.985+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efbf8007450 con 0x7efc0814eb30 2023-12-04T05:38:57.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.985+0000 7efbeffff640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 0x7efbf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:57.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.985+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efbf8083cb0 con 0x7efc0814eb30 2023-12-04T05:38:57.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.985+0000 7efc06ffd640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 0x7efbf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:57.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.985+0000 7efc06ffd640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 0x7efbf4068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0af000 tx=0x7efbfc004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:57.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:57.989+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efbf8050c30 con 0x7efc0814eb30 2023-12-04T05:38:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.141+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc08068440 con 0x7efc0814eb30 2023-12-04T05:38:58.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efbeffff640 1 -- 172.21.15.97:0/724411055 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7efbf8017020 con 0x7efc0814eb30 2023-12-04T05:38:58.148 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:38:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 msgr2=0x7efbf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 0x7efbf4068d90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0af000 tx=0x7efbfc004740 comp rx=0 tx=0).stop 2023-12-04T05:38:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 msgr2=0x7efc081f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c500 tx=0x7efbf800c9c0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 shutdown_connections 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efbf40668d0 0x7efbf4068d90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc08154e10 0x7efc080a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc0814f960 0x7efc08071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 --2- 172.21.15.97:0/724411055 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efc0814eb30 0x7efc081f2b70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 >> 172.21.15.97:0/724411055 conn(0x7efc080c5e70 msgr2=0x7efc080c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 shutdown_connections 2023-12-04T05:38:58.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.145+0000 7efc0e09a640 1 -- 172.21.15.97:0/724411055 wait complete. 2023-12-04T05:38:58.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:38:58.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 Processor -- start 2023-12-04T05:38:58.311 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 -- start start 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e1406c440 0x7f0e141524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e1406d210 0x7f0e1406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140aa240 con 0x7f0e140c1e70 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1406c0c0 con 0x7f0e1406d210 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.305+0000 7f0e18d8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140aa500 con 0x7f0e1406c440 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e1406d210 0x7f0e1406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0e1406d210 0x7f0e1406d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42356/0 (socket says 172.21.15.97:42356) 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 -- 172.21.15.97:0/1142793778 learned_addr learned my addr 172.21.15.97:0/1142793778 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e09d9b640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e1406c440 0x7f0e141524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e11d9b640 1 -- 172.21.15.97:0/1142793778 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115305155 0 0) 0x7f0e140aa240 con 0x7f0e140c1e70 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 -- 172.21.15.97:0/1142793778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e1406c440 msgr2=0x7f0e141524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e1406c440 0x7f0e141524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 -- 172.21.15.97:0/1142793778 >> v1:172.21.15.143:6789/0 conn(0x7f0e140c1e70 legacy=0x7f0e140a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 -- 172.21.15.97:0/1142793778 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140aa7e0 con 0x7f0e1406d210 2023-12-04T05:38:58.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e12d9d640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406d210 0x7f0e1406d680 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab5606a48c51dce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e11d9b640 1 -- 172.21.15.97:0/1142793778 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0a95f0 con 0x7f0e1406d210 2023-12-04T05:38:58.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e11d9b640 1 -- 172.21.15.97:0/1142793778 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0a9750 con 0x7f0e1406d210 2023-12-04T05:38:58.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.309+0000 7f0e11d9b640 1 -- 172.21.15.97:0/1142793778 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0a9ae0 con 0x7f0e1406d210 2023-12-04T05:38:58.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- 172.21.15.97:0/1142793778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406d210 msgr2=0x7f0e1406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406d210 0x7f0e1406d680 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c510 comp rx=0 tx=0).stop 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- 172.21.15.97:0/1142793778 shutdown_connections 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406d210 0x7f0e1406d680 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/1142793778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e1406c440 0x7f0e141524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- 172.21.15.97:0/1142793778 >> 172.21.15.97:0/1142793778 conn(0x7f0e140c5e70 msgr2=0x7f0e140c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- 172.21.15.97:0/1142793778 shutdown_connections 2023-12-04T05:38:58.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- 172.21.15.97:0/1142793778 wait complete. 2023-12-04T05:38:58.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 Processor -- start 2023-12-04T05:38:58.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- start start 2023-12-04T05:38:58.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e1406d210 0x7f0e141ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 0x7f0e141458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e141edde0 con 0x7f0e1406c440 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140c4d30 con 0x7f0e1406d210 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e18d8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140c5010 con 0x7f0e140c1e70 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42366/0 (socket says 172.21.15.97:42366) 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 -- 172.21.15.97:0/680663485 learned_addr learned my addr 172.21.15.97:0/680663485 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e09d9b640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e1406d210 0x7f0e141ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e12d9d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 0x7f0e141458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 -- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 msgr2=0x7f0e141458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 0x7f0e141458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 -- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e1406d210 msgr2=0x7f0e141ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e1406d210 0x7f0e141ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e1259c640 1 -- 172.21.15.97:0/680663485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094d0 con 0x7f0e1406c440 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.313+0000 7f0e12d9d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 0x7f0e141458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e1259c640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0e04001570 tx=0x7f0e0400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04003db0 con 0x7f0e1406c440 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04005070 con 0x7f0e1406c440 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04005420 con 0x7f0e1406c440 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e140c52f0 con 0x7f0e1406c440 2023-12-04T05:38:58.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e140c3a80 con 0x7f0e1406c440 2023-12-04T05:38:58.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e14068440 con 0x7f0e1406c440 2023-12-04T05:38:58.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e04005580 con 0x7f0e1406c440 2023-12-04T05:38:58.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 0x7f0df4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e04083f80 con 0x7f0e1406c440 2023-12-04T05:38:58.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.317+0000 7f0e09d9b640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 0x7f0df4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.321+0000 7f0e09d9b640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 0x7f0df4068dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0e141462a0 tx=0x7f0dfc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.321+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e040b5280 con 0x7f0e1406c440 2023-12-04T05:38:58.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0e14150510 con 0x7f0e1406c440 2023-12-04T05:38:58.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e0b7fe640 1 -- 172.21.15.97:0/680663485 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0e04017070 con 0x7f0e1406c440 2023-12-04T05:38:58.477 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:38:58.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 msgr2=0x7f0df4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 0x7f0df4068dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0e141462a0 tx=0x7f0dfc009190 comp rx=0 tx=0).stop 2023-12-04T05:38:58.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 msgr2=0x7f0e1414ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0e04001570 tx=0x7f0e0400cd00 comp rx=0 tx=0).stop 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 shutdown_connections 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0df4066900 0x7f0df4068dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e140c1e70 0x7f0e141458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e1406d210 0x7f0e141ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 --2- 172.21.15.97:0/680663485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e1406c440 0x7f0e1414ce90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 >> 172.21.15.97:0/680663485 conn(0x7f0e140c5e70 msgr2=0x7f0e14151590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 shutdown_connections 2023-12-04T05:38:58.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.473+0000 7f0e18d8d640 1 -- 172.21.15.97:0/680663485 wait complete. 2023-12-04T05:38:58.499 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:38:58.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 Processor -- start 2023-12-04T05:38:58.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 -- start start 2023-12-04T05:38:58.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb00151f10 0x7fdb000c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdb000cac10 0x7fdb0015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000ca780 con 0x7fdb000c7f00 2023-12-04T05:38:58.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb00158cc0 con 0x7fdb00151f10 2023-12-04T05:38:58.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb06f65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb000c5700 con 0x7fdb000cac10 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb04d01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb00151f10 0x7fdb000c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdaf7fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdb000c7f00 0x7fdb00154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33940/0 (socket says 172.21.15.97:33940) 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdaf7fff640 1 -- 172.21.15.97:0/3365311812 learned_addr learned my addr 172.21.15.97:0/3365311812 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb05502640 1 --2- 172.21.15.97:0/3365311812 >> v2:172.21.15.143:3300/0 conn(0x7fdb000cac10 0x7fdb0015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb04d01640 1 -- 172.21.15.97:0/3365311812 >> v2:172.21.15.143:3300/0 conn(0x7fdb000cac10 msgr2=0x7fdb0015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb04d01640 1 --2- 172.21.15.97:0/3365311812 >> v2:172.21.15.143:3300/0 conn(0x7fdb000cac10 0x7fdb0015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb04d01640 1 -- 172.21.15.97:0/3365311812 >> v1:172.21.15.97:6789/0 conn(0x7fdb000c7f00 legacy=0x7fdb00154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.633+0000 7fdb04d01640 1 -- 172.21.15.97:0/3365311812 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00158720 con 0x7fdb00151f10 2023-12-04T05:38:58.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb04d01640 1 --2- 172.21.15.97:0/3365311812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb000c4980 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdb0006bcd0 tx=0x7fdafc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d5f7059542ece5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdaf77fe640 1 -- 172.21.15.97:0/3365311812 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0ac640 con 0x7fdb00151f10 2023-12-04T05:38:58.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdaf77fe640 1 -- 172.21.15.97:0/3365311812 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc0ac7a0 con 0x7fdb00151f10 2023-12-04T05:38:58.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdaf77fe640 1 -- 172.21.15.97:0/3365311812 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0acb30 con 0x7fdb00151f10 2023-12-04T05:38:58.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 -- 172.21.15.97:0/3365311812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 msgr2=0x7fdb000c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 --2- 172.21.15.97:0/3365311812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb000c4980 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdb0006bcd0 tx=0x7fdafc01c310 comp rx=0 tx=0).stop 2023-12-04T05:38:58.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 -- 172.21.15.97:0/3365311812 shutdown_connections 2023-12-04T05:38:58.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 --2- 172.21.15.97:0/3365311812 >> v2:172.21.15.143:3300/0 conn(0x7fdb000cac10 0x7fdb0015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.643 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 --2- 172.21.15.97:0/3365311812 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb000c4980 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 -- 172.21.15.97:0/3365311812 >> 172.21.15.97:0/3365311812 conn(0x7fdb00073950 msgr2=0x7fdb00073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:58.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 -- 172.21.15.97:0/3365311812 shutdown_connections 2023-12-04T05:38:58.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.637+0000 7fdb06f65640 1 -- 172.21.15.97:0/3365311812 wait complete. 2023-12-04T05:38:58.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 Processor -- start 2023-12-04T05:38:58.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- start start 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb000c7f00 0x7fdb0014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb000cac10 0x7fdb00155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb001f1120 con 0x7fdb00151f10 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0014f1b0 con 0x7fdb000c7f00 2023-12-04T05:38:58.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0014c480 con 0x7fdb000cac10 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42384/0 (socket says 172.21.15.97:42384) 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 -- 172.21.15.97:0/1034658575 learned_addr learned my addr 172.21.15.97:0/1034658575 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb04d01640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb000c7f00 0x7fdb0014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdaf7fff640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb000cac10 0x7fdb00155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 -- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb000cac10 msgr2=0x7fdb00155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb000cac10 0x7fdb00155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 -- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb000c7f00 msgr2=0x7fdb0014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb000c7f00 0x7fdb0014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 -- 172.21.15.97:0/1034658575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009420 con 0x7fdb00151f10 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb05502640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007e30 tx=0x7fdaf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8014620 con 0x7fdb00151f10 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800ee90 con 0x7fdb00151f10 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb001f0e40 con 0x7fdb00151f10 2023-12-04T05:38:58.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80149c0 con 0x7fdb00151f10 2023-12-04T05:38:58.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.641+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb00155f40 con 0x7fdb00151f10 2023-12-04T05:38:58.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb00068440 con 0x7fdb00151f10 2023-12-04T05:38:58.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdaf8014b20 con 0x7fdb00151f10 2023-12-04T05:38:58.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdaf57fa640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 0x7fdaec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:58.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdaf8084ff0 con 0x7fdb00151f10 2023-12-04T05:38:58.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdb04d01640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 0x7fdaec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:58.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.645+0000 7fdb04d01640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 0x7fdaec068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ae000 tx=0x7fdafc0a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:58.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.649+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdaf80b6280 con 0x7fdb00151f10 2023-12-04T05:38:58.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.809+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdb0014e920 con 0x7fdb00151f10 2023-12-04T05:38:58.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.809+0000 7fdaf57fa640 1 -- 172.21.15.97:0/1034658575 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdaf8051f90 con 0x7fdb00151f10 2023-12-04T05:38:58.816 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 msgr2=0x7fdaec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 0x7fdaec068dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ae000 tx=0x7fdafc0a6070 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 msgr2=0x7fdb001f0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8007e30 tx=0x7fdaf800e4b0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 shutdown_connections 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdaec066900 0x7fdaec068dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb00151f10 0x7fdb001f0440 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb000cac10 0x7fdb00155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 --2- 172.21.15.97:0/1034658575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb000c7f00 0x7fdb0014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 >> 172.21.15.97:0/1034658575 conn(0x7fdb00073950 msgr2=0x7fdb000c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 shutdown_connections 2023-12-04T05:38:58.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:58.813+0000 7fdb06f65640 1 -- 172.21.15.97:0/1034658575 wait complete. 2023-12-04T05:38:58.837 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T05:38:58.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:58.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:58.864 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:38:58.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:58.865 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T05:38:58.919 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:38:58.919 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:38:58.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:38:58.968 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:38:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 Processor -- start 2023-12-04T05:38:59.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 -- start start 2023-12-04T05:38:59.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72e0151bf0 0x7f72e00abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f72e0155370 0x7f72e015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e01547d0 con 0x7f72e00c7ef0 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e0158b80 con 0x7f72e0151bf0 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e6965640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e00c4aa0 con 0x7f72e0155370 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72e0151bf0 0x7f72e00abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f72e0151bf0 0x7f72e00abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42392/0 (socket says 172.21.15.97:42392) 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 -- 172.21.15.97:0/10185018 learned_addr learned my addr 172.21.15.97:0/10185018 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72df7fe640 1 --1- 172.21.15.97:0/10185018 >> v1:172.21.15.97:6789/0 conn(0x7f72e00c7ef0 0x7f72e0154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33942/0 (socket says 172.21.15.97:33942) 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72e4f02640 1 --2- 172.21.15.97:0/10185018 >> v2:172.21.15.143:3300/0 conn(0x7f72e0155370 0x7f72e015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 -- 172.21.15.97:0/10185018 >> v2:172.21.15.143:3300/0 conn(0x7f72e0155370 msgr2=0x7f72e015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 --2- 172.21.15.97:0/10185018 >> v2:172.21.15.143:3300/0 conn(0x7f72e0155370 0x7f72e015efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 -- 172.21.15.97:0/10185018 >> v1:172.21.15.97:6789/0 conn(0x7f72e00c7ef0 legacy=0x7f72e0154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72dffff640 1 -- 172.21.15.97:0/10185018 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00c4d40 con 0x7f72e0151bf0 2023-12-04T05:38:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.153+0000 7f72deffd640 1 -- 172.21.15.97:0/10185018 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852343565 0 0) 0x7f72e01547d0 con 0x7f72e00c7ef0 2023-12-04T05:38:59.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72dffff640 1 --2- 172.21.15.97:0/10185018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0151bf0 0x7f72e00abbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f72e00a9b20 tx=0x7f72d001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77909d11902f1e72 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:59.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72deffd640 1 -- 172.21.15.97:0/10185018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00a4900 con 0x7f72e0151bf0 2023-12-04T05:38:59.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72deffd640 1 -- 172.21.15.97:0/10185018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00a4a60 con 0x7f72e0151bf0 2023-12-04T05:38:59.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72deffd640 1 -- 172.21.15.97:0/10185018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00a4df0 con 0x7f72e0151bf0 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 -- 172.21.15.97:0/10185018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0151bf0 msgr2=0x7f72e00abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 --2- 172.21.15.97:0/10185018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0151bf0 0x7f72e00abbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f72e00a9b20 tx=0x7f72d001c0c0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 -- 172.21.15.97:0/10185018 shutdown_connections 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 --2- 172.21.15.97:0/10185018 >> v2:172.21.15.143:3300/0 conn(0x7f72e0155370 0x7f72e015efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 --2- 172.21.15.97:0/10185018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0151bf0 0x7f72e00abbb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 -- 172.21.15.97:0/10185018 >> 172.21.15.97:0/10185018 conn(0x7f72e0073550 msgr2=0x7f72e0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 -- 172.21.15.97:0/10185018 shutdown_connections 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 -- 172.21.15.97:0/10185018 wait complete. 2023-12-04T05:38:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.157+0000 7f72e6965640 1 Processor -- start 2023-12-04T05:38:59.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- start start 2023-12-04T05:38:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e00c7ef0 0x7f72e0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e0151bf0 0x7f72e00c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e00c13f0 con 0x7f72e0155370 2023-12-04T05:38:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e0150c40 con 0x7f72e00c7ef0 2023-12-04T05:38:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01570c0 con 0x7f72e0151bf0 2023-12-04T05:38:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42408/0 (socket says 172.21.15.97:42408) 2023-12-04T05:38:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 -- 172.21.15.97:0/2639209522 learned_addr learned my addr 172.21.15.97:0/2639209522 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 -- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e0151bf0 msgr2=0x7f72e00c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e0151bf0 0x7f72e00c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 -- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e00c7ef0 msgr2=0x7f72e0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e00c7ef0 0x7f72e0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 -- 172.21.15.97:0/2639209522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00094d0 con 0x7f72e0155370 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e4f02640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f72d800efc0 tx=0x7f72d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8009ca0 con 0x7f72e0155370 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d800f040 con 0x7f72e0155370 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d80146c0 con 0x7f72e0155370 2023-12-04T05:38:59.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e01503a0 con 0x7f72e0155370 2023-12-04T05:38:59.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e0150960 con 0x7f72e0155370 2023-12-04T05:38:59.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.161+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e0068440 con 0x7f72e0155370 2023-12-04T05:38:59.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.165+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72d8014820 con 0x7f72e0155370 2023-12-04T05:38:59.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.165+0000 7f72dcff9640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 0x7f72cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:38:59.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.165+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f72d8085640 con 0x7f72e0155370 2023-12-04T05:38:59.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.165+0000 7f72dffff640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 0x7f72cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:38:59.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.165+0000 7f72dffff640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 0x7f72cc068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72d00ae000 tx=0x7f72d0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:38:59.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.169+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72d80525b0 con 0x7f72e0155370 2023-12-04T05:38:59.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72e006c970 con 0x7f72e0155370 2023-12-04T05:38:59.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72dcff9640 1 -- 172.21.15.97:0/2639209522 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f72d8055bd0 con 0x7f72e0155370 2023-12-04T05:38:59.358 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:38:59.358 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 msgr2=0x7f72cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 0x7f72cc068d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f72d00ae000 tx=0x7f72d0004740 comp rx=0 tx=0).stop 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 msgr2=0x7f72e01498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f72d800efc0 tx=0x7f72d800c490 comp rx=0 tx=0).stop 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 shutdown_connections 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72cc0668d0 0x7f72cc068d90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e0155370 0x7f72e01498f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e0151bf0 0x7f72e00c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 --2- 172.21.15.97:0/2639209522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e00c7ef0 0x7f72e0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:38:59.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.353+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 >> 172.21.15.97:0/2639209522 conn(0x7f72e0073550 msgr2=0x7f72e00aa160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:38:59.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.357+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 shutdown_connections 2023-12-04T05:38:59.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:38:59.357+0000 7f72e6965640 1 -- 172.21.15.97:0/2639209522 wait complete. 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:59.379 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:38:59.380 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:38:59.380 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.VZS3dm14Qd 2023-12-04T05:38:59.380 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:38:59.388 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.WtqGLoBza2 2023-12-04T05:38:59.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /tmp/tmp.VZS3dm14Qd /tmp/tmp.WtqGLoBza2 2023-12-04T05:38:59.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.WtqGLoBza2 2023-12-04T05:38:59.565 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.WtqGLoBza2 is 245B 2023-12-04T05:38:59.581 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.WtqGLoBza2 2023-12-04T05:38:59.590 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-04T05:38:59.590 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:38:59.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.590 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:38:59.644 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:38:59.645 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 42010sec preferred_lft 42010sec 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:38:59.646 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:38:59.647 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:38:59.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.648 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:38:59.710 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:38:59.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.713 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:38:59.766 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:38:59.767 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:59.767 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:59.767 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:38:59.767 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:38:59.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.767 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:38:59.767 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:38:59.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:38:59.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:38:59.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:38:59.768 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:38:59.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.858 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:38:59.868 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:38:59.868 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:38:59.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:38:59.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:38:59.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:59.936 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:38:59.988 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:38:59.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:38:59.989 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:00.040 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:00.040 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/tmp/tmp.VZS3dm14Qd of=/dev/stdout 2023-12-04T05:39:00.092 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-04T05:39:00.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:00.092 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:00.185 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:00.186 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:00.186 INFO:teuthology.orchestra.run.smithi097.stdout:keyring.get_secret failed 2023-12-04T05:39:00.195 INFO:teuthology.orchestra.run.smithi097.stderr:mount.ceph: kernel BUG! 2023-12-04T05:39:00.195 INFO:teuthology.orchestra.run.smithi097.stderr:mount error 13 = Permission denied 2023-12-04T05:39:00.196 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:00.196 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:00.196 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:00.196 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: testuser@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:39:00.197 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:00.200 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-04T05:39:00.200 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-04T05:39:00.200 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:39:00.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:39:00.294 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:39:00.387 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:39:00.387 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:00.387 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:00.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:39:00.396 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:00.396 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:00.405 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:00.406 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:00.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:00.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 Processor -- start 2023-12-04T05:39:00.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 -- start start 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 0x7f878c0c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f878c071e10 0x7f878c06be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f878c06c340 0x7f878c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06dd10 con 0x7f878c06c340 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06ff60 con 0x7f878c071e10 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8793832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0707c0 con 0x7f878c0c1880 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f878c06c340 0x7f878c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f878c06c340 0x7f878c15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42412/0 (socket says 172.21.15.97:42412) 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 -- 172.21.15.97:0/928983637 learned_addr learned my addr 172.21.15.97:0/928983637 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8790dcd640 1 --2- 172.21.15.97:0/928983637 >> v2:172.21.15.143:3300/0 conn(0x7f878c071e10 0x7f878c06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f87915ce640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 0x7f878c0c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 -- 172.21.15.97:0/928983637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 msgr2=0x7f878c0c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:00.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 0x7f878c0c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 -- 172.21.15.97:0/928983637 >> v2:172.21.15.143:3300/0 conn(0x7f878c071e10 msgr2=0x7f878c06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:00.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 --2- 172.21.15.97:0/928983637 >> v2:172.21.15.143:3300/0 conn(0x7f878c071e10 0x7f878c06be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f8791dcf640 1 -- 172.21.15.97:0/928983637 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c159470 con 0x7f878c06c340 2023-12-04T05:39:00.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.593+0000 7f87915ce640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 0x7f878c0c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:00.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8791dcf640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c06c340 0x7f878c15bfe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f878c0c28d0 tx=0x7f878401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2c2ab24aa12fca server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8783fff640 1 -- 172.21.15.97:0/928983637 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840a5740 con 0x7f878c06c340 2023-12-04T05:39:00.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8783fff640 1 -- 172.21.15.97:0/928983637 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840a58a0 con 0x7f878c06c340 2023-12-04T05:39:00.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8783fff640 1 -- 172.21.15.97:0/928983637 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840a5c30 con 0x7f878c06c340 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 -- 172.21.15.97:0/928983637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c06c340 msgr2=0x7f878c15bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c06c340 0x7f878c15bfe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f878c0c28d0 tx=0x7f878401c9d0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 -- 172.21.15.97:0/928983637 shutdown_connections 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c06c340 0x7f878c15bfe0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 --2- 172.21.15.97:0/928983637 >> v2:172.21.15.143:3300/0 conn(0x7f878c071e10 0x7f878c06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 --2- 172.21.15.97:0/928983637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c0c1880 0x7f878c0c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 -- 172.21.15.97:0/928983637 >> 172.21.15.97:0/928983637 conn(0x7f878c0c2970 msgr2=0x7f878c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:00.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 -- 172.21.15.97:0/928983637 shutdown_connections 2023-12-04T05:39:00.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.597+0000 7f8793832640 1 -- 172.21.15.97:0/928983637 wait complete. 2023-12-04T05:39:00.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 Processor -- start 2023-12-04T05:39:00.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 -- start start 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f878c06c340 0x7f878c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c071e10 0x7f878c146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0ab370 con 0x7f878c0c1880 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c14b1b0 con 0x7f878c06c340 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c14c570 con 0x7f878c071e10 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42418/0 (socket says 172.21.15.97:42418) 2023-12-04T05:39:00.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 -- 172.21.15.97:0/1751631245 learned_addr learned my addr 172.21.15.97:0/1751631245 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f87915ce640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f878c06c340 0x7f878c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8790dcd640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c071e10 0x7f878c146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 -- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c071e10 msgr2=0x7f878c146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c071e10 0x7f878c146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 -- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f878c06c340 msgr2=0x7f878c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f878c06c340 0x7f878c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 -- 172.21.15.97:0/1751631245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009b30 con 0x7f878c0c1880 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8791dcf640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f87840af040 tx=0x7f8784019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840b8670 con 0x7f878c0c1880 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840b87f0 con 0x7f878c0c1880 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840b8ba0 con 0x7f878c0c1880 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.601+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c147680 con 0x7f878c0c1880 2023-12-04T05:39:00.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c14c2b0 con 0x7f878c0c1880 2023-12-04T05:39:00.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c068440 con 0x7f878c0c1880 2023-12-04T05:39:00.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87840b8d00 con 0x7f878c0c1880 2023-12-04T05:39:00.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f8781ffb640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 0x7f8770068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f878411f490 con 0x7f878c0c1880 2023-12-04T05:39:00.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f87915ce640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 0x7f8770068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.605+0000 7f87915ce640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 0x7f8770068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8788006e90 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.609+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87840ec380 con 0x7f878c0c1880 2023-12-04T05:39:00.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878c14b2f0 con 0x7f878c0c1880 2023-12-04T05:39:00.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8781ffb640 1 -- 172.21.15.97:0/1751631245 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7f8784009510 con 0x7f878c0c1880 2023-12-04T05:39:00.770 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:00.770 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 msgr2=0x7f8770068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 0x7f8770068dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8788006e90 tx=0x7f8788008040 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 msgr2=0x7f878c147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f87840af040 tx=0x7f8784019770 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 shutdown_connections 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8770066900 0x7f8770068dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f878c0c1880 0x7f878c147140 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f878c071e10 0x7f878c146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 --2- 172.21.15.97:0/1751631245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f878c06c340 0x7f878c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 >> 172.21.15.97:0/1751631245 conn(0x7f878c0c2970 msgr2=0x7f878c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 shutdown_connections 2023-12-04T05:39:00.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.765+0000 7f8793832640 1 -- 172.21.15.97:0/1751631245 wait complete. 2023-12-04T05:39:00.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:38:26.438302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:38:27.710828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:38:44.148875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:38:45.405294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:00.791 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:00.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 Processor -- start 2023-12-04T05:39:00.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 -- start start 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fccc014f960 0x7fccc01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc0154640 con 0x7fccc014eb30 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc014ef10 con 0x7fccc0154e10 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc6f96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00c0bd0 con 0x7fccc014f960 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fccc014eb30 0x7fccc014f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33944/0 (socket says 172.21.15.97:33944) 2023-12-04T05:39:00.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 -- 172.21.15.97:0/4100769244 learned_addr learned my addr 172.21.15.97:0/4100769244 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214065868 0 0) 0x7fccc0154640 con 0x7fccc014eb30 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0003530 con 0x7fccc014eb30 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbffff640 1 --2- 172.21.15.97:0/4100769244 >> v2:172.21.15.143:3300/0 conn(0x7fccc014f960 0x7fccc01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506919990 0 0) 0x7fccb0003530 con 0x7fccc014eb30 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 >> v2:172.21.15.143:3300/0 conn(0x7fccc014f960 msgr2=0x7fccc01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 --2- 172.21.15.97:0/4100769244 >> v2:172.21.15.143:3300/0 conn(0x7fccc014f960 0x7fccc01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 >> v1:172.21.15.143:6789/0 conn(0x7fccc0154e10 legacy=0x7fccc015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc01535a0 con 0x7fccc014eb30 2023-12-04T05:39:00.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fccb4001680 con 0x7fccc014eb30 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 >> v1:172.21.15.97:6789/0 conn(0x7fccc014eb30 legacy=0x7fccc014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 0x7fccb0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccb00047d0 0x7fccb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0005190 0x7fccb000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c0bd0 con 0x7fccb0003980 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb000e240 con 0x7fccb0005190 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb000e400 con 0x7fccb00047d0 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 0x7fccb0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccbffff640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccb00047d0 0x7fccb0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc5533640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0005190 0x7fccb000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 -- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccb00047d0 msgr2=0x7fccb0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccb00047d0 0x7fccb0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 -- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0005190 msgr2=0x7fccb000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0005190 0x7fccb000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc4d32640 1 -- 172.21.15.97:0/4100769244 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0003530 con 0x7fccb0003980 2023-12-04T05:39:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc5533640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0005190 0x7fccb000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.929+0000 7fccc5533640 1 -- 172.21.15.97:0/4100769244 reap_dead start 2023-12-04T05:39:00.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc4d32640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 0x7fccb0003da0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c240 tx=0x7fccb401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1346c9aecf5916 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4005ae0 con 0x7fccb0003980 2023-12-04T05:39:00.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb4005c40 con 0x7fccb0003980 2023-12-04T05:39:00.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccbf7fe640 1 -- 172.21.15.97:0/4100769244 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb40a5a40 con 0x7fccb0003980 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 -- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 msgr2=0x7fccb0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 0x7fccb0003da0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c240 tx=0x7fccb401cc10 comp rx=0 tx=0).stop 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 -- 172.21.15.97:0/4100769244 shutdown_connections 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 --2- 172.21.15.97:0/4100769244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccb0003980 0x7fccb0003da0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 -- 172.21.15.97:0/4100769244 >> 172.21.15.97:0/4100769244 conn(0x7fccc00c5e70 msgr2=0x7fccc00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 -- 172.21.15.97:0/4100769244 shutdown_connections 2023-12-04T05:39:00.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.933+0000 7fccc6f96640 1 -- 172.21.15.97:0/4100769244 wait complete. 2023-12-04T05:39:00.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 Processor -- start 2023-12-04T05:39:00.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- start start 2023-12-04T05:39:00.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0003980 0x7fccc01e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0142c30 0x7fccc0142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc006c080 con 0x7fccc0142760 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc01e9c80 con 0x7fccb0003980 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc01e9f60 con 0x7fccc0142c30 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42428/0 (socket says 172.21.15.97:42428) 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 -- 172.21.15.97:0/3898241709 learned_addr learned my addr 172.21.15.97:0/3898241709 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc4d32640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0003980 0x7fccc01e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccbffff640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0142c30 0x7fccc0142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 -- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0142c30 msgr2=0x7fccc0142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0142c30 0x7fccc0142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 -- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0003980 msgr2=0x7fccc01e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0003980 0x7fccc01e9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 -- 172.21.15.97:0/3898241709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0155630 con 0x7fccc0142760 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc5533640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fccc01551f0 tx=0x7fccb800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8003c50 con 0x7fccc0142760 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8003db0 con 0x7fccc0142760 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc01ea240 con 0x7fccc0142760 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8005310 con 0x7fccc0142760 2023-12-04T05:39:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.937+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc01eaac0 con 0x7fccc0142760 2023-12-04T05:39:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc0068440 con 0x7fccc0142760 2023-12-04T05:39:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fccb8005470 con 0x7fccc0142760 2023-12-04T05:39:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccbd7fa640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 0x7fcca4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:00.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fccb8083ee0 con 0x7fccc0142760 2023-12-04T05:39:00.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccc4d32640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 0x7fcca4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:00.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.941+0000 7fccc4d32640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 0x7fcca4068dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ab000 tx=0x7fccb40b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:00.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:00.945+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccb8050e60 con 0x7fccc0142760 2023-12-04T05:39:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.097+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccc00a8ac0 con 0x7fccc0142760 2023-12-04T05:39:01.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.097+0000 7fccbd7fa640 1 -- 172.21.15.97:0/3898241709 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccb8019070 con 0x7fccc0142760 2023-12-04T05:39:01.103 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:01.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 msgr2=0x7fcca4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 0x7fcca4068dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ab000 tx=0x7fccb40b1040 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 msgr2=0x7fccc006d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fccc01551f0 tx=0x7fccb800ead0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 shutdown_connections 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcca4066900 0x7fcca4068dc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fccc0142760 0x7fccc006d5d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0142c30 0x7fccc0142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 --2- 172.21.15.97:0/3898241709 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccb0003980 0x7fccc01e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 >> 172.21.15.97:0/3898241709 conn(0x7fccc00c5e70 msgr2=0x7fccc014dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 shutdown_connections 2023-12-04T05:39:01.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.101+0000 7fccc6f96640 1 -- 172.21.15.97:0/3898241709 wait complete. 2023-12-04T05:39:01.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:01.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 Processor -- start 2023-12-04T05:39:01.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 -- start start 2023-12-04T05:39:01.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85941524e0 0x7f859406d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940aa240 con 0x7f85940c1e70 2023-12-04T05:39:01.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940aa500 con 0x7f859406c440 2023-12-04T05:39:01.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859ab01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859406c0c0 con 0x7f85941524e0 2023-12-04T05:39:01.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859889d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f85940c1e70 0x7f85940a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33960/0 (socket says 172.21.15.97:33960) 2023-12-04T05:39:01.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859889d640 1 -- 172.21.15.97:0/1899322438 learned_addr learned my addr 172.21.15.97:0/1899322438 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837353521 0 0) 0x7f85940aa240 con 0x7f85940c1e70 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8584003530 con 0x7f85940c1e70 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.261+0000 7f859909e640 1 --2- 172.21.15.97:0/1899322438 >> v2:172.21.15.143:3300/0 conn(0x7f85941524e0 0x7f859406d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728171585 0 0) 0x7f8584003530 con 0x7f85940c1e70 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 >> v2:172.21.15.143:3300/0 conn(0x7f85941524e0 msgr2=0x7f859406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 --2- 172.21.15.97:0/1899322438 >> v2:172.21.15.143:3300/0 conn(0x7f85941524e0 0x7f859406d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 >> v1:172.21.15.143:6789/0 conn(0x7f859406c440 legacy=0x7f859406d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940aa7e0 con 0x7f85940c1e70 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f8588001680 con 0x7f85940c1e70 2023-12-04T05:39:01.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 >> v1:172.21.15.97:6789/0 conn(0x7f85940c1e70 legacy=0x7f85940a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 0x7f8584003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840047d0 0x7f8584004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85840051e0 0x7f858400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859406c0c0 con 0x7f85840039d0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858400c130 con 0x7f85840051e0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858400c2f0 con 0x7f85840047d0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 0x7f8584003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f8593fff640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840047d0 0x7f8584004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859909e640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85840051e0 0x7f858400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 -- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840047d0 msgr2=0x7f8584004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840047d0 0x7f8584004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 -- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85840051e0 msgr2=0x7f858400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85840051e0 0x7f858400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 -- 172.21.15.97:0/1899322438 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584003530 con 0x7f85840039d0 2023-12-04T05:39:01.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859909e640 1 -- 172.21.15.97:0/1899322438 reap_dead start 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f859889d640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 0x7f8584003df0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f858800c0e0 tx=0x7f858801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff2a7da880c1654 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588005ae0 con 0x7f85840039d0 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588005c40 con 0x7f85840039d0 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.265+0000 7f85937fe640 1 -- 172.21.15.97:0/1899322438 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880072b0 con 0x7f85840039d0 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 msgr2=0x7f8584003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 0x7f8584003df0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f858800c0e0 tx=0x7f858801cb60 comp rx=0 tx=0).stop 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- 172.21.15.97:0/1899322438 shutdown_connections 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 --2- 172.21.15.97:0/1899322438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85840039d0 0x7f8584003df0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- 172.21.15.97:0/1899322438 >> 172.21.15.97:0/1899322438 conn(0x7f85940c5e70 msgr2=0x7f85940c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- 172.21.15.97:0/1899322438 shutdown_connections 2023-12-04T05:39:01.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- 172.21.15.97:0/1899322438 wait complete. 2023-12-04T05:39:01.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 Processor -- start 2023-12-04T05:39:01.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- start start 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840039d0 0x7f85941434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8594141050 0x7f859413e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594143110 con 0x7f85941418a0 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594145060 con 0x7f8594141050 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859ab01640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8594142900 con 0x7f85840039d0 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f8593fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f8593fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42436/0 (socket says 172.21.15.97:42436) 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f8593fff640 1 -- 172.21.15.97:0/394308260 learned_addr learned my addr 172.21.15.97:0/394308260 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859889d640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840039d0 0x7f85941434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.269+0000 7f859909e640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8594141050 0x7f859413e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 -- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840039d0 msgr2=0x7f85941434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840039d0 0x7f85941434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 -- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8594141050 msgr2=0x7f859413e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8594141050 0x7f859413e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 -- 172.21.15.97:0/394308260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940c23d0 con 0x7f85941418a0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f8593fff640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f858000e440 tx=0x7f858000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800052e0 con 0x7f85941418a0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580005440 con 0x7f85941418a0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580003820 con 0x7f85941418a0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85941414d0 con 0x7f85941418a0 2023-12-04T05:39:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8594142e30 con 0x7f85941418a0 2023-12-04T05:39:01.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8594068440 con 0x7f85941418a0 2023-12-04T05:39:01.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8580003980 con 0x7f85941418a0 2023-12-04T05:39:01.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f85800842e0 con 0x7f85941418a0 2023-12-04T05:39:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.273+0000 7f859889d640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.277+0000 7f859889d640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 0x7f8578068d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f85880ab000 tx=0x7f85880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.277+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8580051260 con 0x7f85941418a0 2023-12-04T05:39:01.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.433+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f859406c220 con 0x7f85941418a0 2023-12-04T05:39:01.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.433+0000 7f85917fa640 1 -- 172.21.15.97:0/394308260 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8580054880 con 0x7f85941418a0 2023-12-04T05:39:01.439 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 msgr2=0x7f8578068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 0x7f8578068d90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f85880ab000 tx=0x7f85880a7070 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 msgr2=0x7f8594140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f858000e440 tx=0x7f858000e900 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 shutdown_connections 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85780668d0 0x7f8578068d90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8594141050 0x7f859413e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85941418a0 0x7f8594140b10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 --2- 172.21.15.97:0/394308260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85840039d0 0x7f85941434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 >> 172.21.15.97:0/394308260 conn(0x7f85940c5e70 msgr2=0x7f85940c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 shutdown_connections 2023-12-04T05:39:01.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.437+0000 7f859ab01640 1 -- 172.21.15.97:0/394308260 wait complete. 2023-12-04T05:39:01.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:01.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.593+0000 7fa9e32fe640 1 Processor -- start 2023-12-04T05:39:01.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.593+0000 7fa9e32fe640 1 -- start start 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e32fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa9dc14eb30 0x7fa9dc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e32fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc154640 con 0x7fa9dc14f790 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e32fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc14ef10 con 0x7fa9dc154fe0 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e32fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c0bd0 con 0x7fa9dc14eb30 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e0899640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa9dc14f790 0x7fa9dc1548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33970/0 (socket says 172.21.15.97:33970) 2023-12-04T05:39:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e0899640 1 -- 172.21.15.97:0/1346170043 learned_addr learned my addr 172.21.15.97:0/1346170043 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:01.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e109a640 1 --2- 172.21.15.97:0/1346170043 >> v2:172.21.15.143:3300/0 conn(0x7fa9dc14eb30 0x7fa9dc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684745571 0 0) 0x7fa9dc154640 con 0x7fa9dc14f790 2023-12-04T05:39:01.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c8005740 con 0x7fa9dc14f790 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476555322 0 0) 0x7fa9dc14ef10 con 0x7fa9dc154fe0 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9dc154640 con 0x7fa9dc154fe0 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213975443 0 0) 0x7fa9c8005740 con 0x7fa9dc14f790 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e109a640 1 -- 172.21.15.97:0/1346170043 >> v1:172.21.15.143:6789/0 conn(0x7fa9dc154fe0 legacy=0x7fa9dc15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e109a640 1 -- 172.21.15.97:0/1346170043 >> v1:172.21.15.97:6789/0 conn(0x7fa9dc14f790 legacy=0x7fa9dc1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.597+0000 7fa9e109a640 1 -- 172.21.15.97:0/1346170043 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc1535a0 con 0x7fa9dc14eb30 2023-12-04T05:39:01.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e109a640 1 --2- 172.21.15.97:0/1346170043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc14eb30 0x7fa9dc14f250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80097c0 tx=0x7fa9d801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3500c77cb84f5acd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc001680 con 0x7fa9dc14eb30 2023-12-04T05:39:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80a7050 con 0x7fa9dc14eb30 2023-12-04T05:39:01.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9d3fff640 1 -- 172.21.15.97:0/1346170043 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80ab600 con 0x7fa9dc14eb30 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- 172.21.15.97:0/1346170043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc14eb30 msgr2=0x7fa9dc14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/1346170043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc14eb30 0x7fa9dc14f250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80097c0 tx=0x7fa9d801c370 comp rx=0 tx=0).stop 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- 172.21.15.97:0/1346170043 shutdown_connections 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/1346170043 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc14eb30 0x7fa9dc14f250 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- 172.21.15.97:0/1346170043 >> 172.21.15.97:0/1346170043 conn(0x7fa9dc0c5e70 msgr2=0x7fa9dc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- 172.21.15.97:0/1346170043 shutdown_connections 2023-12-04T05:39:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- 172.21.15.97:0/1346170043 wait complete. 2023-12-04T05:39:01.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 Processor -- start 2023-12-04T05:39:01.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.601+0000 7fa9e32fe640 1 -- start start 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9dc14eb30 0x7fa9dc151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 0x7fa9dc1ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc14a790 con 0x7fa9dc14f790 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1ed3d0 con 0x7fa9dc154fe0 2023-12-04T05:39:01.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc151bb0 con 0x7fa9dc14eb30 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42444/0 (socket says 172.21.15.97:42444) 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 -- 172.21.15.97:0/531389563 learned_addr learned my addr 172.21.15.97:0/531389563 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e109a640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9dc14eb30 0x7fa9dc151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e189b640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 0x7fa9dc1ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 -- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9dc14eb30 msgr2=0x7fa9dc151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9dc14eb30 0x7fa9dc151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 -- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 msgr2=0x7fa9dc1ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 0x7fa9dc1ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 -- 172.21.15.97:0/531389563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8009420 con 0x7fa9dc14f790 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e189b640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 0x7fa9dc1ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e0899640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c780 tx=0x7fa9cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc005cf0 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc005e50 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0072b0 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc149130 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc149740 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc068440 con 0x7fa9dc14f790 2023-12-04T05:39:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.605+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa9cc007410 con 0x7fa9dc14f790 2023-12-04T05:39:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.609+0000 7fa9d1ffb640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 0x7fa9c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.609+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9cc084500 con 0x7fa9dc14f790 2023-12-04T05:39:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.609+0000 7fa9e109a640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 0x7fa9c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.609+0000 7fa9e109a640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 0x7fa9c0068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ad000 tx=0x7fa9d80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.613+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9cc0513c0 con 0x7fa9dc14f790 2023-12-04T05:39:01.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9dc0a8ac0 con 0x7fa9dc14f790 2023-12-04T05:39:01.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9d1ffb640 1 -- 172.21.15.97:0/531389563 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9cc0549e0 con 0x7fa9dc14f790 2023-12-04T05:39:01.766 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 msgr2=0x7fa9c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 0x7fa9c0068d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ad000 tx=0x7fa9d80a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 msgr2=0x7fa9dc147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00c780 tx=0x7fa9cc00cc40 comp rx=0 tx=0).stop 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 shutdown_connections 2023-12-04T05:39:01.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9c00668d0 0x7fa9c0068d90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9dc154fe0 0x7fa9dc1ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9dc14f790 0x7fa9dc147150 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 --2- 172.21.15.97:0/531389563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9dc14eb30 0x7fa9dc151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 >> 172.21.15.97:0/531389563 conn(0x7fa9dc0c5e70 msgr2=0x7fa9dc148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 shutdown_connections 2023-12-04T05:39:01.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.761+0000 7fa9e32fe640 1 -- 172.21.15.97:0/531389563 wait complete. 2023-12-04T05:39:01.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:01.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 Processor -- start 2023-12-04T05:39:01.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 -- start start 2023-12-04T05:39:01.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0e80c1360 0x7fa0e80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e8150bc0 con 0x7fa0e806c000 2023-12-04T05:39:01.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e8154fd0 con 0x7fa0e8154af0 2023-12-04T05:39:01.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.921+0000 7fa0efdc4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e8151a70 con 0x7fa0e80c1360 2023-12-04T05:39:01.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0e80c1360 0x7fa0e80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa0e80c1360 0x7fa0e80700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42448/0 (socket says 172.21.15.97:42448) 2023-12-04T05:39:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0ed35f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa0e806c000 0x7fa0e8151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33974/0 (socket says 172.21.15.97:33974) 2023-12-04T05:39:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 -- 172.21.15.97:0/916577091 learned_addr learned my addr 172.21.15.97:0/916577091 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 -- 172.21.15.97:0/916577091 >> v1:172.21.15.143:6789/0 conn(0x7fa0e8154af0 legacy=0x7fa0e814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:01.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 -- 172.21.15.97:0/916577091 >> v1:172.21.15.97:6789/0 conn(0x7fa0e806c000 legacy=0x7fa0e8151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 -- 172.21.15.97:0/916577091 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8072160 con 0x7fa0e80c1360 2023-12-04T05:39:01.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0edb60640 1 --2- 172.21.15.97:0/916577091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80700b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400bb10 tx=0x7fa0e401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221a361845429137 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0ecb5e640 1 -- 172.21.15.97:0/916577091 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40a7b00 con 0x7fa0e80c1360 2023-12-04T05:39:01.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0ecb5e640 1 -- 172.21.15.97:0/916577091 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e40a7c60 con 0x7fa0e80c1360 2023-12-04T05:39:01.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.925+0000 7fa0ecb5e640 1 -- 172.21.15.97:0/916577091 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40af440 con 0x7fa0e80c1360 2023-12-04T05:39:01.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- 172.21.15.97:0/916577091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 msgr2=0x7fa0e80700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/916577091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80700b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400bb10 tx=0x7fa0e401eb40 comp rx=0 tx=0).stop 2023-12-04T05:39:01.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- 172.21.15.97:0/916577091 shutdown_connections 2023-12-04T05:39:01.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/916577091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80700b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- 172.21.15.97:0/916577091 >> 172.21.15.97:0/916577091 conn(0x7fa0e80c5e70 msgr2=0x7fa0e80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:01.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- 172.21.15.97:0/916577091 shutdown_connections 2023-12-04T05:39:01.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- 172.21.15.97:0/916577091 wait complete. 2023-12-04T05:39:01.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 Processor -- start 2023-12-04T05:39:01.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- start start 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0e806c000 0x7fa0e814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 0x7fa0e81f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c5b00 con 0x7fa0e80c1360 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e814f050 con 0x7fa0e8154af0 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0efdc4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c53b0 con 0x7fa0e806c000 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42458/0 (socket says 172.21.15.97:42458) 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 -- 172.21.15.97:0/3399824784 learned_addr learned my addr 172.21.15.97:0/3399824784 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 -- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0e806c000 msgr2=0x7fa0e814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0e806c000 0x7fa0e814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 -- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 msgr2=0x7fa0e81f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ee361640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 0x7fa0e81f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 0x7fa0e81f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 -- 172.21.15.97:0/3399824784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e400b770 con 0x7fa0e80c1360 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ee361640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 0x7fa0e81f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.929+0000 7fa0ed35f640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c4c0 tx=0x7fa0d800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8007480 con 0x7fa0e80c1360 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d80075e0 con 0x7fa0e80c1360 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8004a10 con 0x7fa0e80c1360 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e80c46f0 con 0x7fa0e80c1360 2023-12-04T05:39:01.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e814f2e0 con 0x7fa0e80c1360 2023-12-04T05:39:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e80c4930 con 0x7fa0e80c1360 2023-12-04T05:39:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0d8004b70 con 0x7fa0e80c1360 2023-12-04T05:39:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 0x7fa0cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa0d8083970 con 0x7fa0e80c1360 2023-12-04T05:39:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0edb60640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 0x7fa0cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.933+0000 7fa0edb60640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 0x7fa0cc068d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40b1000 tx=0x7fa0e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:01.937+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0e80c4930 con 0x7fa0e80c1360 2023-12-04T05:39:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0e80c5580 con 0x7fa0e80c1360 2023-12-04T05:39:02.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0de7fc640 1 -- 172.21.15.97:0/3399824784 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa0e80c5580 con 0x7fa0e80c1360 2023-12-04T05:39:02.094 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:02.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 msgr2=0x7fa0cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 0x7fa0cc068d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40b1000 tx=0x7fa0e4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 msgr2=0x7fa0e80c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c4c0 tx=0x7fa0d800c980 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 shutdown_connections 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa0cc0668d0 0x7fa0cc068d90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa0e8154af0 0x7fa0e81f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa0e80c1360 0x7fa0e80c30b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 --2- 172.21.15.97:0/3399824784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa0e806c000 0x7fa0e814eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 >> 172.21.15.97:0/3399824784 conn(0x7fa0e80c5e70 msgr2=0x7fa0e8071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 shutdown_connections 2023-12-04T05:39:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.089+0000 7fa0efdc4640 1 -- 172.21.15.97:0/3399824784 wait complete. 2023-12-04T05:39:02.115 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:02.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.253+0000 7f15cc5b8640 1 Processor -- start 2023-12-04T05:39:02.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.253+0000 7f15cc5b8640 1 -- start start 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.253+0000 7f15cc5b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f15c414eb30 0x7f15c414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.253+0000 7f15cc5b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f15c414f790 0x7f15c41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15cc5b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c4154640 con 0x7f15c4154e10 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15cc5b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40c0bd0 con 0x7f15c414f790 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15cc5b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c414ef10 con 0x7f15c414eb30 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f15c414f790 0x7f15c41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15cab55640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f15c4154e10 0x7f15c4151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33976/0 (socket says 172.21.15.97:33976) 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15cab55640 1 -- 172.21.15.97:0/1278796092 learned_addr learned my addr 172.21.15.97:0/1278796092 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15ca354640 1 --2- 172.21.15.97:0/1278796092 >> v2:172.21.15.143:3300/0 conn(0x7f15c414eb30 0x7f15c414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 -- 172.21.15.97:0/1278796092 >> v2:172.21.15.143:3300/0 conn(0x7f15c414eb30 msgr2=0x7f15c414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 --2- 172.21.15.97:0/1278796092 >> v2:172.21.15.143:3300/0 conn(0x7f15c414eb30 0x7f15c414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 -- 172.21.15.97:0/1278796092 >> v1:172.21.15.97:6789/0 conn(0x7f15c4154e10 legacy=0x7f15c4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 -- 172.21.15.97:0/1278796092 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c41535a0 con 0x7f15c414f790 2023-12-04T05:39:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9352640 1 -- 172.21.15.97:0/1278796092 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100862650 0 0) 0x7f15c4154640 con 0x7f15c4154e10 2023-12-04T05:39:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9b53640 1 --2- 172.21.15.97:0/1278796092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c41548d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f15c40c0a80 tx=0x7f15b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eade1f028e170146 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9352640 1 -- 172.21.15.97:0/1278796092 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ab600 con 0x7f15c414f790 2023-12-04T05:39:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9352640 1 -- 172.21.15.97:0/1278796092 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40a7050 con 0x7f15c414f790 2023-12-04T05:39:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.257+0000 7f15c9352640 1 -- 172.21.15.97:0/1278796092 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40ab980 con 0x7f15c414f790 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1278796092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 msgr2=0x7f15c41548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1278796092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c41548d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f15c40c0a80 tx=0x7f15b401c430 comp rx=0 tx=0).stop 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1278796092 shutdown_connections 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1278796092 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c41548d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1278796092 >> v2:172.21.15.143:3300/0 conn(0x7f15c414eb30 0x7f15c414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1278796092 >> 172.21.15.97:0/1278796092 conn(0x7f15c40c5e70 msgr2=0x7f15c40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1278796092 shutdown_connections 2023-12-04T05:39:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1278796092 wait complete. 2023-12-04T05:39:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 Processor -- start 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- start start 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 0x7f15c40712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15c4154e10 0x7f15c413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c414acb0 con 0x7f15c414f790 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41eb8e0 con 0x7f15c414eb30 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15cc5b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41ebdd0 con 0x7f15c4154e10 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42470/0 (socket says 172.21.15.97:42470) 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 -- 172.21.15.97:0/1301801827 learned_addr learned my addr 172.21.15.97:0/1301801827 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 -- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15c4154e10 msgr2=0x7f15c413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15c4154e10 0x7f15c413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 -- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 msgr2=0x7f15c40712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15ca354640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 0x7f15c40712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 0x7f15c40712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15c9b53640 1 -- 172.21.15.97:0/1301801827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009420 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.261+0000 7f15ca354640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 0x7f15c40712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15c9b53640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f15b401a060 tx=0x7f15b401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40b4460 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40b45e0 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40b4990 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c414a730 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c414a9d0 con 0x7f15c414f790 2023-12-04T05:39:02.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4068440 con 0x7f15c414f790 2023-12-04T05:39:02.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15b40b2070 con 0x7f15c414f790 2023-12-04T05:39:02.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 0x7f15a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15b411e6d0 con 0x7f15c414f790 2023-12-04T05:39:02.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.265+0000 7f15ca354640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 0x7f15a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.269+0000 7f15ca354640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 0x7f15a8068d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009a40 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.269+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15b40eb5a0 con 0x7f15c414f790 2023-12-04T05:39:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f15c40a8ac0 con 0x7f15c414f790 2023-12-04T05:39:02.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15baffd640 1 -- 172.21.15.97:0/1301801827 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f15b40eebc0 con 0x7f15c414f790 2023-12-04T05:39:02.426 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 msgr2=0x7f15a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 0x7f15a8068d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009a40 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 msgr2=0x7f15c4148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f15b401a060 tx=0x7f15b401ac70 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 shutdown_connections 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f15a80668d0 0x7f15a8068d90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f15c4154e10 0x7f15c413fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15c414f790 0x7f15c4148de0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 --2- 172.21.15.97:0/1301801827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f15c414eb30 0x7f15c40712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 >> 172.21.15.97:0/1301801827 conn(0x7f15c40c5e70 msgr2=0x7f15c4144dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 shutdown_connections 2023-12-04T05:39:02.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.421+0000 7f15cc5b8640 1 -- 172.21.15.97:0/1301801827 wait complete. 2023-12-04T05:39:02.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:39:02.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 Processor -- start 2023-12-04T05:39:02.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 -- start start 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd8c14eb30 0x7efd8c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8c154fe0 0x7efd8c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c154640 con 0x7efd8c14f790 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0c0bd0 con 0x7efd8c154fe0 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd93cdd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c14ef10 con 0x7efd8c14eb30 2023-12-04T05:39:02.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8c154fe0 0x7efd8c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8c154fe0 0x7efd8c15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42486/0 (socket says 172.21.15.97:42486) 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 -- 172.21.15.97:0/2781856980 learned_addr learned my addr 172.21.15.97:0/2781856980 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd91a79640 1 --2- 172.21.15.97:0/2781856980 >> v2:172.21.15.143:3300/0 conn(0x7efd8c14eb30 0x7efd8c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 -- 172.21.15.97:0/2781856980 >> v2:172.21.15.143:3300/0 conn(0x7efd8c14eb30 msgr2=0x7efd8c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 --2- 172.21.15.97:0/2781856980 >> v2:172.21.15.143:3300/0 conn(0x7efd8c14eb30 0x7efd8c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 -- 172.21.15.97:0/2781856980 >> v1:172.21.15.143:6789/0 conn(0x7efd8c14f790 legacy=0x7efd8c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.581+0000 7efd9227a640 1 -- 172.21.15.97:0/2781856980 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c1535a0 con 0x7efd8c154fe0 2023-12-04T05:39:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd9227a640 1 --2- 172.21.15.97:0/2781856980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c15bc60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c0a80 tx=0x7efd8401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e2242399dcefbb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd90a77640 1 -- 172.21.15.97:0/2781856980 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840a5860 con 0x7efd8c154fe0 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd90a77640 1 -- 172.21.15.97:0/2781856980 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd840a59c0 con 0x7efd8c154fe0 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd90a77640 1 -- 172.21.15.97:0/2781856980 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840a5d50 con 0x7efd8c154fe0 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 -- 172.21.15.97:0/2781856980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 msgr2=0x7efd8c15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2781856980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c15bc60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c0a80 tx=0x7efd8401c9a0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 -- 172.21.15.97:0/2781856980 shutdown_connections 2023-12-04T05:39:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2781856980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c15bc60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2781856980 >> v2:172.21.15.143:3300/0 conn(0x7efd8c14eb30 0x7efd8c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 -- 172.21.15.97:0/2781856980 >> 172.21.15.97:0/2781856980 conn(0x7efd8c0c5e70 msgr2=0x7efd8c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 -- 172.21.15.97:0/2781856980 shutdown_connections 2023-12-04T05:39:02.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.585+0000 7efd93cdd640 1 -- 172.21.15.97:0/2781856980 wait complete. 2023-12-04T05:39:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 Processor -- start 2023-12-04T05:39:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- start start 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 0x7efd8c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 0x7efd8c06d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c150880 con 0x7efd8c154fe0 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c071d40 con 0x7efd8c14f790 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c14ff50 con 0x7efd8c14eb30 2023-12-04T05:39:02.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42488/0 (socket says 172.21.15.97:42488) 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 -- 172.21.15.97:0/2924322033 learned_addr learned my addr 172.21.15.97:0/2924322033 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd91a79640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 0x7efd8c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 -- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 msgr2=0x7efd8c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd91278640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 0x7efd8c06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 0x7efd8c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 -- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 msgr2=0x7efd8c06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 0x7efd8c06d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 -- 172.21.15.97:0/2924322033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009b30 con 0x7efd8c154fe0 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd91a79640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 0x7efd8c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd91278640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 0x7efd8c06d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:02.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd9227a640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd840195b0 tx=0x7efd84019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840b8670 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd840b87d0 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840b8b40 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c14fd20 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c150510 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.589+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c1509f0 con 0x7efd8c154fe0 2023-12-04T05:39:02.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.593+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd840b8ca0 con 0x7efd8c154fe0 2023-12-04T05:39:02.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.593+0000 7efd827fc640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:02.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.593+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd8411fd20 con 0x7efd8c154fe0 2023-12-04T05:39:02.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.593+0000 7efd91a79640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:02.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.593+0000 7efd91a79640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efd88009ae0 tx=0x7efd88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:02.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.597+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd840ecbf0 con 0x7efd8c154fe0 2023-12-04T05:39:02.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efd8c068440 con 0x7efd8c154fe0 2023-12-04T05:39:02.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd827fc640 1 -- 172.21.15.97:0/2924322033 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7efd840f0210 con 0x7efd8c154fe0 2023-12-04T05:39:02.761 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 msgr2=0x7efd70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efd88009ae0 tx=0x7efd88008040 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 msgr2=0x7efd8c0c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efd840195b0 tx=0x7efd84019740 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 shutdown_connections 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8c154fe0 0x7efd8c0c38c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8c14f790 0x7efd8c06d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 --2- 172.21.15.97:0/2924322033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8c14eb30 0x7efd8c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:02.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 >> 172.21.15.97:0/2924322033 conn(0x7efd8c0c5e70 msgr2=0x7efd8c1526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 shutdown_connections 2023-12-04T05:39:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:02.757+0000 7efd93cdd640 1 -- 172.21.15.97:0/2924322033 wait complete. 2023-12-04T05:39:02.782 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:39:02.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:02.782 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:02.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:39:02.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:02.814 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:39:02.870 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:03.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.001+0000 7f2de8f01640 1 Processor -- start 2023-12-04T05:39:03.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.001+0000 7f2de8f01640 1 -- start start 2023-12-04T05:39:03.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de8f01640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2de414e970 0x7f2de406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de8f01640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de4152300 con 0x7f2de406be00 2023-12-04T05:39:03.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de8f01640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de4071580 con 0x7f2de406ca50 2023-12-04T05:39:03.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de8f01640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de414ed50 con 0x7f2de414e970 2023-12-04T05:39:03.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2de406be00 0x7f2de4071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:33988/0 (socket says 172.21.15.97:33988) 2023-12-04T05:39:03.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 -- 172.21.15.97:0/4135986873 learned_addr learned my addr 172.21.15.97:0/4135986873 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de259c640 1 --2- 172.21.15.97:0/4135986873 >> v2:172.21.15.143:3300/0 conn(0x7f2de414e970 0x7f2de406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040698576 0 0) 0x7f2dcc0014a0 con 0x7f2de406be00 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd0003530 con 0x7f2de406be00 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353739012 0 0) 0x7f2dd0003530 con 0x7f2de406be00 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 >> v2:172.21.15.143:3300/0 conn(0x7f2de414e970 msgr2=0x7f2de406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 --2- 172.21.15.97:0/4135986873 >> v2:172.21.15.143:3300/0 conn(0x7f2de414e970 0x7f2de406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 >> v1:172.21.15.143:6789/0 conn(0x7f2de406ca50 legacy=0x7f2de40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4151d60 con 0x7f2de406be00 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f2dcc001b90 con 0x7f2de406be00 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 >> v1:172.21.15.97:6789/0 conn(0x7f2de406be00 legacy=0x7f2de4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd0003980 0x7f2dd0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 0x7f2dd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dd0005190 0x7f2dd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de414ed50 con 0x7f2dd00047d0 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd000c130 con 0x7f2dd0003980 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd000c2f0 con 0x7f2dd0005190 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 0x7f2dd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de259c640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd0003980 0x7f2dd0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de2d9d640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dd0005190 0x7f2dd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 -- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dd0005190 msgr2=0x7f2dd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dd0005190 0x7f2dd000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 -- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd0003980 msgr2=0x7f2dd0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd0003980 0x7f2dd0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2dd9d9b640 1 -- 172.21.15.97:0/4135986873 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0003530 con 0x7f2dd00047d0 2023-12-04T05:39:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.005+0000 7f2de2d9d640 1 -- 172.21.15.97:0/4135986873 reap_dead start 2023-12-04T05:39:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2dd9d9b640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 0x7f2dd0004c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00a830 tx=0x7f2dcc01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e7d67e43c7c6ac server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0ad630 con 0x7f2dd00047d0 2023-12-04T05:39:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0a8070 con 0x7f2dd00047d0 2023-12-04T05:39:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de1d9b640 1 -- 172.21.15.97:0/4135986873 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0ada30 con 0x7f2dd00047d0 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 -- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 msgr2=0x7f2dd0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 0x7f2dd0004c50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00a830 tx=0x7f2dcc01d320 comp rx=0 tx=0).stop 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 -- 172.21.15.97:0/4135986873 shutdown_connections 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 --2- 172.21.15.97:0/4135986873 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2dd00047d0 0x7f2dd0004c50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 -- 172.21.15.97:0/4135986873 >> 172.21.15.97:0/4135986873 conn(0x7f2de40c2970 msgr2=0x7f2de40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 -- 172.21.15.97:0/4135986873 shutdown_connections 2023-12-04T05:39:03.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 -- 172.21.15.97:0/4135986873 wait complete. 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.009+0000 7f2de8f01640 1 Processor -- start 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- start start 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd00047d0 0x7f2de41f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2de40aaee0 0x7f2de40ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4146180 con 0x7f2de40ab8a0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41f0ef0 con 0x7f2dd00047d0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41f11d0 con 0x7f2de40aaee0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42504/0 (socket says 172.21.15.97:42504) 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 -- 172.21.15.97:0/1027261084 learned_addr learned my addr 172.21.15.97:0/1027261084 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de259c640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd00047d0 0x7f2de41f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2dd9d9b640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2de40aaee0 0x7f2de40ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 -- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2de40aaee0 msgr2=0x7f2de40ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2de40aaee0 0x7f2de40ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 -- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd00047d0 msgr2=0x7f2de41f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd00047d0 0x7f2de41f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 -- 172.21.15.97:0/1027261084 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4149e40 con 0x7f2de40ab8a0 2023-12-04T05:39:03.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de2d9d640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2de40c6ee0 tx=0x7f2ddc00e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0050d0 con 0x7f2de40ab8a0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc005230 con 0x7f2de40ab8a0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de414a120 con 0x7f2de40ab8a0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc003600 con 0x7f2de40ab8a0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de4149130 con 0x7f2de40ab8a0 2023-12-04T05:39:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.013+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4068440 con 0x7f2de40ab8a0 2023-12-04T05:39:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.017+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2ddc003760 con 0x7f2de40ab8a0 2023-12-04T05:39:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.017+0000 7f2ddb7fe640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 0x7f2dc4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.017+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2ddc083ae0 con 0x7f2de40ab8a0 2023-12-04T05:39:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.017+0000 7f2de259c640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 0x7f2dc4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.017+0000 7f2de259c640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 0x7f2dc4068dc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2de41e4a80 tx=0x7f2dd4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.021+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ddc050b00 con 0x7f2de40ab8a0 2023-12-04T05:39:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2de40c2560 con 0x7f2de40ab8a0 2023-12-04T05:39:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2ddb7fe640 1 -- 172.21.15.97:0/1027261084 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6138 (secure 0 0 0) 0x7f2ddc019090 con 0x7f2de40ab8a0 2023-12-04T05:39:03.214 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:03.214 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 37 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 msgr2=0x7f2dc4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 0x7f2dc4068dc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2de41e4a80 tx=0x7f2dd4009190 comp rx=0 tx=0).stop 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 msgr2=0x7f2de41ece40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2de40c6ee0 tx=0x7f2ddc00e760 comp rx=0 tx=0).stop 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 shutdown_connections 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2dc4066900 0x7f2dc4068dc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de40ab8a0 0x7f2de41ece40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2de40aaee0 0x7f2de40ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 --2- 172.21.15.97:0/1027261084 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dd00047d0 0x7f2de41f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 >> 172.21.15.97:0/1027261084 conn(0x7f2de40c2970 msgr2=0x7f2de414d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 shutdown_connections 2023-12-04T05:39:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.209+0000 7f2de8f01640 1 -- 172.21.15.97:0/1027261084 wait complete. 2023-12-04T05:39:03.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:03.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.365+0000 7fb0183aa640 1 Processor -- start 2023-12-04T05:39:03.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.365+0000 7fb0183aa640 1 -- start start 2023-12-04T05:39:03.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb0183aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 0x7fb01006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb0183aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb0183aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb010152300 con 0x7fb01014e970 2023-12-04T05:39:03.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb0183aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb010071580 con 0x7fb01006be00 2023-12-04T05:39:03.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb0183aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01014ed50 con 0x7fb01006ca50 2023-12-04T05:39:03.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016146640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb01014e970 0x7fb010071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:58050/0 (socket says 172.21.15.97:58050) 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016146640 1 -- 172.21.15.97:0/503258602 learned_addr learned my addr 172.21.15.97:0/503258602 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:41218/0 (socket says 172.21.15.97:41218) 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb015945640 1 --2- 172.21.15.97:0/503258602 >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 0x7fb01006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 -- 172.21.15.97:0/503258602 >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 msgr2=0x7fb01006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 --2- 172.21.15.97:0/503258602 >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 0x7fb01006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 -- 172.21.15.97:0/503258602 >> v1:172.21.15.143:6789/0 conn(0x7fb01014e970 legacy=0x7fb010071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb016947640 1 -- 172.21.15.97:0/503258602 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01006cea0 con 0x7fb01006ca50 2023-12-04T05:39:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.369+0000 7fb015945640 1 --2- 172.21.15.97:0/503258602 >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 0x7fb01006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb016947640 1 --2- 172.21.15.97:0/503258602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb00800bfa0 tx=0x7fb00801eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973fa046476ace91 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb015144640 1 -- 172.21.15.97:0/503258602 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800b0d0 con 0x7fb01006ca50 2023-12-04T05:39:03.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb015144640 1 -- 172.21.15.97:0/503258602 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800b230 con 0x7fb01006ca50 2023-12-04T05:39:03.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb015144640 1 -- 172.21.15.97:0/503258602 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080a7bb0 con 0x7fb01006ca50 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 -- 172.21.15.97:0/503258602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 msgr2=0x7fb0100c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 --2- 172.21.15.97:0/503258602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb00800bfa0 tx=0x7fb00801eac0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 -- 172.21.15.97:0/503258602 shutdown_connections 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 --2- 172.21.15.97:0/503258602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01006ca50 0x7fb0100c1880 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 --2- 172.21.15.97:0/503258602 >> v2:172.21.15.143:3300/0 conn(0x7fb01006be00 0x7fb01006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 -- 172.21.15.97:0/503258602 >> 172.21.15.97:0/503258602 conn(0x7fb0100c2970 msgr2=0x7fb0100c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 -- 172.21.15.97:0/503258602 shutdown_connections 2023-12-04T05:39:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.373+0000 7fb0183aa640 1 -- 172.21.15.97:0/503258602 wait complete. 2023-12-04T05:39:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 Processor -- start 2023-12-04T05:39:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- start start 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb01006ca50 0x7fb010148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01014e970 0x7fb010143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01014a0c0 con 0x7fb01006be00 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010149710 con 0x7fb01006ca50 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb010142c80 con 0x7fb01014e970 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42514/0 (socket says 172.21.15.97:42514) 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 -- 172.21.15.97:0/1921669213 learned_addr learned my addr 172.21.15.97:0/1921669213 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016947640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01014e970 0x7fb010143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb015945640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb01006ca50 0x7fb010148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 -- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01014e970 msgr2=0x7fb010143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01014e970 0x7fb010143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 -- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb01006ca50 msgr2=0x7fb010148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb01006ca50 0x7fb010148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 -- 172.21.15.97:0/1921669213 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009420 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb016146640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c430 tx=0x7fb00c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c005cf0 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c005e50 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0072d0 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00800bc80 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0101e9ad0 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.377+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0101e9930 con 0x7fb01006be00 2023-12-04T05:39:03.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.381+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb00c007430 con 0x7fb01006be00 2023-12-04T05:39:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.381+0000 7fb006ffd640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 0x7faff4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.381+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb00c083ae0 con 0x7fb01006be00 2023-12-04T05:39:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.381+0000 7fb015945640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 0x7faff4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.381+0000 7fb015945640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 0x7faff4068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb01014d740 tx=0x7fb000009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.385+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0101e9930 con 0x7fb01006be00 2023-12-04T05:39:03.534 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:39:03.538 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:39:03.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.533+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb010152300 con 0x7fb01006be00 2023-12-04T05:39:03.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb006ffd640 1 -- 172.21.15.97:0/1921669213 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7fb010152300 con 0x7fb01006be00 2023-12-04T05:39:03.541 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:03.542 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:03.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 msgr2=0x7faff4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 0x7faff4068d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb01014d740 tx=0x7fb000009190 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 msgr2=0x7fb0101487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c430 tx=0x7fb00c00c8f0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 shutdown_connections 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faff40668d0 0x7faff4068d90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb01014e970 0x7fb010143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb01006ca50 0x7fb010148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 --2- 172.21.15.97:0/1921669213 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb01006be00 0x7fb0101487b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 >> 172.21.15.97:0/1921669213 conn(0x7fb0100c2970 msgr2=0x7fb010071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 shutdown_connections 2023-12-04T05:39:03.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.537+0000 7fb0183aa640 1 -- 172.21.15.97:0/1921669213 wait complete. 2023-12-04T05:39:03.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:38:26.438302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:38:27.710828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:38:44.148875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:38:45.405294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:03.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:03.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 Processor -- start 2023-12-04T05:39:03.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 -- start start 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc406c000 0x7fabc40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc4154af0 0x7fabc414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc4150bc0 con 0x7fabc40c1360 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc4154fd0 con 0x7fabc406c000 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabcaa32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4151a70 con 0x7fabc4154af0 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabc37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc406c000 0x7fabc40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabc37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fabc406c000 0x7fabc40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42516/0 (socket says 172.21.15.97:42516) 2023-12-04T05:39:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabc3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fabc40c1360 0x7fabc4151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34002/0 (socket says 172.21.15.97:34002) 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabc37fe640 1 -- 172.21.15.97:0/3617622432 learned_addr learned my addr 172.21.15.97:0/3617622432 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.765+0000 7fabc8fcf640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc4154af0 0x7fabc414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc37fe640 1 -- 172.21.15.97:0/3617622432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc4154af0 msgr2=0x7fabc414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc37fe640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc4154af0 0x7fabc414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc37fe640 1 -- 172.21.15.97:0/3617622432 >> v1:172.21.15.97:6789/0 conn(0x7fabc40c1360 legacy=0x7fabc4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc37fe640 1 -- 172.21.15.97:0/3617622432 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4072160 con 0x7fabc406c000 2023-12-04T05:39:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc2ffd640 1 -- 172.21.15.97:0/3617622432 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900208907 0 0) 0x7fabc4150bc0 con 0x7fabc40c1360 2023-12-04T05:39:03.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc37fe640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc406c000 0x7fabc40700b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fabb800aa10 tx=0x7fabb801d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e328c72787e530 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc2ffd640 1 -- 172.21.15.97:0/3617622432 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80a6820 con 0x7fabc406c000 2023-12-04T05:39:03.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc2ffd640 1 -- 172.21.15.97:0/3617622432 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80a6980 con 0x7fabc406c000 2023-12-04T05:39:03.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabc2ffd640 1 -- 172.21.15.97:0/3617622432 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80a6d10 con 0x7fabc406c000 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 -- 172.21.15.97:0/3617622432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc406c000 msgr2=0x7fabc40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc406c000 0x7fabc40700b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fabb800aa10 tx=0x7fabb801d880 comp rx=0 tx=0).stop 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 -- 172.21.15.97:0/3617622432 shutdown_connections 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc4154af0 0x7fabc414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 --2- 172.21.15.97:0/3617622432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc406c000 0x7fabc40700b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 -- 172.21.15.97:0/3617622432 >> 172.21.15.97:0/3617622432 conn(0x7fabc40c5e70 msgr2=0x7fabc40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 -- 172.21.15.97:0/3617622432 shutdown_connections 2023-12-04T05:39:03.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.769+0000 7fabcaa32640 1 -- 172.21.15.97:0/3617622432 wait complete. 2023-12-04T05:39:03.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 Processor -- start 2023-12-04T05:39:03.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 -- start start 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc406c000 0x7fabc41f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40c1360 0x7fabc4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40c3890 con 0x7fabc4154af0 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4153fa0 con 0x7fabc40c1360 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40c34f0 con 0x7fabc406c000 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42520/0 (socket says 172.21.15.97:42520) 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 -- 172.21.15.97:0/4294282546 learned_addr learned my addr 172.21.15.97:0/4294282546 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc3fff640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc406c000 0x7fabc41f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc37fe640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40c1360 0x7fabc4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 -- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc406c000 msgr2=0x7fabc41f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc406c000 0x7fabc41f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 -- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40c1360 msgr2=0x7fabc4159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40c1360 0x7fabc4159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 -- 172.21.15.97:0/4294282546 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb800a670 con 0x7fabc4154af0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc8fcf640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009fd0 tx=0x7fabbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc014420 con 0x7fabc4154af0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc014580 con 0x7fabc4154af0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc4153830 con 0x7fabc4154af0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.773+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc014930 con 0x7fabc4154af0 2023-12-04T05:39:03.781 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc4153550 con 0x7fabc4154af0 2023-12-04T05:39:03.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40ab2b0 con 0x7fabc4154af0 2023-12-04T05:39:03.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabbc014a90 con 0x7fabc4154af0 2023-12-04T05:39:03.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabc0ff9640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 0x7fabb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:03.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fabbc084f00 con 0x7fabc4154af0 2023-12-04T05:39:03.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabc3fff640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 0x7fabb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:03.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.777+0000 7fabc3fff640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 0x7fabb0068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007fd0 tx=0x7fabb4007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:03.787 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.781+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabbc051e80 con 0x7fabc4154af0 2023-12-04T05:39:03.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.929+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabc40c39d0 con 0x7fabc4154af0 2023-12-04T05:39:03.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabc0ff9640 1 -- 172.21.15.97:0/4294282546 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabc40c39d0 con 0x7fabc4154af0 2023-12-04T05:39:03.936 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:03.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 msgr2=0x7fabb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 0x7fabb0068d90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007fd0 tx=0x7fabb4007d60 comp rx=0 tx=0).stop 2023-12-04T05:39:03.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 msgr2=0x7fabc40bf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:03.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009fd0 tx=0x7fabbc00e4b0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 shutdown_connections 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabb00668d0 0x7fabb0068d90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabc4154af0 0x7fabc40bf990 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabc40c1360 0x7fabc4159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 --2- 172.21.15.97:0/4294282546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabc406c000 0x7fabc41f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 >> 172.21.15.97:0/4294282546 conn(0x7fabc40c5e70 msgr2=0x7fabc415aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 shutdown_connections 2023-12-04T05:39:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:03.933+0000 7fabcaa32640 1 -- 172.21.15.97:0/4294282546 wait complete. 2023-12-04T05:39:03.957 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:04.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 Processor -- start 2023-12-04T05:39:04.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 -- start start 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd42c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd42c06d210 0x7fd42c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0aa240 con 0x7fd42c0c1e70 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c06c0c0 con 0x7fd42c06d210 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd430a32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0aa500 con 0x7fd42c06c440 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd42a59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd42c0c1e70 0x7fd42c0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:34006/0 (socket says 172.21.15.97:34006) 2023-12-04T05:39:04.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd42a59c640 1 -- 172.21.15.97:0/1472091381 learned_addr learned my addr 172.21.15.97:0/1472091381 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/1472091381 >> v2:172.21.15.143:3300/0 conn(0x7fd42c06d210 0x7fd42c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd423fff640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd42c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636455537 0 0) 0x7fd42c0aa240 con 0x7fd42c0c1e70 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd418003530 con 0x7fd42c0c1e70 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991740764 0 0) 0x7fd418003530 con 0x7fd42c0c1e70 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 msgr2=0x7fd42c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd42c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 >> v2:172.21.15.143:3300/0 conn(0x7fd42c06d210 msgr2=0x7fd42c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 --2- 172.21.15.97:0/1472091381 >> v2:172.21.15.143:3300/0 conn(0x7fd42c06d210 0x7fd42c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c0aa7e0 con 0x7fd42c0c1e70 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fd41c001680 con 0x7fd42c0c1e70 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.093+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 >> v1:172.21.15.97:6789/0 conn(0x7fd42c0c1e70 legacy=0x7fd42c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418003980 0x7fd418003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd418004330 0x7fd418004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd418004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c06c0c0 con 0x7fd418004330 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0aa500 con 0x7fd418003980 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41800b990 con 0x7fd42c06c440 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd418004330 0x7fd418004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd42a59c640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418003980 0x7fd418003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd418004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 -- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 msgr2=0x7fd418004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd418004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 -- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418003980 msgr2=0x7fd418003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418003980 0x7fd418003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 -- 172.21.15.97:0/1472091381 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418003530 con 0x7fd418004330 2023-12-04T05:39:04.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c06c440 0x7fd418004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:04.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd423fff640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd418004330 0x7fd418004810 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ae0 tx=0x7fd41401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3745a8b79f796789 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5640 con 0x7fd418004330 2023-12-04T05:39:04.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a57a0 con 0x7fd418004330 2023-12-04T05:39:04.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.097+0000 7fd429d9b640 1 -- 172.21.15.97:0/1472091381 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5b50 con 0x7fd418004330 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- 172.21.15.97:0/1472091381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd418004330 msgr2=0x7fd418004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 --2- 172.21.15.97:0/1472091381 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd418004330 0x7fd418004810 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ae0 tx=0x7fd41401ca50 comp rx=0 tx=0).stop 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 -- 172.21.15.97:0/1472091381 reap_dead start 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- 172.21.15.97:0/1472091381 shutdown_connections 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- 172.21.15.97:0/1472091381 >> 172.21.15.97:0/1472091381 conn(0x7fd42c0c5e70 msgr2=0x7fd42c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- 172.21.15.97:0/1472091381 shutdown_connections 2023-12-04T05:39:04.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- 172.21.15.97:0/1472091381 wait complete. 2023-12-04T05:39:04.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 Processor -- start 2023-12-04T05:39:04.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- start start 2023-12-04T05:39:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 0x7fd42c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 0x7fd42c0bf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c1561d0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0bfd60 con 0x7fd418004330 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd430a32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0c0410 con 0x7fd42c155850 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:42540/0 (socket says 172.21.15.97:42540) 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 -- 172.21.15.97:0/3189938982 learned_addr learned my addr 172.21.15.97:0/3189938982 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd423fff640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 0x7fd42c0bf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42a59c640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 0x7fd42c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 -- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 msgr2=0x7fd42c0bf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 0x7fd42c0bf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 -- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 msgr2=0x7fd42c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 0x7fd42c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42ad9d640 1 -- 172.21.15.97:0/3189938982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c1e6460 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd423fff640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 0x7fd42c0bf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:04.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.101+0000 7fd42a59c640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 0x7fd42c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd42ad9d640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd424009fd0 tx=0x7fd424010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400e050 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400f040 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240039a0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c1563e0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c152380 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c0c05e0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd424015440 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 0x7fd40c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd424085230 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.105+0000 7fd42a59c640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 0x7fd40c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.109+0000 7fd42a59c640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 0x7fd40c068d50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd41c001b30 tx=0x7fd41c008cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.109+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd424052100 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.261+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd42c1e8cd0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.261+0000 7fd422ffd640 1 -- 172.21.15.97:0/3189938982 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd42c1e8cd0 con 0x7fd42c0bf8e0 2023-12-04T05:39:04.268 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 msgr2=0x7fd40c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 0x7fd40c068d50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd41c001b30 tx=0x7fd41c008cc0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 msgr2=0x7fd42c1e8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd424009fd0 tx=0x7fd424010590 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 shutdown_connections 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd40c066890 0x7fd40c068d50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd42c0bf8e0 0x7fd42c1e8fb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd42c155850 0x7fd42c0bf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 --2- 172.21.15.97:0/3189938982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd418004330 0x7fd42c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 >> 172.21.15.97:0/3189938982 conn(0x7fd42c0c5e70 msgr2=0x7fd42c06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 shutdown_connections 2023-12-04T05:39:04.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.265+0000 7fd430a32640 1 -- 172.21.15.97:0/3189938982 wait complete. 2023-12-04T05:39:04.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:04.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 Processor -- start 2023-12-04T05:39:04.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 -- start start 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f961814e700 0x7f96180c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96180bd720 0x7f9618158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180cad70 con 0x7f9618155160 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9618158cd0 con 0x7f96180bd720 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f9620232640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618155630 con 0x7f961814e700 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96180bd720 0x7f9618158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f96180bd720 0x7f9618158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33640/0 (socket says 172.21.15.97:33640) 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 -- 172.21.15.97:0/2755112779 learned_addr learned my addr 172.21.15.97:0/2755112779 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:04.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961dfce640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f961814e700 0x7f96180c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 -- 172.21.15.97:0/2755112779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f961814e700 msgr2=0x7f96180c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f961814e700 0x7f96180c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 -- 172.21.15.97:0/2755112779 >> v1:172.21.15.143:6789/0 conn(0x7f9618155160 legacy=0x7f9618158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.425+0000 7f961e7cf640 1 -- 172.21.15.97:0/2755112779 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180ca4d0 con 0x7f96180bd720 2023-12-04T05:39:04.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f961e7cf640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618158790 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa51096fd346259 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f961cfcc640 1 -- 172.21.15.97:0/2755112779 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a5780 con 0x7f96180bd720 2023-12-04T05:39:04.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f961cfcc640 1 -- 172.21.15.97:0/2755112779 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100a58e0 con 0x7f96180bd720 2023-12-04T05:39:04.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f961cfcc640 1 -- 172.21.15.97:0/2755112779 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a5c70 con 0x7f96180bd720 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 -- 172.21.15.97:0/2755112779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 msgr2=0x7f9618158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618158790 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961001c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 -- 172.21.15.97:0/2755112779 shutdown_connections 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618158790 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 --2- 172.21.15.97:0/2755112779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f961814e700 0x7f96180c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 -- 172.21.15.97:0/2755112779 >> 172.21.15.97:0/2755112779 conn(0x7f9618073720 msgr2=0x7f9618073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 -- 172.21.15.97:0/2755112779 shutdown_connections 2023-12-04T05:39:04.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.429+0000 7f9620232640 1 -- 172.21.15.97:0/2755112779 wait complete. 2023-12-04T05:39:04.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 Processor -- start 2023-12-04T05:39:04.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- start start 2023-12-04T05:39:04.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f961814e700 0x7f96180bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9618155160 0x7f96180c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618157090 con 0x7f96180bd720 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c38c0 con 0x7f961814e700 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c3b10 con 0x7f9618155160 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33648/0 (socket says 172.21.15.97:33648) 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 -- 172.21.15.97:0/3508102370 learned_addr learned my addr 172.21.15.97:0/3508102370 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961d7cd640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f961814e700 0x7f96180bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961e7cf640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9618155160 0x7f96180c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 -- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9618155160 msgr2=0x7f96180c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9618155160 0x7f96180c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 -- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f961814e700 msgr2=0x7f96180bf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f961814e700 0x7f96180bf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 -- 172.21.15.97:0/3508102370 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009b30 con 0x7f96180bd720 2023-12-04T05:39:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f961dfce640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f961400e870 tx=0x7f961400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614009510 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400eec0 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180c3df0 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400cb40 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.433+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180c0890 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9618156df0 con 0x7f96180bd720 2023-12-04T05:39:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f961400cca0 con 0x7f96180bd720 2023-12-04T05:39:04.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f960e7fc640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 0x7f95fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9614084860 con 0x7f96180bd720 2023-12-04T05:39:04.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f961d7cd640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 0x7f95fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.437+0000 7f961d7cd640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 0x7f95fc068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f96180aa5c0 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.441+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9618156df0 con 0x7f96180bd720 2023-12-04T05:39:04.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.589+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9618157300 con 0x7f96180bd720 2023-12-04T05:39:04.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.589+0000 7f960e7fc640 1 -- 172.21.15.97:0/3508102370 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96140517d0 con 0x7f96180bd720 2023-12-04T05:39:04.596 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 msgr2=0x7f95fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 0x7f95fc068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f96180aa5c0 tx=0x7f9608009040 comp rx=0 tx=0).stop 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 msgr2=0x7f9618155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f961400e870 tx=0x7f961400ec70 comp rx=0 tx=0).stop 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 shutdown_connections 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f95fc0668d0 0x7f95fc068d90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9618155160 0x7f96180c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f961814e700 0x7f96180bf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 --2- 172.21.15.97:0/3508102370 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f96180bd720 0x7f9618155c40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 >> 172.21.15.97:0/3508102370 conn(0x7f9618073720 msgr2=0x7f96180c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 shutdown_connections 2023-12-04T05:39:04.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.593+0000 7f9620232640 1 -- 172.21.15.97:0/3508102370 wait complete. 2023-12-04T05:39:04.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:04.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 Processor -- start 2023-12-04T05:39:04.758 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 -- start start 2023-12-04T05:39:04.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc814151d60 0x7fc814155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406a5f0 0x7fc81406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8140c34d0 con 0x7fc81406f7f0 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc814152140 con 0x7fc814151d60 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81c11d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81406b530 con 0x7fc81406a5f0 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc814151d60 0x7fc814155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc814151d60 0x7fc814155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33650/0 (socket says 172.21.15.97:33650) 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 -- 172.21.15.97:0/3178270811 learned_addr learned my addr 172.21.15.97:0/3178270811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc81a6ba640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406a5f0 0x7fc81406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 -- 172.21.15.97:0/3178270811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406a5f0 msgr2=0x7fc81406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406a5f0 0x7fc81406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 -- 172.21.15.97:0/3178270811 >> v1:172.21.15.143:6789/0 conn(0x7fc81406f7f0 legacy=0x7fc81406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.753+0000 7fc819eb9640 1 -- 172.21.15.97:0/3178270811 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8141556b0 con 0x7fc814151d60 2023-12-04T05:39:04.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc819eb9640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc814155170 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc808009e50 tx=0x7fc80801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479524f28306159f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc818eb7640 1 -- 172.21.15.97:0/3178270811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080a55b0 con 0x7fc814151d60 2023-12-04T05:39:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc818eb7640 1 -- 172.21.15.97:0/3178270811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8080a5710 con 0x7fc814151d60 2023-12-04T05:39:04.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc818eb7640 1 -- 172.21.15.97:0/3178270811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080a5aa0 con 0x7fc814151d60 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 -- 172.21.15.97:0/3178270811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 msgr2=0x7fc814155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc814155170 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc808009e50 tx=0x7fc80801c8f0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 -- 172.21.15.97:0/3178270811 shutdown_connections 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406a5f0 0x7fc81406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 --2- 172.21.15.97:0/3178270811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc814155170 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 -- 172.21.15.97:0/3178270811 >> 172.21.15.97:0/3178270811 conn(0x7fc8140c3980 msgr2=0x7fc8140c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 -- 172.21.15.97:0/3178270811 shutdown_connections 2023-12-04T05:39:04.764 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.757+0000 7fc81c11d640 1 -- 172.21.15.97:0/3178270811 wait complete. 2023-12-04T05:39:04.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 Processor -- start 2023-12-04T05:39:04.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- start start 2023-12-04T05:39:04.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81406a5f0 0x7fc814153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406f7f0 0x7fc81413c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8141407f0 con 0x7fc814151d60 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140c5d20 con 0x7fc81406a5f0 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140c6000 con 0x7fc81406f7f0 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33652/0 (socket says 172.21.15.97:33652) 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 -- 172.21.15.97:0/1888684600 learned_addr learned my addr 172.21.15.97:0/1888684600 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc819eb9640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81406a5f0 0x7fc814153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc8196b8640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406f7f0 0x7fc81413c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 -- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406f7f0 msgr2=0x7fc81413c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406f7f0 0x7fc81413c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 -- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81406a5f0 msgr2=0x7fc814153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81406a5f0 0x7fc814153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 -- 172.21.15.97:0/1888684600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009b30 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81a6ba640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d560 tx=0x7fc80c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0125f0 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c012770 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8140c62e0 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c012b20 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.761+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8140c65c0 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc814068440 con 0x7fc814151d60 2023-12-04T05:39:04.769 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc80c012c80 con 0x7fc814151d60 2023-12-04T05:39:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc8127fc640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 0x7fc7f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc80c084c30 con 0x7fc814151d60 2023-12-04T05:39:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc819eb9640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 0x7fc7f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.765+0000 7fc819eb9640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 0x7fc7f8068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ae000 tx=0x7fc8080a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:04.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.769+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc80c051a90 con 0x7fc814151d60 2023-12-04T05:39:04.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.917+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc81406b260 con 0x7fc814151d60 2023-12-04T05:39:04.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.917+0000 7fc8127fc640 1 -- 172.21.15.97:0/1888684600 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc80c0550b0 con 0x7fc814151d60 2023-12-04T05:39:04.923 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:04.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 msgr2=0x7fc7f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 0x7fc7f8068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ae000 tx=0x7fc8080a7070 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 msgr2=0x7fc81413cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00d560 tx=0x7fc80c00da20 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 shutdown_connections 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7f8066900 0x7fc7f8068dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc814151d60 0x7fc81413cc50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81406f7f0 0x7fc81413c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 --2- 172.21.15.97:0/1888684600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81406a5f0 0x7fc814153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 >> 172.21.15.97:0/1888684600 conn(0x7fc8140c3980 msgr2=0x7fc8140c1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 shutdown_connections 2023-12-04T05:39:04.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:04.921+0000 7fc81c11d640 1 -- 172.21.15.97:0/1888684600 wait complete. 2023-12-04T05:39:04.944 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:05.085 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 Processor -- start 2023-12-04T05:39:05.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 -- start start 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f87c8151da0 0x7f87c80abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 0x7f87c81548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c81587f0 con 0x7f87c80c65b0 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c80c5020 con 0x7f87c8151da0 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87d06e3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8158600 con 0x7f87c80ac120 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cec80640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f87c80c65b0 0x7f87c8154e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42828/0 (socket says 172.21.15.97:42828) 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cec80640 1 -- 172.21.15.97:0/4235884706 learned_addr learned my addr 172.21.15.97:0/4235884706 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:05.087 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/4235884706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 0x7f87c81548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87ce47f640 1 --2- 172.21.15.97:0/4235884706 >> v2:172.21.15.143:3300/0 conn(0x7f87c8151da0 0x7f87c80abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cd47d640 1 -- 172.21.15.97:0/4235884706 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818426037 0 0) 0x7f87c81587f0 con 0x7f87c80c65b0 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cd47d640 1 -- 172.21.15.97:0/4235884706 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b4003530 con 0x7f87c80c65b0 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cdc7e640 1 -- 172.21.15.97:0/4235884706 >> v2:172.21.15.143:3300/0 conn(0x7f87c8151da0 msgr2=0x7f87c80abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/4235884706 >> v2:172.21.15.143:3300/0 conn(0x7f87c8151da0 0x7f87c80abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cdc7e640 1 -- 172.21.15.97:0/4235884706 >> v1:172.21.15.97:6789/0 conn(0x7f87c80c65b0 legacy=0x7f87c8154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.081+0000 7f87cdc7e640 1 -- 172.21.15.97:0/4235884706 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c80c4980 con 0x7f87c80ac120 2023-12-04T05:39:05.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/4235884706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 0x7f87c81548e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87b80097c0 tx=0x7f87b801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff2f1d72dfdaed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87cd47d640 1 -- 172.21.15.97:0/4235884706 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80ab600 con 0x7f87c80ac120 2023-12-04T05:39:05.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87cd47d640 1 -- 172.21.15.97:0/4235884706 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a7050 con 0x7f87c80ac120 2023-12-04T05:39:05.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87cd47d640 1 -- 172.21.15.97:0/4235884706 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80ab980 con 0x7f87c80ac120 2023-12-04T05:39:05.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 -- 172.21.15.97:0/4235884706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 msgr2=0x7f87c81548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 --2- 172.21.15.97:0/4235884706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 0x7f87c81548e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f87b80097c0 tx=0x7f87b801c480 comp rx=0 tx=0).stop 2023-12-04T05:39:05.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 -- 172.21.15.97:0/4235884706 shutdown_connections 2023-12-04T05:39:05.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 --2- 172.21.15.97:0/4235884706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c80ac120 0x7f87c81548e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 --2- 172.21.15.97:0/4235884706 >> v2:172.21.15.143:3300/0 conn(0x7f87c8151da0 0x7f87c80abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.085+0000 7f87d06e3640 1 -- 172.21.15.97:0/4235884706 >> 172.21.15.97:0/4235884706 conn(0x7f87c80ca000 msgr2=0x7f87c80ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- 172.21.15.97:0/4235884706 shutdown_connections 2023-12-04T05:39:05.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- 172.21.15.97:0/4235884706 wait complete. 2023-12-04T05:39:05.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 Processor -- start 2023-12-04T05:39:05.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- start start 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 0x7f87c80aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c8151da0 0x7f87c814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8155c40 con 0x7f87c80c65b0 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a9bf0 con 0x7f87c80ac120 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a9ed0 con 0x7f87c8151da0 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33664/0 (socket says 172.21.15.97:33664) 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 -- 172.21.15.97:0/28563726 learned_addr learned my addr 172.21.15.97:0/28563726 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87ce47f640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 0x7f87c80aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cec80640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c8151da0 0x7f87c814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 -- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c8151da0 msgr2=0x7f87c814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c8151da0 0x7f87c814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 -- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 msgr2=0x7f87c80aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 0x7f87c80aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 -- 172.21.15.97:0/28563726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009420 con 0x7f87c80c65b0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87ce47f640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 0x7f87c80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87cdc7e640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f87b8019090 tx=0x7f87b8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80b4400 con 0x7f87c80c65b0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80b4560 con 0x7f87c80c65b0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80b4910 con 0x7f87c80c65b0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c80aa1b0 con 0x7f87c80c65b0 2023-12-04T05:39:05.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.089+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c80aa770 con 0x7f87c80c65b0 2023-12-04T05:39:05.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c80aa960 con 0x7f87c80c65b0 2023-12-04T05:39:05.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87b80b2040 con 0x7f87c80c65b0 2023-12-04T05:39:05.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87beffd640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 0x7f87ac068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f87b811e370 con 0x7f87c80c65b0 2023-12-04T05:39:05.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87ce47f640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 0x7f87ac068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.093+0000 7f87ce47f640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 0x7f87ac068dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87c814b380 tx=0x7f87c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.097+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87b80eb240 con 0x7f87c80c65b0 2023-12-04T05:39:05.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.249+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f87c8068440 con 0x7f87c80c65b0 2023-12-04T05:39:05.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.249+0000 7f87beffd640 1 -- 172.21.15.97:0/28563726 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f87b80ee860 con 0x7f87c80c65b0 2023-12-04T05:39:05.256 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 msgr2=0x7f87ac068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 0x7f87ac068dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87c814b380 tx=0x7f87c4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 msgr2=0x7f87c8149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f87b8019090 tx=0x7f87b8019220 comp rx=0 tx=0).stop 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 shutdown_connections 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f87ac066900 0x7f87ac068dc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f87c8151da0 0x7f87c814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f87c80c65b0 0x7f87c8149c50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 --2- 172.21.15.97:0/28563726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f87c80ac120 0x7f87c80aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 >> 172.21.15.97:0/28563726 conn(0x7f87c80ca000 msgr2=0x7f87c80c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 shutdown_connections 2023-12-04T05:39:05.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.253+0000 7f87d06e3640 1 -- 172.21.15.97:0/28563726 wait complete. 2023-12-04T05:39:05.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:05.413 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 Processor -- start 2023-12-04T05:39:05.414 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 -- start start 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 0x7f62c406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 0x7f62c40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c4152300 con 0x7f62c406be00 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c4071580 con 0x7f62c406ca50 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c9c9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414ed50 con 0x7f62c414e970 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c2ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f62c406be00 0x7f62c4071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42840/0 (socket says 172.21.15.97:42840) 2023-12-04T05:39:05.415 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c2ffd640 1 -- 172.21.15.97:0/1278072270 learned_addr learned my addr 172.21.15.97:0/1278072270 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c37fe640 1 --2- 172.21.15.97:0/1278072270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 0x7f62c406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c3fff640 1 --2- 172.21.15.97:0/1278072270 >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 0x7f62c40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548485820 0 0) 0x7f62b8001120 con 0x7f62c406be00 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ac003530 con 0x7f62c406be00 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476610765 0 0) 0x7f62ac003530 con 0x7f62c406be00 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c37fe640 1 -- 172.21.15.97:0/1278072270 >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 msgr2=0x7f62c40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:05.416 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c37fe640 1 --2- 172.21.15.97:0/1278072270 >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 0x7f62c40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c37fe640 1 -- 172.21.15.97:0/1278072270 >> v1:172.21.15.97:6789/0 conn(0x7f62c406be00 legacy=0x7f62c4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c37fe640 1 -- 172.21.15.97:0/1278072270 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c406cea0 con 0x7f62c414e970 2023-12-04T05:39:05.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.409+0000 7f62c3fff640 1 --2- 172.21.15.97:0/1278072270 >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 0x7f62c40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:05.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c37fe640 1 --2- 172.21.15.97:0/1278072270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 0x7f62c406e150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62b40097c0 tx=0x7f62b401c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4865135ba620bbce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8001810 con 0x7f62c414e970 2023-12-04T05:39:05.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40a7050 con 0x7f62c414e970 2023-12-04T05:39:05.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c27fc640 1 -- 172.21.15.97:0/1278072270 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40ab620 con 0x7f62c414e970 2023-12-04T05:39:05.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c9c9c640 1 -- 172.21.15.97:0/1278072270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 msgr2=0x7f62c406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.413+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/1278072270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 0x7f62c406e150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62b40097c0 tx=0x7f62b401c280 comp rx=0 tx=0).stop 2023-12-04T05:39:05.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- 172.21.15.97:0/1278072270 shutdown_connections 2023-12-04T05:39:05.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/1278072270 >> v2:172.21.15.143:3300/0 conn(0x7f62c406ca50 0x7f62c40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/1278072270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c414e970 0x7f62c406e150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- 172.21.15.97:0/1278072270 >> 172.21.15.97:0/1278072270 conn(0x7f62c40c2970 msgr2=0x7f62c40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- 172.21.15.97:0/1278072270 shutdown_connections 2023-12-04T05:39:05.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- 172.21.15.97:0/1278072270 wait complete. 2023-12-04T05:39:05.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 Processor -- start 2023-12-04T05:39:05.422 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- start start 2023-12-04T05:39:05.423 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 0x7f62c4140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 0x7f62c41f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414f930 con 0x7f62c414e970 2023-12-04T05:39:05.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414f150 con 0x7f62c406be00 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c9c9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c415cda0 con 0x7f62c406ca50 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33666/0 (socket says 172.21.15.97:33666) 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 -- 172.21.15.97:0/3974298298 learned_addr learned my addr 172.21.15.97:0/3974298298 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c37fe640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 0x7f62c4140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c2ffd640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 0x7f62c41f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 -- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 msgr2=0x7f62c41f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 0x7f62c41f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 -- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 msgr2=0x7f62c4140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 0x7f62c4140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 -- 172.21.15.97:0/3974298298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009a70 con 0x7f62c414e970 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c2ffd640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 0x7f62c41f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c37fe640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 0x7f62c4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:05.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.417+0000 7f62c3fff640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00efc0 tx=0x7f62bc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc009d70 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00f040 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4009420 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0039a0 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c414f410 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c41f5650 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f62bc014480 con 0x7f62c414e970 2023-12-04T05:39:05.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 0x7f62b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f62bc0853a0 con 0x7f62c414e970 2023-12-04T05:39:05.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62c37fe640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 0x7f62b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.421+0000 7f62c37fe640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 0x7f62b0068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62b40ad000 tx=0x7f62b40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.425+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62c41f5650 con 0x7f62c414e970 2023-12-04T05:39:05.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.605+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c41f5650 con 0x7f62c414e970 2023-12-04T05:39:05.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.605+0000 7f62abfff640 1 -- 172.21.15.97:0/3974298298 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6138 (secure 0 0 0) 0x7f62c41f5650 con 0x7f62c414e970 2023-12-04T05:39:05.612 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:05.612 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:05.612 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 37 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 msgr2=0x7f62b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 0x7f62b0068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62b40ad000 tx=0x7f62b40a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 msgr2=0x7f62c41f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00efc0 tx=0x7f62bc009f90 comp rx=0 tx=0).stop 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 shutdown_connections 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62b00668d0 0x7f62b0068d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62c414e970 0x7f62c41f5110 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62c406ca50 0x7f62c41f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 --2- 172.21.15.97:0/3974298298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62c406be00 0x7f62c4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 >> 172.21.15.97:0/3974298298 conn(0x7f62c40c2970 msgr2=0x7f62c41480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 shutdown_connections 2023-12-04T05:39:05.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.609+0000 7f62c9c9c640 1 -- 172.21.15.97:0/3974298298 wait complete. 2023-12-04T05:39:05.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:05.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 Processor -- start 2023-12-04T05:39:05.772 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 -- start start 2023-12-04T05:39:05.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f456c0c5400 0x7f456c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c0c32c0 con 0x7f456c0c40d0 2023-12-04T05:39:05.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c0c5860 con 0x7f456c0c0be0 2023-12-04T05:39:05.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4572488640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0c26b0 con 0x7f456c0c5400 2023-12-04T05:39:05.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4571c87640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f456c0c40d0 0x7f456c15bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42856/0 (socket says 172.21.15.97:42856) 2023-12-04T05:39:05.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4571c87640 1 -- 172.21.15.97:0/4231885349 learned_addr learned my addr 172.21.15.97:0/4231885349 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4570c85640 1 --2- 172.21.15.97:0/4231885349 >> v2:172.21.15.143:3300/0 conn(0x7f456c0c5400 0x7f456c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736422669 0 0) 0x7f456c0c32c0 con 0x7f456c0c40d0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4558003530 con 0x7f456c0c40d0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751283330 0 0) 0x7f456c0c5860 con 0x7f456c0c0be0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f456c0c32c0 con 0x7f456c0c0be0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4570c85640 1 -- 172.21.15.97:0/4231885349 >> v1:172.21.15.143:6789/0 conn(0x7f456c0c0be0 legacy=0x7f456c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4570c85640 1 -- 172.21.15.97:0/4231885349 >> v1:172.21.15.97:6789/0 conn(0x7f456c0c40d0 legacy=0x7f456c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3680126708 0 0) 0x7f4558003530 con 0x7f456c0c40d0 2023-12-04T05:39:05.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.769+0000 7f4570c85640 1 -- 172.21.15.97:0/4231885349 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0c2990 con 0x7f456c0c5400 2023-12-04T05:39:05.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4570c85640 1 --2- 172.21.15.97:0/4231885349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c5400 0x7f456c0c3b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f455c0097c0 tx=0x7f455c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4072944e43041140 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564001a00 con 0x7f456c0c5400 2023-12-04T05:39:05.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c0a7050 con 0x7f456c0c5400 2023-12-04T05:39:05.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4563fff640 1 -- 172.21.15.97:0/4231885349 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0ab620 con 0x7f456c0c5400 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 -- 172.21.15.97:0/4231885349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c5400 msgr2=0x7f456c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 --2- 172.21.15.97:0/4231885349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c5400 0x7f456c0c3b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f455c0097c0 tx=0x7f455c01c2e0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 -- 172.21.15.97:0/4231885349 shutdown_connections 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 --2- 172.21.15.97:0/4231885349 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c5400 0x7f456c0c3b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 -- 172.21.15.97:0/4231885349 >> 172.21.15.97:0/4231885349 conn(0x7f456c0c5a50 msgr2=0x7f456c0c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 -- 172.21.15.97:0/4231885349 shutdown_connections 2023-12-04T05:39:05.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.773+0000 7f4572488640 1 -- 172.21.15.97:0/4231885349 wait complete. 2023-12-04T05:39:05.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 Processor -- start 2023-12-04T05:39:05.780 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- start start 2023-12-04T05:39:05.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c0be0 0x7f456c14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f456c0c40d0 0x7f456c14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c152200 con 0x7f456c0c5400 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0c1b10 con 0x7f456c0c0be0 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1ed910 con 0x7f456c0c40d0 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33680/0 (socket says 172.21.15.97:33680) 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 -- 172.21.15.97:0/621708977 learned_addr learned my addr 172.21.15.97:0/621708977 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4570c85640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f456c0c40d0 0x7f456c14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571486640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c0be0 0x7f456c14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 -- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f456c0c40d0 msgr2=0x7f456c14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f456c0c40d0 0x7f456c14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 -- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c0be0 msgr2=0x7f456c14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c0be0 0x7f456c14ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 -- 172.21.15.97:0/621708977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c009420 con 0x7f456c0c5400 2023-12-04T05:39:05.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4571c87640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4564001fb0 tx=0x7f456400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564012400 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564012560 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564012910 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c14f370 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1ede00 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.777+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c1f04f0 con 0x7f456c0c5400 2023-12-04T05:39:05.784 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.781+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4564012a70 con 0x7f456c0c5400 2023-12-04T05:39:05.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.781+0000 7f4561ffb640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 0x7f4550068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:05.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.781+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4564084e30 con 0x7f456c0c5400 2023-12-04T05:39:05.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.781+0000 7f4571486640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 0x7f4550068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:05.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.781+0000 7f4571486640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 0x7f4550068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45680011f0 tx=0x7f4568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:05.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.785+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f456c1f04f0 con 0x7f456c0c5400 2023-12-04T05:39:05.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.933+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f456c1f04f0 con 0x7f456c0c5400 2023-12-04T05:39:05.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4561ffb640 1 -- 172.21.15.97:0/621708977 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7f456c1f04f0 con 0x7f456c0c5400 2023-12-04T05:39:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:05.942 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 msgr2=0x7f4550068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 0x7f4550068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45680011f0 tx=0x7f4568009040 comp rx=0 tx=0).stop 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 msgr2=0x7f456c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4564001fb0 tx=0x7f456400a430 comp rx=0 tx=0).stop 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 shutdown_connections 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4550066900 0x7f4550068dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456c0c5400 0x7f456c15bfc0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f456c0c40d0 0x7f456c14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 --2- 172.21.15.97:0/621708977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f456c0c0be0 0x7f456c14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:05.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 >> 172.21.15.97:0/621708977 conn(0x7f456c0c5a50 msgr2=0x7f456c0c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:05.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 shutdown_connections 2023-12-04T05:39:05.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:05.937+0000 7f4572488640 1 -- 172.21.15.97:0/621708977 wait complete. 2023-12-04T05:39:05.963 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T05:39:05.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:06.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 Processor -- start 2023-12-04T05:39:06.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 -- start start 2023-12-04T05:39:06.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbf9406be00 0x7fbf9406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf94152300 con 0x7fbf9414e970 2023-12-04T05:39:06.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf94071580 con 0x7fbf9406ca50 2023-12-04T05:39:06.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9c7f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9414ed50 con 0x7fbf9406be00 2023-12-04T05:39:06.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9a594640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbf9414e970 0x7fbf94071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42860/0 (socket says 172.21.15.97:42860) 2023-12-04T05:39:06.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf9a594640 1 -- 172.21.15.97:0/1970760823 learned_addr learned my addr 172.21.15.97:0/1970760823 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:06.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.097+0000 7fbf99d93640 1 --2- 172.21.15.97:0/1970760823 >> v2:172.21.15.143:3300/0 conn(0x7fbf9406be00 0x7fbf9406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736335575 0 0) 0x7fbf90001120 con 0x7fbf9414e970 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf80003530 con 0x7fbf9414e970 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687261490 0 0) 0x7fbf94071580 con 0x7fbf9406ca50 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf90001120 con 0x7fbf9406ca50 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99d93640 1 -- 172.21.15.97:0/1970760823 >> v1:172.21.15.143:6789/0 conn(0x7fbf9406ca50 legacy=0x7fbf940c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99d93640 1 -- 172.21.15.97:0/1970760823 >> v1:172.21.15.97:6789/0 conn(0x7fbf9414e970 legacy=0x7fbf94071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99d93640 1 -- 172.21.15.97:0/1970760823 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94151d60 con 0x7fbf9406be00 2023-12-04T05:39:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99d93640 1 --2- 172.21.15.97:0/1970760823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf9406e150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740dbe6b946bccdc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840ab5f0 con 0x7fbf9406be00 2023-12-04T05:39:06.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf840ab750 con 0x7fbf9406be00 2023-12-04T05:39:06.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.101+0000 7fbf99592640 1 -- 172.21.15.97:0/1970760823 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840abae0 con 0x7fbf9406be00 2023-12-04T05:39:06.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/1970760823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 msgr2=0x7fbf9406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/1970760823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf9406e150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbf840097c0 tx=0x7fbf8401c3f0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/1970760823 shutdown_connections 2023-12-04T05:39:06.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/1970760823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf9406e150 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/1970760823 >> 172.21.15.97:0/1970760823 conn(0x7fbf940c2970 msgr2=0x7fbf940c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/1970760823 shutdown_connections 2023-12-04T05:39:06.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/1970760823 wait complete. 2023-12-04T05:39:06.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 Processor -- start 2023-12-04T05:39:06.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- start start 2023-12-04T05:39:06.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf94147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 0x7fbf941ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940abd40 con 0x7fbf9406ca50 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940aba60 con 0x7fbf9406be00 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9c7f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf941f00a0 con 0x7fbf9414e970 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33688/0 (socket says 172.21.15.97:33688) 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 -- 172.21.15.97:0/115511726 learned_addr learned my addr 172.21.15.97:0/115511726 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:06.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9a594640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf94147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9ad95640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 0x7fbf941ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 -- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 msgr2=0x7fbf941ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 0x7fbf941ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 -- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 msgr2=0x7fbf94147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf94147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 -- 172.21.15.97:0/115511726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009420 con 0x7fbf9406ca50 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf9ad95640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 0x7fbf941ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:06.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.105+0000 7fbf99d93640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbf840ad040 tx=0x7fbf8401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840bf610 con 0x7fbf9406ca50 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf840bf7b0 con 0x7fbf9406ca50 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840bfb60 con 0x7fbf9406ca50 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf941f0380 con 0x7fbf9406ca50 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94142540 con 0x7fbf9406ca50 2023-12-04T05:39:06.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94068440 con 0x7fbf9406ca50 2023-12-04T05:39:06.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf840b5400 con 0x7fbf9406ca50 2023-12-04T05:39:06.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 0x7fbf78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbf840a8050 con 0x7fbf9406ca50 2023-12-04T05:39:06.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf9a594640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 0x7fbf78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.109+0000 7fbf9a594640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 0x7fbf78068dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf90000f70 tx=0x7fbf90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.113+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf840ebcd0 con 0x7fbf9406ca50 2023-12-04T05:39:06.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf94140e30 con 0x7fbf9406ca50 2023-12-04T05:39:06.305 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf8affd640 1 -- 172.21.15.97:0/115511726 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6138 (secure 0 0 0) 0x7fbf840ef2f0 con 0x7fbf9406ca50 2023-12-04T05:39:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:06.306 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:06.306 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 37 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 msgr2=0x7fbf78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 0x7fbf78068dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf90000f70 tx=0x7fbf90009040 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 msgr2=0x7fbf941eca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbf840ad040 tx=0x7fbf8401ac30 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 shutdown_connections 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf78066900 0x7fbf78068dc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf9414e970 0x7fbf941ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf9406ca50 0x7fbf941eca00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 --2- 172.21.15.97:0/115511726 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf9406be00 0x7fbf94147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.308 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 >> 172.21.15.97:0/115511726 conn(0x7fbf940c2970 msgr2=0x7fbf9406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 shutdown_connections 2023-12-04T05:39:06.309 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.301+0000 7fbf9c7f8640 1 -- 172.21.15.97:0/115511726 wait complete. 2023-12-04T05:39:06.327 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:06.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.457+0000 7f3c9251d640 1 Processor -- start 2023-12-04T05:39:06.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.457+0000 7f3c9251d640 1 -- start start 2023-12-04T05:39:06.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c9251d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c154260 0x7f3c8c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c9251d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c8c0a9470 0x7f3c8c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c9251d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c06c760 con 0x7f3c8c06bee0 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c9251d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0a8670 con 0x7f3c8c0a9470 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c9251d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c06c550 con 0x7f3c8c154260 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c8c0a9470 0x7f3c8c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3c8c0a9470 0x7f3c8c154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33698/0 (socket says 172.21.15.97:33698) 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/412039622 learned_addr learned my addr 172.21.15.97:0/412039622 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:06.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8bfff640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c154260 0x7f3c8c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/412039622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c154260 msgr2=0x7f3c8c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:06.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c154260 0x7f3c8c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/412039622 >> v1:172.21.15.143:6789/0 conn(0x7f3c8c06bee0 legacy=0x7f3c8c06d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.461+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/412039622 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c06ca40 con 0x7f3c8c0a9470 2023-12-04T05:39:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c8b7fe640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c154b80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3c80006fd0 tx=0x7f3c8001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1009c1fda1171de1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c8affd640 1 -- 172.21.15.97:0/412039622 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80004230 con 0x7f3c8c0a9470 2023-12-04T05:39:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c8affd640 1 -- 172.21.15.97:0/412039622 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800ab070 con 0x7f3c8c0a9470 2023-12-04T05:39:06.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c8affd640 1 -- 172.21.15.97:0/412039622 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800a7760 con 0x7f3c8c0a9470 2023-12-04T05:39:06.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- 172.21.15.97:0/412039622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 msgr2=0x7f3c8c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c154b80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3c80006fd0 tx=0x7f3c8001e910 comp rx=0 tx=0).stop 2023-12-04T05:39:06.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- 172.21.15.97:0/412039622 shutdown_connections 2023-12-04T05:39:06.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c154b80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 --2- 172.21.15.97:0/412039622 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c154260 0x7f3c8c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- 172.21.15.97:0/412039622 >> 172.21.15.97:0/412039622 conn(0x7f3c8c0c2970 msgr2=0x7f3c8c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- 172.21.15.97:0/412039622 shutdown_connections 2023-12-04T05:39:06.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- 172.21.15.97:0/412039622 wait complete. 2023-12-04T05:39:06.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 Processor -- start 2023-12-04T05:39:06.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.465+0000 7f3c9251d640 1 -- start start 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 0x7f3c8c148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 0x7f3c8c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c1f0970 con 0x7f3c8c0a9470 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c151570 con 0x7f3c8c154260 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c151810 con 0x7f3c8c06bee0 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33700/0 (socket says 172.21.15.97:33700) 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/3875773708 learned_addr learned my addr 172.21.15.97:0/3875773708 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:06.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8bfff640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 0x7f3c8c148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c90aba640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 0x7f3c8c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 msgr2=0x7f3c8c148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 0x7f3c8c148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 msgr2=0x7f3c8c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 0x7f3c8c06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 -- 172.21.15.97:0/3875773708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8000b780 con 0x7f3c8c0a9470 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8bfff640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 0x7f3c8c148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c90aba640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 0x7f3c8c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c8b7fe640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c10 tx=0x7f3c8001b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800a8b00 con 0x7f3c8c0a9470 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800a8c60 con 0x7f3c8c0a9470 2023-12-04T05:39:06.476 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c0719d0 con 0x7f3c8c0a9470 2023-12-04T05:39:06.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80003620 con 0x7f3c8c0a9470 2023-12-04T05:39:06.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c1f0450 con 0x7f3c8c0a9470 2023-12-04T05:39:06.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c1f0640 con 0x7f3c8c0a9470 2023-12-04T05:39:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.469+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c80003780 con 0x7f3c8c0a9470 2023-12-04T05:39:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.473+0000 7f3c88ff9640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 0x7f3c78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.473+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c8011ebf0 con 0x7f3c8c0a9470 2023-12-04T05:39:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.473+0000 7f3c8bfff640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 0x7f3c78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.473+0000 7f3c8bfff640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 0x7f3c78068dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c15b360 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.477+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c800ebac0 con 0x7f3c8c0a9470 2023-12-04T05:39:06.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.653+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c8c068440 con 0x7f3c8c0a9470 2023-12-04T05:39:06.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.653+0000 7f3c88ff9640 1 -- 172.21.15.97:0/3875773708 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6138 (secure 0 0 0) 0x7f3c800ad090 con 0x7f3c8c0a9470 2023-12-04T05:39:06.660 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:06.660 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:28.702052+0000","modified":"2023-12-04T05:38:31.710088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/3150893568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3150893568},{"type":"v1","addr":"172.21.15.97:6837","nonce":3150893568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:06.660 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 37 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 msgr2=0x7f3c78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 0x7f3c78068dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c15b360 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 msgr2=0x7f3c8c1531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c80000c10 tx=0x7f3c8001b6b0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 shutdown_connections 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3c78066900 0x7f3c78068dc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c8c154260 0x7f3c8c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3c8c0a9470 0x7f3c8c1531e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 --2- 172.21.15.97:0/3875773708 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c8c06bee0 0x7f3c8c148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 >> 172.21.15.97:0/3875773708 conn(0x7f3c8c0c2970 msgr2=0x7f3c8c14b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 shutdown_connections 2023-12-04T05:39:06.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.657+0000 7f3c9251d640 1 -- 172.21.15.97:0/3875773708 wait complete. 2023-12-04T05:39:06.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:06.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 Processor -- start 2023-12-04T05:39:06.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 -- start start 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf814e970 0x7fdaf806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdaf806be00 0x7fdaf806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf8152300 con 0x7fdaf8071a10 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf8071580 con 0x7fdaf814e970 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdb00617640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf814ed50 con 0x7fdaf806be00 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafe3b3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf814e970 0x7fdaf806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafebb4640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdaf8071a10 0x7fdaf80c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42874/0 (socket says 172.21.15.97:42874) 2023-12-04T05:39:06.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafe3b3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdaf814e970 0x7fdaf806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33716/0 (socket says 172.21.15.97:33716) 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafebb4640 1 -- 172.21.15.97:0/3413022496 learned_addr learned my addr 172.21.15.97:0/3413022496 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafdbb2640 1 --2- 172.21.15.97:0/3413022496 >> v2:172.21.15.143:3300/0 conn(0x7fdaf806be00 0x7fdaf806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.813+0000 7fdafe3b3640 1 -- 172.21.15.97:0/3413022496 >> v2:172.21.15.143:3300/0 conn(0x7fdaf806be00 msgr2=0x7fdaf806ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3413022496 >> v2:172.21.15.143:3300/0 conn(0x7fdaf806be00 0x7fdaf806ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafe3b3640 1 -- 172.21.15.97:0/3413022496 >> v1:172.21.15.97:6789/0 conn(0x7fdaf8071a10 legacy=0x7fdaf80c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafe3b3640 1 -- 172.21.15.97:0/3413022496 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8151d60 con 0x7fdaf814e970 2023-12-04T05:39:06.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafd3b1640 1 -- 172.21.15.97:0/3413022496 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534771594 0 0) 0x7fdaf00014a0 con 0x7fdaf8071a10 2023-12-04T05:39:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3413022496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf806e150 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80a93f0 tx=0x7fdaf401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa738ab0656a1e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafd3b1640 1 -- 172.21.15.97:0/3413022496 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40ac600 con 0x7fdaf814e970 2023-12-04T05:39:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafd3b1640 1 -- 172.21.15.97:0/3413022496 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40a8050 con 0x7fdaf814e970 2023-12-04T05:39:06.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdafd3b1640 1 -- 172.21.15.97:0/3413022496 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40ac980 con 0x7fdaf814e970 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 -- 172.21.15.97:0/3413022496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 msgr2=0x7fdaf806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 --2- 172.21.15.97:0/3413022496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf806e150 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80a93f0 tx=0x7fdaf401c3a0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 -- 172.21.15.97:0/3413022496 shutdown_connections 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 --2- 172.21.15.97:0/3413022496 >> v2:172.21.15.143:3300/0 conn(0x7fdaf806be00 0x7fdaf806ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 --2- 172.21.15.97:0/3413022496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf806e150 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.817+0000 7fdb00617640 1 -- 172.21.15.97:0/3413022496 >> 172.21.15.97:0/3413022496 conn(0x7fdaf80c2970 msgr2=0x7fdaf80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- 172.21.15.97:0/3413022496 shutdown_connections 2023-12-04T05:39:06.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- 172.21.15.97:0/3413022496 wait complete. 2023-12-04T05:39:06.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 Processor -- start 2023-12-04T05:39:06.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- start start 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 0x7fdaf81494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf8071a10 0x7fdaf8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf815adb0 con 0x7fdaf814e970 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8149a30 con 0x7fdaf806be00 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8158c40 con 0x7fdaf8071a10 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33722/0 (socket says 172.21.15.97:33722) 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 -- 172.21.15.97:0/3659599746 learned_addr learned my addr 172.21.15.97:0/3659599746 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafdbb2640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf8071a10 0x7fdaf8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 0x7fdaf81494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 -- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf8071a10 msgr2=0x7fdaf8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf8071a10 0x7fdaf8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 -- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 msgr2=0x7fdaf81494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 0x7fdaf81494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 -- 172.21.15.97:0/3659599746 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009420 con 0x7fdaf814e970 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 0x7fdaf81494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdafebb4640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c7e0 tx=0x7fdaf000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf000a640 con 0x7fdaf814e970 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf000a7c0 con 0x7fdaf814e970 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf000abb0 con 0x7fdaf814e970 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.821+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf8154c70 con 0x7fdaf814e970 2023-12-04T05:39:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf8154990 con 0x7fdaf814e970 2023-12-04T05:39:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf8068440 con 0x7fdaf814e970 2023-12-04T05:39:06.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdaf000ad10 con 0x7fdaf814e970 2023-12-04T05:39:06.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdaeeffd640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 0x7fdadc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:06.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdaf0083a70 con 0x7fdaf814e970 2023-12-04T05:39:06.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 0x7fdadc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:06.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.825+0000 7fdafe3b3640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 0x7fdadc068dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40ae000 tx=0x7fdaf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:06.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.829+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdaf00509e0 con 0x7fdaf814e970 2023-12-04T05:39:06.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.977+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaf8152300 con 0x7fdaf814e970 2023-12-04T05:39:06.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdaeeffd640 1 -- 172.21.15.97:0/3659599746 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20268 (secure 0 0 0) 0x7fdaf8152300 con 0x7fdaf814e970 2023-12-04T05:39:06.985 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:06.986 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":54,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:38:48.034097+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:38:26.438302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-04T05:38:27.710828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 msgr2=0x7fdadc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 0x7fdadc068dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40ae000 tx=0x7fdaf4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 msgr2=0x7fdaf81ea8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000c7e0 tx=0x7fdaf000cca0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 shutdown_connections 2023-12-04T05:39:06.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdadc066900 0x7fdadc068dc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdaf814e970 0x7fdaf81ea8e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaf8071a10 0x7fdaf8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 --2- 172.21.15.97:0/3659599746 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaf806be00 0x7fdaf81494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 >> 172.21.15.97:0/3659599746 conn(0x7fdaf80c2970 msgr2=0x7fdaf806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 shutdown_connections 2023-12-04T05:39:06.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:06.981+0000 7fdb00617640 1 -- 172.21.15.97:0/3659599746 wait complete. 2023-12-04T05:39:07.006 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-04T05:39:07.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 Processor -- start 2023-12-04T05:39:07.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 -- start start 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0e40151df0 0x7f0e400c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 0x7f0e40154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e40157d10 con 0x7f0e400c8050 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4006c8a0 con 0x7f0e40151df0 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e45046640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40157ff0 con 0x7f0e400bd690 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0e40151df0 0x7f0e400c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3e59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 0x7f0e40154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3f59e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0e400c8050 0x7f0e40154bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:37810/0 (socket says 172.21.15.97:37810) 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3f59e640 1 -- 172.21.15.97:0/366229234 learned_addr learned my addr 172.21.15.97:0/366229234 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/366229234 >> v2:172.21.15.143:3300/0 conn(0x7f0e40151df0 0x7f0e400c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:47918/0 (socket says 172.21.15.97:47918) 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 msgr2=0x7f0e40154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 0x7f0e40154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/366229234 >> v1:172.21.15.143:6789/0 conn(0x7f0e400c8050 legacy=0x7f0e40154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/366229234 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e401582d0 con 0x7f0e40151df0 2023-12-04T05:39:07.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.141+0000 7f0e3e59c640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 0x7f0e40154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:07.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e40151df0 0x7f0e400c4980 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e300097c0 tx=0x7f0e3001cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab159902818d3ee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e3dd9b640 1 -- 172.21.15.97:0/366229234 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300ad680 con 0x7f0e40151df0 2023-12-04T05:39:07.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e3dd9b640 1 -- 172.21.15.97:0/366229234 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300ad7e0 con 0x7f0e40151df0 2023-12-04T05:39:07.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e3dd9b640 1 -- 172.21.15.97:0/366229234 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300adb70 con 0x7f0e40151df0 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 -- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e40151df0 msgr2=0x7f0e400c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e40151df0 0x7f0e400c4980 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e300097c0 tx=0x7f0e3001cdc0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 -- 172.21.15.97:0/366229234 shutdown_connections 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e400bd690 0x7f0e40154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 --2- 172.21.15.97:0/366229234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e40151df0 0x7f0e400c4980 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 -- 172.21.15.97:0/366229234 >> 172.21.15.97:0/366229234 conn(0x7f0e40073950 msgr2=0x7f0e40073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 -- 172.21.15.97:0/366229234 shutdown_connections 2023-12-04T05:39:07.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.145+0000 7f0e45046640 1 -- 172.21.15.97:0/366229234 wait complete. 2023-12-04T05:39:07.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 Processor -- start 2023-12-04T05:39:07.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- start start 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e400c8050 0x7f0e400c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e40151df0 0x7f0e4014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400c2d00 con 0x7f0e400bd690 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e401ee220 con 0x7f0e400c8050 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4014f250 con 0x7f0e40151df0 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33730/0 (socket says 172.21.15.97:33730) 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/3956952461 learned_addr learned my addr 172.21.15.97:0/3956952461 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:07.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3e59c640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e400c8050 0x7f0e400c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3f59e640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e40151df0 0x7f0e4014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e40151df0 msgr2=0x7f0e4014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e40151df0 0x7f0e4014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e400c8050 msgr2=0x7f0e400c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e400c8050 0x7f0e400c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 -- 172.21.15.97:0/3956952461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009420 con 0x7f0e400bd690 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e3ed9d640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0e30019f90 tx=0x7f0e3001aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300add60 con 0x7f0e400bd690 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300b8420 con 0x7f0e400bd690 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e30009420 con 0x7f0e400bd690 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300b87d0 con 0x7f0e400bd690 2023-12-04T05:39:07.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.149+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e400c31c0 con 0x7f0e400bd690 2023-12-04T05:39:07.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e40068440 con 0x7f0e400bd690 2023-12-04T05:39:07.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e300b4040 con 0x7f0e400bd690 2023-12-04T05:39:07.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e277fe640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 0x7f0e2c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e3011ea00 con 0x7f0e400bd690 2023-12-04T05:39:07.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e3e59c640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 0x7f0e2c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.153+0000 7f0e3e59c640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 0x7f0e2c068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0e400af8a0 tx=0x7f0e34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.157+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e300eb970 con 0x7f0e400bd690 2023-12-04T05:39:07.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.341+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0e401550b0 con 0x7f0e400bd690 2023-12-04T05:39:07.347 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:39:07.341+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:39:07.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e277fe640 1 -- 172.21.15.97:0/3956952461 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0e300eef90 con 0x7f0e400bd690 2023-12-04T05:39:07.349 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:39:07.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 msgr2=0x7f0e2c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 0x7f0e2c068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0e400af8a0 tx=0x7f0e34008040 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 msgr2=0x7f0e401edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0e30019f90 tx=0x7f0e3001aba0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 shutdown_connections 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0e2c0668d0 0x7f0e2c068d90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0e40151df0 0x7f0e4014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0e400c8050 0x7f0e400c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 --2- 172.21.15.97:0/3956952461 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e400bd690 0x7f0e401edce0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 >> 172.21.15.97:0/3956952461 conn(0x7f0e40073950 msgr2=0x7f0e400a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:07.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.345+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 shutdown_connections 2023-12-04T05:39:07.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.349+0000 7f0e45046640 1 -- 172.21.15.97:0/3956952461 wait complete. 2023-12-04T05:39:07.358 INFO:tasks.ceph.mds.a.smithi097.stderr: -2735> 2023-12-04T05:38:33.305+0000 7f62d7463640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:39:07.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-04T05:39:07.405 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:39:07.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 Processor -- start 2023-12-04T05:39:07.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 -- start start 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffb7c071e50 0x7ffb7c0c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c3e90 0x7ffb7c153900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c0c6160 con 0x7ffb7c0c0b70 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c5550 con 0x7ffb7c071e50 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb8131e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c5830 con 0x7ffb7c0c3e90 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb7bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ffb7c0c0b70 0x7ffb7c0c2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42896/0 (socket says 172.21.15.97:42896) 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb7bfff640 1 -- 172.21.15.97:0/1856071633 learned_addr learned my addr 172.21.15.97:0/1856071633 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/1856071633 >> v2:172.21.15.143:3300/0 conn(0x7ffb7c071e50 0x7ffb7c0c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.509+0000 7ffb80b1d640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c3e90 0x7ffb7c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7affd640 1 -- 172.21.15.97:0/1856071633 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560902209 0 0) 0x7ffb7c0c6160 con 0x7ffb7c0c0b70 2023-12-04T05:39:07.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7affd640 1 -- 172.21.15.97:0/1856071633 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb64003530 con 0x7ffb7c0c0b70 2023-12-04T05:39:07.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7b7fe640 1 -- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c3e90 msgr2=0x7ffb7c153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:07.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c3e90 0x7ffb7c153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7b7fe640 1 -- 172.21.15.97:0/1856071633 >> v1:172.21.15.97:6789/0 conn(0x7ffb7c0c0b70 legacy=0x7ffb7c0c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7b7fe640 1 -- 172.21.15.97:0/1856071633 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c0c5b10 con 0x7ffb7c071e50 2023-12-04T05:39:07.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c071e50 0x7ffb7c0c3950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb700097c0 tx=0x7ffb7001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbea4193b1487eba server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7affd640 1 -- 172.21.15.97:0/1856071633 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb700ab600 con 0x7ffb7c071e50 2023-12-04T05:39:07.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7affd640 1 -- 172.21.15.97:0/1856071633 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb700a7050 con 0x7ffb7c071e50 2023-12-04T05:39:07.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.513+0000 7ffb7affd640 1 -- 172.21.15.97:0/1856071633 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb700ab980 con 0x7ffb7c071e50 2023-12-04T05:39:07.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c071e50 msgr2=0x7ffb7c0c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c071e50 0x7ffb7c0c3950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb700097c0 tx=0x7ffb7001c3c0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- 172.21.15.97:0/1856071633 shutdown_connections 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c3e90 0x7ffb7c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- 172.21.15.97:0/1856071633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c071e50 0x7ffb7c0c3950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- 172.21.15.97:0/1856071633 >> 172.21.15.97:0/1856071633 conn(0x7ffb7c06a5f0 msgr2=0x7ffb7c06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- 172.21.15.97:0/1856071633 shutdown_connections 2023-12-04T05:39:07.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- 172.21.15.97:0/1856071633 wait complete. 2023-12-04T05:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 Processor -- start 2023-12-04T05:39:07.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- start start 2023-12-04T05:39:07.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c0b70 0x7ffb7c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c0c3e90 0x7ffb7c1ece70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0a6da0 con 0x7ffb7c071e50 2023-12-04T05:39:07.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0a69f0 con 0x7ffb7c0c3e90 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb8131e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1f0f80 con 0x7ffb7c0c0b70 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33752/0 (socket says 172.21.15.97:33752) 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 -- 172.21.15.97:0/616261547 learned_addr learned my addr 172.21.15.97:0/616261547 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c0b70 0x7ffb7c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb80b1d640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c0c3e90 0x7ffb7c1ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 -- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c0b70 msgr2=0x7ffb7c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c0b70 0x7ffb7c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 -- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c0c3e90 msgr2=0x7ffb7c1ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c0c3e90 0x7ffb7c1ece70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.517+0000 7ffb7bfff640 1 -- 172.21.15.97:0/616261547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009420 con 0x7ffb7c071e50 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb7bfff640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00c4d0 tx=0x7ffb6c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005cf0 con 0x7ffb7c071e50 2023-12-04T05:39:07.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c005e50 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c007270 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c070630 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c070bf0 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c0c1b90 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb6c0073d0 con 0x7ffb7c071e50 2023-12-04T05:39:07.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 0x7ffb68068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7ffb6c083cb0 con 0x7ffb7c071e50 2023-12-04T05:39:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.521+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 0x7ffb68068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.525+0000 7ffb7b7fe640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 0x7ffb68068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffb700ad000 tx=0x7ffb70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:07.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.525+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb6c050c80 con 0x7ffb7c071e50 2023-12-04T05:39:07.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:07.709+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffb7c04e890 con 0x7ffb7c071e50 2023-12-04T05:39:08.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.345+0000 7ffb78ff9640 1 -- 172.21.15.97:0/616261547 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffb6c0170a0 con 0x7ffb7c071e50 2023-12-04T05:39:08.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 msgr2=0x7ffb68068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 0x7ffb68068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffb700ad000 tx=0x7ffb70008040 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 msgr2=0x7ffb7c149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00c4d0 tx=0x7ffb6c00c990 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 shutdown_connections 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ffb680668d0 0x7ffb68068d90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb7c0c3e90 0x7ffb7c1ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb7c0c0b70 0x7ffb7c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 --2- 172.21.15.97:0/616261547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ffb7c071e50 0x7ffb7c149a20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 >> 172.21.15.97:0/616261547 conn(0x7ffb7c06a5f0 msgr2=0x7ffb7c0aa340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 shutdown_connections 2023-12-04T05:39:08.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.349+0000 7ffb8131e640 1 -- 172.21.15.97:0/616261547 wait complete. 2023-12-04T05:39:08.375 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-04T05:39:08.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 Processor -- start 2023-12-04T05:39:08.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 -- start start 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c341582a0 0x7f9c34158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340c6bc0 con 0x7f9c34155a70 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c34157b70 con 0x7f9c341582a0 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c38c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c6ea0 con 0x7f9c340af470 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c33fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9c341582a0 0x7f9c34158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c32ffd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9c34155a70 0x7f9c34154fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42910/0 (socket says 172.21.15.97:42910) 2023-12-04T05:39:08.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c32ffd640 1 -- 172.21.15.97:0/1880584633 learned_addr learned my addr 172.21.15.97:0/1880584633 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c337fe640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c327fc640 1 -- 172.21.15.97:0/1880584633 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406556272 0 0) 0x7f9c340c6bc0 con 0x7f9c34155a70 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c33fff640 1 -- 172.21.15.97:0/1880584633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 msgr2=0x7f9c340c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c33fff640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c33fff640 1 -- 172.21.15.97:0/1880584633 >> v1:172.21.15.97:6789/0 conn(0x7f9c34155a70 legacy=0x7f9c34154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c33fff640 1 -- 172.21.15.97:0/1880584633 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340c7180 con 0x7f9c341582a0 2023-12-04T05:39:08.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.553+0000 7f9c337fe640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:08.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c33fff640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c34158730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009d90 tx=0x7f9c2c01d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c1143659292726 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:08.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c327fc640 1 -- 172.21.15.97:0/1880584633 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0a5770 con 0x7f9c341582a0 2023-12-04T05:39:08.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c327fc640 1 -- 172.21.15.97:0/1880584633 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0a58d0 con 0x7f9c341582a0 2023-12-04T05:39:08.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c327fc640 1 -- 172.21.15.97:0/1880584633 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0a5c60 con 0x7f9c341582a0 2023-12-04T05:39:08.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 -- 172.21.15.97:0/1880584633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 msgr2=0x7f9c34158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c34158730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009d90 tx=0x7f9c2c01d2f0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 -- 172.21.15.97:0/1880584633 shutdown_connections 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c34158730 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 --2- 172.21.15.97:0/1880584633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 -- 172.21.15.97:0/1880584633 >> 172.21.15.97:0/1880584633 conn(0x7f9c340ab9a0 msgr2=0x7f9c340abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:08.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 -- 172.21.15.97:0/1880584633 shutdown_connections 2023-12-04T05:39:08.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 -- 172.21.15.97:0/1880584633 wait complete. 2023-12-04T05:39:08.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.557+0000 7f9c38c17640 1 Processor -- start 2023-12-04T05:39:08.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- start start 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c34155a70 0x7f9c341f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c3fb0 con 0x7f9c341582a0 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34147960 con 0x7f9c34155a70 2023-12-04T05:39:08.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34147c40 con 0x7f9c340af470 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33776/0 (socket says 172.21.15.97:33776) 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 -- 172.21.15.97:0/2097962890 learned_addr learned my addr 172.21.15.97:0/2097962890 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c32ffd640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c34155a70 0x7f9c341f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c337fe640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 -- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 msgr2=0x7f9c340c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 -- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c34155a70 msgr2=0x7f9c341f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c34155a70 0x7f9c341f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 -- 172.21.15.97:0/2097962890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009a70 con 0x7f9c341582a0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c337fe640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c33fff640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01a4c0 tx=0x7f9c2c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0ad650 con 0x7f9c341582a0 2023-12-04T05:39:08.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0ad7b0 con 0x7f9c341582a0 2023-12-04T05:39:08.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c0adba0 con 0x7f9c341582a0 2023-12-04T05:39:08.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c34147f20 con 0x7f9c341582a0 2023-12-04T05:39:08.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c340c3240 con 0x7f9c341582a0 2023-12-04T05:39:08.568 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.561+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3404e890 con 0x7f9c341582a0 2023-12-04T05:39:08.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.565+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c2c0b4040 con 0x7f9c341582a0 2023-12-04T05:39:08.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.565+0000 7f9c1bfff640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 0x7f9c20068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:08.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.565+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f9c2c11ec30 con 0x7f9c341582a0 2023-12-04T05:39:08.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.565+0000 7f9c337fe640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 0x7f9c20068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:08.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.565+0000 7f9c337fe640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 0x7f9c20068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9c341459d0 tx=0x7f9c24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:08.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.569+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c2c0ebab0 con 0x7f9c341582a0 2023-12-04T05:39:08.725 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:08.721+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9c341f06a0 con 0x7f9c341582a0 2023-12-04T05:39:09.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.349+0000 7f9c1bfff640 1 -- 172.21.15.97:0/2097962890 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9c2c0ef0d0 con 0x7f9c341582a0 2023-12-04T05:39:09.353 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-12-04T05:39:09.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.349+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 msgr2=0x7f9c20068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.349+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 0x7f9c20068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9c341459d0 tx=0x7f9c24008040 comp rx=0 tx=0).stop 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.349+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 msgr2=0x7f9c341f0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.349+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c01a4c0 tx=0x7f9c2c019630 comp rx=0 tx=0).stop 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 shutdown_connections 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9c20066900 0x7f9c20068dc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c341582a0 0x7f9c341f0f30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c34155a70 0x7f9c341f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 --2- 172.21.15.97:0/2097962890 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c340af470 0x7f9c340c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 >> 172.21.15.97:0/2097962890 conn(0x7f9c340ab9a0 msgr2=0x7f9c34156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:09.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 shutdown_connections 2023-12-04T05:39:09.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.353+0000 7f9c38c17640 1 -- 172.21.15.97:0/2097962890 wait complete. 2023-12-04T05:39:09.383 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-04T05:39:09.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 Processor -- start 2023-12-04T05:39:09.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 -- start start 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 0x7f8470152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847014feb0 con 0x7f84700c3570 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700a92e0 con 0x7f847014fad0 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f8478232640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84701533f0 con 0x7f84700a8e70 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f84757cd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f84700c3570 0x7f84701527a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42912/0 (socket says 172.21.15.97:42912) 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.521+0000 7f84757cd640 1 -- 172.21.15.97:0/2016773922 learned_addr learned my addr 172.21.15.97:0/2016773922 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:09.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f84767cf640 1 --2- 172.21.15.97:0/2016773922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 0x7f8470152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086513672 0 0) 0x7f847014feb0 con 0x7f84700c3570 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845c003530 con 0x7f84700c3570 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114402123 0 0) 0x7f84700a92e0 con 0x7f847014fad0 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847014feb0 con 0x7f847014fad0 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2887552820 0 0) 0x7f845c003530 con 0x7f84700c3570 2023-12-04T05:39:09.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f84767cf640 1 -- 172.21.15.97:0/2016773922 >> v1:172.21.15.143:6789/0 conn(0x7f847014fad0 legacy=0x7f84700c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f84767cf640 1 -- 172.21.15.97:0/2016773922 >> v1:172.21.15.97:6789/0 conn(0x7f84700c3570 legacy=0x7f84701527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f84767cf640 1 -- 172.21.15.97:0/2016773922 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847006d560 con 0x7f84700a8e70 2023-12-04T05:39:09.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f84767cf640 1 --2- 172.21.15.97:0/2016773922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 0x7f8470152eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8468009dc0 tx=0x7f846801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb527517d7c3ee46 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:09.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600016a0 con 0x7f84700a8e70 2023-12-04T05:39:09.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84680a55c0 con 0x7f84700a8e70 2023-12-04T05:39:09.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.525+0000 7f8474fcc640 1 -- 172.21.15.97:0/2016773922 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a5930 con 0x7f84700a8e70 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- 172.21.15.97:0/2016773922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 msgr2=0x7f8470152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 --2- 172.21.15.97:0/2016773922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 0x7f8470152eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8468009dc0 tx=0x7f846801c890 comp rx=0 tx=0).stop 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- 172.21.15.97:0/2016773922 shutdown_connections 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 --2- 172.21.15.97:0/2016773922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700a8e70 0x7f8470152eb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- 172.21.15.97:0/2016773922 >> 172.21.15.97:0/2016773922 conn(0x7f84700c2a50 msgr2=0x7f84700c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- 172.21.15.97:0/2016773922 shutdown_connections 2023-12-04T05:39:09.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- 172.21.15.97:0/2016773922 wait complete. 2023-12-04T05:39:09.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 Processor -- start 2023-12-04T05:39:09.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- start start 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84700a8e70 0x7f847014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700c3570 0x7f84701517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470144a70 con 0x7f847014fad0 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701406a0 con 0x7f84700a8e70 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8478232640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84701edb50 con 0x7f84700c3570 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f8475fce640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84700a8e70 0x7f847014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33778/0 (socket says 172.21.15.97:33778) 2023-12-04T05:39:09.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 -- 172.21.15.97:0/1226852235 learned_addr learned my addr 172.21.15.97:0/1226852235 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84757cd640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700c3570 0x7f84701517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 -- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700c3570 msgr2=0x7f84701517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700c3570 0x7f84701517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 -- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84700a8e70 msgr2=0x7f847014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84700a8e70 0x7f847014c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.529+0000 7f84767cf640 1 -- 172.21.15.97:0/1226852235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009a70 con 0x7f847014fad0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84767cf640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f846801a4c0 tx=0x7f8468019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680bd070 con 0x7f847014fad0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468009450 con 0x7f847014fad0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84700c3b40 con 0x7f847014fad0 2023-12-04T05:39:09.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680ad870 con 0x7f847014fad0 2023-12-04T05:39:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84700c5050 con 0x7f847014fad0 2023-12-04T05:39:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8470068440 con 0x7f847014fad0 2023-12-04T05:39:09.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84680b4070 con 0x7f847014fad0 2023-12-04T05:39:09.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 0x7f8454068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:09.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.533+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f846811e820 con 0x7f847014fad0 2023-12-04T05:39:09.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.537+0000 7f8475fce640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 0x7f8454068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:09.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.537+0000 7f8475fce640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 0x7f8454068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f846c001720 tx=0x7f846c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:09.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.537+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84680eb870 con 0x7f847014fad0 2023-12-04T05:39:09.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:09.701+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84700725d0 con 0x7f847014fad0 2023-12-04T05:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.349+0000 7f84667fc640 1 -- 172.21.15.97:0/1226852235 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f84680eee90 con 0x7f847014fad0 2023-12-04T05:39:10.355 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 msgr2=0x7f8454068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 0x7f8454068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f846c001720 tx=0x7f846c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 msgr2=0x7f84700c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f846801a4c0 tx=0x7f8468019630 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 shutdown_connections 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84540668d0 0x7f8454068d90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f847014fad0 0x7f84700c4040 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84700c3570 0x7f84701517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 --2- 172.21.15.97:0/1226852235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84700a8e70 0x7f847014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 >> 172.21.15.97:0/1226852235 conn(0x7f84700c2a50 msgr2=0x7f8470145c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:10.358 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 shutdown_connections 2023-12-04T05:39:10.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.353+0000 7f8478232640 1 -- 172.21.15.97:0/1226852235 wait complete. 2023-12-04T05:39:10.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:10.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 Processor -- start 2023-12-04T05:39:10.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 -- start start 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 0x7f355c06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f355c0c7d90 0x7f355c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c154680 con 0x7f355c0af630 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c0afa10 con 0x7f355c0c7d90 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f35615f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c154960 con 0x7f355c0c72b0 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f355c0c7d90 0x7f355c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f355c0c7d90 0x7f355c06b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33794/0 (socket says 172.21.15.97:33794) 2023-12-04T05:39:10.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 -- 172.21.15.97:0/1433371831 learned_addr learned my addr 172.21.15.97:0/1433371831 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 -- 172.21.15.97:0/1433371831 >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 msgr2=0x7f355c06b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f355b7fe640 1 --2- 172.21.15.97:0/1433371831 >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 0x7f355c06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 --2- 172.21.15.97:0/1433371831 >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 0x7f355c06b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 -- 172.21.15.97:0/1433371831 >> v1:172.21.15.97:6789/0 conn(0x7f355c0af630 legacy=0x7f355c0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f355affd640 1 -- 172.21.15.97:0/1433371831 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975554527 0 0) 0x7f355c154680 con 0x7f355c0af630 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f3560df7640 1 -- 172.21.15.97:0/1433371831 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c154c40 con 0x7f355c0c7d90 2023-12-04T05:39:10.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.521+0000 7f355b7fe640 1 --2- 172.21.15.97:0/1433371831 >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 0x7f355c06b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:10.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f3560df7640 1 --2- 172.21.15.97:0/1433371831 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c7d90 0x7f355c06b810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f355c0acb00 tx=0x7f355401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d86df5f8d4d1ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f355affd640 1 -- 172.21.15.97:0/1433371831 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540a56a0 con 0x7f355c0c7d90 2023-12-04T05:39:10.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f355affd640 1 -- 172.21.15.97:0/1433371831 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35540a5800 con 0x7f355c0c7d90 2023-12-04T05:39:10.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f355affd640 1 -- 172.21.15.97:0/1433371831 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540a5b90 con 0x7f355c0c7d90 2023-12-04T05:39:10.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- 172.21.15.97:0/1433371831 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c7d90 msgr2=0x7f355c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 --2- 172.21.15.97:0/1433371831 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c7d90 0x7f355c06b810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f355c0acb00 tx=0x7f355401c8b0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- 172.21.15.97:0/1433371831 shutdown_connections 2023-12-04T05:39:10.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 --2- 172.21.15.97:0/1433371831 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c7d90 0x7f355c06b810 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 --2- 172.21.15.97:0/1433371831 >> v2:172.21.15.143:3300/0 conn(0x7f355c0c72b0 0x7f355c06b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- 172.21.15.97:0/1433371831 >> 172.21.15.97:0/1433371831 conn(0x7f355c0aba40 msgr2=0x7f355c0abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:10.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- 172.21.15.97:0/1433371831 shutdown_connections 2023-12-04T05:39:10.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- 172.21.15.97:0/1433371831 wait complete. 2023-12-04T05:39:10.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 Processor -- start 2023-12-04T05:39:10.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.525+0000 7f35615f8640 1 -- start start 2023-12-04T05:39:10.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f355c0af630 0x7f355c1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 0x7f355c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1ecf20 con 0x7f355c0c72b0 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1ee390 con 0x7f355c0c7d90 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c156120 con 0x7f355c0af630 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33810/0 (socket says 172.21.15.97:33810) 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 -- 172.21.15.97:0/3981348535 learned_addr learned my addr 172.21.15.97:0/3981348535 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3560df7640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 0x7f355c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 -- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f355c0af630 msgr2=0x7f355c1efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f355c0af630 0x7f355c1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 -- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 msgr2=0x7f355c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 0x7f355c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 -- 172.21.15.97:0/3981348535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009b30 con 0x7f355c0c72b0 2023-12-04T05:39:10.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3560df7640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 0x7f355c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f355b7fe640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7f0 tx=0x7f355000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550004220 con 0x7f355c0c72b0 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550004380 con 0x7f355c0c72b0 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550003840 con 0x7f355c0c72b0 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c0adad0 con 0x7f355c0c72b0 2023-12-04T05:39:10.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c0ae090 con 0x7f355c0c72b0 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c0afd70 con 0x7f355c0c72b0 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.529+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3550003bb0 con 0x7f355c0c72b0 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.533+0000 7f3558ff9640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 0x7f3548068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.533+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f35500843c0 con 0x7f355c0c72b0 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.533+0000 7f355bfff640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 0x7f3548068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.533+0000 7f355bfff640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 0x7f3548068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f354c007fd0 tx=0x7f354c007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.537+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3550051590 con 0x7f355c0c72b0 2023-12-04T05:39:10.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f355c04e890 con 0x7f355c0c72b0 2023-12-04T05:39:10.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f3558ff9640 1 -- 172.21.15.97:0/3981348535 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f3550003e60 con 0x7f355c0c72b0 2023-12-04T05:39:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:10.706 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":57,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:10.353225+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/3150893568":"2023-12-05T05:39:07.346885+0000","172.21.15.97:6836/3150893568":"2023-12-05T05:39:07.346885+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:10.708 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 msgr2=0x7f3548068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 0x7f3548068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f354c007fd0 tx=0x7f354c007940 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 msgr2=0x7f355c0c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.701+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7f0 tx=0x7f355000ccb0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 shutdown_connections 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f35480668d0 0x7f3548068d90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f355c0c7d90 0x7f355c0c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f355c0c72b0 0x7f355c0c3520 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 --2- 172.21.15.97:0/3981348535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f355c0af630 0x7f355c1efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 >> 172.21.15.97:0/3981348535 conn(0x7f355c0aba40 msgr2=0x7f355c15e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 shutdown_connections 2023-12-04T05:39:10.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.705+0000 7f35615f8640 1 -- 172.21.15.97:0/3981348535 wait complete. 2023-12-04T05:39:10.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:38:44.148875+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:38:45.405294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:10.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:10.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 Processor -- start 2023-12-04T05:39:10.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 -- start start 2023-12-04T05:39:10.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde44151ec0 0x7fde440c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 0x7fde441580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde44155320 con 0x7fde440c4e00 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4406c840 con 0x7fde44151ec0 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde48fd1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde440c5600 con 0x7fde44157c50 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde44151ec0 0x7fde440c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fde44151ec0 0x7fde440c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33818/0 (socket says 172.21.15.97:33818) 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 -- 172.21.15.97:0/2525423152 learned_addr learned my addr 172.21.15.97:0/2525423152 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 -- 172.21.15.97:0/2525423152 >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 msgr2=0x7fde441580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde42d9d640 1 --2- 172.21.15.97:0/2525423152 >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 0x7fde441580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 --2- 172.21.15.97:0/2525423152 >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 0x7fde441580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 -- 172.21.15.97:0/2525423152 >> v1:172.21.15.143:6789/0 conn(0x7fde440c4e00 legacy=0x7fde440c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde4259c640 1 -- 172.21.15.97:0/2525423152 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde441549f0 con 0x7fde44151ec0 2023-12-04T05:39:10.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.865+0000 7fde42d9d640 1 --2- 172.21.15.97:0/2525423152 >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 0x7fde441580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:10.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde4259c640 1 --2- 172.21.15.97:0/2525423152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde44151ec0 0x7fde440c48c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde440c41f0 tx=0x7fde3401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633d89f0ad619f0f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde4159a640 1 -- 172.21.15.97:0/2525423152 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde340ab600 con 0x7fde44151ec0 2023-12-04T05:39:10.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde4159a640 1 -- 172.21.15.97:0/2525423152 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde340ab760 con 0x7fde44151ec0 2023-12-04T05:39:10.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde4159a640 1 -- 172.21.15.97:0/2525423152 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde340abaf0 con 0x7fde44151ec0 2023-12-04T05:39:10.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 -- 172.21.15.97:0/2525423152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde44151ec0 msgr2=0x7fde440c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2525423152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde44151ec0 0x7fde440c48c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde440c41f0 tx=0x7fde3401c400 comp rx=0 tx=0).stop 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 -- 172.21.15.97:0/2525423152 shutdown_connections 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2525423152 >> v2:172.21.15.143:3300/0 conn(0x7fde44157c50 0x7fde441580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2525423152 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde44151ec0 0x7fde440c48c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 -- 172.21.15.97:0/2525423152 >> 172.21.15.97:0/2525423152 conn(0x7fde44073720 msgr2=0x7fde44073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 -- 172.21.15.97:0/2525423152 shutdown_connections 2023-12-04T05:39:10.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.869+0000 7fde48fd1640 1 -- 172.21.15.97:0/2525423152 wait complete. 2023-12-04T05:39:10.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 Processor -- start 2023-12-04T05:39:10.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- start start 2023-12-04T05:39:10.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde44151ec0 0x7fde44146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde44157c50 0x7fde441411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde441491d0 con 0x7fde440c4e00 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44143b00 con 0x7fde44157c50 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440a9e10 con 0x7fde44151ec0 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33828/0 (socket says 172.21.15.97:33828) 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 -- 172.21.15.97:0/2387307201 learned_addr learned my addr 172.21.15.97:0/2387307201 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde42d9d640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde44157c50 0x7fde441411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde41d9b640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde44151ec0 0x7fde44146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 -- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde44151ec0 msgr2=0x7fde44146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde44151ec0 0x7fde44146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 -- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde44157c50 msgr2=0x7fde441411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde44157c50 0x7fde441411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 -- 172.21.15.97:0/2387307201 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340094d0 con 0x7fde440c4e00 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde4259c640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fde3401c8e0 tx=0x7fde3401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde340b4800 con 0x7fde440c4e00 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde340b4980 con 0x7fde440c4e00 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde340b4d30 con 0x7fde440c4e00 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde440c86d0 con 0x7fde440c4e00 2023-12-04T05:39:10.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.873+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440ac920 con 0x7fde440c4e00 2023-12-04T05:39:10.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde44068440 con 0x7fde440c4e00 2023-12-04T05:39:10.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fde340c7440 con 0x7fde440c4e00 2023-12-04T05:39:10.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde32ffd640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 0x7fde24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:10.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fde3411eff0 con 0x7fde440c4e00 2023-12-04T05:39:10.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde41d9b640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 0x7fde24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:10.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.877+0000 7fde41d9b640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 0x7fde24068d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fde4415ef90 tx=0x7fde38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:10.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:10.881+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde34150280 con 0x7fde440c4e00 2023-12-04T05:39:11.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde4406c980 con 0x7fde440c4e00 2023-12-04T05:39:11.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde32ffd640 1 -- 172.21.15.97:0/2387307201 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde340ec200 con 0x7fde440c4e00 2023-12-04T05:39:11.042 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 msgr2=0x7fde24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 0x7fde24068d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fde4415ef90 tx=0x7fde38009040 comp rx=0 tx=0).stop 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 msgr2=0x7fde44143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fde3401c8e0 tx=0x7fde3401ac40 comp rx=0 tx=0).stop 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 shutdown_connections 2023-12-04T05:39:11.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.037+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fde240668d0 0x7fde24068d90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde44157c50 0x7fde441411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde44151ec0 0x7fde44146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 --2- 172.21.15.97:0/2387307201 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fde440c4e00 0x7fde44143400 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 >> 172.21.15.97:0/2387307201 conn(0x7fde44073720 msgr2=0x7fde440c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 shutdown_connections 2023-12-04T05:39:11.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.041+0000 7fde48fd1640 1 -- 172.21.15.97:0/2387307201 wait complete. 2023-12-04T05:39:11.065 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:11.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 Processor -- start 2023-12-04T05:39:11.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 -- start start 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c000 0x7f0b680700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b68154af0 0x7f0b680c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b68150bc0 con 0x7f0b6806c430 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680c0f80 con 0x7f0b68154af0 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6cd65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68154fd0 con 0x7f0b6806c000 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b68154af0 0x7f0b680c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0b68154af0 0x7f0b680c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33842/0 (socket says 172.21.15.97:33842) 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 -- 172.21.15.97:0/189936232 learned_addr learned my addr 172.21.15.97:0/189936232 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b6659c640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c000 0x7f0b680700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 -- 172.21.15.97:0/189936232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c000 msgr2=0x7f0b680700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c000 0x7f0b680700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 -- 172.21.15.97:0/189936232 >> v1:172.21.15.143:6789/0 conn(0x7f0b6806c430 legacy=0x7f0b680c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.201+0000 7f0b65d9b640 1 -- 172.21.15.97:0/189936232 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68072160 con 0x7f0b68154af0 2023-12-04T05:39:11.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b65d9b640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b68154af0 0x7f0b680c1360 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00bb10 tx=0x7f0b5c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67582159f8c072f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6559a640 1 -- 172.21.15.97:0/189936232 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0a7ac0 con 0x7f0b68154af0 2023-12-04T05:39:11.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6559a640 1 -- 172.21.15.97:0/189936232 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c0a7c20 con 0x7f0b68154af0 2023-12-04T05:39:11.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6559a640 1 -- 172.21.15.97:0/189936232 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0af440 con 0x7f0b68154af0 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 -- 172.21.15.97:0/189936232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b68154af0 msgr2=0x7f0b680c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b68154af0 0x7f0b680c1360 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00bb10 tx=0x7f0b5c01eb40 comp rx=0 tx=0).stop 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 -- 172.21.15.97:0/189936232 shutdown_connections 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b68154af0 0x7f0b680c1360 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/189936232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c000 0x7f0b680700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 -- 172.21.15.97:0/189936232 >> 172.21.15.97:0/189936232 conn(0x7f0b680c5e70 msgr2=0x7f0b680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 -- 172.21.15.97:0/189936232 shutdown_connections 2023-12-04T05:39:11.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.205+0000 7f0b6cd65640 1 -- 172.21.15.97:0/189936232 wait complete. 2023-12-04T05:39:11.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 Processor -- start 2023-12-04T05:39:11.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- start start 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c430 0x7f0b6814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 0x7f0b681467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681eabf0 con 0x7f0b6806c000 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68150a40 con 0x7f0b68154af0 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68153870 con 0x7f0b6806c430 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33850/0 (socket says 172.21.15.97:33850) 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 -- 172.21.15.97:0/2096851745 learned_addr learned my addr 172.21.15.97:0/2096851745 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b65d9b640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c430 0x7f0b6814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 -- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c430 msgr2=0x7f0b6814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c430 0x7f0b6814ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 -- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 msgr2=0x7f0b681467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b66d9d640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 0x7f0b681467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 0x7f0b681467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 -- 172.21.15.97:0/2096851745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c00b770 con 0x7f0b6806c000 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b66d9d640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 0x7f0b681467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6659c640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800d830 tx=0x7f0b5800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800b6c0 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800b820 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800bb90 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b681edaf0 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.209+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b68150760 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b68068440 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0b5801e460 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b56ffd640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 0x7f0b48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0b58084d20 con 0x7f0b6806c000 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b65d9b640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 0x7f0b48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.213+0000 7f0b65d9b640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 0x7f0b48068d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b1000 tx=0x7f0b5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.217+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b58051e60 con 0x7f0b6806c000 2023-12-04T05:39:11.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.365+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b680c2430 con 0x7f0b6806c000 2023-12-04T05:39:11.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.365+0000 7f0b56ffd640 1 -- 172.21.15.97:0/2096851745 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0b58055480 con 0x7f0b6806c000 2023-12-04T05:39:11.372 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:11.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 msgr2=0x7f0b48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 0x7f0b48068d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b1000 tx=0x7f0b5c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 msgr2=0x7f0b681427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800d830 tx=0x7f0b5800dcf0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 shutdown_connections 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0b480668d0 0x7f0b48068d90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b68154af0 0x7f0b681467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b6806c430 0x7f0b6814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 --2- 172.21.15.97:0/2096851745 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0b6806c000 0x7f0b681427b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 >> 172.21.15.97:0/2096851745 conn(0x7f0b680c5e70 msgr2=0x7f0b68070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 shutdown_connections 2023-12-04T05:39:11.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.369+0000 7f0b6cd65640 1 -- 172.21.15.97:0/2096851745 wait complete. 2023-12-04T05:39:11.393 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:11.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 Processor -- start 2023-12-04T05:39:11.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 -- start start 2023-12-04T05:39:11.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fabec14eb30 0x7fabec14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec154640 con 0x7fabec154fe0 2023-12-04T05:39:11.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec14ef10 con 0x7fabec14f790 2023-12-04T05:39:11.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf3c5f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec0c0bd0 con 0x7fabec14eb30 2023-12-04T05:39:11.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf21fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fabec154fe0 0x7fabec15bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42918/0 (socket says 172.21.15.97:42918) 2023-12-04T05:39:11.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf21fc640 1 -- 172.21.15.97:0/3549277029 learned_addr learned my addr 172.21.15.97:0/3549277029 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212489379 0 0) 0x7fabec154640 con 0x7fabec154fe0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd8003530 con 0x7fabec154fe0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf19fb640 1 --2- 172.21.15.97:0/3549277029 >> v2:172.21.15.143:3300/0 conn(0x7fabec14eb30 0x7fabec14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2140072107 0 0) 0x7fabd8003530 con 0x7fabec154fe0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 >> v2:172.21.15.143:3300/0 conn(0x7fabec14eb30 msgr2=0x7fabec14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 --2- 172.21.15.97:0/3549277029 >> v2:172.21.15.143:3300/0 conn(0x7fabec14eb30 0x7fabec14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 >> v1:172.21.15.143:6789/0 conn(0x7fabec14f790 legacy=0x7fabec1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec1535a0 con 0x7fabec154fe0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fabe4001a00 con 0x7fabec154fe0 2023-12-04T05:39:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 >> v1:172.21.15.97:6789/0 conn(0x7fabec154fe0 legacy=0x7fabec15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd8003980 0x7fabd8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabd8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd8005190 0x7fabd800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0c0bd0 con 0x7fabd80047d0 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800c0e0 con 0x7fabd8005190 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800c2a0 con 0x7fabd8003980 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf11fa640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabd8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf19fb640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd8003980 0x7fabd8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.529+0000 7fabf21fc640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd8005190 0x7fabd800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 -- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd8003980 msgr2=0x7fabd8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabd8003980 0x7fabd8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 -- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd8005190 msgr2=0x7fabd800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabd8005190 0x7fabd800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 -- 172.21.15.97:0/3549277029 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8003530 con 0x7fabd80047d0 2023-12-04T05:39:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf21fc640 1 -- 172.21.15.97:0/3549277029 reap_dead start 2023-12-04T05:39:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf11fa640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabd8004c50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabdc001780 tx=0x7fabdc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae48638f6bfbdc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0a4ea0 con 0x7fabd80047d0 2023-12-04T05:39:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc0a7050 con 0x7fabd80047d0 2023-12-04T05:39:11.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf09f9640 1 -- 172.21.15.97:0/3549277029 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc003600 con 0x7fabd80047d0 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf3c5f640 1 -- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 msgr2=0x7fabd8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabd8004c50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabdc001780 tx=0x7fabdc01c3e0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf3c5f640 1 -- 172.21.15.97:0/3549277029 shutdown_connections 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/3549277029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabd8004c50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.533+0000 7fabf3c5f640 1 -- 172.21.15.97:0/3549277029 >> 172.21.15.97:0/3549277029 conn(0x7fabec0c5e70 msgr2=0x7fabec0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- 172.21.15.97:0/3549277029 shutdown_connections 2023-12-04T05:39:11.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- 172.21.15.97:0/3549277029 wait complete. 2023-12-04T05:39:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 Processor -- start 2023-12-04T05:39:11.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- start start 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ab010 0x7fabec0a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec0c3a60 0x7fabec145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec151ba0 con 0x7fabd80047d0 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec14a790 con 0x7fabec0ab010 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1eb270 con 0x7fabec0c3a60 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33856/0 (socket says 172.21.15.97:33856) 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 -- 172.21.15.97:0/2221687813 learned_addr learned my addr 172.21.15.97:0/2221687813 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf11fa640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ab010 0x7fabec0a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf21fc640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec0c3a60 0x7fabec145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 -- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec0c3a60 msgr2=0x7fabec145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec0c3a60 0x7fabec145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 -- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ab010 msgr2=0x7fabec0a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ab010 0x7fabec0a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 -- 172.21.15.97:0/2221687813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec1eb550 con 0x7fabd80047d0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf19fb640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b6f0 tx=0x7fabe800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8010830 con 0x7fabd80047d0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8010990 con 0x7fabd80047d0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.537+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec071c30 con 0x7fabd80047d0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8010d20 con 0x7fabd80047d0 2023-12-04T05:39:11.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec152030 con 0x7fabd80047d0 2023-12-04T05:39:11.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec153e00 con 0x7fabd80047d0 2023-12-04T05:39:11.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabe8014430 con 0x7fabd80047d0 2023-12-04T05:39:11.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabe27fc640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fabe8084920 con 0x7fabd80047d0 2023-12-04T05:39:11.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabf11fa640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.541+0000 7fabf11fa640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 0x7fabd0068dc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fabdc001750 tx=0x7fabdc0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.545+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabe8051bb0 con 0x7fabd80047d0 2023-12-04T05:39:11.701 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fabec068440 con 0x7fabd80047d0 2023-12-04T05:39:11.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabe27fc640 1 -- 172.21.15.97:0/2221687813 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7fabe80220a0 con 0x7fabd80047d0 2023-12-04T05:39:11.702 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 msgr2=0x7fabd0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 0x7fabd0068dc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fabdc001750 tx=0x7fabdc0011a0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 msgr2=0x7fabec0c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b6f0 tx=0x7fabe800bbb0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 shutdown_connections 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabd0066900 0x7fabd0068dc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec0c3a60 0x7fabec145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0ab010 0x7fabec0a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 --2- 172.21.15.97:0/2221687813 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabd80047d0 0x7fabec0c1360 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 >> 172.21.15.97:0/2221687813 conn(0x7fabec0c5e70 msgr2=0x7fabec0bfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 shutdown_connections 2023-12-04T05:39:11.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.697+0000 7fabf3c5f640 1 -- 172.21.15.97:0/2221687813 wait complete. 2023-12-04T05:39:11.723 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:11.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 Processor -- start 2023-12-04T05:39:11.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 -- start start 2023-12-04T05:39:11.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e2014e970 0x7f9e2006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 0x7f9e200c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e20152300 con 0x7f9e2006be00 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e20071580 con 0x7f9e2014e970 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e26f65640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2014ed50 con 0x7f9e2006ca50 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e24d01640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e2014e970 0x7f9e2006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e17fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9e2006be00 0x7f9e20071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42922/0 (socket says 172.21.15.97:42922) 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e17fff640 1 -- 172.21.15.97:0/188415595 learned_addr learned my addr 172.21.15.97:0/188415595 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e25502640 1 --2- 172.21.15.97:0/188415595 >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 0x7f9e200c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e24d01640 1 -- 172.21.15.97:0/188415595 >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 msgr2=0x7f9e200c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e24d01640 1 --2- 172.21.15.97:0/188415595 >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 0x7f9e200c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e24d01640 1 -- 172.21.15.97:0/188415595 >> v1:172.21.15.97:6789/0 conn(0x7f9e2006be00 legacy=0x7f9e20071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e24d01640 1 -- 172.21.15.97:0/188415595 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20151d60 con 0x7f9e2014e970 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e25502640 1 --2- 172.21.15.97:0/188415595 >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 0x7f9e200c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:11.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.857+0000 7f9e177fe640 1 -- 172.21.15.97:0/188415595 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023216909 0 0) 0x7f9e10001120 con 0x7f9e2006be00 2023-12-04T05:39:11.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e24d01640 1 --2- 172.21.15.97:0/188415595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2014e970 0x7f9e2006e150 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9e2006fef0 tx=0x7f9e1c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe480b575ea4e4c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e177fe640 1 -- 172.21.15.97:0/188415595 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0ac630 con 0x7f9e2014e970 2023-12-04T05:39:11.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e177fe640 1 -- 172.21.15.97:0/188415595 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c0ac790 con 0x7f9e2014e970 2023-12-04T05:39:11.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e177fe640 1 -- 172.21.15.97:0/188415595 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0acb20 con 0x7f9e2014e970 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 -- 172.21.15.97:0/188415595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2014e970 msgr2=0x7f9e2006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 --2- 172.21.15.97:0/188415595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2014e970 0x7f9e2006e150 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9e2006fef0 tx=0x7f9e1c01c3d0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 -- 172.21.15.97:0/188415595 shutdown_connections 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 --2- 172.21.15.97:0/188415595 >> v2:172.21.15.143:3300/0 conn(0x7f9e2006ca50 0x7f9e200c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 --2- 172.21.15.97:0/188415595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2014e970 0x7f9e2006e150 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 -- 172.21.15.97:0/188415595 >> 172.21.15.97:0/188415595 conn(0x7f9e200c2970 msgr2=0x7f9e200c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 -- 172.21.15.97:0/188415595 shutdown_connections 2023-12-04T05:39:11.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.861+0000 7f9e26f65640 1 -- 172.21.15.97:0/188415595 wait complete. 2023-12-04T05:39:11.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 Processor -- start 2023-12-04T05:39:11.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- start start 2023-12-04T05:39:11.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e2006be00 0x7f9e20155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e2014e970 0x7f9e201ec690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201ecbd0 con 0x7f9e2006ca50 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2014a000 con 0x7f9e2014e970 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20156210 con 0x7f9e2006be00 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33870/0 (socket says 172.21.15.97:33870) 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 -- 172.21.15.97:0/3222842292 learned_addr learned my addr 172.21.15.97:0/3222842292 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e24d01640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e2006be00 0x7f9e20155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e25502640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e2014e970 0x7f9e201ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 -- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e2006be00 msgr2=0x7f9e20155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e2006be00 0x7f9e20155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 -- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e2014e970 msgr2=0x7f9e201ec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:11.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e2014e970 0x7f9e201ec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 -- 172.21.15.97:0/3222842292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c009420 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e17fff640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c480 tx=0x7f9e1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e100074e0 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10007660 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e201496d0 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10004a30 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20149c90 con 0x7f9e2006ca50 2023-12-04T05:39:11.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.865+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2014a170 con 0x7f9e2006ca50 2023-12-04T05:39:11.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.869+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e10004b90 con 0x7f9e2006ca50 2023-12-04T05:39:11.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.869+0000 7f9e157fa640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 0x7f9e0c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:11.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.869+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9e100837b0 con 0x7f9e2006ca50 2023-12-04T05:39:11.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.869+0000 7f9e24d01640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 0x7f9e0c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:11.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.869+0000 7f9e24d01640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 0x7f9e0c068d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0ae000 tx=0x7f9e1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:11.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:11.873+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e100544b0 con 0x7f9e2006ca50 2023-12-04T05:39:12.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e20152300 con 0x7f9e2006ca50 2023-12-04T05:39:12.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e157fa640 1 -- 172.21.15.97:0/3222842292 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f9e20152300 con 0x7f9e2006ca50 2023-12-04T05:39:12.057 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:12.057 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1960318847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1960318847},{"type":"v1","addr":"172.21.15.97:6837","nonce":1960318847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:12.057 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 39 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 msgr2=0x7f9e0c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 0x7f9e0c068d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0ae000 tx=0x7f9e1c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 msgr2=0x7f9e201ec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c480 tx=0x7f9e1000c940 comp rx=0 tx=0).stop 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 shutdown_connections 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e0c0668d0 0x7f9e0c068d90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e2014e970 0x7f9e201ec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e2006ca50 0x7f9e201ec150 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 --2- 172.21.15.97:0/3222842292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e2006be00 0x7f9e20155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 >> 172.21.15.97:0/3222842292 conn(0x7f9e200c2970 msgr2=0x7f9e20071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 shutdown_connections 2023-12-04T05:39:12.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.053+0000 7f9e26f65640 1 -- 172.21.15.97:0/3222842292 wait complete. 2023-12-04T05:39:12.078 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:12.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.209+0000 7fcb09c74640 1 Processor -- start 2023-12-04T05:39:12.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.209+0000 7fcb09c74640 1 -- start start 2023-12-04T05:39:12.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09c74640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb041532f0 0x7fcb040c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09c74640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb040c4810 con 0x7fcb04153e80 2023-12-04T05:39:12.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09c74640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb041536d0 con 0x7fcb0406d190 2023-12-04T05:39:12.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09c74640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0406d640 con 0x7fcb041532f0 2023-12-04T05:39:12.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09473640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcb04153e80 0x7fcb04154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42928/0 (socket says 172.21.15.97:42928) 2023-12-04T05:39:12.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09473640 1 -- 172.21.15.97:0/596990827 learned_addr learned my addr 172.21.15.97:0/596990827 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865729607 0 0) 0x7fcb040c4810 con 0x7fcb04153e80 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb08c72640 1 --2- 172.21.15.97:0/596990827 >> v2:172.21.15.143:3300/0 conn(0x7fcb041532f0 0x7fcb040c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf4003530 con 0x7fcb04153e80 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2080585350 0 0) 0x7fcaf4003530 con 0x7fcb04153e80 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 >> v2:172.21.15.143:3300/0 conn(0x7fcb041532f0 msgr2=0x7fcb040c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 --2- 172.21.15.97:0/596990827 >> v2:172.21.15.143:3300/0 conn(0x7fcb041532f0 0x7fcb040c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 >> v1:172.21.15.143:6789/0 conn(0x7fcb0406d190 legacy=0x7fcb040a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0406e300 con 0x7fcb04153e80 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fcafc001a00 con 0x7fcb04153e80 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 >> v1:172.21.15.97:6789/0 conn(0x7fcb04153e80 legacy=0x7fcb04154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4003980 0x7fcaf4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 0x7fcaf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaf40050f0 0x7fcaf400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406d640 con 0x7fcaf4004380 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf400c030 con 0x7fcaf4003980 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf400c1f0 con 0x7fcaf40050f0 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 0x7fcaf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb08c72640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4003980 0x7fcaf4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09473640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaf40050f0 0x7fcaf400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 -- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaf40050f0 msgr2=0x7fcaf400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaf40050f0 0x7fcaf400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 -- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4003980 msgr2=0x7fcaf4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4003980 0x7fcaf4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb03fff640 1 -- 172.21.15.97:0/596990827 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4003530 con 0x7fcaf4004380 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb08c72640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4003980 0x7fcaf4003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:12.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.213+0000 7fcb09473640 1 -- 172.21.15.97:0/596990827 reap_dead start 2023-12-04T05:39:12.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb03fff640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 0x7fcaf4004850 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0001860 tx=0x7fcaf001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef050d5ead5413f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00a8850 con 0x7fcaf4004380 2023-12-04T05:39:12.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf00a89b0 con 0x7fcaf4004380 2023-12-04T05:39:12.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb037fe640 1 -- 172.21.15.97:0/596990827 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00a8da0 con 0x7fcaf4004380 2023-12-04T05:39:12.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 msgr2=0x7fcaf4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 0x7fcaf4004850 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0001860 tx=0x7fcaf001ec30 comp rx=0 tx=0).stop 2023-12-04T05:39:12.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- 172.21.15.97:0/596990827 shutdown_connections 2023-12-04T05:39:12.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 --2- 172.21.15.97:0/596990827 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcaf4004380 0x7fcaf4004850 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- 172.21.15.97:0/596990827 >> 172.21.15.97:0/596990827 conn(0x7fcb040c5a50 msgr2=0x7fcb040c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- 172.21.15.97:0/596990827 shutdown_connections 2023-12-04T05:39:12.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- 172.21.15.97:0/596990827 wait complete. 2023-12-04T05:39:12.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 Processor -- start 2023-12-04T05:39:12.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.217+0000 7fcb09c74640 1 -- start start 2023-12-04T05:39:12.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4004380 0x7fcb04070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb040729d0 0x7fcb041dbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040c2b00 con 0x7fcb041ea0d0 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041ed870 con 0x7fcaf4004380 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041e98d0 con 0x7fcb040729d0 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33896/0 (socket says 172.21.15.97:33896) 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 -- 172.21.15.97:0/2423282847 learned_addr learned my addr 172.21.15.97:0/2423282847 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb08c72640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4004380 0x7fcb04070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb03fff640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb040729d0 0x7fcb041dbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 -- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb040729d0 msgr2=0x7fcb041dbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb040729d0 0x7fcb041dbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 -- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4004380 msgr2=0x7fcb04070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4004380 0x7fcb04070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 -- 172.21.15.97:0/2423282847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb041e9bb0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09473640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcb040ab1d0 tx=0x7fcafc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00eb90 con 0x7fcb041ea0d0 2023-12-04T05:39:12.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00ed10 con 0x7fcb041ea0d0 2023-12-04T05:39:12.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb041dc2e0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013660 con 0x7fcb041ea0d0 2023-12-04T05:39:12.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb041edb50 con 0x7fcb041ea0d0 2023-12-04T05:39:12.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb041e9da0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.221+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcafc0137c0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.225+0000 7fcb017fa640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 0x7fcae8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.225+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcafc0848d0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.225+0000 7fcb08c72640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 0x7fcae8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.225+0000 7fcb08c72640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 0x7fcae8068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009b30 tx=0x7fcaf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.229+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcafc051aa0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb0404e890 con 0x7fcb041ea0d0 2023-12-04T05:39:12.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb017fa640 1 -- 172.21.15.97:0/2423282847 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16689 (secure 0 0 0) 0x7fcafc0550c0 con 0x7fcb041ea0d0 2023-12-04T05:39:12.390 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:12.390 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":57,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:10.353225+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/3150893568":"2023-12-05T05:39:07.346885+0000","172.21.15.97:6836/3150893568":"2023-12-05T05:39:07.346885+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:12.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 msgr2=0x7fcae8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 0x7fcae8068d90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009b30 tx=0x7fcaf8008040 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 msgr2=0x7fcb0414bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcb040ab1d0 tx=0x7fcafc00e530 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 shutdown_connections 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcae80668d0 0x7fcae8068d90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb041ea0d0 0x7fcb0414bb60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb040729d0 0x7fcb041dbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 --2- 172.21.15.97:0/2423282847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaf4004380 0x7fcb04070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 >> 172.21.15.97:0/2423282847 conn(0x7fcb040c5a50 msgr2=0x7fcb040c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.385+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 shutdown_connections 2023-12-04T05:39:12.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.389+0000 7fcb09c74640 1 -- 172.21.15.97:0/2423282847 wait complete. 2023-12-04T05:39:12.412 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-04T05:39:12.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:12.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 Processor -- start 2023-12-04T05:39:12.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 -- start start 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1414e970 0x7f6e1406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e1406be00 0x7f6e1406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e14152300 con 0x7f6e14071a10 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e14071580 con 0x7f6e1406be00 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e1a901640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1414ed50 con 0x7f6e1414e970 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e18e9e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6e14071a10 0x7f6e140c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42934/0 (socket says 172.21.15.97:42934) 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.545+0000 7f6e18e9e640 1 -- 172.21.15.97:0/3596268142 learned_addr learned my addr 172.21.15.97:0/3596268142 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e13fff640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1414e970 0x7f6e1406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 --2- 172.21.15.97:0/3596268142 >> v2:172.21.15.143:3300/0 conn(0x7f6e1406be00 0x7f6e1406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e12ffd640 1 -- 172.21.15.97:0/3596268142 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899086162 0 0) 0x7f6e0c0014a0 con 0x7f6e14071a10 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e12ffd640 1 -- 172.21.15.97:0/3596268142 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dfc005740 con 0x7f6e14071a10 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 -- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1414e970 msgr2=0x7f6e1406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1414e970 0x7f6e1406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 -- 172.21.15.97:0/3596268142 >> v1:172.21.15.97:6789/0 conn(0x7f6e14071a10 legacy=0x7f6e140c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 -- 172.21.15.97:0/3596268142 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14151d60 con 0x7f6e1406be00 2023-12-04T05:39:12.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e137fe640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1406ca50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e080097c0 tx=0x7f6e0801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c5d43e9ccca2b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e12ffd640 1 -- 172.21.15.97:0/3596268142 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080ab400 con 0x7f6e1406be00 2023-12-04T05:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e12ffd640 1 -- 172.21.15.97:0/3596268142 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e080a7050 con 0x7f6e1406be00 2023-12-04T05:39:12.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.549+0000 7f6e12ffd640 1 -- 172.21.15.97:0/3596268142 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080ab780 con 0x7f6e1406be00 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 msgr2=0x7f6e1406ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1406ca50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e080097c0 tx=0x7f6e0801c330 comp rx=0 tx=0).stop 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- 172.21.15.97:0/3596268142 shutdown_connections 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1406ca50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- 172.21.15.97:0/3596268142 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1414e970 0x7f6e1406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- 172.21.15.97:0/3596268142 >> 172.21.15.97:0/3596268142 conn(0x7f6e140c2970 msgr2=0x7f6e140c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- 172.21.15.97:0/3596268142 shutdown_connections 2023-12-04T05:39:12.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- 172.21.15.97:0/3596268142 wait complete. 2023-12-04T05:39:12.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 Processor -- start 2023-12-04T05:39:12.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- start start 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 0x7f6e1414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140c54b0 con 0x7f6e1414e970 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140c51f0 con 0x7f6e1406be00 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e1a901640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140aa3a0 con 0x7f6e14071a10 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e18e9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e18e9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33902/0 (socket says 172.21.15.97:33902) 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.553+0000 7f6e18e9e640 1 -- 172.21.15.97:0/2294327807 learned_addr learned my addr 172.21.15.97:0/2294327807 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e13fff640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e137fe640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 0x7f6e1414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 -- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 msgr2=0x7f6e1414fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 0x7f6e1414fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 -- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 msgr2=0x7f6e1414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 -- 172.21.15.97:0/2294327807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08009420 con 0x7f6e1414e970 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e13fff640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e137fe640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 0x7f6e1414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e18e9e640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00cae0 tx=0x7f6e0c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00ac40 con 0x7f6e1414e970 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c00ada0 con 0x7f6e1414e970 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e140aa960 con 0x7f6e1414e970 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c012620 con 0x7f6e1414e970 2023-12-04T05:39:12.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e140aae80 con 0x7f6e1414e970 2023-12-04T05:39:12.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e140aa7c0 con 0x7f6e1414e970 2023-12-04T05:39:12.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e0c007070 con 0x7f6e1414e970 2023-12-04T05:39:12.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 0x7f6e00068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6e0c0841f0 con 0x7f6e1414e970 2023-12-04T05:39:12.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.557+0000 7f6e13fff640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 0x7f6e00068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.561+0000 7f6e13fff640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 0x7f6e00068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009ae0 tx=0x7f6e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.561+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e140aa7c0 con 0x7f6e1414e970 2023-12-04T05:39:12.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.741+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e14152300 con 0x7f6e1414e970 2023-12-04T05:39:12.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.741+0000 7f6e10ff9640 1 -- 172.21.15.97:0/2294327807 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f6e14152300 con 0x7f6e1414e970 2023-12-04T05:39:12.747 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:12.747 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1960318847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1960318847},{"type":"v1","addr":"172.21.15.97:6837","nonce":1960318847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:12.747 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 39 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 msgr2=0x7f6e00068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 0x7f6e00068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009ae0 tx=0x7f6e04008040 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 msgr2=0x7f6e140c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00cae0 tx=0x7f6e0c00a060 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 shutdown_connections 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e000668d0 0x7f6e00068d90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1414e970 0x7f6e140c43b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e14071a10 0x7f6e1414fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 --2- 172.21.15.97:0/2294327807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1406be00 0x7f6e1414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 >> 172.21.15.97:0/2294327807 conn(0x7f6e140c2970 msgr2=0x7f6e1414cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 shutdown_connections 2023-12-04T05:39:12.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.745+0000 7f6e1a901640 1 -- 172.21.15.97:0/2294327807 wait complete. 2023-12-04T05:39:12.768 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:12.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 Processor -- start 2023-12-04T05:39:12.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 -- start start 2023-12-04T05:39:12.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3df00c1030 0x7f3df00c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3df0158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00739b0 con 0x7f3df006b860 2023-12-04T05:39:12.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00c15a0 con 0x7f3df00c1030 2023-12-04T05:39:12.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df67b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0155220 con 0x7f3df0157da0 2023-12-04T05:39:12.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3deffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3df006b860 0x7f3df0151b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42938/0 (socket says 172.21.15.97:42938) 2023-12-04T05:39:12.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3deffff640 1 -- 172.21.15.97:0/4145355260 learned_addr learned my addr 172.21.15.97:0/4145355260 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:12.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3df4d55640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3df0158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3def7fe640 1 --2- 172.21.15.97:0/4145355260 >> v2:172.21.15.143:3300/0 conn(0x7f3df00c1030 0x7f3df00c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460672124 0 0) 0x7f3df00739b0 con 0x7f3df006b860 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.901+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd8003530 con 0x7f3df006b860 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219419449 0 0) 0x7f3dd8003530 con 0x7f3df006b860 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 msgr2=0x7f3df0158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3df0158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 >> v2:172.21.15.143:3300/0 conn(0x7f3df00c1030 msgr2=0x7f3df00c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 --2- 172.21.15.97:0/4145355260 >> v2:172.21.15.143:3300/0 conn(0x7f3df00c1030 0x7f3df00c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0155710 con 0x7f3df006b860 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f3de0001680 con 0x7f3df006b860 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 >> v1:172.21.15.97:6789/0 conn(0x7f3df006b860 legacy=0x7f3df0151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3dd8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dd8003f00 0x7f3dd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8004d10 0x7f3dd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c15a0 con 0x7f3dd8003f00 2023-12-04T05:39:12.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0155220 con 0x7f3dd8004d10 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd800b9e0 con 0x7f3df0157da0 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dd8003f00 0x7f3dd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3deffff640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3dd8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3df4d55640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8004d10 0x7f3dd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 -- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 msgr2=0x7f3dd8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df0157da0 0x7f3dd8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 -- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8004d10 msgr2=0x7f3dd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8004d10 0x7f3dd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 -- 172.21.15.97:0/4145355260 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8003530 con 0x7f3dd8003f00 2023-12-04T05:39:12.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.905+0000 7f3def7fe640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dd8003f00 0x7f3dd80047d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009ae0 tx=0x7f3de401c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f33073581a82b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40aa420 con 0x7f3dd8003f00 2023-12-04T05:39:12.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de40aa580 con 0x7f3dd8003f00 2023-12-04T05:39:12.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3deeffd640 1 -- 172.21.15.97:0/4145355260 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40aa930 con 0x7f3dd8003f00 2023-12-04T05:39:12.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- 172.21.15.97:0/4145355260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dd8003f00 msgr2=0x7f3dd80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 --2- 172.21.15.97:0/4145355260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3dd8003f00 0x7f3dd80047d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009ae0 tx=0x7f3de401c790 comp rx=0 tx=0).stop 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df4d55640 1 -- 172.21.15.97:0/4145355260 reap_dead start 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- 172.21.15.97:0/4145355260 shutdown_connections 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- 172.21.15.97:0/4145355260 >> 172.21.15.97:0/4145355260 conn(0x7f3df00c3130 msgr2=0x7f3df00c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- 172.21.15.97:0/4145355260 shutdown_connections 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- 172.21.15.97:0/4145355260 wait complete. 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 Processor -- start 2023-12-04T05:39:12.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- start start 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 0x7f3df00c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 0x7f3df00717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df01ed430 con 0x7f3df01ecfb0 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df01f0520 con 0x7f3dd8003f00 2023-12-04T05:39:12.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df67b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00c5d20 con 0x7f3df01f11d0 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3def7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3def7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33916/0 (socket says 172.21.15.97:33916) 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3def7fe640 1 -- 172.21.15.97:0/3389501804 learned_addr learned my addr 172.21.15.97:0/3389501804 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3df4d55640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 0x7f3df00717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.909+0000 7f3deffff640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 0x7f3df00c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 -- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 msgr2=0x7f3df00717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 0x7f3df00717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 -- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 msgr2=0x7f3df00c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 0x7f3df00c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 -- 172.21.15.97:0/3389501804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00c6000 con 0x7f3df01ecfb0 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3df4d55640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 0x7f3df00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3deffff640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 0x7f3df00c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:12.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3def7fe640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009a00 tx=0x7f3dd8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4005ba0 con 0x7f3df01ecfb0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4005d00 con 0x7f3df01ecfb0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40aa930 con 0x7f3df01ecfb0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00c62e0 con 0x7f3df01ecfb0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00ab570 con 0x7f3df01ecfb0 2023-12-04T05:39:12.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df0068440 con 0x7f3df01ecfb0 2023-12-04T05:39:12.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3de40ba070 con 0x7f3df01ecfb0 2023-12-04T05:39:12.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 0x7f3ddc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:12.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f3de411e870 con 0x7f3df01ecfb0 2023-12-04T05:39:12.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.913+0000 7f3deffff640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 0x7f3ddc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:12.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.917+0000 7f3deffff640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 0x7f3ddc068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3df01ee0e0 tx=0x7f3de0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:12.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:12.917+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3de40ebbe0 con 0x7f3df01ecfb0 2023-12-04T05:39:13.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.097+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df00aba80 con 0x7f3df01ecfb0 2023-12-04T05:39:13.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.097+0000 7f3decff9640 1 -- 172.21.15.97:0/3389501804 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f3de40c2020 con 0x7f3df01ecfb0 2023-12-04T05:39:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:13.104 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1960318847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1960318847},{"type":"v1","addr":"172.21.15.97:6837","nonce":1960318847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:38:46.407985+0000","modified":"2023-12-04T05:38:49.427916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":9,"addr":"172.21.15.97:6835/3569776712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":3569776712},{"type":"v1","addr":"172.21.15.97:6835","nonce":3569776712}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-04T05:39:13.105 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 39 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 msgr2=0x7f3ddc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 0x7f3ddc068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3df01ee0e0 tx=0x7f3de0009040 comp rx=0 tx=0).stop 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 msgr2=0x7f3df01f0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009a00 tx=0x7f3dd8005800 comp rx=0 tx=0).stop 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 shutdown_connections 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ddc066900 0x7f3ddc068dc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3df01f11d0 0x7f3df00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3df01ecfb0 0x7f3df01f0c90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 --2- 172.21.15.97:0/3389501804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3dd8003f00 0x7f3df00c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 >> 172.21.15.97:0/3389501804 conn(0x7f3df00c3130 msgr2=0x7f3df0157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 shutdown_connections 2023-12-04T05:39:13.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.101+0000 7f3df67b8640 1 -- 172.21.15.97:0/3389501804 wait complete. 2023-12-04T05:39:13.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:13.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.257+0000 7f9dbac5a640 1 Processor -- start 2023-12-04T05:39:13.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 -- start start 2023-12-04T05:39:13.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9db40a88e0 0x7f9db4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db41530e0 con 0x7f9db40a8460 2023-12-04T05:39:13.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db414ff90 con 0x7f9db40a88e0 2023-12-04T05:39:13.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dbac5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40a9770 con 0x7f9db414fbb0 2023-12-04T05:39:13.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:39094/0 (socket says 172.21.15.97:39094) 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 -- 172.21.15.97:0/2319272960 learned_addr learned my addr 172.21.15.97:0/2319272960 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dabfff640 1 --1- 172.21.15.97:0/2319272960 >> v1:172.21.15.143:6789/0 conn(0x7f9db40a8460 0x7f9db4152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:37872/0 (socket says 172.21.15.97:37872) 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db91f7640 1 --2- 172.21.15.97:0/2319272960 >> v2:172.21.15.143:3300/0 conn(0x7f9db40a88e0 0x7f9db4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dab7fe640 1 -- 172.21.15.97:0/2319272960 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828172396 0 0) 0x7f9db41530e0 con 0x7f9db40a8460 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9dab7fe640 1 -- 172.21.15.97:0/2319272960 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d9c003530 con 0x7f9db40a8460 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 -- 172.21.15.97:0/2319272960 >> v2:172.21.15.143:3300/0 conn(0x7f9db40a88e0 msgr2=0x7f9db4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 --2- 172.21.15.97:0/2319272960 >> v2:172.21.15.143:3300/0 conn(0x7f9db40a88e0 0x7f9db4152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 -- 172.21.15.97:0/2319272960 >> v1:172.21.15.143:6789/0 conn(0x7f9db40a8460 legacy=0x7f9db4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.261+0000 7f9db89f6640 1 -- 172.21.15.97:0/2319272960 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4071730 con 0x7f9db414fbb0 2023-12-04T05:39:13.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9db89f6640 1 --2- 172.21.15.97:0/2319272960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009870 tx=0x7f9db001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab0a9ea9e05c28e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dab7fe640 1 -- 172.21.15.97:0/2319272960 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00ab620 con 0x7f9db414fbb0 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dab7fe640 1 -- 172.21.15.97:0/2319272960 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00ab780 con 0x7f9db414fbb0 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dab7fe640 1 -- 172.21.15.97:0/2319272960 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db00abb10 con 0x7f9db414fbb0 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2319272960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 msgr2=0x7f9db40a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2319272960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009870 tx=0x7f9db001c420 comp rx=0 tx=0).stop 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2319272960 shutdown_connections 2023-12-04T05:39:13.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2319272960 >> v2:172.21.15.143:3300/0 conn(0x7f9db40a88e0 0x7f9db4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2319272960 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db414fbb0 0x7f9db40a8f20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2319272960 >> 172.21.15.97:0/2319272960 conn(0x7f9db40c2970 msgr2=0x7f9db40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2319272960 shutdown_connections 2023-12-04T05:39:13.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.265+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2319272960 wait complete. 2023-12-04T05:39:13.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 Processor -- start 2023-12-04T05:39:13.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- start start 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40a8460 0x7f9db4153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40a88e0 0x7f9db406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4154250 con 0x7f9db414fbb0 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db41522e0 con 0x7f9db40a88e0 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40c3fe0 con 0x7f9db40a8460 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33928/0 (socket says 172.21.15.97:33928) 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 -- 172.21.15.97:0/2382296513 learned_addr learned my addr 172.21.15.97:0/2382296513 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db89f6640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40a8460 0x7f9db4153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dabfff640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40a88e0 0x7f9db406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 -- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40a8460 msgr2=0x7f9db4153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40a8460 0x7f9db4153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 -- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40a88e0 msgr2=0x7f9db406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40a88e0 0x7f9db406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 -- 172.21.15.97:0/2382296513 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00094d0 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9db91f7640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d30 tx=0x7f9dac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac009ba0 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00f040 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40c3a60 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0146c0 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40c3d00 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.269+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db4068440 con 0x7f9db414fbb0 2023-12-04T05:39:13.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.273+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9dac014820 con 0x7f9db414fbb0 2023-12-04T05:39:13.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.273+0000 7f9da97fa640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.273+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9dac084e30 con 0x7f9db414fbb0 2023-12-04T05:39:13.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.273+0000 7f9db89f6640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.273+0000 7f9db89f6640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 0x7f9da0068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9db00af000 tx=0x7f9db00b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.277+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dac0520b0 con 0x7f9db414fbb0 2023-12-04T05:39:13.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.429+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9db40c24d0 con 0x7f9db414fbb0 2023-12-04T05:39:13.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.429+0000 7f9da97fa640 1 -- 172.21.15.97:0/2382296513 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f9dac0556d0 con 0x7f9db414fbb0 2023-12-04T05:39:13.434 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:13.434 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":57,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:10.353225+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:38:44.148875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:38:45.405294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/3150893568":"2023-12-05T05:39:07.346885+0000","172.21.15.97:6836/3150893568":"2023-12-05T05:39:07.346885+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:13.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 msgr2=0x7f9da0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 0x7f9da0068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9db00af000 tx=0x7f9db00b6040 comp rx=0 tx=0).stop 2023-12-04T05:39:13.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 msgr2=0x7f9db4145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d30 tx=0x7f9dac00c490 comp rx=0 tx=0).stop 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 shutdown_connections 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9da00668d0 0x7f9da0068d90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9db414fbb0 0x7f9db4145480 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9db40a88e0 0x7f9db406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 --2- 172.21.15.97:0/2382296513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9db40a8460 0x7f9db4153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 >> 172.21.15.97:0/2382296513 conn(0x7f9db40c2970 msgr2=0x7f9db40c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 shutdown_connections 2023-12-04T05:39:13.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.433+0000 7f9dbac5a640 1 -- 172.21.15.97:0/2382296513 wait complete. 2023-12-04T05:39:13.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-04T05:39:13.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 Processor -- start 2023-12-04T05:39:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 -- start start 2023-12-04T05:39:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f85c414eb30 0x7f85c414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c414f790 0x7f85c41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 0x7f85c4151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40c0bd0 con 0x7f85c414f790 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c4154640 con 0x7f85c414eb30 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85ca609640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c414ef10 con 0x7f85c4154e10 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85c37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c414f790 0x7f85c41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85c37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f85c414f790 0x7f85c41548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33940/0 (socket says 172.21.15.97:33940) 2023-12-04T05:39:13.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85c37fe640 1 -- 172.21.15.97:0/1417156940 learned_addr learned my addr 172.21.15.97:0/1417156940 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85c8ba6640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 0x7f85c4151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.589+0000 7f85c3fff640 1 --2- 172.21.15.97:0/1417156940 >> v2:172.21.15.143:3300/0 conn(0x7f85c414eb30 0x7f85c414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 -- 172.21.15.97:0/1417156940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 msgr2=0x7f85c4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 0x7f85c4151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 -- 172.21.15.97:0/1417156940 >> v2:172.21.15.143:3300/0 conn(0x7f85c414eb30 msgr2=0x7f85c414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 --2- 172.21.15.97:0/1417156940 >> v2:172.21.15.143:3300/0 conn(0x7f85c414eb30 0x7f85c414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 -- 172.21.15.97:0/1417156940 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c41535a0 con 0x7f85c414f790 2023-12-04T05:39:13.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c8ba6640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 0x7f85c4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c37fe640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c414f790 0x7f85c41548d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f85c40c0a80 tx=0x7f85b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd5c014551aefd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c2ffd640 1 -- 172.21.15.97:0/1417156940 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80ac600 con 0x7f85c414f790 2023-12-04T05:39:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c2ffd640 1 -- 172.21.15.97:0/1417156940 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80a8050 con 0x7f85c414f790 2023-12-04T05:39:13.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85c2ffd640 1 -- 172.21.15.97:0/1417156940 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80ac980 con 0x7f85c414f790 2023-12-04T05:39:13.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 -- 172.21.15.97:0/1417156940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c414f790 msgr2=0x7f85c41548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c414f790 0x7f85c41548d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f85c40c0a80 tx=0x7f85b801c4d0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 -- 172.21.15.97:0/1417156940 shutdown_connections 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c4154e10 0x7f85c4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 --2- 172.21.15.97:0/1417156940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c414f790 0x7f85c41548d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 --2- 172.21.15.97:0/1417156940 >> v2:172.21.15.143:3300/0 conn(0x7f85c414eb30 0x7f85c414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.593+0000 7f85ca609640 1 -- 172.21.15.97:0/1417156940 >> 172.21.15.97:0/1417156940 conn(0x7f85c40c5e70 msgr2=0x7f85c40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- 172.21.15.97:0/1417156940 shutdown_connections 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- 172.21.15.97:0/1417156940 wait complete. 2023-12-04T05:39:13.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 Processor -- start 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- start start 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c414eb30 0x7f85c40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c414f790 0x7f85c413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40712b0 con 0x7f85c4154e10 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4071e70 con 0x7f85c414f790 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85ca609640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4140960 con 0x7f85c414eb30 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33946/0 (socket says 172.21.15.97:33946) 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 -- 172.21.15.97:0/92006018 learned_addr learned my addr 172.21.15.97:0/92006018 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c3fff640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c414eb30 0x7f85c40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c37fe640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c414f790 0x7f85c413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 -- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c414eb30 msgr2=0x7f85c40700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c414eb30 0x7f85c40700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 -- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c414f790 msgr2=0x7f85c413fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c414f790 0x7f85c413fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 -- 172.21.15.97:0/92006018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80094d0 con 0x7f85c4154e10 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.597+0000 7f85c8ba6640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f85bc009fa0 tx=0x7f85bc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc003ba0 con 0x7f85c4154e10 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc00f040 con 0x7f85c4154e10 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4140c40 con 0x7f85c4154e10 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc004030 con 0x7f85c4154e10 2023-12-04T05:39:13.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c4141200 con 0x7f85c4154e10 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c41413f0 con 0x7f85c4154e10 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f85bc004190 con 0x7f85c4154e10 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 0x7f85b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f85bc0847b0 con 0x7f85c4154e10 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c3fff640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 0x7f85b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.601+0000 7f85c3fff640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 0x7f85b0068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f85b40079c0 tx=0x7f85b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.605+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85bc0519a0 con 0x7f85c4154e10 2023-12-04T05:39:13.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.785+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f85c4068440 con 0x7f85c4154e10 2023-12-04T05:39:13.791 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:39:13.785+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:39:13.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.789+0000 7f85c0ff9640 1 -- 172.21.15.97:0/92006018 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f85bc054fc0 con 0x7f85c4154e10 2023-12-04T05:39:13.794 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:39:13.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.789+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 msgr2=0x7f85b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 0x7f85b0068d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f85b40079c0 tx=0x7f85b4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:13.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 msgr2=0x7f85c41ee750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f85bc009fa0 tx=0x7f85bc00d560 comp rx=0 tx=0).stop 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 shutdown_connections 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f85b00668d0 0x7f85b0068d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f85c4154e10 0x7f85c41ee750 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85c414f790 0x7f85c413fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 --2- 172.21.15.97:0/92006018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85c414eb30 0x7f85c40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 >> 172.21.15.97:0/92006018 conn(0x7f85c40c5e70 msgr2=0x7f85c415b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 shutdown_connections 2023-12-04T05:39:13.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.793+0000 7f85ca609640 1 -- 172.21.15.97:0/92006018 wait complete. 2023-12-04T05:39:13.802 INFO:tasks.ceph.mds.c.smithi097.stderr: -1921> 2023-12-04T05:38:52.453+0000 7f7ffe4ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:39:13.818 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-04T05:39:13.848 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:39:13.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.953+0000 7f8a7d69a640 1 Processor -- start 2023-12-04T05:39:13.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.953+0000 7f8a7d69a640 1 -- start start 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a7d69a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8a7814eb30 0x7f8a7814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a7d69a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a7814f790 0x7f8a781548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a7d69a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a78154640 con 0x7f8a78154e10 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a7d69a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a780c0bd0 con 0x7f8a7814eb30 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a7d69a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7814ef10 con 0x7f8a7814f790 2023-12-04T05:39:13.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a777fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8a78154e10 0x7f8a78151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:42946/0 (socket says 172.21.15.97:42946) 2023-12-04T05:39:13.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a777fe640 1 -- 172.21.15.97:0/2101571039 learned_addr learned my addr 172.21.15.97:0/2101571039 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:13.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/2101571039 >> v2:172.21.15.143:3300/0 conn(0x7f8a7814eb30 0x7f8a7814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a6e7fc640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a7814f790 0x7f8a781548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949966169 0 0) 0x7f8a78154640 con 0x7f8a78154e10 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a64003530 con 0x7f8a78154e10 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443151338 0 0) 0x7f8a64003530 con 0x7f8a78154e10 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a76ffd640 1 -- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a7814f790 msgr2=0x7f8a781548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a7814f790 0x7f8a781548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a76ffd640 1 -- 172.21.15.97:0/2101571039 >> v1:172.21.15.97:6789/0 conn(0x7f8a78154e10 legacy=0x7f8a78151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.957+0000 7f8a76ffd640 1 -- 172.21.15.97:0/2101571039 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a781535a0 con 0x7f8a7814eb30 2023-12-04T05:39:13.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814eb30 0x7f8a7814f250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009d90 tx=0x7f8a6801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1668c734183989ab server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70001680 con 0x7f8a7814eb30 2023-12-04T05:39:13.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680a5550 con 0x7f8a7814eb30 2023-12-04T05:39:13.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a767fc640 1 -- 172.21.15.97:0/2101571039 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680a58e0 con 0x7f8a7814eb30 2023-12-04T05:39:13.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 -- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814eb30 msgr2=0x7f8a7814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814eb30 0x7f8a7814f250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009d90 tx=0x7f8a6801c840 comp rx=0 tx=0).stop 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 -- 172.21.15.97:0/2101571039 shutdown_connections 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a7814f790 0x7f8a781548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/2101571039 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814eb30 0x7f8a7814f250 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 -- 172.21.15.97:0/2101571039 >> 172.21.15.97:0/2101571039 conn(0x7f8a780c5e70 msgr2=0x7f8a780c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 -- 172.21.15.97:0/2101571039 shutdown_connections 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 -- 172.21.15.97:0/2101571039 wait complete. 2023-12-04T05:39:13.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.961+0000 7f8a7d69a640 1 Processor -- start 2023-12-04T05:39:13.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- start start 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 0x7f8a7814d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 0x7f8a781ee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781f17f0 con 0x7f8a7814eb30 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781ed2f0 con 0x7f8a7814f790 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7806de70 con 0x7f8a78154e10 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:33974/0 (socket says 172.21.15.97:33974) 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 -- 172.21.15.97:0/1562696358 learned_addr learned my addr 172.21.15.97:0/1562696358 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a777fe640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 0x7f8a781ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a6e7fc640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 0x7f8a7814d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 -- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 msgr2=0x7f8a781ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 0x7f8a781ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 -- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 msgr2=0x7f8a7814d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 0x7f8a7814d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 -- 172.21.15.97:0/1562696358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009a70 con 0x7f8a7814eb30 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a777fe640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 0x7f8a781ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a6e7fc640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 0x7f8a7814d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a76ffd640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801aef0 tx=0x7f8a680195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68009450 con 0x7f8a7814eb30 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680ad650 con 0x7f8a7814eb30 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a781edb50 con 0x7f8a7814eb30 2023-12-04T05:39:13.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680ada00 con 0x7f8a7814eb30 2023-12-04T05:39:13.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a781f1510 con 0x7f8a7814eb30 2023-12-04T05:39:13.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.965+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78068440 con 0x7f8a7814eb30 2023-12-04T05:39:13.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.969+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a680b4050 con 0x7f8a7814eb30 2023-12-04T05:39:13.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.969+0000 7f8a6ffff640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 0x7f8a58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:13.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.969+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f8a6811f1c0 con 0x7f8a7814eb30 2023-12-04T05:39:13.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.969+0000 7f8a6e7fc640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 0x7f8a58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:13.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.969+0000 7f8a6e7fc640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 0x7f8a58068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a781f07c0 tx=0x7f8a60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:13.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:13.973+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a680ec500 con 0x7f8a7814eb30 2023-12-04T05:39:14.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.153+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8a780a8ac0 con 0x7f8a7814eb30 2023-12-04T05:39:14.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a6ffff640 1 -- 172.21.15.97:0/1562696358 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8a680efb20 con 0x7f8a7814eb30 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 msgr2=0x7f8a58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 0x7f8a58068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a781f07c0 tx=0x7f8a60008040 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 msgr2=0x7f8a7806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801aef0 tx=0x7f8a680195e0 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 shutdown_connections 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8a580668d0 0x7f8a58068d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a78154e10 0x7f8a781ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a7814f790 0x7f8a7814d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 --2- 172.21.15.97:0/1562696358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a7814eb30 0x7f8a7806d930 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:14.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.797+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 >> 172.21.15.97:0/1562696358 conn(0x7f8a780c5e70 msgr2=0x7f8a780c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:14.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.801+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 shutdown_connections 2023-12-04T05:39:14.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:14.801+0000 7f8a7d69a640 1 -- 172.21.15.97:0/1562696358 wait complete. 2023-12-04T05:39:14.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-04T05:39:15.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 Processor -- start 2023-12-04T05:39:15.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 -- start start 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40640c4d40 0x7f40640c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640c68e0 con 0x7f4064157ed0 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40640c6450 con 0x7f4064152060 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40696fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406406c600 con 0x7f40640c4d40 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40627fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40640c4d40 0x7f40640c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40637fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4064157ed0 0x7f4064158360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36984/0 (socket says 172.21.15.97:36984) 2023-12-04T05:39:15.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40637fe640 1 -- 172.21.15.97:0/1648000998 learned_addr learned my addr 172.21.15.97:0/1648000998 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:15.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40627fc640 1 -- 172.21.15.97:0/1648000998 >> v1:172.21.15.143:6789/0 conn(0x7f4064152060 legacy=0x7f40640c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:15.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40627fc640 1 -- 172.21.15.97:0/1648000998 >> v1:172.21.15.97:6789/0 conn(0x7f4064157ed0 legacy=0x7f4064158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:15.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f40627fc640 1 -- 172.21.15.97:0/1648000998 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640c5e40 con 0x7f40640c4d40 2023-12-04T05:39:15.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.013+0000 7f4061ffb640 1 -- 172.21.15.97:0/1648000998 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582422142 0 0) 0x7f40640c68e0 con 0x7f4064157ed0 2023-12-04T05:39:15.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40627fc640 1 --2- 172.21.15.97:0/1648000998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40640c4d40 0x7f40640c8600 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f40580097a0 tx=0x7f405801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6731550413205b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:15.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f4061ffb640 1 -- 172.21.15.97:0/1648000998 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058004230 con 0x7f40640c4d40 2023-12-04T05:39:15.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f4061ffb640 1 -- 172.21.15.97:0/1648000998 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580a7050 con 0x7f40640c4d40 2023-12-04T05:39:15.021 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f4061ffb640 1 -- 172.21.15.97:0/1648000998 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4058003620 con 0x7f40640c4d40 2023-12-04T05:39:15.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 -- 172.21.15.97:0/1648000998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40640c4d40 msgr2=0x7f40640c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:15.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 --2- 172.21.15.97:0/1648000998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40640c4d40 0x7f40640c8600 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f40580097a0 tx=0x7f405801c460 comp rx=0 tx=0).stop 2023-12-04T05:39:15.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 -- 172.21.15.97:0/1648000998 shutdown_connections 2023-12-04T05:39:15.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 --2- 172.21.15.97:0/1648000998 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40640c4d40 0x7f40640c8600 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:15.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 -- 172.21.15.97:0/1648000998 >> 172.21.15.97:0/1648000998 conn(0x7f40640abb80 msgr2=0x7f40640abf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:15.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 -- 172.21.15.97:0/1648000998 shutdown_connections 2023-12-04T05:39:15.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 -- 172.21.15.97:0/1648000998 wait complete. 2023-12-04T05:39:15.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.017+0000 7f40696fe640 1 Processor -- start 2023-12-04T05:39:15.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- start start 2023-12-04T05:39:15.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 0x7f40641f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:15.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4064152060 0x7f4064147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641edf60 con 0x7f4064157ed0 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641f0eb0 con 0x7f4064152060 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40640c3a60 con 0x7f40640c4d40 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57890/0 (socket says 172.21.15.97:57890) 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 -- 172.21.15.97:0/1106970036 learned_addr learned my addr 172.21.15.97:0/1106970036 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f4062ffd640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 0x7f40641f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40627fc640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4064152060 0x7f4064147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 -- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 msgr2=0x7f40641f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:15.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 0x7f40641f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 -- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4064152060 msgr2=0x7f4064147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4064152060 0x7f4064147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 -- 172.21.15.97:0/1106970036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40580093b0 con 0x7f4064157ed0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f4062ffd640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 0x7f40641f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40637fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f405c001570 tx=0x7f405c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00a640 con 0x7f4064157ed0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00a7c0 con 0x7f4064157ed0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00ab70 con 0x7f4064157ed0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40640c3d40 con 0x7f4064157ed0 2023-12-04T05:39:15.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40640c2290 con 0x7f4064157ed0 2023-12-04T05:39:15.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.021+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40640c2f20 con 0x7f4064157ed0 2023-12-04T05:39:15.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.025+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f405c00acd0 con 0x7f4064157ed0 2023-12-04T05:39:15.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.025+0000 7f404b7fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 0x7f4050068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:15.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.025+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f405c083a80 con 0x7f4064157ed0 2023-12-04T05:39:15.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.025+0000 7f4062ffd640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 0x7f4050068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:15.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.025+0000 7f4062ffd640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 0x7f4050068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4054000f70 tx=0x7f4054009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:15.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.029+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40640c2f20 con 0x7f4064157ed0 2023-12-04T05:39:15.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.181+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40640c2f20 con 0x7f4064157ed0 2023-12-04T05:39:15.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f404b7fe640 1 -- 172.21.15.97:0/1106970036 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f40640c2f20 con 0x7f4064157ed0 2023-12-04T05:39:15.999 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' removed 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 msgr2=0x7f4050068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 0x7f4050068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4054000f70 tx=0x7f4054009040 comp rx=0 tx=0).stop 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 msgr2=0x7f4064151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f405c001570 tx=0x7f405c00cca0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 shutdown_connections 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f40500668d0 0x7f4050068d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4064157ed0 0x7f4064151280 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4064152060 0x7f4064147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 --2- 172.21.15.97:0/1106970036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40640c4d40 0x7f40641f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 >> 172.21.15.97:0/1106970036 conn(0x7f40640abb80 msgr2=0x7f4064157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:16.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 shutdown_connections 2023-12-04T05:39:16.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:15.997+0000 7f40696fe640 1 -- 172.21.15.97:0/1106970036 wait complete. 2023-12-04T05:39:16.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-04T05:39:16.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 Processor -- start 2023-12-04T05:39:16.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 -- start start 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feabc0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc14b6d0 con 0x7feabc0c7f90 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0c6880 con 0x7feabc1552b0 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feac0e79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc155800 con 0x7feabc14b2f0 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab3fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7feabc0c7f90 0x7feabc0c6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36990/0 (socket says 172.21.15.97:36990) 2023-12-04T05:39:16.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab3fff640 1 -- 172.21.15.97:0/3346385718 learned_addr learned my addr 172.21.15.97:0/3346385718 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feaba59c640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feabc0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382311859 0 0) 0x7feabc14b6d0 con 0x7feabc0c7f90 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa8003530 con 0x7feabc0c7f90 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371737029 0 0) 0x7feaa8003530 con 0x7feabc0c7f90 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 msgr2=0x7feabc0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feabc0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 >> v1:172.21.15.143:6789/0 conn(0x7feabc1552b0 legacy=0x7feabc15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0ca610 con 0x7feabc0c7f90 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.165+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7feaa4001680 con 0x7feabc0c7f90 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 >> v1:172.21.15.97:6789/0 conn(0x7feabc0c7f90 legacy=0x7feabc0c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa80039b0 0x7feaa8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feaa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa8004d10 0x7feaa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc155800 con 0x7feaa80039b0 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa800ba70 con 0x7feaa8004d10 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa800bc30 con 0x7feabc14b2f0 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa80039b0 0x7feaa8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feab3fff640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feaa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feabad9d640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa8004d10 0x7feaa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 -- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 msgr2=0x7feaa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:16.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc14b2f0 0x7feaa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 -- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa8004d10 msgr2=0x7feaa8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:16.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa8004d10 0x7feaa8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 -- 172.21.15.97:0/3346385718 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8003530 con 0x7feaa80039b0 2023-12-04T05:39:16.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.169+0000 7feaba59c640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa80039b0 0x7feaa8003d90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feaac009ae0 tx=0x7feaac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b3703d9a503be3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:16.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a55f0 con 0x7feaa80039b0 2023-12-04T05:39:16.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac0a5750 con 0x7feaa80039b0 2023-12-04T05:39:16.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feab9d9b640 1 -- 172.21.15.97:0/3346385718 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a5900 con 0x7feaa80039b0 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- 172.21.15.97:0/3346385718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa80039b0 msgr2=0x7feaa8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 --2- 172.21.15.97:0/3346385718 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feaa80039b0 0x7feaa8003d90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feaac009ae0 tx=0x7feaac01ca20 comp rx=0 tx=0).stop 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feabad9d640 1 -- 172.21.15.97:0/3346385718 reap_dead start 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- 172.21.15.97:0/3346385718 shutdown_connections 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- 172.21.15.97:0/3346385718 >> 172.21.15.97:0/3346385718 conn(0x7feabc073720 msgr2=0x7feabc073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- 172.21.15.97:0/3346385718 shutdown_connections 2023-12-04T05:39:16.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- 172.21.15.97:0/3346385718 wait complete. 2023-12-04T05:39:16.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 Processor -- start 2023-12-04T05:39:16.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- start start 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa80039b0 0x7feabc1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc145800 0x7feabc1f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0ab450 con 0x7feabc1f0d30 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc145c60 con 0x7feaa80039b0 2023-12-04T05:39:16.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feac0e79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc0aa560 con 0x7feabc145800 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feabad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feabad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57900/0 (socket says 172.21.15.97:57900) 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feabad9d640 1 -- 172.21.15.97:0/653195315 learned_addr learned my addr 172.21.15.97:0/653195315 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.173+0000 7feab3fff640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc145800 0x7feabc1f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feaba59c640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa80039b0 0x7feabc1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 -- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc145800 msgr2=0x7feabc1f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc145800 0x7feabc1f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 -- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa80039b0 msgr2=0x7feabc1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa80039b0 0x7feabc1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 -- 172.21.15.97:0/653195315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0aa840 con 0x7feabc1f0d30 2023-12-04T05:39:16.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feabad9d640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003980 tx=0x7feab400eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:16.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4003b90 con 0x7feabc1f0d30 2023-12-04T05:39:16.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4003cf0 con 0x7feabc1f0d30 2023-12-04T05:39:16.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc0aab20 con 0x7feabc1f0d30 2023-12-04T05:39:16.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4005310 con 0x7feabc1f0d30 2023-12-04T05:39:16.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc0ab0e0 con 0x7feabc1f0d30 2023-12-04T05:39:16.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc0ab600 con 0x7feabc1f0d30 2023-12-04T05:39:16.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feab4005470 con 0x7feabc1f0d30 2023-12-04T05:39:16.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 0x7fea9c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:16.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7feab4084140 con 0x7feabc1f0d30 2023-12-04T05:39:16.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.177+0000 7feaba59c640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 0x7fea9c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:16.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.181+0000 7feaba59c640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 0x7fea9c068dc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feaac0af000 tx=0x7feaac0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:16.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.181+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feabc0ab600 con 0x7feabc1f0d30 2023-12-04T05:39:16.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:16.333+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feabc0c7c40 con 0x7feabc1f0d30 2023-12-04T05:39:17.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.001+0000 7feab2ffd640 1 -- 172.21.15.97:0/653195315 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7feab4051490 con 0x7feabc1f0d30 2023-12-04T05:39:17.007 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' removed 2023-12-04T05:39:17.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 msgr2=0x7fea9c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 0x7fea9c068dc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feaac0af000 tx=0x7feaac0046d0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 msgr2=0x7feabc1ee590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7feaa8003980 tx=0x7feab400eae0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 shutdown_connections 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fea9c066900 0x7fea9c068dc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7feabc1f0d30 0x7feabc1ee590 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feabc145800 0x7feabc1f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 --2- 172.21.15.97:0/653195315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feaa80039b0 0x7feabc1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 >> 172.21.15.97:0/653195315 conn(0x7feabc073720 msgr2=0x7feabc14a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 shutdown_connections 2023-12-04T05:39:17.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.005+0000 7feac0e79640 1 -- 172.21.15.97:0/653195315 wait complete. 2023-12-04T05:39:17.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-04T05:39:17.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 Processor -- start 2023-12-04T05:39:17.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 -- start start 2023-12-04T05:39:17.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9af0154fe0 0x7f9af015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af0154640 con 0x7f9af014eb30 2023-12-04T05:39:17.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af014ef10 con 0x7f9af014f960 2023-12-04T05:39:17.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af82ea640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00c0bd0 con 0x7f9af0154fe0 2023-12-04T05:39:17.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6086640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9af014eb30 0x7f9af014f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:36992/0 (socket says 172.21.15.97:36992) 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6086640 1 -- 172.21.15.97:0/2873999767 learned_addr learned my addr 172.21.15.97:0/2873999767 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6887640 1 --2- 172.21.15.97:0/2873999767 >> v2:172.21.15.97:3300/0 conn(0x7f9af0154fe0 0x7f9af015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af5084640 1 -- 172.21.15.97:0/2873999767 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943516913 0 0) 0x7f9af0154640 con 0x7f9af014eb30 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af5084640 1 -- 172.21.15.97:0/2873999767 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc005740 con 0x7f9af014eb30 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6887640 1 -- 172.21.15.97:0/2873999767 >> v1:172.21.15.143:6789/0 conn(0x7f9af014f960 legacy=0x7f9af01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6887640 1 -- 172.21.15.97:0/2873999767 >> v1:172.21.15.97:6789/0 conn(0x7f9af014eb30 legacy=0x7f9af014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.173+0000 7f9af6887640 1 -- 172.21.15.97:0/2873999767 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af01535a0 con 0x7f9af0154fe0 2023-12-04T05:39:17.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af6887640 1 --2- 172.21.15.97:0/2873999767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af015cc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009d90 tx=0x7f9ae801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da48db55614f979c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af5084640 1 -- 172.21.15.97:0/2873999767 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80a57f0 con 0x7f9af0154fe0 2023-12-04T05:39:17.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af5084640 1 -- 172.21.15.97:0/2873999767 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80a5950 con 0x7f9af0154fe0 2023-12-04T05:39:17.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af5084640 1 -- 172.21.15.97:0/2873999767 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80a5ce0 con 0x7f9af0154fe0 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 -- 172.21.15.97:0/2873999767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 msgr2=0x7f9af015cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 --2- 172.21.15.97:0/2873999767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af015cc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009d90 tx=0x7f9ae801c920 comp rx=0 tx=0).stop 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 -- 172.21.15.97:0/2873999767 shutdown_connections 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 --2- 172.21.15.97:0/2873999767 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af015cc70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 -- 172.21.15.97:0/2873999767 >> 172.21.15.97:0/2873999767 conn(0x7f9af00c5e70 msgr2=0x7f9af00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 -- 172.21.15.97:0/2873999767 shutdown_connections 2023-12-04T05:39:17.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.177+0000 7f9af82ea640 1 -- 172.21.15.97:0/2873999767 wait complete. 2023-12-04T05:39:17.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 Processor -- start 2023-12-04T05:39:17.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- start start 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9af014eb30 0x7f9af0144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 0x7f9af006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af013f970 con 0x7f9af0154fe0 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0141660 con 0x7f9af014f960 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01413a0 con 0x7f9af014eb30 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57920/0 (socket says 172.21.15.97:57920) 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 -- 172.21.15.97:0/1333215582 learned_addr learned my addr 172.21.15.97:0/1333215582 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6086640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9af014eb30 0x7f9af0144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af5885640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 0x7f9af006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 -- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9af014eb30 msgr2=0x7f9af0144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9af014eb30 0x7f9af0144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 -- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 msgr2=0x7f9af006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 0x7f9af006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 -- 172.21.15.97:0/1333215582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009a70 con 0x7f9af0154fe0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af5885640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 0x7f9af006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af6887640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801a550 tx=0x7f9ae80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80b9650 con 0x7f9af0154fe0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80b97b0 con 0x7f9af0154fe0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80b9b20 con 0x7f9af0154fe0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af00a93f0 con 0x7f9af0154fe0 2023-12-04T05:39:17.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af006c930 con 0x7f9af0154fe0 2023-12-04T05:39:17.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.181+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af013f740 con 0x7f9af0154fe0 2023-12-04T05:39:17.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.185+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ae80b9c80 con 0x7f9af0154fe0 2023-12-04T05:39:17.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.185+0000 7f9ae6ffd640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.185+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9ae811f300 con 0x7f9af0154fe0 2023-12-04T05:39:17.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.185+0000 7f9af6086640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.185+0000 7f9af6086640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 0x7f9ad4068dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0011f0 tx=0x7f9aec007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.189+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9af013f740 con 0x7f9af0154fe0 2023-12-04T05:39:17.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.337+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9af013f740 con 0x7f9af0154fe0 2023-12-04T05:39:17.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.341+0000 7f9ae6ffd640 1 -- 172.21.15.97:0/1333215582 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9af013f740 con 0x7f9af0154fe0 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 msgr2=0x7f9ad4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 0x7f9ad4068dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0011f0 tx=0x7f9aec007d40 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 msgr2=0x7f9af013fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801a550 tx=0x7f9ae80196c0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 shutdown_connections 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9af0154fe0 0x7f9af013fe00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9af014f960 0x7f9af006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 --2- 172.21.15.97:0/1333215582 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9af014eb30 0x7f9af0144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 >> 172.21.15.97:0/1333215582 conn(0x7f9af00c5e70 msgr2=0x7f9af014dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 shutdown_connections 2023-12-04T05:39:17.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.345+0000 7f9af82ea640 1 -- 172.21.15.97:0/1333215582 wait complete. 2023-12-04T05:39:17.369 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-04T05:39:17.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 Processor -- start 2023-12-04T05:39:17.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 -- start start 2023-12-04T05:39:17.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8314071390 0x7f8314163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140707c0 con 0x7f8314071e10 2023-12-04T05:39:17.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831406dd10 con 0x7f8314071390 2023-12-04T05:39:17.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.501+0000 7f831bf96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831406ff60 con 0x7f83140c1880 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:44112/0 (socket says 172.21.15.97:44112) 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 -- 172.21.15.97:0/2914632823 learned_addr learned my addr 172.21.15.97:0/2914632823 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319531640 1 --1- 172.21.15.97:0/2914632823 >> v1:172.21.15.143:6789/0 conn(0x7f8314071e10 0x7f831406be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:34350/0 (socket says 172.21.15.97:34350) 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f831a533640 1 --2- 172.21.15.97:0/2914632823 >> v2:172.21.15.143:3300/0 conn(0x7f8314071390 0x7f8314163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 -- 172.21.15.97:0/2914632823 >> v2:172.21.15.143:3300/0 conn(0x7f8314071390 msgr2=0x7f8314163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:17.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 --2- 172.21.15.97:0/2914632823 >> v2:172.21.15.143:3300/0 conn(0x7f8314071390 0x7f8314163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 -- 172.21.15.97:0/2914632823 >> v1:172.21.15.143:6789/0 conn(0x7f8314071e10 legacy=0x7f831406be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8319d32640 1 -- 172.21.15.97:0/2914632823 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314159470 con 0x7f83140c1880 2023-12-04T05:39:17.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.505+0000 7f8318d30640 1 -- 172.21.15.97:0/2914632823 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320882071 0 0) 0x7f83140707c0 con 0x7f8314071e10 2023-12-04T05:39:17.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f8319d32640 1 --2- 172.21.15.97:0/2914632823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8310009870 tx=0x7f831001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b098ea594f9df1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f8318d30640 1 -- 172.21.15.97:0/2914632823 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100ab600 con 0x7f83140c1880 2023-12-04T05:39:17.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f8318d30640 1 -- 172.21.15.97:0/2914632823 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a7050 con 0x7f83140c1880 2023-12-04T05:39:17.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f8318d30640 1 -- 172.21.15.97:0/2914632823 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100ab980 con 0x7f83140c1880 2023-12-04T05:39:17.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- 172.21.15.97:0/2914632823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 msgr2=0x7f83140c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- 172.21.15.97:0/2914632823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8310009870 tx=0x7f831001c540 comp rx=0 tx=0).stop 2023-12-04T05:39:17.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- 172.21.15.97:0/2914632823 shutdown_connections 2023-12-04T05:39:17.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- 172.21.15.97:0/2914632823 >> v2:172.21.15.143:3300/0 conn(0x7f8314071390 0x7f8314163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- 172.21.15.97:0/2914632823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83140c1880 0x7f83140c1c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- 172.21.15.97:0/2914632823 >> 172.21.15.97:0/2914632823 conn(0x7f83140c2970 msgr2=0x7f83140c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:17.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- 172.21.15.97:0/2914632823 shutdown_connections 2023-12-04T05:39:17.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- 172.21.15.97:0/2914632823 wait complete. 2023-12-04T05:39:17.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 Processor -- start 2023-12-04T05:39:17.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- start start 2023-12-04T05:39:17.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8314071e10 0x7f83141f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140c1880 0x7f83141f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141f1c40 con 0x7f8314071390 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141f2170 con 0x7f83140c1880 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f831bf96640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83140bfab0 con 0x7f8314071e10 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.509+0000 7f8319d32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57926/0 (socket says 172.21.15.97:57926) 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 -- 172.21.15.97:0/2702160804 learned_addr learned my addr 172.21.15.97:0/2702160804 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319531640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8314071e10 0x7f83141f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f831a533640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140c1880 0x7f83141f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 -- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8314071e10 msgr2=0x7f83141f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8314071e10 0x7f83141f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 -- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140c1880 msgr2=0x7f83141f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140c1880 0x7f83141f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 -- 172.21.15.97:0/2702160804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094d0 con 0x7f8314071390 2023-12-04T05:39:17.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f8319d32640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f831001abf0 tx=0x7f83100192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100b6440 con 0x7f8314071390 2023-12-04T05:39:17.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100b65c0 con 0x7f8314071390 2023-12-04T05:39:17.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83140bfd50 con 0x7f8314071390 2023-12-04T05:39:17.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100b6970 con 0x7f8314071390 2023-12-04T05:39:17.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83141f4860 con 0x7f8314071390 2023-12-04T05:39:17.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83141f4a50 con 0x7f8314071390 2023-12-04T05:39:17.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.513+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f83100b2040 con 0x7f8314071390 2023-12-04T05:39:17.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.517+0000 7f830a7fc640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:17.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.517+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f831011dd00 con 0x7f8314071390 2023-12-04T05:39:17.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.517+0000 7f8319531640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:17.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.517+0000 7f8319531640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83140bb590 tx=0x7f8304007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:17.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.521+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83100eb320 con 0x7f8314071390 2023-12-04T05:39:17.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:17.725+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f8314068440 con 0x7f8314071390 2023-12-04T05:39:18.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f830a7fc640 1 -- 172.21.15.97:0/2702160804 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v175) v1 ==== 184+0+0 (secure 0 0 0) 0x7f83100ee940 con 0x7f8314071390 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 msgr2=0x7f82f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f83140bb590 tx=0x7f8304007d60 comp rx=0 tx=0).stop 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 msgr2=0x7f8314158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f831001abf0 tx=0x7f83100192e0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 shutdown_connections 2023-12-04T05:39:18.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83140c1880 0x7f83141f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8314071e10 0x7f83141f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 --2- 172.21.15.97:0/2702160804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8314071390 0x7f8314158090 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 >> 172.21.15.97:0/2702160804 conn(0x7f83140c2970 msgr2=0x7f83141490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 shutdown_connections 2023-12-04T05:39:18.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.005+0000 7f831bf96640 1 -- 172.21.15.97:0/2702160804 wait complete. 2023-12-04T05:39:18.031 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-04T05:39:18.031 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-04T05:39:18.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:18.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.165+0000 7f102a888640 1 Processor -- start 2023-12-04T05:39:18.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f102a888640 1 -- start start 2023-12-04T05:39:18.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f102a888640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f10240af630 0x7f10240c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f102a888640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1024154680 con 0x7f10240c72b0 2023-12-04T05:39:18.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f102a888640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1024154960 con 0x7f10240c4d50 2023-12-04T05:39:18.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f102a888640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240afa10 con 0x7f10240af630 2023-12-04T05:39:18.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029085640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f10240c72b0 0x7f102406b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37000/0 (socket says 172.21.15.97:37000) 2023-12-04T05:39:18.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029085640 1 -- 172.21.15.97:0/160625307 learned_addr learned my addr 172.21.15.97:0/160625307 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:18.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029886640 1 --2- 172.21.15.97:0/160625307 >> v2:172.21.15.143:3300/0 conn(0x7f10240af630 0x7f10240c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088236552 0 0) 0x7f1024154680 con 0x7f10240c72b0 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1010003530 con 0x7f10240c72b0 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936507254 0 0) 0x7f1010003530 con 0x7f10240c72b0 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029886640 1 -- 172.21.15.97:0/160625307 >> v1:172.21.15.143:6789/0 conn(0x7f10240c4d50 legacy=0x7f102406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029886640 1 -- 172.21.15.97:0/160625307 >> v1:172.21.15.97:6789/0 conn(0x7f10240c72b0 legacy=0x7f102406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.169+0000 7f1029886640 1 -- 172.21.15.97:0/160625307 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024154c40 con 0x7f10240af630 2023-12-04T05:39:18.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f1029886640 1 --2- 172.21.15.97:0/160625307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c4810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f10200097c0 tx=0x7f102001c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e582dad24ddbfe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1014001680 con 0x7f10240af630 2023-12-04T05:39:18.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10200a7050 con 0x7f10240af630 2023-12-04T05:39:18.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f1028884640 1 -- 172.21.15.97:0/160625307 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200ab620 con 0x7f10240af630 2023-12-04T05:39:18.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- 172.21.15.97:0/160625307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 msgr2=0x7f10240c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 --2- 172.21.15.97:0/160625307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c4810 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f10200097c0 tx=0x7f102001c280 comp rx=0 tx=0).stop 2023-12-04T05:39:18.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- 172.21.15.97:0/160625307 shutdown_connections 2023-12-04T05:39:18.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 --2- 172.21.15.97:0/160625307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c4810 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- 172.21.15.97:0/160625307 >> 172.21.15.97:0/160625307 conn(0x7f10240aba40 msgr2=0x7f10240abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- 172.21.15.97:0/160625307 shutdown_connections 2023-12-04T05:39:18.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- 172.21.15.97:0/160625307 wait complete. 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 Processor -- start 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.173+0000 7f102a888640 1 -- start start 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10240c4d50 0x7f10240c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 0x7f1024151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240bf840 con 0x7f10240c72b0 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10241ed030 con 0x7f10240af630 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240c0f60 con 0x7f10240c4d50 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 0x7f1024151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f1029886640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f1029886640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:55698/0 (socket says 172.21.15.97:55698) 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f1029886640 1 -- 172.21.15.97:0/3739196804 learned_addr learned my addr 172.21.15.97:0/3739196804 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f1029085640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10240c4d50 0x7f10240c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 -- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10240c4d50 msgr2=0x7f10240c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10240c4d50 0x7f10240c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 -- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 msgr2=0x7f10240c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 -- 172.21.15.97:0/3739196804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020009420 con 0x7f10240c72b0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f1029886640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a087640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 0x7f1024151080 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c730 tx=0x7f101c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c003b80 con 0x7f10240c72b0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c003ce0 con 0x7f10240c72b0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00aa30 con 0x7f10240c72b0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10240c1800 con 0x7f10240c72b0 2023-12-04T05:39:18.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10240c11b0 con 0x7f10240c72b0 2023-12-04T05:39:18.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.177+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10240c1990 con 0x7f10240c72b0 2023-12-04T05:39:18.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.181+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f101c00ab90 con 0x7f10240c72b0 2023-12-04T05:39:18.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.181+0000 7f101a7fc640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 0x7f1008068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.181+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f101c083d60 con 0x7f10240c72b0 2023-12-04T05:39:18.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.181+0000 7f1029886640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 0x7f1008068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.181+0000 7f1029886640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 0x7f1008068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f10240bd420 tx=0x7f10200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.185+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f101c051380 con 0x7f10240c72b0 2023-12-04T05:39:18.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.337+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f102404e890 con 0x7f10240c72b0 2023-12-04T05:39:18.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.337+0000 7f101a7fc640 1 -- 172.21.15.97:0/3739196804 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13105 (secure 0 0 0) 0x7f101c0549a0 con 0x7f10240c72b0 2023-12-04T05:39:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:18.343 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":60,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:17.000219+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/3569776712":"2023-12-05T05:39:13.792012+0000","172.21.15.97:6834/3569776712":"2023-12-05T05:39:13.792012+0000","172.21.15.97:6837/3150893568":"2023-12-05T05:39:07.346885+0000","172.21.15.97:6836/3150893568":"2023-12-05T05:39:07.346885+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 msgr2=0x7f1008068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 0x7f1008068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f10240bd420 tx=0x7f10200a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 msgr2=0x7f1024151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 0x7f1024151080 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c730 tx=0x7f101c00cbf0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 shutdown_connections 2023-12-04T05:39:18.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f10080668d0 0x7f1008068d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10240c72b0 0x7f1024151080 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10240c4d50 0x7f10240c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 --2- 172.21.15.97:0/3739196804 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10240af630 0x7f10240c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 >> 172.21.15.97:0/3739196804 conn(0x7f10240aba40 msgr2=0x7f1024151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 shutdown_connections 2023-12-04T05:39:18.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.341+0000 7f102a888640 1 -- 172.21.15.97:0/3739196804 wait complete. 2023-12-04T05:39:18.367 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:18.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:18.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.501+0000 7f1d474fe640 1 Processor -- start 2023-12-04T05:39:18.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.501+0000 7f1d474fe640 1 -- start start 2023-12-04T05:39:18.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.501+0000 7f1d474fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 0x7f1d400bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.501+0000 7f1d474fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d4006dea0 0x7f1d400700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d474fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4006da10 con 0x7f1d400bf7e0 2023-12-04T05:39:18.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d474fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4006d120 con 0x7f1d4006dea0 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d474fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4006d3c0 con 0x7f1d40071920 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 0x7f1d400bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d45a9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1d400bf7e0 0x7f1d4013d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:34370/0 (socket says 172.21.15.97:34370) 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d44a99640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1d4006dea0 0x7f1d400700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d45a9b640 1 -- 172.21.15.97:0/55540617 learned_addr learned my addr 172.21.15.97:0/55540617 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:18.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 -- 172.21.15.97:0/55540617 >> v2:172.21.15.143:3300/0 conn(0x7f1d4006dea0 msgr2=0x7f1d400700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 --2- 172.21.15.97:0/55540617 >> v2:172.21.15.143:3300/0 conn(0x7f1d4006dea0 0x7f1d400700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d37fff640 1 -- 172.21.15.97:0/55540617 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101770529 0 0) 0x7f1d4006da10 con 0x7f1d400bf7e0 2023-12-04T05:39:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 -- 172.21.15.97:0/55540617 >> v1:172.21.15.143:6789/0 conn(0x7f1d400bf7e0 legacy=0x7f1d4013d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 -- 172.21.15.97:0/55540617 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4006d6a0 con 0x7f1d40071920 2023-12-04T05:39:18.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.505+0000 7f1d4529a640 1 --2- 172.21.15.97:0/55540617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 0x7f1d400bf2a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097c0 tx=0x7f1d3c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5f64fc0242e5ec server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d37fff640 1 -- 172.21.15.97:0/55540617 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0ab660 con 0x7f1d40071920 2023-12-04T05:39:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d37fff640 1 -- 172.21.15.97:0/55540617 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0ab7c0 con 0x7f1d40071920 2023-12-04T05:39:18.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d37fff640 1 -- 172.21.15.97:0/55540617 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0abb50 con 0x7f1d40071920 2023-12-04T05:39:18.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- 172.21.15.97:0/55540617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 msgr2=0x7f1d400bf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- 172.21.15.97:0/55540617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 0x7f1d400bf2a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097c0 tx=0x7f1d3c01c480 comp rx=0 tx=0).stop 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- 172.21.15.97:0/55540617 shutdown_connections 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- 172.21.15.97:0/55540617 >> v2:172.21.15.143:3300/0 conn(0x7f1d4006dea0 0x7f1d400700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- 172.21.15.97:0/55540617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d40071920 0x7f1d400bf2a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- 172.21.15.97:0/55540617 >> 172.21.15.97:0/55540617 conn(0x7f1d400c5e70 msgr2=0x7f1d400c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- 172.21.15.97:0/55540617 shutdown_connections 2023-12-04T05:39:18.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- 172.21.15.97:0/55540617 wait complete. 2023-12-04T05:39:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 Processor -- start 2023-12-04T05:39:18.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- start start 2023-12-04T05:39:18.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4006dea0 0x7f1d400a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d400bf7e0 0x7f1d401394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401527d0 con 0x7f1d40071920 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401eda10 con 0x7f1d4006dea0 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d474fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400ab370 con 0x7f1d400bf7e0 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d44a99640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d44a99640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57948/0 (socket says 172.21.15.97:57948) 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d44a99640 1 -- 172.21.15.97:0/2485246915 learned_addr learned my addr 172.21.15.97:0/2485246915 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.509+0000 7f1d4529a640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4006dea0 0x7f1d400a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d45a9b640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d400bf7e0 0x7f1d401394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 -- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d400bf7e0 msgr2=0x7f1d401394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d400bf7e0 0x7f1d401394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 -- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4006dea0 msgr2=0x7f1d400a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4006dea0 0x7f1d400a8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 -- 172.21.15.97:0/2485246915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c009420 con 0x7f1d40071920 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d44a99640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000e930 tx=0x7f1d3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30009690 con 0x7f1d40071920 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000ca00 con 0x7f1d40071920 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d400aaad0 con 0x7f1d40071920 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000cd70 con 0x7f1d40071920 2023-12-04T05:39:18.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d400ab090 con 0x7f1d40071920 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d401edb50 con 0x7f1d40071920 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d30013470 con 0x7f1d40071920 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 0x7f1d24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.513+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1d30084360 con 0x7f1d40071920 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.517+0000 7f1d4529a640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 0x7f1d24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.517+0000 7f1d4529a640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 0x7f1d24068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0af000 tx=0x7f1d3c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.517+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d401edb50 con 0x7f1d40071920 2023-12-04T05:39:18.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d401edb50 con 0x7f1d40071920 2023-12-04T05:39:18.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d35ffb640 1 -- 172.21.15.97:0/2485246915 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d401edb50 con 0x7f1d40071920 2023-12-04T05:39:18.674 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:18.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 msgr2=0x7f1d24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 0x7f1d24068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0af000 tx=0x7f1d3c0a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 msgr2=0x7f1d40138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000e930 tx=0x7f1d3000edf0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 shutdown_connections 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d240668d0 0x7f1d24068d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d400bf7e0 0x7f1d401394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d40071920 0x7f1d40138ac0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 --2- 172.21.15.97:0/2485246915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4006dea0 0x7f1d400a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 >> 172.21.15.97:0/2485246915 conn(0x7f1d400c5e70 msgr2=0x7f1d400c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 shutdown_connections 2023-12-04T05:39:18.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.669+0000 7f1d474fe640 1 -- 172.21.15.97:0/2485246915 wait complete. 2023-12-04T05:39:18.695 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-04T05:39:18.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.825+0000 7fc6a23c3640 1 Processor -- start 2023-12-04T05:39:18.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a23c3640 1 -- start start 2023-12-04T05:39:18.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a23c3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc69c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a23c3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c152300 con 0x7fc69c14e970 2023-12-04T05:39:18.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a23c3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c071580 con 0x7fc69c06ca50 2023-12-04T05:39:18.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a23c3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14ed50 con 0x7fc69c06be00 2023-12-04T05:39:18.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fc69c14e970 0x7fc69c071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37010/0 (socket says 172.21.15.97:37010) 2023-12-04T05:39:18.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69bfff640 1 -- 172.21.15.97:0/2157598894 learned_addr learned my addr 172.21.15.97:0/2157598894 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc69c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014345745 0 0) 0x7fc68c001120 con 0x7fc69c14e970 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc684003530 con 0x7fc69c14e970 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019027700 0 0) 0x7fc684003530 con 0x7fc69c14e970 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 msgr2=0x7fc69c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc69c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 >> v1:172.21.15.143:6789/0 conn(0x7fc69c06ca50 legacy=0x7fc69c0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c06cea0 con 0x7fc69c14e970 2023-12-04T05:39:18.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fc68c001810 con 0x7fc69c14e970 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 >> v1:172.21.15.97:6789/0 conn(0x7fc69c14e970 legacy=0x7fc69c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc6840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc684003ef0 0x7fc6840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684004d10 0x7fc684005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14ed50 con 0x7fc684003ef0 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68400bb50 con 0x7fc684004d10 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68400df20 con 0x7fc69c06be00 2023-12-04T05:39:18.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc684003ef0 0x7fc6840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69bfff640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc6840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a0960640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684004d10 0x7fc684005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 -- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 msgr2=0x7fc6840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c06be00 0x7fc6840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 -- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684004d10 msgr2=0x7fc684005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684004d10 0x7fc684005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc69b7fe640 1 -- 172.21.15.97:0/2157598894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684003530 con 0x7fc684003ef0 2023-12-04T05:39:18.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.829+0000 7fc6a0960640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684004d10 0x7fc684005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:18.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc684003ef0 0x7fc6840047d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc690009ae0 tx=0x7fc69001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d089296877e24e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900a5530 con 0x7fc684003ef0 2023-12-04T05:39:18.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900a5690 con 0x7fc684003ef0 2023-12-04T05:39:18.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc69affd640 1 -- 172.21.15.97:0/2157598894 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900a5840 con 0x7fc684003ef0 2023-12-04T05:39:18.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 -- 172.21.15.97:0/2157598894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc684003ef0 msgr2=0x7fc6840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/2157598894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc684003ef0 0x7fc6840047d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc690009ae0 tx=0x7fc69001ca50 comp rx=0 tx=0).stop 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a0960640 1 -- 172.21.15.97:0/2157598894 reap_dead start 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 -- 172.21.15.97:0/2157598894 shutdown_connections 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 -- 172.21.15.97:0/2157598894 >> 172.21.15.97:0/2157598894 conn(0x7fc69c0c2970 msgr2=0x7fc69c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 -- 172.21.15.97:0/2157598894 shutdown_connections 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.833+0000 7fc6a23c3640 1 -- 172.21.15.97:0/2157598894 wait complete. 2023-12-04T05:39:18.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 Processor -- start 2023-12-04T05:39:18.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- start start 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 0x7fc69c0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c1ed550 0x7fc69c1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14f0e0 con 0x7fc69c150200 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14f3c0 con 0x7fc684003ef0 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c14f6a0 con 0x7fc69c1ed550 2023-12-04T05:39:18.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57966/0 (socket says 172.21.15.97:57966) 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 -- 172.21.15.97:0/4203284136 learned_addr learned my addr 172.21.15.97:0/4203284136 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69bfff640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 0x7fc69c0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a0960640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c1ed550 0x7fc69c1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 -- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c1ed550 msgr2=0x7fc69c1f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c1ed550 0x7fc69c1f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 -- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 msgr2=0x7fc69c0c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 0x7fc69c0c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 -- 172.21.15.97:0/4203284136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c14f980 con 0x7fc69c150200 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69bfff640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 0x7fc69c0c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc69b7fe640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc690009ae0 tx=0x7fc684005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690004020 con 0x7fc69c150200 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc690004180 con 0x7fc69c150200 2023-12-04T05:39:18.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6900044f0 con 0x7fc69c150200 2023-12-04T05:39:18.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c14f0e0 con 0x7fc69c150200 2023-12-04T05:39:18.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.837+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c0c5b80 con 0x7fc69c150200 2023-12-04T05:39:18.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c14fb10 con 0x7fc69c150200 2023-12-04T05:39:18.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc6900b4040 con 0x7fc69c150200 2023-12-04T05:39:18.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc698ff9640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 0x7fc688068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:18.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc69011e370 con 0x7fc69c150200 2023-12-04T05:39:18.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc69bfff640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 0x7fc688068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:18.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.841+0000 7fc69bfff640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 0x7fc688068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc69c1e1960 tx=0x7fc68c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:18.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:18.845+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6900eb8f0 con 0x7fc69c150200 2023-12-04T05:39:19.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:19.049+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7fc69c068440 con 0x7fc69c150200 2023-12-04T05:39:20.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc698ff9640 1 -- 172.21.15.97:0/4203284136 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v177) v1 ==== 162+0+0 (secure 0 0 0) 0x7fc6900eef10 con 0x7fc69c150200 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 msgr2=0x7fc688068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 0x7fc688068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc69c1e1960 tx=0x7fc68c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 msgr2=0x7fc69c1ed010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc690009ae0 tx=0x7fc684005800 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 shutdown_connections 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc6880668d0 0x7fc688068d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc69c1ed550 0x7fc69c1f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc69c150200 0x7fc69c1ed010 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 --2- 172.21.15.97:0/4203284136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc684003ef0 0x7fc69c0c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 >> 172.21.15.97:0/4203284136 conn(0x7fc69c0c2970 msgr2=0x7fc69c156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 shutdown_connections 2023-12-04T05:39:20.020 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.013+0000 7fc6a23c3640 1 -- 172.21.15.97:0/4203284136 wait complete. 2023-12-04T05:39:20.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-04T05:39:20.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.181+0000 7fcd35cfe640 1 Processor -- start 2023-12-04T05:39:20.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.181+0000 7fcd35cfe640 1 -- start start 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd35cfe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcd3014f960 0x7fcd301548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd35cfe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd3015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd35cfe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd30154640 con 0x7fcd3014eb30 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd35cfe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd300c0bd0 con 0x7fcd3014f960 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd35cfe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014ef10 con 0x7fcd30154e10 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcd3014eb30 0x7fcd3014f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37014/0 (socket says 172.21.15.97:37014) 2023-12-04T05:39:20.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2f7fe640 1 -- 172.21.15.97:0/1110205965 learned_addr learned my addr 172.21.15.97:0/1110205965 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:20.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2ffff640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd3015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 --2- 172.21.15.97:0/1110205965 >> v2:172.21.15.143:3300/0 conn(0x7fcd3014f960 0x7fcd301548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993047984 0 0) 0x7fcd30154640 con 0x7fcd3014eb30 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003530 con 0x7fcd3014eb30 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1711889439 0 0) 0x7fcd18003530 con 0x7fcd3014eb30 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 msgr2=0x7fcd3015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd3015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 >> v2:172.21.15.143:3300/0 conn(0x7fcd3014f960 msgr2=0x7fcd301548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 --2- 172.21.15.97:0/1110205965 >> v2:172.21.15.143:3300/0 conn(0x7fcd3014f960 0x7fcd301548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd301535a0 con 0x7fcd3014eb30 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fcd20001680 con 0x7fcd3014eb30 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 >> v1:172.21.15.97:6789/0 conn(0x7fcd3014eb30 legacy=0x7fcd3014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd180047d0 0x7fcd18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300c0bd0 con 0x7fcd180047d0 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3014ef10 con 0x7fcd18003980 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800dba0 con 0x7fcd30154e10 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd180047d0 0x7fcd18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2f7fe640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2ffff640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 -- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 msgr2=0x7fcd18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd30154e10 0x7fcd18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 -- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd18003980 msgr2=0x7fcd18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2effd640 1 -- 172.21.15.97:0/1110205965 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18003530 con 0x7fcd180047d0 2023-12-04T05:39:20.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.185+0000 7fcd2f7fe640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd18003980 0x7fcd18003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd2effd640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd180047d0 0x7fcd18004c50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009ae0 tx=0x7fcd2401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c76b582d96cc3e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240a55a0 con 0x7fcd180047d0 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd240a5700 con 0x7fcd180047d0 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd2e7fc640 1 -- 172.21.15.97:0/1110205965 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd240a5ab0 con 0x7fcd180047d0 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 -- 172.21.15.97:0/1110205965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd180047d0 msgr2=0x7fcd18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/1110205965 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd180047d0 0x7fcd18004c50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009ae0 tx=0x7fcd2401ca90 comp rx=0 tx=0).stop 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd2ffff640 1 -- 172.21.15.97:0/1110205965 reap_dead start 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 -- 172.21.15.97:0/1110205965 shutdown_connections 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 -- 172.21.15.97:0/1110205965 >> 172.21.15.97:0/1110205965 conn(0x7fcd300c5e70 msgr2=0x7fcd300c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:20.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 -- 172.21.15.97:0/1110205965 shutdown_connections 2023-12-04T05:39:20.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.189+0000 7fcd35cfe640 1 -- 172.21.15.97:0/1110205965 wait complete. 2023-12-04T05:39:20.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 Processor -- start 2023-12-04T05:39:20.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- start start 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd180047d0 0x7fcd30144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3006bf50 0x7fcd300aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30150930 con 0x7fcd301ea2b0 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301451e0 con 0x7fcd180047d0 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd300c54a0 con 0x7fcd3006bf50 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57994/0 (socket says 172.21.15.97:57994) 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 -- 172.21.15.97:0/3725793966 learned_addr learned my addr 172.21.15.97:0/3725793966 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2effd640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3006bf50 0x7fcd300aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2f7fe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd180047d0 0x7fcd30144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 -- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3006bf50 msgr2=0x7fcd300aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3006bf50 0x7fcd300aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 -- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd180047d0 msgr2=0x7fcd30144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd180047d0 0x7fcd30144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 -- 172.21.15.97:0/3725793966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd301449c0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd2ffff640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcd301551f0 tx=0x7fcd280115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800e070 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28011ed0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280039a0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3014fea0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd300aaab0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.193+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd300740f0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.197+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd28003b20 con 0x7fcd301ea2b0 2023-12-04T05:39:20.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.197+0000 7fcd17fff640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 0x7fcd1c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.197+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcd28084650 con 0x7fcd301ea2b0 2023-12-04T05:39:20.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.197+0000 7fcd2f7fe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 0x7fcd1c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.197+0000 7fcd2f7fe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 0x7fcd1c068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd300aadd0 tx=0x7fcd20001e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.201+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd28051bd0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.353+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd30068440 con 0x7fcd301ea2b0 2023-12-04T05:39:20.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.357+0000 7fcd17fff640 1 -- 172.21.15.97:0/3725793966 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd280551f0 con 0x7fcd301ea2b0 2023-12-04T05:39:20.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 msgr2=0x7fcd1c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 0x7fcd1c068dc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd300aadd0 tx=0x7fcd20001e50 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 msgr2=0x7fcd301ea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcd301551f0 tx=0x7fcd280115a0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 shutdown_connections 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcd1c066900 0x7fcd1c068dc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd301ea2b0 0x7fcd301ea740 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcd3006bf50 0x7fcd300aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 --2- 172.21.15.97:0/3725793966 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd180047d0 0x7fcd30144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 >> 172.21.15.97:0/3725793966 conn(0x7fcd300c5e70 msgr2=0x7fcd300c0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 shutdown_connections 2023-12-04T05:39:20.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.361+0000 7fcd35cfe640 1 -- 172.21.15.97:0/3725793966 wait complete. 2023-12-04T05:39:20.385 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:39:20.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:39:20.471 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:39:20.554 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:39:20.555 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:20.555 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:20.564 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:39:20.565 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:20.565 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:20.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:39:20.575 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-04T05:39:20.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:20.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 Processor -- start 2023-12-04T05:39:20.749 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 -- start start 2023-12-04T05:39:20.750 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa33c0c5d40 0x7fa33c0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33c157dc0 con 0x7fa33c151e10 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33c0c3cd0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa34165f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1521f0 con 0x7fa33c0a7290 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33affd640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa33c151e10 0x7fa33c158550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37028/0 (socket says 172.21.15.97:37028) 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33affd640 1 -- 172.21.15.97:0/1459850675 learned_addr learned my addr 172.21.15.97:0/1459850675 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa3327fc640 1 --2- 172.21.15.97:0/1459850675 >> v2:172.21.15.143:3300/0 conn(0x7fa33c0c5d40 0x7fa33c0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.751 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33b7fe640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33a7fc640 1 -- 172.21.15.97:0/1459850675 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017941634 0 0) 0x7fa33c157dc0 con 0x7fa33c151e10 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33a7fc640 1 -- 172.21.15.97:0/1459850675 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa328003530 con 0x7fa33c151e10 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa3327fc640 1 -- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 msgr2=0x7fa33c0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa3327fc640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c0c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa3327fc640 1 -- 172.21.15.97:0/1459850675 >> v1:172.21.15.97:6789/0 conn(0x7fa33c151e10 legacy=0x7fa33c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa3327fc640 1 -- 172.21.15.97:0/1459850675 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c158c60 con 0x7fa33c0c5d40 2023-12-04T05:39:20.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.745+0000 7fa33b7fe640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:20.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa3327fc640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c0c5d40 0x7fa33c0c1270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa324009d90 tx=0x7fa32401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a17049a720ac42 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa33a7fc640 1 -- 172.21.15.97:0/1459850675 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240a5860 con 0x7fa33c0c5d40 2023-12-04T05:39:20.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa33a7fc640 1 -- 172.21.15.97:0/1459850675 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3240a59c0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa33a7fc640 1 -- 172.21.15.97:0/1459850675 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240a5d30 con 0x7fa33c0c5d40 2023-12-04T05:39:20.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 -- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c0c5d40 msgr2=0x7fa33c0c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c0c5d40 0x7fa33c0c1270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa324009d90 tx=0x7fa32401c890 comp rx=0 tx=0).stop 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 -- 172.21.15.97:0/1459850675 shutdown_connections 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 --2- 172.21.15.97:0/1459850675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c0c5d40 0x7fa33c0c1270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 -- 172.21.15.97:0/1459850675 >> 172.21.15.97:0/1459850675 conn(0x7fa33c0c7e40 msgr2=0x7fa33c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 -- 172.21.15.97:0/1459850675 shutdown_connections 2023-12-04T05:39:20.756 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.749+0000 7fa34165f640 1 -- 172.21.15.97:0/1459850675 wait complete. 2023-12-04T05:39:20.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 Processor -- start 2023-12-04T05:39:20.757 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- start start 2023-12-04T05:39:20.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 0x7fa33c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1f06d0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c149a90 con 0x7fa33c151e10 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c1f08e0 con 0x7fa33c0a7290 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:57998/0 (socket says 172.21.15.97:57998) 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 -- 172.21.15.97:0/132150199 learned_addr learned my addr 172.21.15.97:0/132150199 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa33affd640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa33b7fe640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 0x7fa33c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 -- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 msgr2=0x7fa33c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 -- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 msgr2=0x7fa33c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 0x7fa33c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 -- 172.21.15.97:0/132150199 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009420 con 0x7fa33c0c5d40 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa33affd640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa33b7fe640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 0x7fa33c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:20.760 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa3327fc640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa32401af40 tx=0x7fa324019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324003ba0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324003d00 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324004240 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa324009a70 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.753+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c1f0ea0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c1f1090 con 0x7fa33c0c5d40 2023-12-04T05:39:20.761 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3240b4070 con 0x7fa33c0c5d40 2023-12-04T05:39:20.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa333fff640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 0x7fa31c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:20.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa32411e4e0 con 0x7fa33c0c5d40 2023-12-04T05:39:20.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa33affd640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 0x7fa31c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:20.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.757+0000 7fa33affd640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 0x7fa31c068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005890 tx=0x7fa32c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:20.766 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.761+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3240eb930 con 0x7fa33c0c5d40 2023-12-04T05:39:20.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.941+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa33c066b80 con 0x7fa33c0c5d40 2023-12-04T05:39:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.941+0000 7fa333fff640 1 -- 172.21.15.97:0/132150199 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fa3240b2090 con 0x7fa33c0c5d40 2023-12-04T05:39:20.947 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:20.947 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2882734537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2882734537},{"type":"v1","addr":"172.21.15.143:6834","nonce":2882734537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3440081242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3440081242},{"type":"v1","addr":"172.21.15.143:6835","nonce":3440081242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/1960318847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1960318847},{"type":"v1","addr":"172.21.15.97:6837","nonce":1960318847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6420,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2951145440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2951145440},{"type":"v1","addr":"172.21.15.97:6835","nonce":2951145440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-12-04T05:39:20.947 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 41 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 msgr2=0x7fa31c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 0x7fa31c068d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa32c005890 tx=0x7fa32c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 msgr2=0x7fa33c14d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa32401af40 tx=0x7fa324019630 comp rx=0 tx=0).stop 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 shutdown_connections 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa31c0668d0 0x7fa31c068d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa33c151e10 0x7fa33c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c0c5d40 0x7fa33c14d5f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 --2- 172.21.15.97:0/132150199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa33c0a7290 0x7fa33c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 >> 172.21.15.97:0/132150199 conn(0x7fa33c0c7e40 msgr2=0x7fa33c14efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 shutdown_connections 2023-12-04T05:39:20.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:20.945+0000 7fa34165f640 1 -- 172.21.15.97:0/132150199 wait complete. 2023-12-04T05:39:20.968 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T05:39:20.968 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-04T05:39:20.969 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-04T05:39:20.969 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:39:20.969 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T05:39:20.969 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-04T05:39:20.969 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-04T05:39:20.969 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:39:20.969 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T05:39:20.969 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-04T05:39:20.970 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-04T05:39:20.970 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:39:20.970 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T05:39:20.970 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-04T05:39:20.970 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-04T05:39:20.970 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:39:20.982 INFO:tasks.ceph.mds.a:Stopped 2023-12-04T05:39:20.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T05:39:20.984 INFO:tasks.ceph.mds.c:Stopped 2023-12-04T05:39:20.984 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T05:39:20.986 INFO:tasks.ceph.mds.b:Stopped 2023-12-04T05:39:20.986 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T05:39:20.987 INFO:tasks.ceph.mds.d:Stopped 2023-12-04T05:39:20.988 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T05:39:21.027 INFO:tasks.ceph.mds.a:Started 2023-12-04T05:39:21.027 DEBUG:teuthology.parallel:result is None 2023-12-04T05:39:21.029 INFO:tasks.ceph.mds.c:Started 2023-12-04T05:39:21.029 DEBUG:teuthology.parallel:result is None 2023-12-04T05:39:21.038 INFO:tasks.ceph.mds.b:Started 2023-12-04T05:39:21.038 DEBUG:teuthology.parallel:result is None 2023-12-04T05:39:21.041 INFO:tasks.ceph.mds.d:Started 2023-12-04T05:39:21.041 DEBUG:teuthology.parallel:result is None 2023-12-04T05:39:21.041 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-04T05:39:21.114 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:39:21.116 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:39:21.130 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2023-12-04T05:39:21.130 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2023-12-04T05:39:21.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 Processor -- start 2023-12-04T05:39:21.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 -- start start 2023-12-04T05:39:21.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-04T05:39:21.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-04T05:39:21.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-04T05:39:21.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4f00c1e70 0x7fe4f01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 0x7fe4f00a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f00aa240 con 0x7fe4f00a89a0 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f006c0c0 con 0x7fe4f00c1e70 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f686b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00aa500 con 0x7fe4f006c440 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4effff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe4f00c1e70 0x7fe4f01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f4e08640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe4f00a89a0 0x7fe4f006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37030/0 (socket says 172.21.15.97:37030) 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4f4e08640 1 -- 172.21.15.97:0/888716158 learned_addr learned my addr 172.21.15.97:0/888716158 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4ef7fe640 1 --2- 172.21.15.97:0/888716158 >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 0x7fe4f00a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4effff640 1 -- 172.21.15.97:0/888716158 >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 msgr2=0x7fe4f00a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4effff640 1 --2- 172.21.15.97:0/888716158 >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 0x7fe4f00a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:21.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4effff640 1 -- 172.21.15.97:0/888716158 >> v1:172.21.15.97:6789/0 conn(0x7fe4f00a89a0 legacy=0x7fe4f006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:21.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4effff640 1 -- 172.21.15.97:0/888716158 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00aa7e0 con 0x7fe4f00c1e70 2023-12-04T05:39:21.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4eeffd640 1 -- 172.21.15.97:0/888716158 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149364645 0 0) 0x7fe4f00aa240 con 0x7fe4f00a89a0 2023-12-04T05:39:21.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.185+0000 7fe4ef7fe640 1 --2- 172.21.15.97:0/888716158 >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 0x7fe4f00a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:21.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4effff640 1 --2- 172.21.15.97:0/888716158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00c1e70 0x7fe4f01524e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0072780 tx=0x7fe4e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf086a5086eaf30 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:21.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4eeffd640 1 -- 172.21.15.97:0/888716158 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00a7070 con 0x7fe4f00c1e70 2023-12-04T05:39:21.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4eeffd640 1 -- 172.21.15.97:0/888716158 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e00ab430 con 0x7fe4f00c1e70 2023-12-04T05:39:21.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4eeffd640 1 -- 172.21.15.97:0/888716158 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00ab7c0 con 0x7fe4f00c1e70 2023-12-04T05:39:21.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 -- 172.21.15.97:0/888716158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00c1e70 msgr2=0x7fe4f01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:21.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 --2- 172.21.15.97:0/888716158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00c1e70 0x7fe4f01524e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0072780 tx=0x7fe4e001c430 comp rx=0 tx=0).stop 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 -- 172.21.15.97:0/888716158 shutdown_connections 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 --2- 172.21.15.97:0/888716158 >> v2:172.21.15.143:3300/0 conn(0x7fe4f006c440 0x7fe4f00a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 --2- 172.21.15.97:0/888716158 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f00c1e70 0x7fe4f01524e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 -- 172.21.15.97:0/888716158 >> 172.21.15.97:0/888716158 conn(0x7fe4f00c5e70 msgr2=0x7fe4f00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 -- 172.21.15.97:0/888716158 shutdown_connections 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 -- 172.21.15.97:0/888716158 wait complete. 2023-12-04T05:39:21.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.189+0000 7fe4f686b640 1 Processor -- start 2023-12-04T05:39:21.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- start start 2023-12-04T05:39:21.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4f00a89a0 0x7fe4f0148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4f00c1e70 0x7fe4f014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f014e2d0 con 0x7fe4f006c440 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0142dc0 con 0x7fe4f00c1e70 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01425b0 con 0x7fe4f00a89a0 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58044/0 (socket says 172.21.15.97:58044) 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 -- 172.21.15.97:0/310555059 learned_addr learned my addr 172.21.15.97:0/310555059 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f4e08640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4f00c1e70 0x7fe4f014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4ef7fe640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4f00a89a0 0x7fe4f0148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 -- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4f00a89a0 msgr2=0x7fe4f0148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:21.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4f00a89a0 0x7fe4f0148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:21.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 -- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4f00c1e70 msgr2=0x7fe4f014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:21.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4f00c1e70 0x7fe4f014cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:21.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 -- 172.21.15.97:0/310555059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0009420 con 0x7fe4f006c440 2023-12-04T05:39:21.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4effff640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0019040 tx=0x7fe4e001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:21.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0004220 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e00b9070 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00c23d0 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00abe30 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f0142800 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.193+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0068440 con 0x7fe4f006c440 2023-12-04T05:39:21.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.197+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe4e00b4610 con 0x7fe4f006c440 2023-12-04T05:39:21.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.197+0000 7fe4ecff9640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 0x7fe4dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:21.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.197+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe4e00bb070 con 0x7fe4f006c440 2023-12-04T05:39:21.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.197+0000 7fe4ef7fe640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 0x7fe4dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:21.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.197+0000 7fe4ef7fe640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 0x7fe4dc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0156430 tx=0x7fe4e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:21.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.201+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4e00ebee0 con 0x7fe4f006c440 2023-12-04T05:39:21.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:21.361+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe4f006c220 con 0x7fe4f006c440 2023-12-04T05:39:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.037+0000 7fe4ecff9640 1 -- 172.21.15.97:0/310555059 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe4e00ef500 con 0x7fe4f006c440 2023-12-04T05:39:22.042 INFO:teuthology.orchestra.run.smithi097.stderr: removed all blocklist entries 2023-12-04T05:39:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 msgr2=0x7fe4dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 0x7fe4dc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0156430 tx=0x7fe4e4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 msgr2=0x7fe4f014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0019040 tx=0x7fe4e001ac70 comp rx=0 tx=0).stop 2023-12-04T05:39:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 shutdown_connections 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4dc0668d0 0x7fe4dc068d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4f00c1e70 0x7fe4f014cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe4f00a89a0 0x7fe4f0148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 --2- 172.21.15.97:0/310555059 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe4f006c440 0x7fe4f014f3b0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 >> 172.21.15.97:0/310555059 conn(0x7fe4f00c5e70 msgr2=0x7fe4f006c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 shutdown_connections 2023-12-04T05:39:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.041+0000 7fe4f686b640 1 -- 172.21.15.97:0/310555059 wait complete. 2023-12-04T05:39:22.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-04T05:39:22.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 Processor -- start 2023-12-04T05:39:22.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 -- start start 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fda5c154260 0x7fda5c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fda5c06df10 0x7fda5c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c06c760 con 0x7fda5c0a9470 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c0a8670 con 0x7fda5c06df10 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda61609640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c06c550 con 0x7fda5c154260 2023-12-04T05:39:22.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda527fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fda5c0a9470 0x7fda5c06d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37034/0 (socket says 172.21.15.97:37034) 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda527fc640 1 -- 172.21.15.97:0/2824723086 learned_addr learned my addr 172.21.15.97:0/2824723086 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda5b7fe640 1 --2- 172.21.15.97:0/2824723086 >> v2:172.21.15.97:3300/0 conn(0x7fda5c06df10 0x7fda5c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.205+0000 7fda5affd640 1 --2- 172.21.15.97:0/2824723086 >> v2:172.21.15.143:3300/0 conn(0x7fda5c154260 0x7fda5c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5a7fc640 1 -- 172.21.15.97:0/2824723086 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51510333 0 0) 0x7fda5c06c760 con 0x7fda5c0a9470 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5a7fc640 1 -- 172.21.15.97:0/2824723086 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda48003450 con 0x7fda5c0a9470 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5b7fe640 1 -- 172.21.15.97:0/2824723086 >> v2:172.21.15.143:3300/0 conn(0x7fda5c154260 msgr2=0x7fda5c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5b7fe640 1 --2- 172.21.15.97:0/2824723086 >> v2:172.21.15.143:3300/0 conn(0x7fda5c154260 0x7fda5c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5b7fe640 1 -- 172.21.15.97:0/2824723086 >> v1:172.21.15.97:6789/0 conn(0x7fda5c0a9470 legacy=0x7fda5c06d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5b7fe640 1 -- 172.21.15.97:0/2824723086 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c06ca40 con 0x7fda5c06df10 2023-12-04T05:39:22.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5b7fe640 1 --2- 172.21.15.97:0/2824723086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c06df10 0x7fda5c154b80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0c6f10 tx=0x7fda5401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fc68475054cc73 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5a7fc640 1 -- 172.21.15.97:0/2824723086 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ac410 con 0x7fda5c06df10 2023-12-04T05:39:22.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5a7fc640 1 -- 172.21.15.97:0/2824723086 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540ac570 con 0x7fda5c06df10 2023-12-04T05:39:22.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda5a7fc640 1 -- 172.21.15.97:0/2824723086 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ac900 con 0x7fda5c06df10 2023-12-04T05:39:22.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 -- 172.21.15.97:0/2824723086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c06df10 msgr2=0x7fda5c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 --2- 172.21.15.97:0/2824723086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c06df10 0x7fda5c154b80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0c6f10 tx=0x7fda5401c430 comp rx=0 tx=0).stop 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 -- 172.21.15.97:0/2824723086 shutdown_connections 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 --2- 172.21.15.97:0/2824723086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c06df10 0x7fda5c154b80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 --2- 172.21.15.97:0/2824723086 >> v2:172.21.15.143:3300/0 conn(0x7fda5c154260 0x7fda5c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.209+0000 7fda61609640 1 -- 172.21.15.97:0/2824723086 >> 172.21.15.97:0/2824723086 conn(0x7fda5c0c2970 msgr2=0x7fda5c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- 172.21.15.97:0/2824723086 shutdown_connections 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- 172.21.15.97:0/2824723086 wait complete. 2023-12-04T05:39:22.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 Processor -- start 2023-12-04T05:39:22.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- start start 2023-12-04T05:39:22.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 0x7fda5c13e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda5c154260 0x7fda5c1f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c147e20 con 0x7fda5c0a9470 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0bf440 con 0x7fda5c06df10 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda61609640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0bf720 con 0x7fda5c154260 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58056/0 (socket says 172.21.15.97:58056) 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 -- 172.21.15.97:0/3553924220 learned_addr learned my addr 172.21.15.97:0/3553924220 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda5affd640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 0x7fda5c13e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda5b7fe640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda5c154260 0x7fda5c1f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 -- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda5c154260 msgr2=0x7fda5c1f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda5c154260 0x7fda5c1f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 -- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 msgr2=0x7fda5c13e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 0x7fda5c13e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 -- 172.21.15.97:0/3553924220 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009420 con 0x7fda5c0a9470 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda5affd640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 0x7fda5c13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:22.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.213+0000 7fda527fc640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fda44005c10 tx=0x7fda4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400ad40 con 0x7fda5c0a9470 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44012400 con 0x7fda5c0a9470 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c0bfa00 con 0x7fda5c0a9470 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400aea0 con 0x7fda5c0a9470 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c147990 con 0x7fda5c0a9470 2023-12-04T05:39:22.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c147be0 con 0x7fda5c0a9470 2023-12-04T05:39:22.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fda44012790 con 0x7fda5c0a9470 2023-12-04T05:39:22.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 0x7fda3c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda44084640 con 0x7fda5c0a9470 2023-12-04T05:39:22.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.217+0000 7fda5affd640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 0x7fda3c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.221+0000 7fda5affd640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 0x7fda3c068dc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0a9980 tx=0x7fda4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.221+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda5c147be0 con 0x7fda5c0a9470 2023-12-04T05:39:22.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.425+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda5c147be0 con 0x7fda5c0a9470 2023-12-04T05:39:22.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.425+0000 7fda53fff640 1 -- 172.21.15.97:0/3553924220 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5081 (secure 0 0 0) 0x7fda5c147be0 con 0x7fda5c0a9470 2023-12-04T05:39:22.432 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_dump": [ 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.a", 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lOIFILRAAicRg3crgxeVlsV7NM1n7mw==", 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.433 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.434 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.b", 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lYdJoOhAA/pXezZGzriXfC7PkJPYzxw==", 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.c", 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ljoayNBAA5Quugau8ZuP7purlpz5Ilw==", 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:39:22.436 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mds.d", 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l86FvBhAARfh7Pfe7OxC55XiemjCXYw==", 2023-12-04T05:39:22.437 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.0", 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQArZW1lgv9DGxAAESL7fT3cBtlDP3ZL+8SiEQ==", 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.439 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.1", 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAuZW1lpkkDIxAAemUKa7Rs4XiY7eaOnzCZRw==", 2023-12-04T05:39:22.440 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.2", 2023-12-04T05:39:22.441 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAxZW1lsGxCKRAAVWWNEXg7H3hUauiE4BtjfA==", 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.3", 2023-12-04T05:39:22.442 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA0ZW1lUFbXLxAA2YUaH5LIpJU8Qq2k64ARFg==", 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.443 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.4", 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA6ZW1lJsdpOxAAtvDjgGrfndThS7iJdSYxZA==", 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.444 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.5", 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQA+ZW1lZzyUBhAAwZO11IA60hqFX9N9osxCXA==", 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.6", 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBBZW1lZbuLDRAAPQBdTdQHhezNoymtejlsvA==", 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.446 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "osd.7", 2023-12-04T05:39:22.447 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQBEZW1l1q8+ExAAaoF2kTbzNXGmjW03HTVXeA==", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow profile osd", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile osd", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.0", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg==", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow r", 2023-12-04T05:39:22.448 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.1", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ==", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow r", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.admin", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1ly44ACxAA1iafTImcOQmxRzlURmohcw==", 2023-12-04T05:39:22.449 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": "allow *", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow *", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "client.testuser", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQDvZW1lF3nyNRAApvGYN4s1ceJO031v4wlijg==", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow rw fsname=cephfs", 2023-12-04T05:39:22.450 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.x", 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1lLP/pKBAA0n+KwZOZL9N93B4cduwStQ==", 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:22.451 INFO:teuthology.orchestra.run.smithi097.stdout: "entity": "mgr.y", 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "AQAnZW1l8dDaJBAANHBgEjKz2FTTo8OrJVB1pw==", 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": { 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": "allow *", 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: "mon": "allow profile mgr", 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": "allow *" 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2023-12-04T05:39:22.452 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 msgr2=0x7fda3c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 0x7fda3c068dc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0a9980 tx=0x7fda4c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 msgr2=0x7fda5c141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fda44005c10 tx=0x7fda4400a430 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 shutdown_connections 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fda3c066900 0x7fda3c068dc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda5c154260 0x7fda5c1f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fda5c0a9470 0x7fda5c141b20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 --2- 172.21.15.97:0/3553924220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda5c06df10 0x7fda5c13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 >> 172.21.15.97:0/3553924220 conn(0x7fda5c0c2970 msgr2=0x7fda5c1e20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 shutdown_connections 2023-12-04T05:39:22.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.429+0000 7fda61609640 1 -- 172.21.15.97:0/3553924220 wait complete. 2023-12-04T05:39:22.455 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-04T05:39:22.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 Processor -- start 2023-12-04T05:39:22.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 -- start start 2023-12-04T05:39:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e280c7f00 0x7f6e28154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 0x7f6e28154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e280ca780 con 0x7f6e28151f10 2023-12-04T05:39:22.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e28158cc0 con 0x7f6e280c7f00 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e2d7e6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280c5700 con 0x7f6e280cac10 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e280c7f00 0x7f6e28154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e280c7f00 0x7f6e28154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58062/0 (socket says 172.21.15.97:58062) 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 -- 172.21.15.97:0/594385131 learned_addr learned my addr 172.21.15.97:0/594385131 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 -- 172.21.15.97:0/594385131 >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 msgr2=0x7f6e28154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e277fe640 1 --2- 172.21.15.97:0/594385131 >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 0x7f6e28154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 --2- 172.21.15.97:0/594385131 >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 0x7f6e28154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 -- 172.21.15.97:0/594385131 >> v1:172.21.15.143:6789/0 conn(0x7f6e28151f10 legacy=0x7f6e280c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e267fc640 1 -- 172.21.15.97:0/594385131 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28158720 con 0x7f6e280c7f00 2023-12-04T05:39:22.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.589+0000 7f6e277fe640 1 --2- 172.21.15.97:0/594385131 >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 0x7f6e28154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:22.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e267fc640 1 --2- 172.21.15.97:0/594385131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e280c7f00 0x7f6e28154720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6e2806bcd0 tx=0x7f6e1c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7820d41f879e53 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e25ffb640 1 -- 172.21.15.97:0/594385131 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0ab600 con 0x7f6e280c7f00 2023-12-04T05:39:22.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e25ffb640 1 -- 172.21.15.97:0/594385131 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0a7050 con 0x7f6e280c7f00 2023-12-04T05:39:22.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e25ffb640 1 -- 172.21.15.97:0/594385131 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0ab980 con 0x7f6e280c7f00 2023-12-04T05:39:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/594385131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e280c7f00 msgr2=0x7f6e28154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/594385131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e280c7f00 0x7f6e28154720 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6e2806bcd0 tx=0x7f6e1c01c370 comp rx=0 tx=0).stop 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/594385131 shutdown_connections 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/594385131 >> v2:172.21.15.143:3300/0 conn(0x7f6e280cac10 0x7f6e28154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/594385131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e280c7f00 0x7f6e28154720 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/594385131 >> 172.21.15.97:0/594385131 conn(0x7f6e28073950 msgr2=0x7f6e28073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/594385131 shutdown_connections 2023-12-04T05:39:22.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.593+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/594385131 wait complete. 2023-12-04T05:39:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 Processor -- start 2023-12-04T05:39:22.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- start start 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e280c7f00 0x7f6e280c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280cac10 0x7f6e280c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2814bcc0 con 0x7f6e28151f10 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280c0ea0 con 0x7f6e280cac10 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280c4060 con 0x7f6e280c7f00 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58078/0 (socket says 172.21.15.97:58078) 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 -- 172.21.15.97:0/4044914527 learned_addr learned my addr 172.21.15.97:0/4044914527 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e26ffd640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e280c7f00 0x7f6e280c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e267fc640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280cac10 0x7f6e280c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 -- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e280c7f00 msgr2=0x7f6e280c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e280c7f00 0x7f6e280c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 -- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280cac10 msgr2=0x7f6e280c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280cac10 0x7f6e280c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 -- 172.21.15.97:0/4044914527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0094d0 con 0x7f6e28151f10 2023-12-04T05:39:22.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e277fe640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000cd80 tx=0x7f6e2000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20003ba0 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20003d20 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20004260 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e280c4340 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.597+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280bf930 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28068440 con 0x7f6e28151f10 2023-12-04T05:39:22.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e2000b040 con 0x7f6e28151f10 2023-12-04T05:39:22.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e0f7fe640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 0x7f6e14068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e20084730 con 0x7f6e28151f10 2023-12-04T05:39:22.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e26ffd640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 0x7f6e14068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.601+0000 7f6e26ffd640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 0x7f6e14068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e280bf820 tx=0x7f6e18007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.605+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e20051d60 con 0x7f6e28151f10 2023-12-04T05:39:22.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.809+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f6e280c4920 con 0x7f6e28151f10 2023-12-04T05:39:22.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e0f7fe640 1 -- 172.21.15.97:0/4044914527 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v20) v1 ==== 85+0+0 (secure 0 0 0) 0x7f6e2001d090 con 0x7f6e28151f10 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 msgr2=0x7f6e14068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 0x7f6e14068d90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e280bf820 tx=0x7f6e18007e40 comp rx=0 tx=0).stop 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 msgr2=0x7f6e280c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000cd80 tx=0x7f6e2000a650 comp rx=0 tx=0).stop 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 shutdown_connections 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e140668d0 0x7f6e14068d90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e28151f10 0x7f6e280c10d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e280cac10 0x7f6e280c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 --2- 172.21.15.97:0/4044914527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e280c7f00 0x7f6e280c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 >> 172.21.15.97:0/4044914527 conn(0x7f6e28073950 msgr2=0x7f6e280aadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 shutdown_connections 2023-12-04T05:39:22.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.813+0000 7f6e2d7e6640 1 -- 172.21.15.97:0/4044914527 wait complete. 2023-12-04T05:39:22.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:22.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.969+0000 7f974ea32640 1 Processor -- start 2023-12-04T05:39:22.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.969+0000 7f974ea32640 1 -- start start 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f974ea32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97480ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f974ea32640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97480c48b0 0x7f97480c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f974ea32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480c9960 con 0x7f97480cab80 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f974ea32640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9748155120 con 0x7f97480c48b0 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f974ea32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974813d920 con 0x7f974813d1f0 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97480c48b0 0x7f97480c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97480c48b0 0x7f97480c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58094/0 (socket says 172.21.15.97:58094) 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 -- 172.21.15.97:0/3559779768 learned_addr learned my addr 172.21.15.97:0/3559779768 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f9747fff640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97480ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 -- 172.21.15.97:0/3559779768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 msgr2=0x7f97480ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97480ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 -- 172.21.15.97:0/3559779768 >> v1:172.21.15.143:6789/0 conn(0x7f97480cab80 legacy=0x7f9748157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.973+0000 7f97477fe640 1 -- 172.21.15.97:0/3559779768 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748154a60 con 0x7f97480c48b0 2023-12-04T05:39:22.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f97477fe640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480c48b0 0x7f97480c7e30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f973c009870 tx=0x7f973c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320c6b1052611ae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f9746ffd640 1 -- 172.21.15.97:0/3559779768 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0ab610 con 0x7f97480c48b0 2023-12-04T05:39:22.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f9746ffd640 1 -- 172.21.15.97:0/3559779768 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c0ab770 con 0x7f97480c48b0 2023-12-04T05:39:22.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f9746ffd640 1 -- 172.21.15.97:0/3559779768 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0abb00 con 0x7f97480c48b0 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- 172.21.15.97:0/3559779768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480c48b0 msgr2=0x7f97480c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480c48b0 0x7f97480c7e30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f973c009870 tx=0x7f973c01c3f0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- 172.21.15.97:0/3559779768 shutdown_connections 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480c48b0 0x7f97480c7e30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 --2- 172.21.15.97:0/3559779768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97480ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- 172.21.15.97:0/3559779768 >> 172.21.15.97:0/3559779768 conn(0x7f97480ac160 msgr2=0x7f97480c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- 172.21.15.97:0/3559779768 shutdown_connections 2023-12-04T05:39:22.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- 172.21.15.97:0/3559779768 wait complete. 2023-12-04T05:39:22.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 Processor -- start 2023-12-04T05:39:22.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.977+0000 7f974ea32640 1 -- start start 2023-12-04T05:39:22.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 0x7f974806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97481ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748157b70 con 0x7f97480cab80 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748133770 con 0x7f97480c48b0 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974813b8c0 con 0x7f974813d1f0 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58108/0 (socket says 172.21.15.97:58108) 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 -- 172.21.15.97:0/136841968 learned_addr learned my addr 172.21.15.97:0/136841968 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9747fff640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 0x7f974806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974cfcf640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97481ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 -- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 msgr2=0x7f97481ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97481ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 -- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 msgr2=0x7f974806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 0x7f974806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:22.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 -- 172.21.15.97:0/136841968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0094d0 con 0x7f97480cab80 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9747fff640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 0x7f974806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f97477fe640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f973c0ad040 tx=0x7f973c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0b4800 con 0x7f97480cab80 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c0b4980 con 0x7f97480cab80 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748133940 con 0x7f97480cab80 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0b4d30 con 0x7f97480cab80 2023-12-04T05:39:22.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480aab70 con 0x7f97480cab80 2023-12-04T05:39:22.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480aad00 con 0x7f97480cab80 2023-12-04T05:39:22.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.981+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f973c0c7440 con 0x7f97480cab80 2023-12-04T05:39:22.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.985+0000 7f9744ff9640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 0x7f9734068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:22.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.985+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f973c11ec70 con 0x7f97480cab80 2023-12-04T05:39:22.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.985+0000 7f9747fff640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 0x7f9734068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:22.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.985+0000 7f9747fff640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 0x7f9734068d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974806c7b0 tx=0x7f9738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:22.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:22.989+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f973c0ec1f0 con 0x7f97480cab80 2023-12-04T05:39:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.141+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9748068440 con 0x7f97480cab80 2023-12-04T05:39:23.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.141+0000 7f9744ff9640 1 -- 172.21.15.97:0/136841968 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12846 (secure 0 0 0) 0x7f973c0ef810 con 0x7f97480cab80 2023-12-04T05:39:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:23.148 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":64,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:22.055230+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 msgr2=0x7f9734068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 0x7f9734068d90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974806c7b0 tx=0x7f9738008040 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 msgr2=0x7f9748151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f973c0ad040 tx=0x7f973c01ac30 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 shutdown_connections 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97340668d0 0x7f9734068d90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f974813d1f0 0x7f97481ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97480cab80 0x7f9748151420 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 --2- 172.21.15.97:0/136841968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97480c48b0 0x7f974806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 >> 172.21.15.97:0/136841968 conn(0x7f97480ac160 msgr2=0x7f974813c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 shutdown_connections 2023-12-04T05:39:23.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.145+0000 7f974ea32640 1 -- 172.21.15.97:0/136841968 wait complete. 2023-12-04T05:39:23.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:23.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:23.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 Processor -- start 2023-12-04T05:39:23.310 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 -- start start 2023-12-04T05:39:23.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f00c1e70 0x7fc7f01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f006c440 0x7fc7f00a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.312 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00aa240 con 0x7fc7f00a89a0 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f006c0c0 con 0x7fc7f00c1e70 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7f5b8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00aa500 con 0x7fc7f006c440 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f00c1e70 0x7fc7f01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f00c1e70 0x7fc7f01524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58122/0 (socket says 172.21.15.97:58122) 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1006646567 learned_addr learned my addr 172.21.15.97:0/1006646567 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7eeffd640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f006c440 0x7fc7f00a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1006646567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f006c440 msgr2=0x7fc7f00a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f006c440 0x7fc7f00a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.313 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1006646567 >> v1:172.21.15.143:6789/0 conn(0x7fc7f00a89a0 legacy=0x7fc7f006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.314 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.305+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1006646567 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00aa7e0 con 0x7fc7f00c1e70 2023-12-04T05:39:23.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01524e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009870 tx=0x7fc7e001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351f4c465f151b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7ee7fc640 1 -- 172.21.15.97:0/1006646567 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00a95f0 con 0x7fc7f00c1e70 2023-12-04T05:39:23.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7ee7fc640 1 -- 172.21.15.97:0/1006646567 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e00a9750 con 0x7fc7f00c1e70 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7ee7fc640 1 -- 172.21.15.97:0/1006646567 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00a9ae0 con 0x7fc7f00c1e70 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1006646567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f00c1e70 msgr2=0x7fc7f01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01524e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009870 tx=0x7fc7e001c510 comp rx=0 tx=0).stop 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1006646567 shutdown_connections 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f006c440 0x7fc7f00a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1006646567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01524e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1006646567 >> 172.21.15.97:0/1006646567 conn(0x7fc7f00c5e70 msgr2=0x7fc7f00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1006646567 shutdown_connections 2023-12-04T05:39:23.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.309+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1006646567 wait complete. 2023-12-04T05:39:23.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 Processor -- start 2023-12-04T05:39:23.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- start start 2023-12-04T05:39:23.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f00a89a0 0x7fc7f015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01ed130 con 0x7fc7f006c440 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01f06a0 con 0x7fc7f00c1e70 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014d050 con 0x7fc7f00a89a0 2023-12-04T05:39:23.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58128/0 (socket says 172.21.15.97:58128) 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1801639535 learned_addr learned my addr 172.21.15.97:0/1801639535 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7eeffd640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f00a89a0 0x7fc7f015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7effff640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f00a89a0 msgr2=0x7fc7f015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f00a89a0 0x7fc7f015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f00c1e70 msgr2=0x7fc7f01ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 -- 172.21.15.97:0/1801639535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00094d0 con 0x7fc7f006c440 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ab040 tx=0x7fc7e001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00a95f0 con 0x7fc7f006c440 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e00b1820 con 0x7fc7f006c440 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00b1bd0 con 0x7fc7f006c440 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f00c23d0 con 0x7fc7f006c440 2023-12-04T05:39:23.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.313+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f0071e30 con 0x7fc7f006c440 2023-12-04T05:39:23.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f01ed2a0 con 0x7fc7f006c440 2023-12-04T05:39:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7e00b1d30 con 0x7fc7f006c440 2023-12-04T05:39:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7d7fff640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 0x7fc7dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7e011ec20 con 0x7fc7f006c440 2023-12-04T05:39:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7eeffd640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 0x7fc7dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.317+0000 7fc7eeffd640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 0x7fc7dc068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0156250 tx=0x7fc7e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.321+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7e00ec2c0 con 0x7fc7f006c440 2023-12-04T05:39:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7f0068440 con 0x7fc7f006c440 2023-12-04T05:39:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7d7fff640 1 -- 172.21.15.97:0/1801639535 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7e00c1020 con 0x7fc7f006c440 2023-12-04T05:39:23.478 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 msgr2=0x7fc7dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 0x7fc7dc068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0156250 tx=0x7fc7e4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 msgr2=0x7fc7f01f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ab040 tx=0x7fc7e001ad50 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 shutdown_connections 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7dc0668d0 0x7fc7dc068d90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f00c1e70 0x7fc7f01ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f00a89a0 0x7fc7f015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 --2- 172.21.15.97:0/1801639535 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f006c440 0x7fc7f01f10a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 >> 172.21.15.97:0/1801639535 conn(0x7fc7f00c5e70 msgr2=0x7fc7f015c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.473+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 shutdown_connections 2023-12-04T05:39:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.477+0000 7fc7f5b8d640 1 -- 172.21.15.97:0/1801639535 wait complete. 2023-12-04T05:39:23.500 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:39:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 Processor -- start 2023-12-04T05:39:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 -- start start 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d4c13d1f0 0x7f1d4c0ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0c9960 con 0x7f1d4c0cab80 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c155120 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d50e6b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c13d920 con 0x7f1d4c0c48b0 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1d4c13d1f0 0x7f1d4c0ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4ad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1d4c0cab80 0x7f1d4c157c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37036/0 (socket says 172.21.15.97:37036) 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4ad9d640 1 -- 172.21.15.97:0/3475193876 learned_addr learned my addr 172.21.15.97:0/3475193876 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d41d9b640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d49d9b640 1 -- 172.21.15.97:0/3475193876 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167530525 0 0) 0x7f1d4c0c9960 con 0x7f1d4c0cab80 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d49d9b640 1 -- 172.21.15.97:0/3475193876 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d38003530 con 0x7f1d4c0cab80 2023-12-04T05:39:23.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4a59c640 1 -- 172.21.15.97:0/3475193876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 msgr2=0x7f1d4c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:23.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4a59c640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c0c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4a59c640 1 -- 172.21.15.97:0/3475193876 >> v1:172.21.15.97:6789/0 conn(0x7f1d4c0cab80 legacy=0x7f1d4c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d4a59c640 1 -- 172.21.15.97:0/3475193876 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c154a60 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.633+0000 7f1d41d9b640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:23.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d4a59c640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0ca640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097c0 tx=0x7f1d3c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b8ba5064bf1ece server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d49d9b640 1 -- 172.21.15.97:0/3475193876 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c004230 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d49d9b640 1 -- 172.21.15.97:0/3475193876 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0a7050 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d49d9b640 1 -- 172.21.15.97:0/3475193876 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c003620 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 -- 172.21.15.97:0/3475193876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 msgr2=0x7f1d4c0ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0ca640 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097c0 tx=0x7f1d3c01c330 comp rx=0 tx=0).stop 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 -- 172.21.15.97:0/3475193876 shutdown_connections 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/3475193876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0ca640 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 -- 172.21.15.97:0/3475193876 >> 172.21.15.97:0/3475193876 conn(0x7f1d4c0ac160 msgr2=0x7f1d4c0c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 -- 172.21.15.97:0/3475193876 shutdown_connections 2023-12-04T05:39:23.644 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.637+0000 7f1d50e6b640 1 -- 172.21.15.97:0/3475193876 wait complete. 2023-12-04T05:39:23.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 Processor -- start 2023-12-04T05:39:23.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- start start 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4c0cab80 0x7f1d4c0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0af9d0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c157770 con 0x7f1d4c0cab80 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c157a50 con 0x7f1d4c0c48b0 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58142/0 (socket says 172.21.15.97:58142) 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 -- 172.21.15.97:0/2555305519 learned_addr learned my addr 172.21.15.97:0/2555305519 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4a59c640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d41d9b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4c0cab80 0x7f1d4c0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 -- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 msgr2=0x7f1d4c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c06c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 -- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4c0cab80 msgr2=0x7f1d4c0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4c0cab80 0x7f1d4c0ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 -- 172.21.15.97:0/2555305519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c009420 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d4ad9d640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c450 tx=0x7f1d4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44005cf0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44005e50 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0af660 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440072b0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.641+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c06c900 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0afb40 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d44007410 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d437fe640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 0x7f1d2c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d44083490 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d4a59c640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 0x7f1d2c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.645+0000 7f1d4a59c640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 0x7f1d2c068dc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0ad000 tx=0x7f1d3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.649+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d44050ac0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1d4c157bc0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d437fe640 1 -- 172.21.15.97:0/2555305519 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1d440540e0 con 0x7f1d4c13d1f0 2023-12-04T05:39:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:23.807 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:39:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:23.807 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:39:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:39:23.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:23.808 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:39:23.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 msgr2=0x7f1d2c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 0x7f1d2c068dc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0ad000 tx=0x7f1d3c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:23.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 msgr2=0x7f1d4c0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c450 tx=0x7f1d4400c910 comp rx=0 tx=0).stop 2023-12-04T05:39:23.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 shutdown_connections 2023-12-04T05:39:23.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1d2c066900 0x7f1d2c068dc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1d4c13d1f0 0x7f1d4c0adba0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d4c0cab80 0x7f1d4c0ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 --2- 172.21.15.97:0/2555305519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d4c0c48b0 0x7f1d4c06c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 >> 172.21.15.97:0/2555305519 conn(0x7f1d4c0ac160 msgr2=0x7f1d4c13c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 shutdown_connections 2023-12-04T05:39:23.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.801+0000 7f1d50e6b640 1 -- 172.21.15.97:0/2555305519 wait complete. 2023-12-04T05:39:23.827 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T05:39:23.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T05:39:23.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.961+0000 7f2ebce17640 1 Processor -- start 2023-12-04T05:39:23.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.961+0000 7f2ebce17640 1 -- start start 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2ebce17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2eb80a8e70 0x7f2eb8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2ebce17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb814feb0 con 0x7f2eb80c3570 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2ebce17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb806d560 con 0x7f2eb814fad0 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2ebce17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb81533f0 con 0x7f2eb80a8e70 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eaffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2eb80c3570 0x7f2eb81527a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:37052/0 (socket says 172.21.15.97:37052) 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eaffff640 1 -- 172.21.15.97:0/1479872762 learned_addr learned my addr 172.21.15.97:0/1479872762 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:23.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb6d9d640 1 --2- 172.21.15.97:0/1479872762 >> v2:172.21.15.143:3300/0 conn(0x7f2eb80a8e70 0x7f2eb8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190988055 0 0) 0x7f2eb814feb0 con 0x7f2eb80c3570 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea4003530 con 0x7f2eb80c3570 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110110326 0 0) 0x7f2eb806d560 con 0x7f2eb814fad0 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb814feb0 con 0x7f2eb814fad0 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 86188295 0 0) 0x7f2ea4003530 con 0x7f2eb80c3570 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb6d9d640 1 -- 172.21.15.97:0/1479872762 >> v1:172.21.15.143:6789/0 conn(0x7f2eb814fad0 legacy=0x7f2eb80c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb6d9d640 1 -- 172.21.15.97:0/1479872762 >> v1:172.21.15.97:6789/0 conn(0x7f2eb80c3570 legacy=0x7f2eb81527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.971 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.965+0000 7f2eb6d9d640 1 -- 172.21.15.97:0/1479872762 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb806d840 con 0x7f2eb80a8e70 2023-12-04T05:39:23.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2eb6d9d640 1 --2- 172.21.15.97:0/1479872762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb8152eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009d90 tx=0x7f2eb001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cebebd435e15f40 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00016a0 con 0x7f2eb80a8e70 2023-12-04T05:39:23.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00a55a0 con 0x7f2eb80a8e70 2023-12-04T05:39:23.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2eb5d9b640 1 -- 172.21.15.97:0/1479872762 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00a5910 con 0x7f2eb80a8e70 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 -- 172.21.15.97:0/1479872762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 msgr2=0x7f2eb8152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 --2- 172.21.15.97:0/1479872762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb8152eb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009d90 tx=0x7f2eb001c870 comp rx=0 tx=0).stop 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 -- 172.21.15.97:0/1479872762 shutdown_connections 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 --2- 172.21.15.97:0/1479872762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb8152eb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 -- 172.21.15.97:0/1479872762 >> 172.21.15.97:0/1479872762 conn(0x7f2eb80c2a50 msgr2=0x7f2eb80c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 -- 172.21.15.97:0/1479872762 shutdown_connections 2023-12-04T05:39:23.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 -- 172.21.15.97:0/1479872762 wait complete. 2023-12-04T05:39:23.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.969+0000 7f2ebce17640 1 Processor -- start 2023-12-04T05:39:23.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- start start 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb81490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 0x7f2eb8151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81496d0 con 0x7f2eb80c3570 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81eb5d0 con 0x7f2eb80a8e70 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81568a0 con 0x7f2eb814fad0 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:58158/0 (socket says 172.21.15.97:58158) 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 -- 172.21.15.97:0/2825647259 learned_addr learned my addr 172.21.15.97:0/2825647259 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:23.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eb6d9d640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 0x7f2eb8151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eb659c640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb81490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 -- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 msgr2=0x7f2eb8151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 0x7f2eb8151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 -- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 msgr2=0x7f2eb81490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb81490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 -- 172.21.15.97:0/2825647259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0009a70 con 0x7f2eb80c3570 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eb6d9d640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 0x7f2eb8151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaffff640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c750 tx=0x7f2ea000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0005ae0 con 0x7f2eb80c3570 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0005c40 con 0x7f2eb80c3570 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0007070 con 0x7f2eb80c3570 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb81ea810 con 0x7f2eb80c3570 2023-12-04T05:39:23.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb81eadd0 con 0x7f2eb80c3570 2023-12-04T05:39:23.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8068440 con 0x7f2eb80c3570 2023-12-04T05:39:23.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.973+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2ea00071d0 con 0x7f2eb80c3570 2023-12-04T05:39:23.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.977+0000 7f2eaeffd640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 0x7f2e98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:23.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.977+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ea00836d0 con 0x7f2eb80c3570 2023-12-04T05:39:23.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.977+0000 7f2eb659c640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 0x7f2e98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:23.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.977+0000 7f2eb659c640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 0x7f2e98068d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80011f0 tx=0x7f2ea8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:23.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:23.981+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ea0050d00 con 0x7f2eb80c3570 2023-12-04T05:39:24.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:24.133+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2eb80725d0 con 0x7f2eb80c3570 2023-12-04T05:39:25.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.041+0000 7f2eaeffd640 1 -- 172.21.15.97:0/2825647259 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2ea00170b0 con 0x7f2eb80c3570 2023-12-04T05:39:25.047 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' created 2023-12-04T05:39:25.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 msgr2=0x7f2e98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 0x7f2e98068d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80011f0 tx=0x7f2ea8009040 comp rx=0 tx=0).stop 2023-12-04T05:39:25.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 msgr2=0x7f2eb813dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c750 tx=0x7f2ea000cc10 comp rx=0 tx=0).stop 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 shutdown_connections 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e980668d0 0x7f2e98068d90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb814fad0 0x7f2eb8151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2eb80c3570 0x7f2eb813dc60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 --2- 172.21.15.97:0/2825647259 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb80a8e70 0x7f2eb81490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 >> 172.21.15.97:0/2825647259 conn(0x7f2eb80c2a50 msgr2=0x7f2eb80c2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 shutdown_connections 2023-12-04T05:39:25.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.045+0000 7f2ebce17640 1 -- 172.21.15.97:0/2825647259 wait complete. 2023-12-04T05:39:25.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:39:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 Processor -- start 2023-12-04T05:39:25.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 -- start start 2023-12-04T05:39:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f72e814f960 0x7f72e81548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e8154640 con 0x7f72e814eb30 2023-12-04T05:39:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e80c0bd0 con 0x7f72e814f960 2023-12-04T05:39:25.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72eddaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e814ef10 con 0x7f72e8154e10 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:40422/0 (socket says 172.21.15.97:40422) 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 -- 172.21.15.97:0/2978420247 learned_addr learned my addr 172.21.15.97:0/2978420247 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e6ffd640 1 --2- 172.21.15.97:0/2978420247 >> v2:172.21.15.143:3300/0 conn(0x7f72e814f960 0x7f72e81548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e67fc640 1 -- 172.21.15.97:0/2978420247 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501264523 0 0) 0x7f72e8154640 con 0x7f72e814eb30 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 -- 172.21.15.97:0/2978420247 >> v2:172.21.15.143:3300/0 conn(0x7f72e814f960 msgr2=0x7f72e81548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 --2- 172.21.15.97:0/2978420247 >> v2:172.21.15.143:3300/0 conn(0x7f72e814f960 0x7f72e81548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 -- 172.21.15.97:0/2978420247 >> v1:172.21.15.143:6789/0 conn(0x7f72e814eb30 legacy=0x7f72e814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.217+0000 7f72e7fff640 1 -- 172.21.15.97:0/2978420247 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e81535a0 con 0x7f72e8154e10 2023-12-04T05:39:25.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72e7fff640 1 --2- 172.21.15.97:0/2978420247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009e50 tx=0x7f72e001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba44ccc88cb097b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72e67fc640 1 -- 172.21.15.97:0/2978420247 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00a57c0 con 0x7f72e8154e10 2023-12-04T05:39:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72e67fc640 1 -- 172.21.15.97:0/2978420247 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00a5920 con 0x7f72e8154e10 2023-12-04T05:39:25.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72e67fc640 1 -- 172.21.15.97:0/2978420247 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00a5cb0 con 0x7f72e8154e10 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 -- 172.21.15.97:0/2978420247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 msgr2=0x7f72e815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 --2- 172.21.15.97:0/2978420247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009e50 tx=0x7f72e001c9e0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 -- 172.21.15.97:0/2978420247 shutdown_connections 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 --2- 172.21.15.97:0/2978420247 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e8154e10 0x7f72e815bc60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 --2- 172.21.15.97:0/2978420247 >> v2:172.21.15.143:3300/0 conn(0x7f72e814f960 0x7f72e81548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 -- 172.21.15.97:0/2978420247 >> 172.21.15.97:0/2978420247 conn(0x7f72e80c5e70 msgr2=0x7f72e80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 -- 172.21.15.97:0/2978420247 shutdown_connections 2023-12-04T05:39:25.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.221+0000 7f72eddaa640 1 -- 172.21.15.97:0/2978420247 wait complete. 2023-12-04T05:39:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 Processor -- start 2023-12-04T05:39:25.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- start start 2023-12-04T05:39:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e814eb30 0x7f72e8149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e814f960 0x7f72e806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e814d2d0 con 0x7f72e8154e10 2023-12-04T05:39:25.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e81f1980 con 0x7f72e814f960 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e81f0bc0 con 0x7f72e814eb30 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60394/0 (socket says 172.21.15.97:60394) 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 -- 172.21.15.97:0/3983908876 learned_addr learned my addr 172.21.15.97:0/3983908876 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e77fe640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e814eb30 0x7f72e8149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e6ffd640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e814f960 0x7f72e806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 -- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e814eb30 msgr2=0x7f72e8149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e814eb30 0x7f72e8149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 -- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e814f960 msgr2=0x7f72e806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e814f960 0x7f72e806bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 -- 172.21.15.97:0/3983908876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009b30 con 0x7f72e8154e10 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72e7fff640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f72e001a610 tx=0x7f72e0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b8640 con 0x7f72e8154e10 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00b87c0 con 0x7f72e8154e10 2023-12-04T05:39:25.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00b8b70 con 0x7f72e8154e10 2023-12-04T05:39:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e81f0ea0 con 0x7f72e8154e10 2023-12-04T05:39:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.225+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e81f1460 con 0x7f72e8154e10 2023-12-04T05:39:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8068440 con 0x7f72e8154e10 2023-12-04T05:39:25.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72e00b8cd0 con 0x7f72e8154e10 2023-12-04T05:39:25.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72cffff640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 0x7f72d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f72e011f460 con 0x7f72e8154e10 2023-12-04T05:39:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72e77fe640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 0x7f72d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:25.235 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.229+0000 7f72e77fe640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 0x7f72d4068d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000f70 tx=0x7f72d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:25.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.233+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72e00ec920 con 0x7f72e8154e10 2023-12-04T05:39:25.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:25.385+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f72e80a8ac0 con 0x7f72e8154e10 2023-12-04T05:39:26.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.049+0000 7f72cffff640 1 -- 172.21.15.97:0/3983908876 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f72e00eff40 con 0x7f72e8154e10 2023-12-04T05:39:26.056 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' created 2023-12-04T05:39:26.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 msgr2=0x7f72d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 0x7f72d4068d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f72d8000f70 tx=0x7f72d8009040 comp rx=0 tx=0).stop 2023-12-04T05:39:26.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 msgr2=0x7f72e806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f72e001a610 tx=0x7f72e0019780 comp rx=0 tx=0).stop 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 shutdown_connections 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f72d40668d0 0x7f72d4068d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f72e8154e10 0x7f72e806c490 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72e814f960 0x7f72e806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 --2- 172.21.15.97:0/3983908876 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72e814eb30 0x7f72e8149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 >> 172.21.15.97:0/3983908876 conn(0x7f72e80c5e70 msgr2=0x7f72e8144c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:26.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.053+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 shutdown_connections 2023-12-04T05:39:26.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.057+0000 7f72eddaa640 1 -- 172.21.15.97:0/3983908876 wait complete. 2023-12-04T05:39:26.098 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T05:39:26.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 Processor -- start 2023-12-04T05:39:26.242 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 -- start start 2023-12-04T05:39:26.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f39a406c440 0x7f39a41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39a406d210 0x7f39a406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.243 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a40aa240 con 0x7f39a40c1e70 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a406c0c0 con 0x7f39a406c440 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a96c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40aa500 con 0x7f39a406d210 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f39a406c440 0x7f39a41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f39a406c440 0x7f39a41524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60404/0 (socket says 172.21.15.97:60404) 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 -- 172.21.15.97:0/695122591 learned_addr learned my addr 172.21.15.97:0/695122591 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f39a37fe640 1 --2- 172.21.15.97:0/695122591 >> v2:172.21.15.143:3300/0 conn(0x7f39a406d210 0x7f39a406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 -- 172.21.15.97:0/695122591 >> v2:172.21.15.143:3300/0 conn(0x7f39a406d210 msgr2=0x7f39a406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 --2- 172.21.15.97:0/695122591 >> v2:172.21.15.143:3300/0 conn(0x7f39a406d210 0x7f39a406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 -- 172.21.15.97:0/695122591 >> v1:172.21.15.143:6789/0 conn(0x7f39a40c1e70 legacy=0x7f39a40a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.237+0000 7f399a7fc640 1 -- 172.21.15.97:0/695122591 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40aa7e0 con 0x7f39a406c440 2023-12-04T05:39:26.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f399a7fc640 1 --2- 172.21.15.97:0/695122591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a406c440 0x7f39a41524e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f39a4150020 tx=0x7f398c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e948fc4bc847380 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:26.246 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a27fc640 1 -- 172.21.15.97:0/695122591 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0ac640 con 0x7f39a406c440 2023-12-04T05:39:26.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a27fc640 1 -- 172.21.15.97:0/695122591 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c0ac7a0 con 0x7f39a406c440 2023-12-04T05:39:26.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a27fc640 1 -- 172.21.15.97:0/695122591 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0acb30 con 0x7f39a406c440 2023-12-04T05:39:26.247 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 -- 172.21.15.97:0/695122591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a406c440 msgr2=0x7f39a41524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 --2- 172.21.15.97:0/695122591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a406c440 0x7f39a41524e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f39a4150020 tx=0x7f398c01c4d0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 -- 172.21.15.97:0/695122591 shutdown_connections 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 --2- 172.21.15.97:0/695122591 >> v2:172.21.15.143:3300/0 conn(0x7f39a406d210 0x7f39a406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 --2- 172.21.15.97:0/695122591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a406c440 0x7f39a41524e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 -- 172.21.15.97:0/695122591 >> 172.21.15.97:0/695122591 conn(0x7f39a40c5e70 msgr2=0x7f39a40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 -- 172.21.15.97:0/695122591 shutdown_connections 2023-12-04T05:39:26.248 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.241+0000 7f39a96c9640 1 -- 172.21.15.97:0/695122591 wait complete. 2023-12-04T05:39:26.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 Processor -- start 2023-12-04T05:39:26.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- start start 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39a406c440 0x7f39a4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 0x7f39a40c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4156550 con 0x7f39a40c1e70 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41eaf90 con 0x7f39a406d210 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41eac40 con 0x7f39a406c440 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60410/0 (socket says 172.21.15.97:60410) 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 -- 172.21.15.97:0/1105378803 learned_addr learned my addr 172.21.15.97:0/1105378803 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:26.251 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a2ffd640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39a406c440 0x7f39a4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f399a7fc640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 0x7f39a40c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 -- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39a406c440 msgr2=0x7f39a4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39a406c440 0x7f39a4154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 -- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 msgr2=0x7f39a40c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 0x7f39a40c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 -- 172.21.15.97:0/1105378803 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0094d0 con 0x7f39a40c1e70 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f399a7fc640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 0x7f39a40c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:26.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a37fe640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f399c00d560 tx=0x7f399c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0125f0 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c012770 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a4153b50 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c012b20 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.245+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a4154110 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.249+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a4068440 con 0x7f39a40c1e70 2023-12-04T05:39:26.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.249+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f399c012c80 con 0x7f39a40c1e70 2023-12-04T05:39:26.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.249+0000 7f399bfff640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:26.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.249+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f399c085340 con 0x7f39a40c1e70 2023-12-04T05:39:26.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.249+0000 7f39a2ffd640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:26.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.253+0000 7f39a2ffd640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 0x7f3984068d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f39940012f0 tx=0x7f3994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:26.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.253+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f399c052650 con 0x7f39a40c1e70 2023-12-04T05:39:26.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:26.433+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f39a41eb0d0 con 0x7f39a40c1e70 2023-12-04T05:39:27.080 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 12 and data pool 13 2023-12-04T05:39:27.080 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.073+0000 7f399bfff640 1 -- 172.21.15.97:0/1105378803 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f399c055c70 con 0x7f39a40c1e70 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.089+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 msgr2=0x7f3984068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.089+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 0x7f3984068d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f39940012f0 tx=0x7f3994009040 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.089+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 msgr2=0x7f39a41eb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.089+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f399c00d560 tx=0x7f399c00da20 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 shutdown_connections 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f39a40c1e70 0x7f39a41eb420 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39a406d210 0x7f39a40c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 --2- 172.21.15.97:0/1105378803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39a406c440 0x7f39a4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 >> 172.21.15.97:0/1105378803 conn(0x7f39a40c5e70 msgr2=0x7f39a4151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 shutdown_connections 2023-12-04T05:39:27.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.093+0000 7f39a96c9640 1 -- 172.21.15.97:0/1105378803 wait complete. 2023-12-04T05:39:27.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:27.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 Processor -- start 2023-12-04T05:39:27.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 -- start start 2023-12-04T05:39:27.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f882006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8820152300 con 0x7f882006be00 2023-12-04T05:39:27.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8820071580 con 0x7f882006ca50 2023-12-04T05:39:27.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f882739d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882014ed50 con 0x7f882014e970 2023-12-04T05:39:27.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f8824938640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f882006be00 0x7f8820071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46530/0 (socket says 172.21.15.97:46530) 2023-12-04T05:39:27.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f8824938640 1 -- 172.21.15.97:0/3547075387 learned_addr learned my addr 172.21.15.97:0/3547075387 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:27.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.261+0000 7f8825139640 1 --2- 172.21.15.97:0/3547075387 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f882006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762999387 0 0) 0x7f8810001120 con 0x7f882006be00 2023-12-04T05:39:27.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880c003530 con 0x7f882006be00 2023-12-04T05:39:27.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755968434 0 0) 0x7f8820071580 con 0x7f882006ca50 2023-12-04T05:39:27.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8825139640 1 -- 172.21.15.97:0/3547075387 >> v1:172.21.15.143:6789/0 conn(0x7f882006ca50 legacy=0x7f88200c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8825139640 1 -- 172.21.15.97:0/3547075387 >> v1:172.21.15.97:6789/0 conn(0x7f882006be00 legacy=0x7f8820071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8825139640 1 -- 172.21.15.97:0/3547075387 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882006cea0 con 0x7f882014e970 2023-12-04T05:39:27.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8825139640 1 --2- 172.21.15.97:0/3547075387 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f882006e150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097f0 tx=0x7f881c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3970c0574e7f5e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ac600 con 0x7f882014e970 2023-12-04T05:39:27.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0a8050 con 0x7f882014e970 2023-12-04T05:39:27.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f8817fff640 1 -- 172.21.15.97:0/3547075387 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ac980 con 0x7f882014e970 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f882739d640 1 -- 172.21.15.97:0/3547075387 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 msgr2=0x7f882006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.265+0000 7f882739d640 1 --2- 172.21.15.97:0/3547075387 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f882006e150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097f0 tx=0x7f881c01c3a0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- 172.21.15.97:0/3547075387 shutdown_connections 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 --2- 172.21.15.97:0/3547075387 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f882006e150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- 172.21.15.97:0/3547075387 >> 172.21.15.97:0/3547075387 conn(0x7f88200c2970 msgr2=0x7f88200c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- 172.21.15.97:0/3547075387 shutdown_connections 2023-12-04T05:39:27.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- 172.21.15.97:0/3547075387 wait complete. 2023-12-04T05:39:27.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 Processor -- start 2023-12-04T05:39:27.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- start start 2023-12-04T05:39:27.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 0x7f88200bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f8820147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88200aa410 con 0x7f882006be00 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820152ac0 con 0x7f882006ca50 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882739d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8820152790 con 0x7f882014e970 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60418/0 (socket says 172.21.15.97:60418) 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 -- 172.21.15.97:0/1287125683 learned_addr learned my addr 172.21.15.97:0/1287125683 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882593a640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f8820147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8824938640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 0x7f88200bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 -- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 msgr2=0x7f8820147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f8820147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 -- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 msgr2=0x7f88200bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 0x7f88200bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 -- 172.21.15.97:0/1287125683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009420 con 0x7f882006be00 2023-12-04T05:39:27.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f882593a640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f8820147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:27.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8824938640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 0x7f88200bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:27.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.269+0000 7f8825139640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f881c009740 tx=0x7f881c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0b6670 con 0x7f882006be00 2023-12-04T05:39:27.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0b67d0 con 0x7f882006be00 2023-12-04T05:39:27.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88200a9e50 con 0x7f882006be00 2023-12-04T05:39:27.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0b6b80 con 0x7f882006be00 2023-12-04T05:39:27.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88201519a0 con 0x7f882006be00 2023-12-04T05:39:27.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8820068440 con 0x7f882006be00 2023-12-04T05:39:27.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f881c0b3040 con 0x7f882006be00 2023-12-04T05:39:27.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 0x7f8804068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f881c11ea20 con 0x7f882006be00 2023-12-04T05:39:27.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8824938640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 0x7f8804068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.273+0000 7f8824938640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 0x7f8804068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f88200c2470 tx=0x7f8810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.277+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f881c0ebc50 con 0x7f882006be00 2023-12-04T05:39:27.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.429+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8820071f00 con 0x7f882006be00 2023-12-04T05:39:27.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.429+0000 7f8815ffb640 1 -- 172.21.15.97:0/1287125683 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16561 (secure 0 0 0) 0x7f881c0ef270 con 0x7f882006be00 2023-12-04T05:39:27.435 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:27.435 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":67,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:26.440798+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 msgr2=0x7f8804068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 0x7f8804068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f88200c2470 tx=0x7f8810009040 comp rx=0 tx=0).stop 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 msgr2=0x7f88200ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f881c009740 tx=0x7f881c019140 comp rx=0 tx=0).stop 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 shutdown_connections 2023-12-04T05:39:27.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f88040668d0 0x7f8804068d90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f882014e970 0x7f8820147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f882006ca50 0x7f88200bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 --2- 172.21.15.97:0/1287125683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f882006be00 0x7f88200ab9a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 >> 172.21.15.97:0/1287125683 conn(0x7f88200c2970 msgr2=0x7f8820148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 shutdown_connections 2023-12-04T05:39:27.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.433+0000 7f882739d640 1 -- 172.21.15.97:0/1287125683 wait complete. 2023-12-04T05:39:27.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:27.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 Processor -- start 2023-12-04T05:39:27.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 -- start start 2023-12-04T05:39:27.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60bc0a9470 0x7f60bc06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc06c760 con 0x7f60bc154260 2023-12-04T05:39:27.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc0a8670 con 0x7f60bc0a9470 2023-12-04T05:39:27.595 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c3c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc06c550 con 0x7f60bc154d50 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c1235640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c1235640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:40448/0 (socket says 172.21.15.97:40448) 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c1235640 1 -- 172.21.15.97:0/898923074 learned_addr learned my addr 172.21.15.97:0/898923074 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.589+0000 7f60c2237640 1 --2- 172.21.15.97:0/898923074 >> v2:172.21.15.143:3300/0 conn(0x7f60bc0a9470 0x7f60bc06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c1235640 1 -- 172.21.15.97:0/898923074 >> v2:172.21.15.143:3300/0 conn(0x7f60bc0a9470 msgr2=0x7f60bc06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c1235640 1 --2- 172.21.15.97:0/898923074 >> v2:172.21.15.143:3300/0 conn(0x7f60bc0a9470 0x7f60bc06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c1235640 1 -- 172.21.15.97:0/898923074 >> v1:172.21.15.143:6789/0 conn(0x7f60bc154260 legacy=0x7f60bc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c1235640 1 -- 172.21.15.97:0/898923074 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc06ca40 con 0x7f60bc154d50 2023-12-04T05:39:27.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c1235640 1 --2- 172.21.15.97:0/898923074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009870 tx=0x7f60ac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a7b6e0eb137b12 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c0a34640 1 -- 172.21.15.97:0/898923074 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0ad680 con 0x7f60bc154d50 2023-12-04T05:39:27.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c0a34640 1 -- 172.21.15.97:0/898923074 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0ad7e0 con 0x7f60bc154d50 2023-12-04T05:39:27.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c0a34640 1 -- 172.21.15.97:0/898923074 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0adb70 con 0x7f60bc154d50 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 -- 172.21.15.97:0/898923074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 msgr2=0x7f60bc06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/898923074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009870 tx=0x7f60ac01c510 comp rx=0 tx=0).stop 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 -- 172.21.15.97:0/898923074 shutdown_connections 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/898923074 >> v2:172.21.15.143:3300/0 conn(0x7f60bc0a9470 0x7f60bc06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/898923074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc154d50 0x7f60bc06d800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.593+0000 7f60c3c9a640 1 -- 172.21.15.97:0/898923074 >> 172.21.15.97:0/898923074 conn(0x7f60bc0c2970 msgr2=0x7f60bc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- 172.21.15.97:0/898923074 shutdown_connections 2023-12-04T05:39:27.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- 172.21.15.97:0/898923074 wait complete. 2023-12-04T05:39:27.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 Processor -- start 2023-12-04T05:39:27.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- start start 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60bc154260 0x7f60bc145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60bc154d50 0x7f60bc1f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc1edf10 con 0x7f60bc154d50 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc153b10 con 0x7f60bc154260 2023-12-04T05:39:27.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c3c9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc070320 con 0x7f60bc0a9470 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:40460/0 (socket says 172.21.15.97:40460) 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 -- 172.21.15.97:0/2963194981 learned_addr learned my addr 172.21.15.97:0/2963194981 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c2237640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60bc154d50 0x7f60bc1f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1235640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60bc154260 0x7f60bc145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 -- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60bc154260 msgr2=0x7f60bc145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60bc154260 0x7f60bc145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 -- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60bc154d50 msgr2=0x7f60bc1f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60bc154d50 0x7f60bc1f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 -- 172.21.15.97:0/2963194981 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0094d0 con 0x7f60bc0a9470 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.597+0000 7f60c1a36640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c500 tx=0x7f60b800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8005220 con 0x7f60bc0a9470 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b8005380 con 0x7f60bc0a9470 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8007270 con 0x7f60bc0a9470 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc0c5860 con 0x7f60bc0a9470 2023-12-04T05:39:27.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc1f0460 con 0x7f60bc0a9470 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc068440 con 0x7f60bc0a9470 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60b80073d0 con 0x7f60bc0a9470 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 0x7f60a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60b8084180 con 0x7f60bc0a9470 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.601+0000 7f60c1235640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 0x7f60a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.605+0000 7f60c1235640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 0x7f60a0068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0af000 tx=0x7f60ac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.605+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60b8051460 con 0x7f60bc0a9470 2023-12-04T05:39:27.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.757+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60bc066680 con 0x7f60bc0a9470 2023-12-04T05:39:27.765 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60b27fc640 1 -- 172.21.15.97:0/2963194981 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16561 (secure 0 0 0) 0x7f60b8054a80 con 0x7f60bc0a9470 2023-12-04T05:39:27.765 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:27.765 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":67,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:26.440798+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 msgr2=0x7f60a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 0x7f60a0068d90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0af000 tx=0x7f60ac0a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 msgr2=0x7f60bc1ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c500 tx=0x7f60b800c9c0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 shutdown_connections 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f60a00668d0 0x7f60a0068d90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f60bc154d50 0x7f60bc1f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60bc154260 0x7f60bc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 --2- 172.21.15.97:0/2963194981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f60bc0a9470 0x7f60bc1ecef0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 >> 172.21.15.97:0/2963194981 conn(0x7f60bc0c2970 msgr2=0x7f60bc14cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 shutdown_connections 2023-12-04T05:39:27.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.761+0000 7f60c3c9a640 1 -- 172.21.15.97:0/2963194981 wait complete. 2023-12-04T05:39:27.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T05:39:27.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-04T05:39:27.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-04T05:39:27.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-04T05:39:27.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-04T05:39:27.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.921+0000 7fbb10df5640 1 Processor -- start 2023-12-04T05:39:27.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.921+0000 7fbb10df5640 1 -- start start 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb10df5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbb0c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb10df5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb0c06d210 0x7fbb0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb10df5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0aa240 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb10df5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c06c0c0 con 0x7fbb0c06d210 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb10df5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0aa500 con 0x7fbb0c06c440 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbb0c0c1e70 0x7fbb0c0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46532/0 (socket says 172.21.15.97:46532) 2023-12-04T05:39:27.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 -- 172.21.15.97:0/1372876226 learned_addr learned my addr 172.21.15.97:0/1372876226 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:27.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb01d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbb0c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0ad9d640 1 --2- 172.21.15.97:0/1372876226 >> v2:172.21.15.143:3300/0 conn(0x7fbb0c06d210 0x7fbb0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860750392 0 0) 0x7fbb0c0aa240 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf8003530 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736990573 0 0) 0x7fbaf8003530 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 msgr2=0x7fbb0c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbb0c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 >> v2:172.21.15.143:3300/0 conn(0x7fbb0c06d210 msgr2=0x7fbb0c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 --2- 172.21.15.97:0/1372876226 >> v2:172.21.15.143:3300/0 conn(0x7fbb0c06d210 0x7fbb0c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0aa7e0 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fbafc001a00 con 0x7fbb0c0c1e70 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 >> v1:172.21.15.97:6789/0 conn(0x7fbb0c0c1e70 legacy=0x7fbb0c0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf8003980 0x7fbaf8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaf80047d0 0x7fbaf8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbaf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c06c0c0 con 0x7fbaf8003980 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0aa500 con 0x7fbaf80047d0 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf800b990 con 0x7fbb0c06c440 2023-12-04T05:39:27.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf8003980 0x7fbaf8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0ad9d640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbaf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb01d9b640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaf80047d0 0x7fbaf8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 -- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 msgr2=0x7fbaf8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb0c06c440 0x7fbaf8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 -- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaf80047d0 msgr2=0x7fbaf8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaf80047d0 0x7fbaf8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.925+0000 7fbb0a59c640 1 -- 172.21.15.97:0/1372876226 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8003530 con 0x7fbaf8003980 2023-12-04T05:39:27.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf8003980 0x7fbaf8003da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00a830 tx=0x7fbafc01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cc89adc595923f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ad630 con 0x7fbaf8003980 2023-12-04T05:39:27.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0a8070 con 0x7fbaf8003980 2023-12-04T05:39:27.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb09d9b640 1 -- 172.21.15.97:0/1372876226 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ad9d0 con 0x7fbaf8003980 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 -- 172.21.15.97:0/1372876226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf8003980 msgr2=0x7fbaf8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1372876226 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbaf8003980 0x7fbaf8003da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00a830 tx=0x7fbafc01d310 comp rx=0 tx=0).stop 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb0ad9d640 1 -- 172.21.15.97:0/1372876226 reap_dead start 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 -- 172.21.15.97:0/1372876226 shutdown_connections 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 -- 172.21.15.97:0/1372876226 >> 172.21.15.97:0/1372876226 conn(0x7fbb0c0c5e70 msgr2=0x7fbb0c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 -- 172.21.15.97:0/1372876226 shutdown_connections 2023-12-04T05:39:27.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.929+0000 7fbb10df5640 1 -- 172.21.15.97:0/1372876226 wait complete. 2023-12-04T05:39:27.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 Processor -- start 2023-12-04T05:39:27.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- start start 2023-12-04T05:39:27.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbaf8003980 0x7fbb0c13ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb0c143fa0 0x7fbb0c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c1f0360 con 0x7fbb0c151bf0 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c1f05b0 con 0x7fbb0c143fa0 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c1f0890 con 0x7fbaf8003980 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60452/0 (socket says 172.21.15.97:60452) 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 -- 172.21.15.97:0/1747655034 learned_addr learned my addr 172.21.15.97:0/1747655034 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb0ad9d640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb0c143fa0 0x7fbb0c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbaf8003980 0x7fbb0c13ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 -- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbaf8003980 msgr2=0x7fbb0c13ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbaf8003980 0x7fbb0c13ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 -- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb0c143fa0 msgr2=0x7fbb0c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:27.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb0c143fa0 0x7fbb0c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:27.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 -- 172.21.15.97:0/1747655034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c1f0b70 con 0x7fbb0c151bf0 2023-12-04T05:39:27.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb01d9b640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4011960 tx=0x7fbaf4011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400fa30 con 0x7fbb0c151bf0 2023-12-04T05:39:27.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400fb90 con 0x7fbb0c151bf0 2023-12-04T05:39:27.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c1f0e50 con 0x7fbb0c151bf0 2023-12-04T05:39:27.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4014440 con 0x7fbb0c151bf0 2023-12-04T05:39:27.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c152050 con 0x7fbb0c151bf0 2023-12-04T05:39:27.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.933+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c068440 con 0x7fbb0c151bf0 2023-12-04T05:39:27.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.937+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbaf401d400 con 0x7fbb0c151bf0 2023-12-04T05:39:27.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.937+0000 7fbb037fe640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 0x7fbaec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:27.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.937+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbaf4084c10 con 0x7fbb0c151bf0 2023-12-04T05:39:27.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.937+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 0x7fbaec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:27.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.937+0000 7fbb0a59c640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 0x7fbaec068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ad000 tx=0x7fbafc001370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:27.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:27.941+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbaf4051db0 con 0x7fbb0c151bf0 2023-12-04T05:39:28.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:28.125+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbb0c06c220 con 0x7fbb0c151bf0 2023-12-04T05:39:29.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.081+0000 7fbb037fe640 1 -- 172.21.15.97:0/1747655034 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbaf40553d0 con 0x7fbb0c151bf0 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 msgr2=0x7fbaec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 0x7fbaec068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ad000 tx=0x7fbafc001370 comp rx=0 tx=0).stop 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 msgr2=0x7fbb0c143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4011960 tx=0x7fbaf4011d60 comp rx=0 tx=0).stop 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 shutdown_connections 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbaec0668d0 0x7fbaec068d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb0c143fa0 0x7fbb0c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb0c151bf0 0x7fbb0c143a60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 --2- 172.21.15.97:0/1747655034 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbaf8003980 0x7fbb0c13ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 >> 172.21.15.97:0/1747655034 conn(0x7fbb0c0c5e70 msgr2=0x7fbb0c0c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:29.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 shutdown_connections 2023-12-04T05:39:29.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.085+0000 7fbb10df5640 1 -- 172.21.15.97:0/1747655034 wait complete. 2023-12-04T05:39:29.114 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:39:29.114 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T05:39:29.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.253+0000 7f4b081c4640 1 Processor -- start 2023-12-04T05:39:29.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.253+0000 7f4b081c4640 1 -- start start 2023-12-04T05:39:29.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b081c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b0014eb30 0x7f4b0014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b081c4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b00154fe0 0x7f4b0015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b081c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b00154640 con 0x7f4b0014f790 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b081c4640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b000c0bd0 con 0x7f4b00154fe0 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b081c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0014ef10 con 0x7f4b0014eb30 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b00154fe0 0x7f4b0015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4b00154fe0 0x7f4b0015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60454/0 (socket says 172.21.15.97:60454) 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 -- 172.21.15.97:0/2785329153 learned_addr learned my addr 172.21.15.97:0/2785329153 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b0575f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4b0014f790 0x7f4b001548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46544/0 (socket says 172.21.15.97:46544) 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b05f60640 1 --2- 172.21.15.97:0/2785329153 >> v2:172.21.15.143:3300/0 conn(0x7f4b0014eb30 0x7f4b0014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 -- 172.21.15.97:0/2785329153 >> v2:172.21.15.143:3300/0 conn(0x7f4b0014eb30 msgr2=0x7f4b0014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 --2- 172.21.15.97:0/2785329153 >> v2:172.21.15.143:3300/0 conn(0x7f4b0014eb30 0x7f4b0014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 -- 172.21.15.97:0/2785329153 >> v1:172.21.15.97:6789/0 conn(0x7f4b0014f790 legacy=0x7f4b001548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b06761640 1 -- 172.21.15.97:0/2785329153 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b001535a0 con 0x7f4b00154fe0 2023-12-04T05:39:29.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.257+0000 7f4b04f5e640 1 -- 172.21.15.97:0/2785329153 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700529533 0 0) 0x7f4b00154640 con 0x7f4b0014f790 2023-12-04T05:39:29.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b06761640 1 --2- 172.21.15.97:0/2785329153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b0015bc60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4b000c0a80 tx=0x7f4af801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183787516a4c2c8d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:29.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b04f5e640 1 -- 172.21.15.97:0/2785329153 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80a5860 con 0x7f4b00154fe0 2023-12-04T05:39:29.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b04f5e640 1 -- 172.21.15.97:0/2785329153 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af80a59c0 con 0x7f4b00154fe0 2023-12-04T05:39:29.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b04f5e640 1 -- 172.21.15.97:0/2785329153 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80a5d50 con 0x7f4b00154fe0 2023-12-04T05:39:29.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- 172.21.15.97:0/2785329153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 msgr2=0x7f4b0015bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- 172.21.15.97:0/2785329153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b0015bc60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4b000c0a80 tx=0x7f4af801c9a0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- 172.21.15.97:0/2785329153 shutdown_connections 2023-12-04T05:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- 172.21.15.97:0/2785329153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b0015bc60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- 172.21.15.97:0/2785329153 >> v2:172.21.15.143:3300/0 conn(0x7f4b0014eb30 0x7f4b0014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- 172.21.15.97:0/2785329153 >> 172.21.15.97:0/2785329153 conn(0x7f4b000c5e70 msgr2=0x7f4b000c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- 172.21.15.97:0/2785329153 shutdown_connections 2023-12-04T05:39:29.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- 172.21.15.97:0/2785329153 wait complete. 2023-12-04T05:39:29.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 Processor -- start 2023-12-04T05:39:29.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- start start 2023-12-04T05:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b0014eb30 0x7f4b001ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0014f790 0x7f4b00070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000a9630 con 0x7f4b00154fe0 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b001ee810 con 0x7f4b0014f790 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.261+0000 7f4b081c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00140660 con 0x7f4b0014eb30 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60470/0 (socket says 172.21.15.97:60470) 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 -- 172.21.15.97:0/4146326606 learned_addr learned my addr 172.21.15.97:0/4146326606 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b0575f640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0014f790 0x7f4b00070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b05f60640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b0014eb30 0x7f4b001ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 -- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b0014eb30 msgr2=0x7f4b001ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b0014eb30 0x7f4b001ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 -- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0014f790 msgr2=0x7f4b00070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0014f790 0x7f4b00070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:29.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 -- 172.21.15.97:0/4146326606 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009b30 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b06761640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4af80195b0 tx=0x7f4af8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80b8670 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af80b87d0 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b00071380 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80b8b40 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b00071940 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0014fba0 con 0x7f4b00154fe0 2023-12-04T05:39:29.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.265+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4af80b8ca0 con 0x7f4b00154fe0 2023-12-04T05:39:29.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.269+0000 7f4af67fc640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:29.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.269+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4af811f9a0 con 0x7f4b00154fe0 2023-12-04T05:39:29.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.269+0000 7f4b05f60640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:29.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.269+0000 7f4b05f60640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 0x7f4ae4068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009af0 tx=0x7f4afc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:29.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.273+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b0014fba0 con 0x7f4b00154fe0 2023-12-04T05:39:29.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:29.453+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b000a97e0 con 0x7f4b00154fe0 2023-12-04T05:39:30.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4af67fc640 1 -- 172.21.15.97:0/4146326606 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b000a97e0 con 0x7f4b00154fe0 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 msgr2=0x7f4ae4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 0x7f4ae4068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009af0 tx=0x7f4afc008040 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 msgr2=0x7f4b000a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4af80195b0 tx=0x7f4af8019740 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 shutdown_connections 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4ae40668d0 0x7f4ae4068d90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4b00154fe0 0x7f4b000a9ac0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b0014f790 0x7f4b00070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 --2- 172.21.15.97:0/4146326606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b0014eb30 0x7f4b001ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 >> 172.21.15.97:0/4146326606 conn(0x7f4b000c5e70 msgr2=0x7f4b0014c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 shutdown_connections 2023-12-04T05:39:30.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.089+0000 7f4b081c4640 1 -- 172.21.15.97:0/4146326606 wait complete. 2023-12-04T05:39:30.118 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T05:39:30.118 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:30.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.253+0000 7f55f5c79640 1 Processor -- start 2023-12-04T05:39:30.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.253+0000 7f55f5c79640 1 -- start start 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f55f014e970 0x7f55f006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55f006be00 0x7f55f006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f00c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f0152300 con 0x7f55f006be00 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f0071580 con 0x7f55f014e970 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55f5c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f014ed50 con 0x7f55f0071a10 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55f006be00 0x7f55f006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f55f006be00 0x7f55f006ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60474/0 (socket says 172.21.15.97:60474) 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 -- 172.21.15.97:0/2248701668 learned_addr learned my addr 172.21.15.97:0/2248701668 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:30.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55effff640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f00c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55ef7fe640 1 --2- 172.21.15.97:0/2248701668 >> v2:172.21.15.143:3300/0 conn(0x7f55f014e970 0x7f55f006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 -- 172.21.15.97:0/2248701668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 msgr2=0x7f55f00c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f00c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 -- 172.21.15.97:0/2248701668 >> v2:172.21.15.143:3300/0 conn(0x7f55f014e970 msgr2=0x7f55f006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 --2- 172.21.15.97:0/2248701668 >> v2:172.21.15.143:3300/0 conn(0x7f55f014e970 0x7f55f006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 -- 172.21.15.97:0/2248701668 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0151d60 con 0x7f55f006be00 2023-12-04T05:39:30.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.257+0000 7f55eeffd640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f006ca50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f55f0072510 tx=0x7f55e401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b6768267636e7b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55ee7fc640 1 -- 172.21.15.97:0/2248701668 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40a7ba0 con 0x7f55f006be00 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55ee7fc640 1 -- 172.21.15.97:0/2248701668 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e40a7d00 con 0x7f55f006be00 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55ee7fc640 1 -- 172.21.15.97:0/2248701668 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40af660 con 0x7f55f006be00 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- 172.21.15.97:0/2248701668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 msgr2=0x7f55f006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f006ca50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f55f0072510 tx=0x7f55e401eb10 comp rx=0 tx=0).stop 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- 172.21.15.97:0/2248701668 shutdown_connections 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f00c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- 172.21.15.97:0/2248701668 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f006ca50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- 172.21.15.97:0/2248701668 >> v2:172.21.15.143:3300/0 conn(0x7f55f014e970 0x7f55f006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- 172.21.15.97:0/2248701668 >> 172.21.15.97:0/2248701668 conn(0x7f55f00c2970 msgr2=0x7f55f00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- 172.21.15.97:0/2248701668 shutdown_connections 2023-12-04T05:39:30.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- 172.21.15.97:0/2248701668 wait complete. 2023-12-04T05:39:30.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 Processor -- start 2023-12-04T05:39:30.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- start start 2023-12-04T05:39:30.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f0146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55f014e970 0x7f55f01f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01479a0 con 0x7f55f006be00 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f014fad0 con 0x7f55f014e970 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55f5c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f014fdb0 con 0x7f55f0071a10 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.261+0000 7f55ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60478/0 (socket says 172.21.15.97:60478) 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 -- 172.21.15.97:0/3640255956 learned_addr learned my addr 172.21.15.97:0/3640255956 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55eeffd640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f0146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55effff640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55f014e970 0x7f55f01f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 -- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 msgr2=0x7f55f0146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f0146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 -- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55f014e970 msgr2=0x7f55f01f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55f014e970 0x7f55f01f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 -- 172.21.15.97:0/3640255956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e400b770 con 0x7f55f006be00 2023-12-04T05:39:30.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55ef7fe640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f55e000d5f0 tx=0x7f55e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00125f0 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0012750 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f014f1f0 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0012ae0 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f014f7b0 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00c1d80 con 0x7f55f006be00 2023-12-04T05:39:30.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55e0012c40 con 0x7f55f006be00 2023-12-04T05:39:30.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 0x7f55dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.265+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55e00847d0 con 0x7f55f006be00 2023-12-04T05:39:30.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.269+0000 7f55eeffd640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 0x7f55dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.269+0000 7f55eeffd640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 0x7f55dc068dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f55e40b1000 tx=0x7f55e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.269+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55e0051ab0 con 0x7f55f006be00 2023-12-04T05:39:30.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55f0068440 con 0x7f55f006be00 2023-12-04T05:39:30.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55d7fff640 1 -- 172.21.15.97:0/3640255956 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f55e00550d0 con 0x7f55f006be00 2023-12-04T05:39:30.461 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:30.461 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6489,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-04T05:39:30.461 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 48 2023-12-04T05:39:30.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 msgr2=0x7f55dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 0x7f55dc068dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f55e40b1000 tx=0x7f55e4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 msgr2=0x7f55f0153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f55e000d5f0 tx=0x7f55e000dab0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 shutdown_connections 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f55dc066900 0x7f55dc068dc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55f014e970 0x7f55f01f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55f0071a10 0x7f55f0146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 --2- 172.21.15.97:0/3640255956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f55f006be00 0x7f55f0153d00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 >> 172.21.15.97:0/3640255956 conn(0x7f55f00c2970 msgr2=0x7f55f00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 shutdown_connections 2023-12-04T05:39:30.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.457+0000 7f55f5c79640 1 -- 172.21.15.97:0/3640255956 wait complete. 2023-12-04T05:39:30.482 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:30.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 Processor -- start 2023-12-04T05:39:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 -- start start 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb6200c7ef0 0x7fb620154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb620158630 0x7fb6201551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6201547d0 con 0x7fb620151bf0 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb620158b80 con 0x7fb620158630 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb625a79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6200c4aa0 con 0x7fb6200c7ef0 2023-12-04T05:39:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb620158630 0x7fb6201551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb620158630 0x7fb6201551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60490/0 (socket says 172.21.15.97:60490) 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 -- 172.21.15.97:0/3123715420 learned_addr learned my addr 172.21.15.97:0/3123715420 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb617fff640 1 --2- 172.21.15.97:0/3123715420 >> v2:172.21.15.143:3300/0 conn(0x7fb6200c7ef0 0x7fb620154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 -- 172.21.15.97:0/3123715420 >> v2:172.21.15.143:3300/0 conn(0x7fb6200c7ef0 msgr2=0x7fb620154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 --2- 172.21.15.97:0/3123715420 >> v2:172.21.15.143:3300/0 conn(0x7fb6200c7ef0 0x7fb620154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 -- 172.21.15.97:0/3123715420 >> v1:172.21.15.143:6789/0 conn(0x7fb620151bf0 legacy=0x7fb6200abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.617+0000 7fb61ffff640 1 -- 172.21.15.97:0/3123715420 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200c4d40 con 0x7fb620158630 2023-12-04T05:39:30.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb61ffff640 1 --2- 172.21.15.97:0/3123715420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620158630 0x7fb6201551a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb6200acc00 tx=0x7fb61801c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461abaddf15aecae server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb61effd640 1 -- 172.21.15.97:0/3123715420 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180a4be0 con 0x7fb620158630 2023-12-04T05:39:30.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb61effd640 1 -- 172.21.15.97:0/3123715420 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6180a4d40 con 0x7fb620158630 2023-12-04T05:39:30.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb61effd640 1 -- 172.21.15.97:0/3123715420 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180ac610 con 0x7fb620158630 2023-12-04T05:39:30.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 -- 172.21.15.97:0/3123715420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620158630 msgr2=0x7fb6201551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 --2- 172.21.15.97:0/3123715420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620158630 0x7fb6201551a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb6200acc00 tx=0x7fb61801c590 comp rx=0 tx=0).stop 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 -- 172.21.15.97:0/3123715420 shutdown_connections 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 --2- 172.21.15.97:0/3123715420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620158630 0x7fb6201551a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 --2- 172.21.15.97:0/3123715420 >> v2:172.21.15.143:3300/0 conn(0x7fb6200c7ef0 0x7fb620154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 -- 172.21.15.97:0/3123715420 >> 172.21.15.97:0/3123715420 conn(0x7fb620073550 msgr2=0x7fb620073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 -- 172.21.15.97:0/3123715420 shutdown_connections 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.621+0000 7fb625a79640 1 -- 172.21.15.97:0/3123715420 wait complete. 2023-12-04T05:39:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 Processor -- start 2023-12-04T05:39:30.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- start start 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6200c7ef0 0x7fb620155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb620158630 0x7fb620157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201500f0 con 0x7fb620151bf0 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620156890 con 0x7fb620158630 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb620156b70 con 0x7fb6200c7ef0 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60500/0 (socket says 172.21.15.97:60500) 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 -- 172.21.15.97:0/1383247779 learned_addr learned my addr 172.21.15.97:0/1383247779 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb61f7fe640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6200c7ef0 0x7fb620155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb61ffff640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb620158630 0x7fb620157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 -- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6200c7ef0 msgr2=0x7fb620155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6200c7ef0 0x7fb620155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 -- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb620158630 msgr2=0x7fb620157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb620158630 0x7fb620157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 -- 172.21.15.97:0/1383247779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009b30 con 0x7fb620151bf0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb617fff640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb60800d5d0 tx=0x7fb60800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608004240 con 0x7fb620151bf0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6080043a0 con 0x7fb620151bf0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6201503d0 con 0x7fb620151bf0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608003840 con 0x7fb620151bf0 2023-12-04T05:39:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.625+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb620156360 con 0x7fb620151bf0 2023-12-04T05:39:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62014de70 con 0x7fb620151bf0 2023-12-04T05:39:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6080039a0 con 0x7fb620151bf0 2023-12-04T05:39:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb61cff9640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb608084530 con 0x7fb620151bf0 2023-12-04T05:39:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb61f7fe640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.629+0000 7fb61f7fe640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 0x7fb600068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb610007fd0 tx=0x7fb610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.633+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb608051810 con 0x7fb620151bf0 2023-12-04T05:39:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.785+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb620068440 con 0x7fb620151bf0 2023-12-04T05:39:30.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.785+0000 7fb61cff9640 1 -- 172.21.15.97:0/1383247779 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16548 (secure 0 0 0) 0x7fb608054e30 con 0x7fb620151bf0 2023-12-04T05:39:30.790 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:30.791 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":68,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:28.074941+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 msgr2=0x7fb600068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 0x7fb600068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb610007fd0 tx=0x7fb610009040 comp rx=0 tx=0).stop 2023-12-04T05:39:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 msgr2=0x7fb620149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb60800d5d0 tx=0x7fb60800da90 comp rx=0 tx=0).stop 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 shutdown_connections 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb6000668d0 0x7fb600068d90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb620158630 0x7fb620157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb620151bf0 0x7fb620149bc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 --2- 172.21.15.97:0/1383247779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6200c7ef0 0x7fb620155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 >> 172.21.15.97:0/1383247779 conn(0x7fb620073550 msgr2=0x7fb620073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 shutdown_connections 2023-12-04T05:39:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.789+0000 7fb625a79640 1 -- 172.21.15.97:0/1383247779 wait complete. 2023-12-04T05:39:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:39:30.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:39:30.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 Processor -- start 2023-12-04T05:39:30.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 -- start start 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b7815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7814b440 con 0x7f6b780c1c60 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780c20e0 con 0x7f6b780c1880 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7e380640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7806caf0 con 0x7f6b78155230 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b777fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6b780c1c60 0x7f6b78154b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46560/0 (socket says 172.21.15.97:46560) 2023-12-04T05:39:30.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b777fe640 1 -- 172.21.15.97:0/3250620630 learned_addr learned my addr 172.21.15.97:0/3250620630 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b7815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495520246 0 0) 0x7f6b7814b440 con 0x7f6b780c1c60 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003530 con 0x7f6b780c1c60 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153863414 0 0) 0x7f6b780c20e0 con 0x7f6b780c1880 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b7814b440 con 0x7f6b780c1880 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076400542 0 0) 0x7f6b60003530 con 0x7f6b780c1c60 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 msgr2=0x7f6b7815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b7815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 >> v1:172.21.15.143:6789/0 conn(0x7f6b780c1880 legacy=0x7f6b7806be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.945+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78154670 con 0x7f6b780c1c60 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f6b6c001680 con 0x7f6b780c1c60 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 >> v1:172.21.15.97:6789/0 conn(0x7f6b780c1c60 legacy=0x7f6b78154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b60003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b600040a0 0x7f6b600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b60004d10 0x7f6b60005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6000ba40 con 0x7f6b600040a0 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6000bbb0 con 0x7f6b60004d10 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6000bd70 con 0x7f6b78155230 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b777fe640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b600040a0 0x7f6b600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b60004d10 0x7f6b60005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b77fff640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b60003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 -- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 msgr2=0x7f6b60003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b78155230 0x7f6b60003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 -- 172.21.15.97:0/3250620630 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b600040a0 msgr2=0x7f6b600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:30.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b600040a0 0x7f6b600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 -- 172.21.15.97:0/3250620630 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60003530 con 0x7f6b60004d10 2023-12-04T05:39:30.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b777fe640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b600040a0 0x7f6b600047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:30.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.949+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b60004d10 0x7f6b60005190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c2340 tx=0x7f6b7001cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509e3dbc4756a748 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700a5c10 con 0x7f6b60004d10 2023-12-04T05:39:30.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000f040 con 0x7f6b60004d10 2023-12-04T05:39:30.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b76ffd640 1 -- 172.21.15.97:0/3250620630 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700ad440 con 0x7f6b60004d10 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b60004d10 msgr2=0x7f6b60005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 --2- 172.21.15.97:0/3250620630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b60004d10 0x7f6b60005190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c2340 tx=0x7f6b7001cc00 comp rx=0 tx=0).stop 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7c91d640 1 -- 172.21.15.97:0/3250620630 reap_dead start 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- 172.21.15.97:0/3250620630 shutdown_connections 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- 172.21.15.97:0/3250620630 >> 172.21.15.97:0/3250620630 conn(0x7f6b780c2970 msgr2=0x7f6b780c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- 172.21.15.97:0/3250620630 shutdown_connections 2023-12-04T05:39:30.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- 172.21.15.97:0/3250620630 wait complete. 2023-12-04T05:39:30.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 Processor -- start 2023-12-04T05:39:30.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- start start 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 0x7f6b781498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78149de0 0x7f6b781ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7814ef30 con 0x7f6b60004d10 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7814d050 con 0x7f6b78149de0 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b7e380640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7814d610 con 0x7f6b781eb0e0 2023-12-04T05:39:30.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b77fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b77fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60518/0 (socket says 172.21.15.97:60518) 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.953+0000 7f6b77fff640 1 -- 172.21.15.97:0/727462527 learned_addr learned my addr 172.21.15.97:0/727462527 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b7c91d640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78149de0 0x7f6b781ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b777fe640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 0x7f6b781498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 -- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 msgr2=0x7f6b781498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 0x7f6b781498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 -- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78149de0 msgr2=0x7f6b781ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78149de0 0x7f6b781ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 -- 172.21.15.97:0/727462527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7814dfe0 con 0x7f6b60004d10 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b777fe640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 0x7f6b781498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:30.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b77fff640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b68012860 tx=0x7f6b68012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68007060 con 0x7f6b60004d10 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68010bf0 con 0x7f6b60004d10 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b781e7810 con 0x7f6b60004d10 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68016480 con 0x7f6b60004d10 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78155f60 con 0x7f6b60004d10 2023-12-04T05:39:30.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78068440 con 0x7f6b60004d10 2023-12-04T05:39:30.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6b680165e0 con 0x7f6b60004d10 2023-12-04T05:39:30.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 0x7f6b64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:30.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b68087db0 con 0x7f6b60004d10 2023-12-04T05:39:30.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.957+0000 7f6b777fe640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 0x7f6b64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:30.964 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.961+0000 7f6b777fe640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 0x7f6b64068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c007fd0 tx=0x7f6b6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:30.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:30.961+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b6808c070 con 0x7f6b60004d10 2023-12-04T05:39:31.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.109+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b7806caa0 con 0x7f6b640668d0 2023-12-04T05:39:31.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.117+0000 7f6b74ff9640 1 -- 172.21.15.97:0/727462527 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289367 (secure 0 0 0) 0x7f6b7806caa0 con 0x7f6b640668d0 2023-12-04T05:39:31.127 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:31.130 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:39:31.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 msgr2=0x7f6b64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 0x7f6b64068d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c007fd0 tx=0x7f6b6c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:31.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 msgr2=0x7f6b7814daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b68012860 tx=0x7f6b68012d20 comp rx=0 tx=0).stop 2023-12-04T05:39:31.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 shutdown_connections 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b640668d0 0x7f6b64068d90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78149de0 0x7f6b781ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b781eb0e0 0x7f6b781498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 --2- 172.21.15.97:0/727462527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b60004d10 0x7f6b7814daa0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 >> 172.21.15.97:0/727462527 conn(0x7f6b780c2970 msgr2=0x7f6b780c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:31.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 shutdown_connections 2023-12-04T05:39:31.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.121+0000 7f6b7e380640 1 -- 172.21.15.97:0/727462527 wait complete. 2023-12-04T05:39:31.146 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2023-12-04T05:39:30.224612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244668,"kb_used_data":7680,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730052,"statfs":{"total":773094113280,"available":772843573248,"internally_reserved":0,"allocated":7864320,"data_stored":4063940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176206"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089131+0000","last_change":"2023-12-04T05:39:27.075692+0000","last_active":"2023-12-04T05:39:28.089131+0000","last_peered":"2023-12-04T05:39:28.089131+0000","last_clean":"2023-12-04T05:39:28.089131+0000","last_became_active":"2023-12-04T05:39:27.075338+0000","last_became_peered":"2023-12-04T05:39:27.075338+0000","last_unstale":"2023-12-04T05:39:28.089131+0000","last_undegraded":"2023-12-04T05:39:28.089131+0000","last_fullsized":"2023-12-04T05:39:28.089131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.083915+0000","last_change":"2023-12-04T05:39:27.076323+0000","last_active":"2023-12-04T05:39:27.083915+0000","last_peered":"2023-12-04T05:39:27.083915+0000","last_clean":"2023-12-04T05:39:27.083915+0000","last_became_active":"2023-12-04T05:39:27.075952+0000","last_became_peered":"2023-12-04T05:39:27.075952+0000","last_unstale":"2023-12-04T05:39:27.083915+0000","last_undegraded":"2023-12-04T05:39:27.083915+0000","last_fullsized":"2023-12-04T05:39:27.083915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:16.088331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094831+0000","last_change":"2023-12-04T05:39:27.088405+0000","last_active":"2023-12-04T05:39:27.094831+0000","last_peered":"2023-12-04T05:39:27.094831+0000","last_clean":"2023-12-04T05:39:27.094831+0000","last_became_active":"2023-12-04T05:39:27.088123+0000","last_became_peered":"2023-12-04T05:39:27.088123+0000","last_unstale":"2023-12-04T05:39:27.094831+0000","last_undegraded":"2023-12-04T05:39:27.094831+0000","last_fullsized":"2023-12-04T05:39:27.094831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087266+0000","last_change":"2023-12-04T05:39:27.091201+0000","last_active":"2023-12-04T05:39:28.087266+0000","last_peered":"2023-12-04T05:39:28.087266+0000","last_clean":"2023-12-04T05:39:28.087266+0000","last_became_active":"2023-12-04T05:39:27.090589+0000","last_became_peered":"2023-12-04T05:39:27.090589+0000","last_unstale":"2023-12-04T05:39:28.087266+0000","last_undegraded":"2023-12-04T05:39:28.087266+0000","last_fullsized":"2023-12-04T05:39:28.087266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:28:23.983451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088954+0000","last_change":"2023-12-04T05:39:27.078406+0000","last_active":"2023-12-04T05:39:28.088954+0000","last_peered":"2023-12-04T05:39:28.088954+0000","last_clean":"2023-12-04T05:39:28.088954+0000","last_became_active":"2023-12-04T05:39:27.078131+0000","last_became_peered":"2023-12-04T05:39:27.078131+0000","last_unstale":"2023-12-04T05:39:28.088954+0000","last_undegraded":"2023-12-04T05:39:28.088954+0000","last_fullsized":"2023-12-04T05:39:28.088954+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107517+0000","last_change":"2023-12-04T05:39:27.100515+0000","last_active":"2023-12-04T05:39:27.107517+0000","last_peered":"2023-12-04T05:39:27.107517+0000","last_clean":"2023-12-04T05:39:27.107517+0000","last_became_active":"2023-12-04T05:39:27.100182+0000","last_became_peered":"2023-12-04T05:39:27.100182+0000","last_unstale":"2023-12-04T05:39:27.107517+0000","last_undegraded":"2023-12-04T05:39:27.107517+0000","last_fullsized":"2023-12-04T05:39:27.107517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:40.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087016+0000","last_change":"2023-12-04T05:39:27.088212+0000","last_active":"2023-12-04T05:39:28.087016+0000","last_peered":"2023-12-04T05:39:28.087016+0000","last_clean":"2023-12-04T05:39:28.087016+0000","last_became_active":"2023-12-04T05:39:27.087929+0000","last_became_peered":"2023-12-04T05:39:27.087929+0000","last_unstale":"2023-12-04T05:39:28.087016+0000","last_undegraded":"2023-12-04T05:39:28.087016+0000","last_fullsized":"2023-12-04T05:39:28.087016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:40:35.762126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.096206+0000","last_change":"2023-12-04T05:39:27.089681+0000","last_active":"2023-12-04T05:39:27.096206+0000","last_peered":"2023-12-04T05:39:27.096206+0000","last_clean":"2023-12-04T05:39:27.096206+0000","last_became_active":"2023-12-04T05:39:27.089288+0000","last_became_peered":"2023-12-04T05:39:27.089288+0000","last_unstale":"2023-12-04T05:39:27.096206+0000","last_undegraded":"2023-12-04T05:39:27.096206+0000","last_fullsized":"2023-12-04T05:39:27.096206+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:58:05.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092627+0000","last_change":"2023-12-04T05:39:27.083541+0000","last_active":"2023-12-04T05:39:27.092627+0000","last_peered":"2023-12-04T05:39:27.092627+0000","last_clean":"2023-12-04T05:39:27.092627+0000","last_became_active":"2023-12-04T05:39:27.083207+0000","last_became_peered":"2023-12-04T05:39:27.083207+0000","last_unstale":"2023-12-04T05:39:27.092627+0000","last_undegraded":"2023-12-04T05:39:27.092627+0000","last_fullsized":"2023-12-04T05:39:27.092627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:59.601876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089581+0000","last_change":"2023-12-04T05:39:27.097340+0000","last_active":"2023-12-04T05:39:28.089581+0000","last_peered":"2023-12-04T05:39:28.089581+0000","last_clean":"2023-12-04T05:39:28.089581+0000","last_became_active":"2023-12-04T05:39:27.096699+0000","last_became_peered":"2023-12-04T05:39:27.096699+0000","last_unstale":"2023-12-04T05:39:28.089581+0000","last_undegraded":"2023-12-04T05:39:28.089581+0000","last_fullsized":"2023-12-04T05:39:28.089581+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101433+0000","last_change":"2023-12-04T05:39:27.087492+0000","last_active":"2023-12-04T05:39:27.101433+0000","last_peered":"2023-12-04T05:39:27.101433+0000","last_clean":"2023-12-04T05:39:27.101433+0000","last_became_active":"2023-12-04T05:39:27.087207+0000","last_became_peered":"2023-12-04T05:39:27.087207+0000","last_unstale":"2023-12-04T05:39:27.101433+0000","last_undegraded":"2023-12-04T05:39:27.101433+0000","last_fullsized":"2023-12-04T05:39:27.101433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:34:05.627903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088860+0000","last_change":"2023-12-04T05:39:27.088572+0000","last_active":"2023-12-04T05:39:28.088860+0000","last_peered":"2023-12-04T05:39:28.088860+0000","last_clean":"2023-12-04T05:39:28.088860+0000","last_became_active":"2023-12-04T05:39:27.088269+0000","last_became_peered":"2023-12-04T05:39:27.088269+0000","last_unstale":"2023-12-04T05:39:28.088860+0000","last_undegraded":"2023-12-04T05:39:28.088860+0000","last_fullsized":"2023-12-04T05:39:28.088860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094391+0000","last_change":"2023-12-04T05:39:27.088085+0000","last_active":"2023-12-04T05:39:27.094391+0000","last_peered":"2023-12-04T05:39:27.094391+0000","last_clean":"2023-12-04T05:39:27.094391+0000","last_became_active":"2023-12-04T05:39:27.087726+0000","last_became_peered":"2023-12-04T05:39:27.087726+0000","last_unstale":"2023-12-04T05:39:27.094391+0000","last_undegraded":"2023-12-04T05:39:27.094391+0000","last_fullsized":"2023-12-04T05:39:27.094391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087266+0000","last_change":"2023-12-04T05:39:27.100050+0000","last_active":"2023-12-04T05:39:28.087266+0000","last_peered":"2023-12-04T05:39:28.087266+0000","last_clean":"2023-12-04T05:39:28.087266+0000","last_became_active":"2023-12-04T05:39:27.099704+0000","last_became_peered":"2023-12-04T05:39:27.099704+0000","last_unstale":"2023-12-04T05:39:28.087266+0000","last_undegraded":"2023-12-04T05:39:28.087266+0000","last_fullsized":"2023-12-04T05:39:28.087266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:26.128910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101756+0000","last_change":"2023-12-04T05:39:27.096514+0000","last_active":"2023-12-04T05:39:27.101756+0000","last_peered":"2023-12-04T05:39:27.101756+0000","last_clean":"2023-12-04T05:39:27.101756+0000","last_became_active":"2023-12-04T05:39:27.096198+0000","last_became_peered":"2023-12-04T05:39:27.096198+0000","last_unstale":"2023-12-04T05:39:27.101756+0000","last_undegraded":"2023-12-04T05:39:27.101756+0000","last_fullsized":"2023-12-04T05:39:27.101756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:29.183594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088249+0000","last_change":"2023-12-04T05:39:27.076053+0000","last_active":"2023-12-04T05:39:28.088249+0000","last_peered":"2023-12-04T05:39:28.088249+0000","last_clean":"2023-12-04T05:39:28.088249+0000","last_became_active":"2023-12-04T05:39:27.075664+0000","last_became_peered":"2023-12-04T05:39:27.075664+0000","last_unstale":"2023-12-04T05:39:28.088249+0000","last_undegraded":"2023-12-04T05:39:28.088249+0000","last_fullsized":"2023-12-04T05:39:28.088249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089026+0000","last_change":"2023-12-04T05:39:27.102230+0000","last_active":"2023-12-04T05:39:28.089026+0000","last_peered":"2023-12-04T05:39:28.089026+0000","last_clean":"2023-12-04T05:39:28.089026+0000","last_became_active":"2023-12-04T05:39:27.101891+0000","last_became_peered":"2023-12-04T05:39:27.101891+0000","last_unstale":"2023-12-04T05:39:28.089026+0000","last_undegraded":"2023-12-04T05:39:28.089026+0000","last_fullsized":"2023-12-04T05:39:28.089026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087345+0000","last_change":"2023-12-04T05:39:27.091794+0000","last_active":"2023-12-04T05:39:28.087345+0000","last_peered":"2023-12-04T05:39:28.087345+0000","last_clean":"2023-12-04T05:39:28.087345+0000","last_became_active":"2023-12-04T05:39:27.091435+0000","last_became_peered":"2023-12-04T05:39:27.091435+0000","last_unstale":"2023-12-04T05:39:28.087345+0000","last_undegraded":"2023-12-04T05:39:28.087345+0000","last_fullsized":"2023-12-04T05:39:28.087345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.102780+0000","last_change":"2023-12-04T05:39:27.094081+0000","last_active":"2023-12-04T05:39:27.102780+0000","last_peered":"2023-12-04T05:39:27.102780+0000","last_clean":"2023-12-04T05:39:27.102780+0000","last_became_active":"2023-12-04T05:39:27.093805+0000","last_became_peered":"2023-12-04T05:39:27.093805+0000","last_unstale":"2023-12-04T05:39:27.102780+0000","last_undegraded":"2023-12-04T05:39:27.102780+0000","last_fullsized":"2023-12-04T05:39:27.102780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087396+0000","last_change":"2023-12-04T05:39:27.090956+0000","last_active":"2023-12-04T05:39:28.087396+0000","last_peered":"2023-12-04T05:39:28.087396+0000","last_clean":"2023-12-04T05:39:28.087396+0000","last_became_active":"2023-12-04T05:39:27.090277+0000","last_became_peered":"2023-12-04T05:39:27.090277+0000","last_unstale":"2023-12-04T05:39:28.087396+0000","last_undegraded":"2023-12-04T05:39:28.087396+0000","last_fullsized":"2023-12-04T05:39:28.087396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:04.080470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087188+0000","last_change":"2023-12-04T05:39:27.094421+0000","last_active":"2023-12-04T05:39:28.087188+0000","last_peered":"2023-12-04T05:39:28.087188+0000","last_clean":"2023-12-04T05:39:28.087188+0000","last_became_active":"2023-12-04T05:39:27.094055+0000","last_became_peered":"2023-12-04T05:39:27.094055+0000","last_unstale":"2023-12-04T05:39:28.087188+0000","last_undegraded":"2023-12-04T05:39:28.087188+0000","last_fullsized":"2023-12-04T05:39:28.087188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:39:31.395233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.085202+0000","last_change":"2023-12-04T05:39:27.078833+0000","last_active":"2023-12-04T05:39:27.085202+0000","last_peered":"2023-12-04T05:39:27.085202+0000","last_clean":"2023-12-04T05:39:27.085202+0000","last_became_active":"2023-12-04T05:39:27.078478+0000","last_became_peered":"2023-12-04T05:39:27.078478+0000","last_unstale":"2023-12-04T05:39:27.085202+0000","last_undegraded":"2023-12-04T05:39:27.085202+0000","last_fullsized":"2023-12-04T05:39:27.085202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:20:15.016309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088352+0000","last_change":"2023-12-04T05:39:27.082161+0000","last_active":"2023-12-04T05:39:28.088352+0000","last_peered":"2023-12-04T05:39:28.088352+0000","last_clean":"2023-12-04T05:39:28.088352+0000","last_became_active":"2023-12-04T05:39:27.081890+0000","last_became_peered":"2023-12-04T05:39:27.081890+0000","last_unstale":"2023-12-04T05:39:28.088352+0000","last_undegraded":"2023-12-04T05:39:28.088352+0000","last_fullsized":"2023-12-04T05:39:28.088352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086940+0000","last_change":"2023-12-04T05:39:27.099452+0000","last_active":"2023-12-04T05:39:28.086940+0000","last_peered":"2023-12-04T05:39:28.086940+0000","last_clean":"2023-12-04T05:39:28.086940+0000","last_became_active":"2023-12-04T05:39:27.099205+0000","last_became_peered":"2023-12-04T05:39:27.099205+0000","last_unstale":"2023-12-04T05:39:28.086940+0000","last_undegraded":"2023-12-04T05:39:28.086940+0000","last_fullsized":"2023-12-04T05:39:28.086940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:55:30.871506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.084186+0000","last_change":"2023-12-04T05:39:27.077164+0000","last_active":"2023-12-04T05:39:27.084186+0000","last_peered":"2023-12-04T05:39:27.084186+0000","last_clean":"2023-12-04T05:39:27.084186+0000","last_became_active":"2023-12-04T05:39:27.076536+0000","last_became_peered":"2023-12-04T05:39:27.076536+0000","last_unstale":"2023-12-04T05:39:27.084186+0000","last_undegraded":"2023-12-04T05:39:27.084186+0000","last_fullsized":"2023-12-04T05:39:27.084186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:04.176837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090120+0000","last_change":"2023-12-04T05:39:27.082797+0000","last_active":"2023-12-04T05:39:27.090120+0000","last_peered":"2023-12-04T05:39:27.090120+0000","last_clean":"2023-12-04T05:39:27.090120+0000","last_became_active":"2023-12-04T05:39:27.081419+0000","last_became_peered":"2023-12-04T05:39:27.081419+0000","last_unstale":"2023-12-04T05:39:27.090120+0000","last_undegraded":"2023-12-04T05:39:27.090120+0000","last_fullsized":"2023-12-04T05:39:27.090120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088809+0000","last_change":"2023-12-04T05:39:27.092222+0000","last_active":"2023-12-04T05:39:28.088809+0000","last_peered":"2023-12-04T05:39:28.088809+0000","last_clean":"2023-12-04T05:39:28.088809+0000","last_became_active":"2023-12-04T05:39:27.091888+0000","last_became_peered":"2023-12-04T05:39:27.091888+0000","last_unstale":"2023-12-04T05:39:28.088809+0000","last_undegraded":"2023-12-04T05:39:28.088809+0000","last_fullsized":"2023-12-04T05:39:28.088809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088987+0000","last_change":"2023-12-04T05:39:27.083638+0000","last_active":"2023-12-04T05:39:28.088987+0000","last_peered":"2023-12-04T05:39:28.088987+0000","last_clean":"2023-12-04T05:39:28.088987+0000","last_became_active":"2023-12-04T05:39:27.083278+0000","last_became_peered":"2023-12-04T05:39:27.083278+0000","last_unstale":"2023-12-04T05:39:28.088987+0000","last_undegraded":"2023-12-04T05:39:28.088987+0000","last_fullsized":"2023-12-04T05:39:28.088987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101500+0000","last_change":"2023-12-04T05:39:27.089048+0000","last_active":"2023-12-04T05:39:27.101500+0000","last_peered":"2023-12-04T05:39:27.101500+0000","last_clean":"2023-12-04T05:39:27.101500+0000","last_became_active":"2023-12-04T05:39:27.088751+0000","last_became_peered":"2023-12-04T05:39:27.088751+0000","last_unstale":"2023-12-04T05:39:27.101500+0000","last_undegraded":"2023-12-04T05:39:27.101500+0000","last_fullsized":"2023-12-04T05:39:27.101500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:32:02.232351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108829+0000","last_change":"2023-12-04T05:39:27.103464+0000","last_active":"2023-12-04T05:39:27.108829+0000","last_peered":"2023-12-04T05:39:27.108829+0000","last_clean":"2023-12-04T05:39:27.108829+0000","last_became_active":"2023-12-04T05:39:27.102812+0000","last_became_peered":"2023-12-04T05:39:27.102812+0000","last_unstale":"2023-12-04T05:39:27.108829+0000","last_undegraded":"2023-12-04T05:39:27.108829+0000","last_fullsized":"2023-12-04T05:39:27.108829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:08:16.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088776+0000","last_change":"2023-12-04T05:39:27.077619+0000","last_active":"2023-12-04T05:39:28.088776+0000","last_peered":"2023-12-04T05:39:28.088776+0000","last_clean":"2023-12-04T05:39:28.088776+0000","last_became_active":"2023-12-04T05:39:27.077334+0000","last_became_peered":"2023-12-04T05:39:27.077334+0000","last_unstale":"2023-12-04T05:39:28.088776+0000","last_undegraded":"2023-12-04T05:39:28.088776+0000","last_fullsized":"2023-12-04T05:39:28.088776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088266+0000","last_change":"2023-12-04T05:39:27.078402+0000","last_active":"2023-12-04T05:39:28.088266+0000","last_peered":"2023-12-04T05:39:28.088266+0000","last_clean":"2023-12-04T05:39:28.088266+0000","last_became_active":"2023-12-04T05:39:27.078138+0000","last_became_peered":"2023-12-04T05:39:27.078138+0000","last_unstale":"2023-12-04T05:39:28.088266+0000","last_undegraded":"2023-12-04T05:39:28.088266+0000","last_fullsized":"2023-12-04T05:39:28.088266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089400+0000","last_change":"2023-12-04T05:39:27.075620+0000","last_active":"2023-12-04T05:39:28.089400+0000","last_peered":"2023-12-04T05:39:28.089400+0000","last_clean":"2023-12-04T05:39:28.089400+0000","last_became_active":"2023-12-04T05:39:27.075284+0000","last_became_peered":"2023-12-04T05:39:27.075284+0000","last_unstale":"2023-12-04T05:39:28.089400+0000","last_undegraded":"2023-12-04T05:39:28.089400+0000","last_fullsized":"2023-12-04T05:39:28.089400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089740+0000","last_change":"2023-12-04T05:39:26.076976+0000","last_active":"2023-12-04T05:39:28.089740+0000","last_peered":"2023-12-04T05:39:28.089740+0000","last_clean":"2023-12-04T05:39:28.089740+0000","last_became_active":"2023-12-04T05:39:26.076581+0000","last_became_peered":"2023-12-04T05:39:26.076581+0000","last_unstale":"2023-12-04T05:39:28.089740+0000","last_undegraded":"2023-12-04T05:39:28.089740+0000","last_fullsized":"2023-12-04T05:39:28.089740+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089651+0000","last_change":"2023-12-04T05:39:27.083622+0000","last_active":"2023-12-04T05:39:28.089651+0000","last_peered":"2023-12-04T05:39:28.089651+0000","last_clean":"2023-12-04T05:39:28.089651+0000","last_became_active":"2023-12-04T05:39:27.083307+0000","last_became_peered":"2023-12-04T05:39:27.083307+0000","last_unstale":"2023-12-04T05:39:28.089651+0000","last_undegraded":"2023-12-04T05:39:28.089651+0000","last_fullsized":"2023-12-04T05:39:28.089651+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089674+0000","last_change":"2023-12-04T05:39:26.078897+0000","last_active":"2023-12-04T05:39:28.089674+0000","last_peered":"2023-12-04T05:39:28.089674+0000","last_clean":"2023-12-04T05:39:28.089674+0000","last_became_active":"2023-12-04T05:39:26.078018+0000","last_became_peered":"2023-12-04T05:39:26.078018+0000","last_unstale":"2023-12-04T05:39:28.089674+0000","last_undegraded":"2023-12-04T05:39:28.089674+0000","last_fullsized":"2023-12-04T05:39:28.089674+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089125+0000","last_change":"2023-12-04T05:39:27.079603+0000","last_active":"2023-12-04T05:39:28.089125+0000","last_peered":"2023-12-04T05:39:28.089125+0000","last_clean":"2023-12-04T05:39:28.089125+0000","last_became_active":"2023-12-04T05:39:27.079350+0000","last_became_peered":"2023-12-04T05:39:27.079350+0000","last_unstale":"2023-12-04T05:39:28.089125+0000","last_undegraded":"2023-12-04T05:39:28.089125+0000","last_fullsized":"2023-12-04T05:39:28.089125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.105910+0000","last_change":"2023-12-04T05:39:26.076007+0000","last_active":"2023-12-04T05:39:27.105910+0000","last_peered":"2023-12-04T05:39:27.105910+0000","last_clean":"2023-12-04T05:39:27.105910+0000","last_became_active":"2023-12-04T05:39:26.075733+0000","last_became_peered":"2023-12-04T05:39:26.075733+0000","last_unstale":"2023-12-04T05:39:27.105910+0000","last_undegraded":"2023-12-04T05:39:27.105910+0000","last_fullsized":"2023-12-04T05:39:27.105910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:05.655015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.110446+0000","last_change":"2023-12-04T05:39:27.105372+0000","last_active":"2023-12-04T05:39:27.110446+0000","last_peered":"2023-12-04T05:39:27.110446+0000","last_clean":"2023-12-04T05:39:27.110446+0000","last_became_active":"2023-12-04T05:39:27.105036+0000","last_became_peered":"2023-12-04T05:39:27.105036+0000","last_unstale":"2023-12-04T05:39:27.110446+0000","last_undegraded":"2023-12-04T05:39:27.110446+0000","last_fullsized":"2023-12-04T05:39:27.110446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107182+0000","last_change":"2023-12-04T05:39:26.077203+0000","last_active":"2023-12-04T05:39:27.107182+0000","last_peered":"2023-12-04T05:39:27.107182+0000","last_clean":"2023-12-04T05:39:27.107182+0000","last_became_active":"2023-12-04T05:39:26.076877+0000","last_became_peered":"2023-12-04T05:39:26.076877+0000","last_unstale":"2023-12-04T05:39:27.107182+0000","last_undegraded":"2023-12-04T05:39:27.107182+0000","last_fullsized":"2023-12-04T05:39:27.107182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:14.982034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108809+0000","last_change":"2023-12-04T05:39:27.103318+0000","last_active":"2023-12-04T05:39:27.108809+0000","last_peered":"2023-12-04T05:39:27.108809+0000","last_clean":"2023-12-04T05:39:27.108809+0000","last_became_active":"2023-12-04T05:39:27.102506+0000","last_became_peered":"2023-12-04T05:39:27.102506+0000","last_unstale":"2023-12-04T05:39:27.108809+0000","last_undegraded":"2023-12-04T05:39:27.108809+0000","last_fullsized":"2023-12-04T05:39:27.108809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:48:53.558900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089332+0000","last_change":"2023-12-04T05:39:26.083745+0000","last_active":"2023-12-04T05:39:28.089332+0000","last_peered":"2023-12-04T05:39:28.089332+0000","last_clean":"2023-12-04T05:39:28.089332+0000","last_became_active":"2023-12-04T05:39:26.083470+0000","last_became_peered":"2023-12-04T05:39:26.083470+0000","last_unstale":"2023-12-04T05:39:28.089332+0000","last_undegraded":"2023-12-04T05:39:28.089332+0000","last_fullsized":"2023-12-04T05:39:28.089332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089137+0000","last_change":"2023-12-04T05:39:27.095704+0000","last_active":"2023-12-04T05:39:28.089137+0000","last_peered":"2023-12-04T05:39:28.089137+0000","last_clean":"2023-12-04T05:39:28.089137+0000","last_became_active":"2023-12-04T05:39:27.095453+0000","last_became_peered":"2023-12-04T05:39:27.095453+0000","last_unstale":"2023-12-04T05:39:28.089137+0000","last_undegraded":"2023-12-04T05:39:28.089137+0000","last_fullsized":"2023-12-04T05:39:28.089137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089025+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:28.089025+0000","last_peered":"2023-12-04T05:39:28.089025+0000","last_clean":"2023-12-04T05:39:28.089025+0000","last_became_active":"2023-12-04T05:39:26.082344+0000","last_became_peered":"2023-12-04T05:39:26.082344+0000","last_unstale":"2023-12-04T05:39:28.089025+0000","last_undegraded":"2023-12-04T05:39:28.089025+0000","last_fullsized":"2023-12-04T05:39:28.089025+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:58.593571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090865+0000","last_change":"2023-12-04T05:39:27.083885+0000","last_active":"2023-12-04T05:39:27.090865+0000","last_peered":"2023-12-04T05:39:27.090865+0000","last_clean":"2023-12-04T05:39:27.090865+0000","last_became_active":"2023-12-04T05:39:27.083258+0000","last_became_peered":"2023-12-04T05:39:27.083258+0000","last_unstale":"2023-12-04T05:39:27.090865+0000","last_undegraded":"2023-12-04T05:39:27.090865+0000","last_fullsized":"2023-12-04T05:39:27.090865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069705+0000","last_change":"2023-12-04T05:39:26.079216+0000","last_active":"2023-12-04T05:39:27.069705+0000","last_peered":"2023-12-04T05:39:27.069705+0000","last_clean":"2023-12-04T05:39:27.069705+0000","last_became_active":"2023-12-04T05:39:26.078909+0000","last_became_peered":"2023-12-04T05:39:26.078909+0000","last_unstale":"2023-12-04T05:39:27.069705+0000","last_undegraded":"2023-12-04T05:39:27.069705+0000","last_fullsized":"2023-12-04T05:39:27.069705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.099891+0000","last_change":"2023-12-04T05:39:27.088070+0000","last_active":"2023-12-04T05:39:27.099891+0000","last_peered":"2023-12-04T05:39:27.099891+0000","last_clean":"2023-12-04T05:39:27.099891+0000","last_became_active":"2023-12-04T05:39:27.087797+0000","last_became_peered":"2023-12-04T05:39:27.087797+0000","last_unstale":"2023-12-04T05:39:27.099891+0000","last_undegraded":"2023-12-04T05:39:27.099891+0000","last_fullsized":"2023-12-04T05:39:27.099891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:03.949105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.064449+0000","last_change":"2023-12-04T05:39:26.081292+0000","last_active":"2023-12-04T05:39:27.064449+0000","last_peered":"2023-12-04T05:39:27.064449+0000","last_clean":"2023-12-04T05:39:27.064449+0000","last_became_active":"2023-12-04T05:39:26.080956+0000","last_became_peered":"2023-12-04T05:39:26.080956+0000","last_unstale":"2023-12-04T05:39:27.064449+0000","last_undegraded":"2023-12-04T05:39:27.064449+0000","last_fullsized":"2023-12-04T05:39:27.064449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:59:30.549509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.099826+0000","last_change":"2023-12-04T05:39:27.086538+0000","last_active":"2023-12-04T05:39:27.099826+0000","last_peered":"2023-12-04T05:39:27.099826+0000","last_clean":"2023-12-04T05:39:27.099826+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:27.099826+0000","last_undegraded":"2023-12-04T05:39:27.099826+0000","last_fullsized":"2023-12-04T05:39:27.099826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:24:07.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089782+0000","last_change":"2023-12-04T05:39:26.079751+0000","last_active":"2023-12-04T05:39:28.089782+0000","last_peered":"2023-12-04T05:39:28.089782+0000","last_clean":"2023-12-04T05:39:28.089782+0000","last_became_active":"2023-12-04T05:39:26.079416+0000","last_became_peered":"2023-12-04T05:39:26.079416+0000","last_unstale":"2023-12-04T05:39:28.089782+0000","last_undegraded":"2023-12-04T05:39:28.089782+0000","last_fullsized":"2023-12-04T05:39:28.089782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:38.798222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107500+0000","last_change":"2023-12-04T05:39:27.100388+0000","last_active":"2023-12-04T05:39:27.107500+0000","last_peered":"2023-12-04T05:39:27.107500+0000","last_clean":"2023-12-04T05:39:27.107500+0000","last_became_active":"2023-12-04T05:39:27.100126+0000","last_became_peered":"2023-12-04T05:39:27.100126+0000","last_unstale":"2023-12-04T05:39:27.107500+0000","last_undegraded":"2023-12-04T05:39:27.107500+0000","last_fullsized":"2023-12-04T05:39:27.107500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:01.666984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089530+0000","last_change":"2023-12-04T05:39:26.076770+0000","last_active":"2023-12-04T05:39:28.089530+0000","last_peered":"2023-12-04T05:39:28.089530+0000","last_clean":"2023-12-04T05:39:28.089530+0000","last_became_active":"2023-12-04T05:39:26.076464+0000","last_became_peered":"2023-12-04T05:39:26.076464+0000","last_unstale":"2023-12-04T05:39:28.089530+0000","last_undegraded":"2023-12-04T05:39:28.089530+0000","last_fullsized":"2023-12-04T05:39:28.089530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.098945+0000","last_change":"2023-12-04T05:39:27.090003+0000","last_active":"2023-12-04T05:39:27.098945+0000","last_peered":"2023-12-04T05:39:27.098945+0000","last_clean":"2023-12-04T05:39:27.098945+0000","last_became_active":"2023-12-04T05:39:27.089648+0000","last_became_peered":"2023-12-04T05:39:27.089648+0000","last_unstale":"2023-12-04T05:39:27.098945+0000","last_undegraded":"2023-12-04T05:39:27.098945+0000","last_fullsized":"2023-12-04T05:39:27.098945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088403+0000","last_change":"2023-12-04T05:39:26.084259+0000","last_active":"2023-12-04T05:39:28.088403+0000","last_peered":"2023-12-04T05:39:28.088403+0000","last_clean":"2023-12-04T05:39:28.088403+0000","last_became_active":"2023-12-04T05:39:26.083846+0000","last_became_peered":"2023-12-04T05:39:26.083846+0000","last_unstale":"2023-12-04T05:39:28.088403+0000","last_undegraded":"2023-12-04T05:39:28.088403+0000","last_fullsized":"2023-12-04T05:39:28.088403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:57.269372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088965+0000","last_change":"2023-12-04T05:39:27.079605+0000","last_active":"2023-12-04T05:39:28.088965+0000","last_peered":"2023-12-04T05:39:28.088965+0000","last_clean":"2023-12-04T05:39:28.088965+0000","last_became_active":"2023-12-04T05:39:27.079189+0000","last_became_peered":"2023-12-04T05:39:27.079189+0000","last_unstale":"2023-12-04T05:39:28.088965+0000","last_undegraded":"2023-12-04T05:39:28.088965+0000","last_fullsized":"2023-12-04T05:39:28.088965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.110362+0000","last_change":"2023-12-04T05:39:26.080958+0000","last_active":"2023-12-04T05:39:27.110362+0000","last_peered":"2023-12-04T05:39:27.110362+0000","last_clean":"2023-12-04T05:39:27.110362+0000","last_became_active":"2023-12-04T05:39:26.080666+0000","last_became_peered":"2023-12-04T05:39:26.080666+0000","last_unstale":"2023-12-04T05:39:27.110362+0000","last_undegraded":"2023-12-04T05:39:27.110362+0000","last_fullsized":"2023-12-04T05:39:27.110362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:49.072351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092313+0000","last_change":"2023-12-04T05:39:27.081943+0000","last_active":"2023-12-04T05:39:27.092313+0000","last_peered":"2023-12-04T05:39:27.092313+0000","last_clean":"2023-12-04T05:39:27.092313+0000","last_became_active":"2023-12-04T05:39:27.081675+0000","last_became_peered":"2023-12-04T05:39:27.081675+0000","last_unstale":"2023-12-04T05:39:27.092313+0000","last_undegraded":"2023-12-04T05:39:27.092313+0000","last_fullsized":"2023-12-04T05:39:27.092313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108990+0000","last_change":"2023-12-04T05:39:26.082163+0000","last_active":"2023-12-04T05:39:27.108990+0000","last_peered":"2023-12-04T05:39:27.108990+0000","last_clean":"2023-12-04T05:39:27.108990+0000","last_became_active":"2023-12-04T05:39:26.081837+0000","last_became_peered":"2023-12-04T05:39:26.081837+0000","last_unstale":"2023-12-04T05:39:27.108990+0000","last_undegraded":"2023-12-04T05:39:27.108990+0000","last_fullsized":"2023-12-04T05:39:27.108990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:58.918868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090706+0000","last_change":"2023-12-04T05:39:27.083342+0000","last_active":"2023-12-04T05:39:27.090706+0000","last_peered":"2023-12-04T05:39:27.090706+0000","last_clean":"2023-12-04T05:39:27.090706+0000","last_became_active":"2023-12-04T05:39:27.082988+0000","last_became_peered":"2023-12-04T05:39:27.082988+0000","last_unstale":"2023-12-04T05:39:27.090706+0000","last_undegraded":"2023-12-04T05:39:27.090706+0000","last_fullsized":"2023-12-04T05:39:27.090706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.089057+0000","last_change":"2023-12-04T05:39:26.087193+0000","last_active":"2023-12-04T05:39:27.089057+0000","last_peered":"2023-12-04T05:39:27.089057+0000","last_clean":"2023-12-04T05:39:27.089057+0000","last_became_active":"2023-12-04T05:39:26.086857+0000","last_became_peered":"2023-12-04T05:39:26.086857+0000","last_unstale":"2023-12-04T05:39:27.089057+0000","last_undegraded":"2023-12-04T05:39:27.089057+0000","last_fullsized":"2023-12-04T05:39:27.089057+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:50.459837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108005+0000","last_change":"2023-12-04T05:39:27.098688+0000","last_active":"2023-12-04T05:39:27.108005+0000","last_peered":"2023-12-04T05:39:27.108005+0000","last_clean":"2023-12-04T05:39:27.108005+0000","last_became_active":"2023-12-04T05:39:27.098339+0000","last_became_peered":"2023-12-04T05:39:27.098339+0000","last_unstale":"2023-12-04T05:39:27.108005+0000","last_undegraded":"2023-12-04T05:39:27.108005+0000","last_fullsized":"2023-12-04T05:39:27.108005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:16:16.818773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.075016+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:27.075016+0000","last_peered":"2023-12-04T05:39:27.075016+0000","last_clean":"2023-12-04T05:39:27.075016+0000","last_became_active":"2023-12-04T05:39:26.081807+0000","last_became_peered":"2023-12-04T05:39:26.081807+0000","last_unstale":"2023-12-04T05:39:27.075016+0000","last_undegraded":"2023-12-04T05:39:27.075016+0000","last_fullsized":"2023-12-04T05:39:27.075016+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.083508+0000","last_change":"2023-12-04T05:39:27.075983+0000","last_active":"2023-12-04T05:39:27.083508+0000","last_peered":"2023-12-04T05:39:27.083508+0000","last_clean":"2023-12-04T05:39:27.083508+0000","last_became_active":"2023-12-04T05:39:27.075631+0000","last_became_peered":"2023-12-04T05:39:27.075631+0000","last_unstale":"2023-12-04T05:39:27.083508+0000","last_undegraded":"2023-12-04T05:39:27.083508+0000","last_fullsized":"2023-12-04T05:39:27.083508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:46:26.699542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104782+0000","last_change":"2023-12-04T05:39:26.075035+0000","last_active":"2023-12-04T05:39:27.104782+0000","last_peered":"2023-12-04T05:39:27.104782+0000","last_clean":"2023-12-04T05:39:27.104782+0000","last_became_active":"2023-12-04T05:39:26.074755+0000","last_became_peered":"2023-12-04T05:39:26.074755+0000","last_unstale":"2023-12-04T05:39:27.104782+0000","last_undegraded":"2023-12-04T05:39:27.104782+0000","last_fullsized":"2023-12-04T05:39:27.104782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094351+0000","last_change":"2023-12-04T05:39:27.086542+0000","last_active":"2023-12-04T05:39:27.094351+0000","last_peered":"2023-12-04T05:39:27.094351+0000","last_clean":"2023-12-04T05:39:27.094351+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:27.094351+0000","last_undegraded":"2023-12-04T05:39:27.094351+0000","last_fullsized":"2023-12-04T05:39:27.094351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089838+0000","last_change":"2023-12-04T05:39:26.079175+0000","last_active":"2023-12-04T05:39:28.089838+0000","last_peered":"2023-12-04T05:39:28.089838+0000","last_clean":"2023-12-04T05:39:28.089838+0000","last_became_active":"2023-12-04T05:39:26.078543+0000","last_became_peered":"2023-12-04T05:39:26.078543+0000","last_unstale":"2023-12-04T05:39:28.089838+0000","last_undegraded":"2023-12-04T05:39:28.089838+0000","last_fullsized":"2023-12-04T05:39:28.089838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089720+0000","last_change":"2023-12-04T05:39:27.083002+0000","last_active":"2023-12-04T05:39:28.089720+0000","last_peered":"2023-12-04T05:39:28.089720+0000","last_clean":"2023-12-04T05:39:28.089720+0000","last_became_active":"2023-12-04T05:39:27.082167+0000","last_became_peered":"2023-12-04T05:39:27.082167+0000","last_unstale":"2023-12-04T05:39:28.089720+0000","last_undegraded":"2023-12-04T05:39:28.089720+0000","last_fullsized":"2023-12-04T05:39:28.089720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.105033+0000","last_change":"2023-12-04T05:39:26.078377+0000","last_active":"2023-12-04T05:39:27.105033+0000","last_peered":"2023-12-04T05:39:27.105033+0000","last_clean":"2023-12-04T05:39:27.105033+0000","last_became_active":"2023-12-04T05:39:26.077976+0000","last_became_peered":"2023-12-04T05:39:26.077976+0000","last_unstale":"2023-12-04T05:39:27.105033+0000","last_undegraded":"2023-12-04T05:39:27.105033+0000","last_fullsized":"2023-12-04T05:39:27.105033+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:13.700732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089118+0000","last_change":"2023-12-04T05:39:27.079741+0000","last_active":"2023-12-04T05:39:28.089118+0000","last_peered":"2023-12-04T05:39:28.089118+0000","last_clean":"2023-12-04T05:39:28.089118+0000","last_became_active":"2023-12-04T05:39:27.079309+0000","last_became_peered":"2023-12-04T05:39:27.079309+0000","last_unstale":"2023-12-04T05:39:28.089118+0000","last_undegraded":"2023-12-04T05:39:28.089118+0000","last_fullsized":"2023-12-04T05:39:28.089118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069997+0000","last_change":"2023-12-04T05:39:26.075679+0000","last_active":"2023-12-04T05:39:27.069997+0000","last_peered":"2023-12-04T05:39:27.069997+0000","last_clean":"2023-12-04T05:39:27.069997+0000","last_became_active":"2023-12-04T05:39:26.075408+0000","last_became_peered":"2023-12-04T05:39:26.075408+0000","last_unstale":"2023-12-04T05:39:27.069997+0000","last_undegraded":"2023-12-04T05:39:27.069997+0000","last_fullsized":"2023-12-04T05:39:27.069997+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087397+0000","last_change":"2023-12-04T05:39:27.096722+0000","last_active":"2023-12-04T05:39:28.087397+0000","last_peered":"2023-12-04T05:39:28.087397+0000","last_clean":"2023-12-04T05:39:28.087397+0000","last_became_active":"2023-12-04T05:39:27.089687+0000","last_became_peered":"2023-12-04T05:39:27.089687+0000","last_unstale":"2023-12-04T05:39:28.087397+0000","last_undegraded":"2023-12-04T05:39:28.087397+0000","last_fullsized":"2023-12-04T05:39:28.087397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:04:15.694056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108489+0000","last_change":"2023-12-04T05:39:26.086640+0000","last_active":"2023-12-04T05:39:27.108489+0000","last_peered":"2023-12-04T05:39:27.108489+0000","last_clean":"2023-12-04T05:39:27.108489+0000","last_became_active":"2023-12-04T05:39:26.086335+0000","last_became_peered":"2023-12-04T05:39:26.086335+0000","last_unstale":"2023-12-04T05:39:27.108489+0000","last_undegraded":"2023-12-04T05:39:27.108489+0000","last_fullsized":"2023-12-04T05:39:27.108489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:18:07.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104455+0000","last_change":"2023-12-04T05:39:27.096615+0000","last_active":"2023-12-04T05:39:27.104455+0000","last_peered":"2023-12-04T05:39:27.104455+0000","last_clean":"2023-12-04T05:39:27.104455+0000","last_became_active":"2023-12-04T05:39:27.096318+0000","last_became_peered":"2023-12-04T05:39:27.096318+0000","last_unstale":"2023-12-04T05:39:27.104455+0000","last_undegraded":"2023-12-04T05:39:27.104455+0000","last_fullsized":"2023-12-04T05:39:27.104455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:45:15.043031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087437+0000","last_change":"2023-12-04T05:39:26.084101+0000","last_active":"2023-12-04T05:39:28.087437+0000","last_peered":"2023-12-04T05:39:28.087437+0000","last_clean":"2023-12-04T05:39:28.087437+0000","last_became_active":"2023-12-04T05:39:26.083785+0000","last_became_peered":"2023-12-04T05:39:26.083785+0000","last_unstale":"2023-12-04T05:39:28.087437+0000","last_undegraded":"2023-12-04T05:39:28.087437+0000","last_fullsized":"2023-12-04T05:39:28.087437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:47:37.800218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086988+0000","last_change":"2023-12-04T05:39:27.082611+0000","last_active":"2023-12-04T05:39:28.086988+0000","last_peered":"2023-12-04T05:39:28.086988+0000","last_clean":"2023-12-04T05:39:28.086988+0000","last_became_active":"2023-12-04T05:39:27.082317+0000","last_became_peered":"2023-12-04T05:39:27.082317+0000","last_unstale":"2023-12-04T05:39:28.086988+0000","last_undegraded":"2023-12-04T05:39:28.086988+0000","last_fullsized":"2023-12-04T05:39:28.086988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:24:22.060177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086995+0000","last_change":"2023-12-04T05:39:26.080322+0000","last_active":"2023-12-04T05:39:28.086995+0000","last_peered":"2023-12-04T05:39:28.086995+0000","last_clean":"2023-12-04T05:39:28.086995+0000","last_became_active":"2023-12-04T05:39:26.079499+0000","last_became_peered":"2023-12-04T05:39:26.079499+0000","last_unstale":"2023-12-04T05:39:28.086995+0000","last_undegraded":"2023-12-04T05:39:28.086995+0000","last_fullsized":"2023-12-04T05:39:28.086995+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:57:37.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.096461+0000","last_change":"2023-12-04T05:39:27.087432+0000","last_active":"2023-12-04T05:39:27.096461+0000","last_peered":"2023-12-04T05:39:27.096461+0000","last_clean":"2023-12-04T05:39:27.096461+0000","last_became_active":"2023-12-04T05:39:27.086159+0000","last_became_peered":"2023-12-04T05:39:27.086159+0000","last_unstale":"2023-12-04T05:39:27.096461+0000","last_undegraded":"2023-12-04T05:39:27.096461+0000","last_fullsized":"2023-12-04T05:39:27.096461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:58.277677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.081461+0000","last_change":"2023-12-04T05:39:26.082897+0000","last_active":"2023-12-04T05:39:27.081461+0000","last_peered":"2023-12-04T05:39:27.081461+0000","last_clean":"2023-12-04T05:39:27.081461+0000","last_became_active":"2023-12-04T05:39:26.082589+0000","last_became_peered":"2023-12-04T05:39:26.082589+0000","last_unstale":"2023-12-04T05:39:27.081461+0000","last_undegraded":"2023-12-04T05:39:27.081461+0000","last_fullsized":"2023-12-04T05:39:27.081461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:38:35.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089527+0000","last_change":"2023-12-04T05:39:27.084628+0000","last_active":"2023-12-04T05:39:28.089527+0000","last_peered":"2023-12-04T05:39:28.089527+0000","last_clean":"2023-12-04T05:39:28.089527+0000","last_became_active":"2023-12-04T05:39:27.084326+0000","last_became_peered":"2023-12-04T05:39:27.084326+0000","last_unstale":"2023-12-04T05:39:28.089527+0000","last_undegraded":"2023-12-04T05:39:28.089527+0000","last_fullsized":"2023-12-04T05:39:28.089527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108062+0000","last_change":"2023-12-04T05:39:26.081865+0000","last_active":"2023-12-04T05:39:27.108062+0000","last_peered":"2023-12-04T05:39:27.108062+0000","last_clean":"2023-12-04T05:39:27.108062+0000","last_became_active":"2023-12-04T05:39:26.081533+0000","last_became_peered":"2023-12-04T05:39:26.081533+0000","last_unstale":"2023-12-04T05:39:27.108062+0000","last_undegraded":"2023-12-04T05:39:27.108062+0000","last_fullsized":"2023-12-04T05:39:27.108062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:57.328933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094522+0000","last_change":"2023-12-04T05:39:27.087533+0000","last_active":"2023-12-04T05:39:27.094522+0000","last_peered":"2023-12-04T05:39:27.094522+0000","last_clean":"2023-12-04T05:39:27.094522+0000","last_became_active":"2023-12-04T05:39:27.087076+0000","last_became_peered":"2023-12-04T05:39:27.087076+0000","last_unstale":"2023-12-04T05:39:27.094522+0000","last_undegraded":"2023-12-04T05:39:27.094522+0000","last_fullsized":"2023-12-04T05:39:27.094522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.064019+0000","last_change":"2023-12-04T05:39:26.082858+0000","last_active":"2023-12-04T05:39:27.064019+0000","last_peered":"2023-12-04T05:39:27.064019+0000","last_clean":"2023-12-04T05:39:27.064019+0000","last_became_active":"2023-12-04T05:39:26.082559+0000","last_became_peered":"2023-12-04T05:39:26.082559+0000","last_unstale":"2023-12-04T05:39:27.064019+0000","last_undegraded":"2023-12-04T05:39:27.064019+0000","last_fullsized":"2023-12-04T05:39:27.064019+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:37:14.553422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089281+0000","last_change":"2023-12-04T05:39:27.093250+0000","last_active":"2023-12-04T05:39:28.089281+0000","last_peered":"2023-12-04T05:39:28.089281+0000","last_clean":"2023-12-04T05:39:28.089281+0000","last_became_active":"2023-12-04T05:39:27.092375+0000","last_became_peered":"2023-12-04T05:39:27.092375+0000","last_unstale":"2023-12-04T05:39:28.089281+0000","last_undegraded":"2023-12-04T05:39:28.089281+0000","last_fullsized":"2023-12-04T05:39:28.089281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088584+0000","last_change":"2023-12-04T05:39:26.082662+0000","last_active":"2023-12-04T05:39:28.088584+0000","last_peered":"2023-12-04T05:39:28.088584+0000","last_clean":"2023-12-04T05:39:28.088584+0000","last_became_active":"2023-12-04T05:39:26.082131+0000","last_became_peered":"2023-12-04T05:39:26.082131+0000","last_unstale":"2023-12-04T05:39:28.088584+0000","last_undegraded":"2023-12-04T05:39:28.088584+0000","last_fullsized":"2023-12-04T05:39:28.088584+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089259+0000","last_change":"2023-12-04T05:39:27.079536+0000","last_active":"2023-12-04T05:39:28.089259+0000","last_peered":"2023-12-04T05:39:28.089259+0000","last_clean":"2023-12-04T05:39:28.089259+0000","last_became_active":"2023-12-04T05:39:27.078782+0000","last_became_peered":"2023-12-04T05:39:27.078782+0000","last_unstale":"2023-12-04T05:39:28.089259+0000","last_undegraded":"2023-12-04T05:39:28.089259+0000","last_fullsized":"2023-12-04T05:39:28.089259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089370+0000","last_change":"2023-12-04T05:39:26.080171+0000","last_active":"2023-12-04T05:39:28.089370+0000","last_peered":"2023-12-04T05:39:28.089370+0000","last_clean":"2023-12-04T05:39:28.089370+0000","last_became_active":"2023-12-04T05:39:26.079829+0000","last_became_peered":"2023-12-04T05:39:26.079829+0000","last_unstale":"2023-12-04T05:39:28.089370+0000","last_undegraded":"2023-12-04T05:39:28.089370+0000","last_fullsized":"2023-12-04T05:39:28.089370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.095839+0000","last_change":"2023-12-04T05:39:27.086155+0000","last_active":"2023-12-04T05:39:27.095839+0000","last_peered":"2023-12-04T05:39:27.095839+0000","last_clean":"2023-12-04T05:39:27.095839+0000","last_became_active":"2023-12-04T05:39:27.085887+0000","last_became_peered":"2023-12-04T05:39:27.085887+0000","last_unstale":"2023-12-04T05:39:27.095839+0000","last_undegraded":"2023-12-04T05:39:27.095839+0000","last_fullsized":"2023-12-04T05:39:27.095839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:10.220064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069917+0000","last_change":"2023-12-04T05:39:26.079734+0000","last_active":"2023-12-04T05:39:27.069917+0000","last_peered":"2023-12-04T05:39:27.069917+0000","last_clean":"2023-12-04T05:39:27.069917+0000","last_became_active":"2023-12-04T05:39:26.079419+0000","last_became_peered":"2023-12-04T05:39:26.079419+0000","last_unstale":"2023-12-04T05:39:27.069917+0000","last_undegraded":"2023-12-04T05:39:27.069917+0000","last_fullsized":"2023-12-04T05:39:27.069917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092030+0000","last_change":"2023-12-04T05:39:27.081159+0000","last_active":"2023-12-04T05:39:27.092030+0000","last_peered":"2023-12-04T05:39:27.092030+0000","last_clean":"2023-12-04T05:39:27.092030+0000","last_became_active":"2023-12-04T05:39:27.080820+0000","last_became_peered":"2023-12-04T05:39:27.080820+0000","last_unstale":"2023-12-04T05:39:27.092030+0000","last_undegraded":"2023-12-04T05:39:27.092030+0000","last_fullsized":"2023-12-04T05:39:27.092030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089163+0000","last_change":"2023-12-04T05:39:26.080928+0000","last_active":"2023-12-04T05:39:28.089163+0000","last_peered":"2023-12-04T05:39:28.089163+0000","last_clean":"2023-12-04T05:39:28.089163+0000","last_became_active":"2023-12-04T05:39:26.080474+0000","last_became_peered":"2023-12-04T05:39:26.080474+0000","last_unstale":"2023-12-04T05:39:28.089163+0000","last_undegraded":"2023-12-04T05:39:28.089163+0000","last_fullsized":"2023-12-04T05:39:28.089163+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:49.152723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090906+0000","last_change":"2023-12-04T05:39:27.083988+0000","last_active":"2023-12-04T05:39:27.090906+0000","last_peered":"2023-12-04T05:39:27.090906+0000","last_clean":"2023-12-04T05:39:27.090906+0000","last_became_active":"2023-12-04T05:39:27.083606+0000","last_became_peered":"2023-12-04T05:39:27.083606+0000","last_unstale":"2023-12-04T05:39:27.090906+0000","last_undegraded":"2023-12-04T05:39:27.090906+0000","last_fullsized":"2023-12-04T05:39:27.090906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088651+0000","last_change":"2023-12-04T05:39:26.079887+0000","last_active":"2023-12-04T05:39:28.088651+0000","last_peered":"2023-12-04T05:39:28.088651+0000","last_clean":"2023-12-04T05:39:28.088651+0000","last_became_active":"2023-12-04T05:39:26.079365+0000","last_became_peered":"2023-12-04T05:39:26.079365+0000","last_unstale":"2023-12-04T05:39:28.088651+0000","last_undegraded":"2023-12-04T05:39:28.088651+0000","last_fullsized":"2023-12-04T05:39:28.088651+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088554+0000","last_change":"2023-12-04T05:39:27.102361+0000","last_active":"2023-12-04T05:39:28.088554+0000","last_peered":"2023-12-04T05:39:28.088554+0000","last_clean":"2023-12-04T05:39:28.088554+0000","last_became_active":"2023-12-04T05:39:27.101931+0000","last_became_peered":"2023-12-04T05:39:27.101931+0000","last_unstale":"2023-12-04T05:39:28.088554+0000","last_undegraded":"2023-12-04T05:39:28.088554+0000","last_fullsized":"2023-12-04T05:39:28.088554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088707+0000","last_change":"2023-12-04T05:39:26.076033+0000","last_active":"2023-12-04T05:39:28.088707+0000","last_peered":"2023-12-04T05:39:28.088707+0000","last_clean":"2023-12-04T05:39:28.088707+0000","last_became_active":"2023-12-04T05:39:26.075725+0000","last_became_peered":"2023-12-04T05:39:26.075725+0000","last_unstale":"2023-12-04T05:39:28.088707+0000","last_undegraded":"2023-12-04T05:39:28.088707+0000","last_fullsized":"2023-12-04T05:39:28.088707+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104482+0000","last_change":"2023-12-04T05:39:27.088782+0000","last_active":"2023-12-04T05:39:27.104482+0000","last_peered":"2023-12-04T05:39:27.104482+0000","last_clean":"2023-12-04T05:39:27.104482+0000","last_became_active":"2023-12-04T05:39:27.088524+0000","last_became_peered":"2023-12-04T05:39:27.088524+0000","last_unstale":"2023-12-04T05:39:27.104482+0000","last_undegraded":"2023-12-04T05:39:27.104482+0000","last_fullsized":"2023-12-04T05:39:27.104482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:55:37.166590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108386+0000","last_change":"2023-12-04T05:39:26.087051+0000","last_active":"2023-12-04T05:39:27.108386+0000","last_peered":"2023-12-04T05:39:27.108386+0000","last_clean":"2023-12-04T05:39:27.108386+0000","last_became_active":"2023-12-04T05:39:26.086791+0000","last_became_peered":"2023-12-04T05:39:26.086791+0000","last_unstale":"2023-12-04T05:39:27.108386+0000","last_undegraded":"2023-12-04T05:39:27.108386+0000","last_fullsized":"2023-12-04T05:39:27.108386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-04T05:39:26.070478+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:39:26.070478+0000","last_peered":"2023-12-04T05:39:26.070478+0000","last_clean":"2023-12-04T05:39:26.070478+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:39:26.070478+0000","last_undegraded":"2023-12-04T05:39:26.070478+0000","last_fullsized":"2023-12-04T05:39:26.070478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":948661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84199999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71599999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.90000000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.43099999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.49099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":358917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.81200000000000006}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.98099999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":359857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79600000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":364523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.752}]},{"osd":1,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82799999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85499999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.84299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.87}]},{"osd":5,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":1.167,"15min":1.167},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96699999999999997,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":359835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46200000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.748},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.46400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.4130000000000003,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.38}]},{"osd":3,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82999999999999996,"15min":0.81699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.3710000000000004,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.96299999999999997,"15min":0.97099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":5.4889999999999999,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.622}]},{"osd":6,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.218,"5min":4.218,"15min":4.218},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":358417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.621}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.94099999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":948625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.317},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.433}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.377}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.443}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:39:31.151 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:39:31.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 Processor -- start 2023-12-04T05:39:31.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 -- start start 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdc34151bf0 0x7fdc340abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc34155370 0x7fdc3415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc341547d0 con 0x7fdc340c7ef0 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc34158b80 con 0x7fdc34155370 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc3b46b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340c4aa0 con 0x7fdc34151bf0 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc34155370 0x7fdc3415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdc34155370 0x7fdc3415efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60532/0 (socket says 172.21.15.97:60532) 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 -- 172.21.15.97:0/2426582599 learned_addr learned my addr 172.21.15.97:0/2426582599 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:31.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc38a06640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdc340c7ef0 0x7fdc34154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46564/0 (socket says 172.21.15.97:46564) 2023-12-04T05:39:31.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39207640 1 --2- 172.21.15.97:0/2426582599 >> v2:172.21.15.143:3300/0 conn(0x7fdc34151bf0 0x7fdc340abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 -- 172.21.15.97:0/2426582599 >> v2:172.21.15.143:3300/0 conn(0x7fdc34151bf0 msgr2=0x7fdc340abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:31.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 --2- 172.21.15.97:0/2426582599 >> v2:172.21.15.143:3300/0 conn(0x7fdc34151bf0 0x7fdc340abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 -- 172.21.15.97:0/2426582599 >> v1:172.21.15.97:6789/0 conn(0x7fdc340c7ef0 legacy=0x7fdc34154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.321+0000 7fdc39a08640 1 -- 172.21.15.97:0/2426582599 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340c4d40 con 0x7fdc34155370 2023-12-04T05:39:31.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc39a08640 1 --2- 172.21.15.97:0/2426582599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc34155370 0x7fdc3415efb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdc340b01e0 tx=0x7fdc2c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f965bc0126a6933 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc2bfff640 1 -- 172.21.15.97:0/2426582599 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0090d0 con 0x7fdc34155370 2023-12-04T05:39:31.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc2bfff640 1 -- 172.21.15.97:0/2426582599 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c009230 con 0x7fdc34155370 2023-12-04T05:39:31.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc2bfff640 1 -- 172.21.15.97:0/2426582599 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0ac610 con 0x7fdc34155370 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 -- 172.21.15.97:0/2426582599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc34155370 msgr2=0x7fdc3415efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/2426582599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc34155370 0x7fdc3415efb0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdc340b01e0 tx=0x7fdc2c01c590 comp rx=0 tx=0).stop 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 -- 172.21.15.97:0/2426582599 shutdown_connections 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/2426582599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc34155370 0x7fdc3415efb0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/2426582599 >> v2:172.21.15.143:3300/0 conn(0x7fdc34151bf0 0x7fdc340abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 -- 172.21.15.97:0/2426582599 >> 172.21.15.97:0/2426582599 conn(0x7fdc34073550 msgr2=0x7fdc34073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 -- 172.21.15.97:0/2426582599 shutdown_connections 2023-12-04T05:39:31.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.325+0000 7fdc3b46b640 1 -- 172.21.15.97:0/2426582599 wait complete. 2023-12-04T05:39:31.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 Processor -- start 2023-12-04T05:39:31.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- start start 2023-12-04T05:39:31.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdc34151bf0 0x7fdc341f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdc34155370 0x7fdc341ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341f22a0 con 0x7fdc340c7ef0 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341ee1f0 con 0x7fdc34151bf0 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341edef0 con 0x7fdc34155370 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60544/0 (socket says 172.21.15.97:60544) 2023-12-04T05:39:31.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 -- 172.21.15.97:0/464235040 learned_addr learned my addr 172.21.15.97:0/464235040 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 -- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdc34155370 msgr2=0x7fdc341ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdc34155370 0x7fdc341ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 -- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdc34151bf0 msgr2=0x7fdc341f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdc34151bf0 0x7fdc341f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 -- 172.21.15.97:0/464235040 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009b30 con 0x7fdc340c7ef0 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc39207640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000d620 tx=0x7fdc3000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000b620 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000b780 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000bb10 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc340adda0 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc340ae360 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.329+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc34068440 con 0x7fdc340c7ef0 2023-12-04T05:39:31.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.333+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc3000bc70 con 0x7fdc340c7ef0 2023-12-04T05:39:31.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.333+0000 7fdc29ffb640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.333+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc30084920 con 0x7fdc340c7ef0 2023-12-04T05:39:31.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.333+0000 7fdc38a06640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.333+0000 7fdc38a06640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 0x7fdc18068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc34067950 tx=0x7fdc240079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.337+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc30051b50 con 0x7fdc340c7ef0 2023-12-04T05:39:31.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.481+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc341ee330 con 0x7fdc180668d0 2023-12-04T05:39:31.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.489+0000 7fdc29ffb640 1 -- 172.21.15.97:0/464235040 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289367 (secure 0 0 0) 0x7fdc240070d0 con 0x7fdc180668d0 2023-12-04T05:39:31.498 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:31.500 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 msgr2=0x7fdc18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 0x7fdc18068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc34067950 tx=0x7fdc240079d0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 msgr2=0x7fdc34155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000d620 tx=0x7fdc3000dae0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 shutdown_connections 2023-12-04T05:39:31.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdc34155370 0x7fdc341ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdc34151bf0 0x7fdc341f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 --2- 172.21.15.97:0/464235040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc340c7ef0 0x7fdc34155a00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 >> 172.21.15.97:0/464235040 conn(0x7fdc34073550 msgr2=0x7fdc34153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 shutdown_connections 2023-12-04T05:39:31.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.493+0000 7fdc3b46b640 1 -- 172.21.15.97:0/464235040 wait complete. 2023-12-04T05:39:31.517 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2023-12-04T05:39:30.224612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244668,"kb_used_data":7680,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730052,"statfs":{"total":773094113280,"available":772843573248,"internally_reserved":0,"allocated":7864320,"data_stored":4063940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176206"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089131+0000","last_change":"2023-12-04T05:39:27.075692+0000","last_active":"2023-12-04T05:39:28.089131+0000","last_peered":"2023-12-04T05:39:28.089131+0000","last_clean":"2023-12-04T05:39:28.089131+0000","last_became_active":"2023-12-04T05:39:27.075338+0000","last_became_peered":"2023-12-04T05:39:27.075338+0000","last_unstale":"2023-12-04T05:39:28.089131+0000","last_undegraded":"2023-12-04T05:39:28.089131+0000","last_fullsized":"2023-12-04T05:39:28.089131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.083915+0000","last_change":"2023-12-04T05:39:27.076323+0000","last_active":"2023-12-04T05:39:27.083915+0000","last_peered":"2023-12-04T05:39:27.083915+0000","last_clean":"2023-12-04T05:39:27.083915+0000","last_became_active":"2023-12-04T05:39:27.075952+0000","last_became_peered":"2023-12-04T05:39:27.075952+0000","last_unstale":"2023-12-04T05:39:27.083915+0000","last_undegraded":"2023-12-04T05:39:27.083915+0000","last_fullsized":"2023-12-04T05:39:27.083915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:16.088331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094831+0000","last_change":"2023-12-04T05:39:27.088405+0000","last_active":"2023-12-04T05:39:27.094831+0000","last_peered":"2023-12-04T05:39:27.094831+0000","last_clean":"2023-12-04T05:39:27.094831+0000","last_became_active":"2023-12-04T05:39:27.088123+0000","last_became_peered":"2023-12-04T05:39:27.088123+0000","last_unstale":"2023-12-04T05:39:27.094831+0000","last_undegraded":"2023-12-04T05:39:27.094831+0000","last_fullsized":"2023-12-04T05:39:27.094831+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087266+0000","last_change":"2023-12-04T05:39:27.091201+0000","last_active":"2023-12-04T05:39:28.087266+0000","last_peered":"2023-12-04T05:39:28.087266+0000","last_clean":"2023-12-04T05:39:28.087266+0000","last_became_active":"2023-12-04T05:39:27.090589+0000","last_became_peered":"2023-12-04T05:39:27.090589+0000","last_unstale":"2023-12-04T05:39:28.087266+0000","last_undegraded":"2023-12-04T05:39:28.087266+0000","last_fullsized":"2023-12-04T05:39:28.087266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:28:23.983451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088954+0000","last_change":"2023-12-04T05:39:27.078406+0000","last_active":"2023-12-04T05:39:28.088954+0000","last_peered":"2023-12-04T05:39:28.088954+0000","last_clean":"2023-12-04T05:39:28.088954+0000","last_became_active":"2023-12-04T05:39:27.078131+0000","last_became_peered":"2023-12-04T05:39:27.078131+0000","last_unstale":"2023-12-04T05:39:28.088954+0000","last_undegraded":"2023-12-04T05:39:28.088954+0000","last_fullsized":"2023-12-04T05:39:28.088954+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107517+0000","last_change":"2023-12-04T05:39:27.100515+0000","last_active":"2023-12-04T05:39:27.107517+0000","last_peered":"2023-12-04T05:39:27.107517+0000","last_clean":"2023-12-04T05:39:27.107517+0000","last_became_active":"2023-12-04T05:39:27.100182+0000","last_became_peered":"2023-12-04T05:39:27.100182+0000","last_unstale":"2023-12-04T05:39:27.107517+0000","last_undegraded":"2023-12-04T05:39:27.107517+0000","last_fullsized":"2023-12-04T05:39:27.107517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:40.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087016+0000","last_change":"2023-12-04T05:39:27.088212+0000","last_active":"2023-12-04T05:39:28.087016+0000","last_peered":"2023-12-04T05:39:28.087016+0000","last_clean":"2023-12-04T05:39:28.087016+0000","last_became_active":"2023-12-04T05:39:27.087929+0000","last_became_peered":"2023-12-04T05:39:27.087929+0000","last_unstale":"2023-12-04T05:39:28.087016+0000","last_undegraded":"2023-12-04T05:39:28.087016+0000","last_fullsized":"2023-12-04T05:39:28.087016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:40:35.762126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.096206+0000","last_change":"2023-12-04T05:39:27.089681+0000","last_active":"2023-12-04T05:39:27.096206+0000","last_peered":"2023-12-04T05:39:27.096206+0000","last_clean":"2023-12-04T05:39:27.096206+0000","last_became_active":"2023-12-04T05:39:27.089288+0000","last_became_peered":"2023-12-04T05:39:27.089288+0000","last_unstale":"2023-12-04T05:39:27.096206+0000","last_undegraded":"2023-12-04T05:39:27.096206+0000","last_fullsized":"2023-12-04T05:39:27.096206+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:58:05.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092627+0000","last_change":"2023-12-04T05:39:27.083541+0000","last_active":"2023-12-04T05:39:27.092627+0000","last_peered":"2023-12-04T05:39:27.092627+0000","last_clean":"2023-12-04T05:39:27.092627+0000","last_became_active":"2023-12-04T05:39:27.083207+0000","last_became_peered":"2023-12-04T05:39:27.083207+0000","last_unstale":"2023-12-04T05:39:27.092627+0000","last_undegraded":"2023-12-04T05:39:27.092627+0000","last_fullsized":"2023-12-04T05:39:27.092627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:59.601876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089581+0000","last_change":"2023-12-04T05:39:27.097340+0000","last_active":"2023-12-04T05:39:28.089581+0000","last_peered":"2023-12-04T05:39:28.089581+0000","last_clean":"2023-12-04T05:39:28.089581+0000","last_became_active":"2023-12-04T05:39:27.096699+0000","last_became_peered":"2023-12-04T05:39:27.096699+0000","last_unstale":"2023-12-04T05:39:28.089581+0000","last_undegraded":"2023-12-04T05:39:28.089581+0000","last_fullsized":"2023-12-04T05:39:28.089581+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101433+0000","last_change":"2023-12-04T05:39:27.087492+0000","last_active":"2023-12-04T05:39:27.101433+0000","last_peered":"2023-12-04T05:39:27.101433+0000","last_clean":"2023-12-04T05:39:27.101433+0000","last_became_active":"2023-12-04T05:39:27.087207+0000","last_became_peered":"2023-12-04T05:39:27.087207+0000","last_unstale":"2023-12-04T05:39:27.101433+0000","last_undegraded":"2023-12-04T05:39:27.101433+0000","last_fullsized":"2023-12-04T05:39:27.101433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:34:05.627903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088860+0000","last_change":"2023-12-04T05:39:27.088572+0000","last_active":"2023-12-04T05:39:28.088860+0000","last_peered":"2023-12-04T05:39:28.088860+0000","last_clean":"2023-12-04T05:39:28.088860+0000","last_became_active":"2023-12-04T05:39:27.088269+0000","last_became_peered":"2023-12-04T05:39:27.088269+0000","last_unstale":"2023-12-04T05:39:28.088860+0000","last_undegraded":"2023-12-04T05:39:28.088860+0000","last_fullsized":"2023-12-04T05:39:28.088860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094391+0000","last_change":"2023-12-04T05:39:27.088085+0000","last_active":"2023-12-04T05:39:27.094391+0000","last_peered":"2023-12-04T05:39:27.094391+0000","last_clean":"2023-12-04T05:39:27.094391+0000","last_became_active":"2023-12-04T05:39:27.087726+0000","last_became_peered":"2023-12-04T05:39:27.087726+0000","last_unstale":"2023-12-04T05:39:27.094391+0000","last_undegraded":"2023-12-04T05:39:27.094391+0000","last_fullsized":"2023-12-04T05:39:27.094391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087266+0000","last_change":"2023-12-04T05:39:27.100050+0000","last_active":"2023-12-04T05:39:28.087266+0000","last_peered":"2023-12-04T05:39:28.087266+0000","last_clean":"2023-12-04T05:39:28.087266+0000","last_became_active":"2023-12-04T05:39:27.099704+0000","last_became_peered":"2023-12-04T05:39:27.099704+0000","last_unstale":"2023-12-04T05:39:28.087266+0000","last_undegraded":"2023-12-04T05:39:28.087266+0000","last_fullsized":"2023-12-04T05:39:28.087266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:26.128910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101756+0000","last_change":"2023-12-04T05:39:27.096514+0000","last_active":"2023-12-04T05:39:27.101756+0000","last_peered":"2023-12-04T05:39:27.101756+0000","last_clean":"2023-12-04T05:39:27.101756+0000","last_became_active":"2023-12-04T05:39:27.096198+0000","last_became_peered":"2023-12-04T05:39:27.096198+0000","last_unstale":"2023-12-04T05:39:27.101756+0000","last_undegraded":"2023-12-04T05:39:27.101756+0000","last_fullsized":"2023-12-04T05:39:27.101756+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:29.183594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088249+0000","last_change":"2023-12-04T05:39:27.076053+0000","last_active":"2023-12-04T05:39:28.088249+0000","last_peered":"2023-12-04T05:39:28.088249+0000","last_clean":"2023-12-04T05:39:28.088249+0000","last_became_active":"2023-12-04T05:39:27.075664+0000","last_became_peered":"2023-12-04T05:39:27.075664+0000","last_unstale":"2023-12-04T05:39:28.088249+0000","last_undegraded":"2023-12-04T05:39:28.088249+0000","last_fullsized":"2023-12-04T05:39:28.088249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089026+0000","last_change":"2023-12-04T05:39:27.102230+0000","last_active":"2023-12-04T05:39:28.089026+0000","last_peered":"2023-12-04T05:39:28.089026+0000","last_clean":"2023-12-04T05:39:28.089026+0000","last_became_active":"2023-12-04T05:39:27.101891+0000","last_became_peered":"2023-12-04T05:39:27.101891+0000","last_unstale":"2023-12-04T05:39:28.089026+0000","last_undegraded":"2023-12-04T05:39:28.089026+0000","last_fullsized":"2023-12-04T05:39:28.089026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087345+0000","last_change":"2023-12-04T05:39:27.091794+0000","last_active":"2023-12-04T05:39:28.087345+0000","last_peered":"2023-12-04T05:39:28.087345+0000","last_clean":"2023-12-04T05:39:28.087345+0000","last_became_active":"2023-12-04T05:39:27.091435+0000","last_became_peered":"2023-12-04T05:39:27.091435+0000","last_unstale":"2023-12-04T05:39:28.087345+0000","last_undegraded":"2023-12-04T05:39:28.087345+0000","last_fullsized":"2023-12-04T05:39:28.087345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.102780+0000","last_change":"2023-12-04T05:39:27.094081+0000","last_active":"2023-12-04T05:39:27.102780+0000","last_peered":"2023-12-04T05:39:27.102780+0000","last_clean":"2023-12-04T05:39:27.102780+0000","last_became_active":"2023-12-04T05:39:27.093805+0000","last_became_peered":"2023-12-04T05:39:27.093805+0000","last_unstale":"2023-12-04T05:39:27.102780+0000","last_undegraded":"2023-12-04T05:39:27.102780+0000","last_fullsized":"2023-12-04T05:39:27.102780+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087396+0000","last_change":"2023-12-04T05:39:27.090956+0000","last_active":"2023-12-04T05:39:28.087396+0000","last_peered":"2023-12-04T05:39:28.087396+0000","last_clean":"2023-12-04T05:39:28.087396+0000","last_became_active":"2023-12-04T05:39:27.090277+0000","last_became_peered":"2023-12-04T05:39:27.090277+0000","last_unstale":"2023-12-04T05:39:28.087396+0000","last_undegraded":"2023-12-04T05:39:28.087396+0000","last_fullsized":"2023-12-04T05:39:28.087396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:04.080470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087188+0000","last_change":"2023-12-04T05:39:27.094421+0000","last_active":"2023-12-04T05:39:28.087188+0000","last_peered":"2023-12-04T05:39:28.087188+0000","last_clean":"2023-12-04T05:39:28.087188+0000","last_became_active":"2023-12-04T05:39:27.094055+0000","last_became_peered":"2023-12-04T05:39:27.094055+0000","last_unstale":"2023-12-04T05:39:28.087188+0000","last_undegraded":"2023-12-04T05:39:28.087188+0000","last_fullsized":"2023-12-04T05:39:28.087188+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:39:31.395233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.085202+0000","last_change":"2023-12-04T05:39:27.078833+0000","last_active":"2023-12-04T05:39:27.085202+0000","last_peered":"2023-12-04T05:39:27.085202+0000","last_clean":"2023-12-04T05:39:27.085202+0000","last_became_active":"2023-12-04T05:39:27.078478+0000","last_became_peered":"2023-12-04T05:39:27.078478+0000","last_unstale":"2023-12-04T05:39:27.085202+0000","last_undegraded":"2023-12-04T05:39:27.085202+0000","last_fullsized":"2023-12-04T05:39:27.085202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:20:15.016309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088352+0000","last_change":"2023-12-04T05:39:27.082161+0000","last_active":"2023-12-04T05:39:28.088352+0000","last_peered":"2023-12-04T05:39:28.088352+0000","last_clean":"2023-12-04T05:39:28.088352+0000","last_became_active":"2023-12-04T05:39:27.081890+0000","last_became_peered":"2023-12-04T05:39:27.081890+0000","last_unstale":"2023-12-04T05:39:28.088352+0000","last_undegraded":"2023-12-04T05:39:28.088352+0000","last_fullsized":"2023-12-04T05:39:28.088352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086940+0000","last_change":"2023-12-04T05:39:27.099452+0000","last_active":"2023-12-04T05:39:28.086940+0000","last_peered":"2023-12-04T05:39:28.086940+0000","last_clean":"2023-12-04T05:39:28.086940+0000","last_became_active":"2023-12-04T05:39:27.099205+0000","last_became_peered":"2023-12-04T05:39:27.099205+0000","last_unstale":"2023-12-04T05:39:28.086940+0000","last_undegraded":"2023-12-04T05:39:28.086940+0000","last_fullsized":"2023-12-04T05:39:28.086940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:55:30.871506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.084186+0000","last_change":"2023-12-04T05:39:27.077164+0000","last_active":"2023-12-04T05:39:27.084186+0000","last_peered":"2023-12-04T05:39:27.084186+0000","last_clean":"2023-12-04T05:39:27.084186+0000","last_became_active":"2023-12-04T05:39:27.076536+0000","last_became_peered":"2023-12-04T05:39:27.076536+0000","last_unstale":"2023-12-04T05:39:27.084186+0000","last_undegraded":"2023-12-04T05:39:27.084186+0000","last_fullsized":"2023-12-04T05:39:27.084186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:04.176837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090120+0000","last_change":"2023-12-04T05:39:27.082797+0000","last_active":"2023-12-04T05:39:27.090120+0000","last_peered":"2023-12-04T05:39:27.090120+0000","last_clean":"2023-12-04T05:39:27.090120+0000","last_became_active":"2023-12-04T05:39:27.081419+0000","last_became_peered":"2023-12-04T05:39:27.081419+0000","last_unstale":"2023-12-04T05:39:27.090120+0000","last_undegraded":"2023-12-04T05:39:27.090120+0000","last_fullsized":"2023-12-04T05:39:27.090120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088809+0000","last_change":"2023-12-04T05:39:27.092222+0000","last_active":"2023-12-04T05:39:28.088809+0000","last_peered":"2023-12-04T05:39:28.088809+0000","last_clean":"2023-12-04T05:39:28.088809+0000","last_became_active":"2023-12-04T05:39:27.091888+0000","last_became_peered":"2023-12-04T05:39:27.091888+0000","last_unstale":"2023-12-04T05:39:28.088809+0000","last_undegraded":"2023-12-04T05:39:28.088809+0000","last_fullsized":"2023-12-04T05:39:28.088809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088987+0000","last_change":"2023-12-04T05:39:27.083638+0000","last_active":"2023-12-04T05:39:28.088987+0000","last_peered":"2023-12-04T05:39:28.088987+0000","last_clean":"2023-12-04T05:39:28.088987+0000","last_became_active":"2023-12-04T05:39:27.083278+0000","last_became_peered":"2023-12-04T05:39:27.083278+0000","last_unstale":"2023-12-04T05:39:28.088987+0000","last_undegraded":"2023-12-04T05:39:28.088987+0000","last_fullsized":"2023-12-04T05:39:28.088987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.101500+0000","last_change":"2023-12-04T05:39:27.089048+0000","last_active":"2023-12-04T05:39:27.101500+0000","last_peered":"2023-12-04T05:39:27.101500+0000","last_clean":"2023-12-04T05:39:27.101500+0000","last_became_active":"2023-12-04T05:39:27.088751+0000","last_became_peered":"2023-12-04T05:39:27.088751+0000","last_unstale":"2023-12-04T05:39:27.101500+0000","last_undegraded":"2023-12-04T05:39:27.101500+0000","last_fullsized":"2023-12-04T05:39:27.101500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:32:02.232351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108829+0000","last_change":"2023-12-04T05:39:27.103464+0000","last_active":"2023-12-04T05:39:27.108829+0000","last_peered":"2023-12-04T05:39:27.108829+0000","last_clean":"2023-12-04T05:39:27.108829+0000","last_became_active":"2023-12-04T05:39:27.102812+0000","last_became_peered":"2023-12-04T05:39:27.102812+0000","last_unstale":"2023-12-04T05:39:27.108829+0000","last_undegraded":"2023-12-04T05:39:27.108829+0000","last_fullsized":"2023-12-04T05:39:27.108829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:08:16.721519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088776+0000","last_change":"2023-12-04T05:39:27.077619+0000","last_active":"2023-12-04T05:39:28.088776+0000","last_peered":"2023-12-04T05:39:28.088776+0000","last_clean":"2023-12-04T05:39:28.088776+0000","last_became_active":"2023-12-04T05:39:27.077334+0000","last_became_peered":"2023-12-04T05:39:27.077334+0000","last_unstale":"2023-12-04T05:39:28.088776+0000","last_undegraded":"2023-12-04T05:39:28.088776+0000","last_fullsized":"2023-12-04T05:39:28.088776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088266+0000","last_change":"2023-12-04T05:39:27.078402+0000","last_active":"2023-12-04T05:39:28.088266+0000","last_peered":"2023-12-04T05:39:28.088266+0000","last_clean":"2023-12-04T05:39:28.088266+0000","last_became_active":"2023-12-04T05:39:27.078138+0000","last_became_peered":"2023-12-04T05:39:27.078138+0000","last_unstale":"2023-12-04T05:39:28.088266+0000","last_undegraded":"2023-12-04T05:39:28.088266+0000","last_fullsized":"2023-12-04T05:39:28.088266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089400+0000","last_change":"2023-12-04T05:39:27.075620+0000","last_active":"2023-12-04T05:39:28.089400+0000","last_peered":"2023-12-04T05:39:28.089400+0000","last_clean":"2023-12-04T05:39:28.089400+0000","last_became_active":"2023-12-04T05:39:27.075284+0000","last_became_peered":"2023-12-04T05:39:27.075284+0000","last_unstale":"2023-12-04T05:39:28.089400+0000","last_undegraded":"2023-12-04T05:39:28.089400+0000","last_fullsized":"2023-12-04T05:39:28.089400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089740+0000","last_change":"2023-12-04T05:39:26.076976+0000","last_active":"2023-12-04T05:39:28.089740+0000","last_peered":"2023-12-04T05:39:28.089740+0000","last_clean":"2023-12-04T05:39:28.089740+0000","last_became_active":"2023-12-04T05:39:26.076581+0000","last_became_peered":"2023-12-04T05:39:26.076581+0000","last_unstale":"2023-12-04T05:39:28.089740+0000","last_undegraded":"2023-12-04T05:39:28.089740+0000","last_fullsized":"2023-12-04T05:39:28.089740+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089651+0000","last_change":"2023-12-04T05:39:27.083622+0000","last_active":"2023-12-04T05:39:28.089651+0000","last_peered":"2023-12-04T05:39:28.089651+0000","last_clean":"2023-12-04T05:39:28.089651+0000","last_became_active":"2023-12-04T05:39:27.083307+0000","last_became_peered":"2023-12-04T05:39:27.083307+0000","last_unstale":"2023-12-04T05:39:28.089651+0000","last_undegraded":"2023-12-04T05:39:28.089651+0000","last_fullsized":"2023-12-04T05:39:28.089651+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089674+0000","last_change":"2023-12-04T05:39:26.078897+0000","last_active":"2023-12-04T05:39:28.089674+0000","last_peered":"2023-12-04T05:39:28.089674+0000","last_clean":"2023-12-04T05:39:28.089674+0000","last_became_active":"2023-12-04T05:39:26.078018+0000","last_became_peered":"2023-12-04T05:39:26.078018+0000","last_unstale":"2023-12-04T05:39:28.089674+0000","last_undegraded":"2023-12-04T05:39:28.089674+0000","last_fullsized":"2023-12-04T05:39:28.089674+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089125+0000","last_change":"2023-12-04T05:39:27.079603+0000","last_active":"2023-12-04T05:39:28.089125+0000","last_peered":"2023-12-04T05:39:28.089125+0000","last_clean":"2023-12-04T05:39:28.089125+0000","last_became_active":"2023-12-04T05:39:27.079350+0000","last_became_peered":"2023-12-04T05:39:27.079350+0000","last_unstale":"2023-12-04T05:39:28.089125+0000","last_undegraded":"2023-12-04T05:39:28.089125+0000","last_fullsized":"2023-12-04T05:39:28.089125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.105910+0000","last_change":"2023-12-04T05:39:26.076007+0000","last_active":"2023-12-04T05:39:27.105910+0000","last_peered":"2023-12-04T05:39:27.105910+0000","last_clean":"2023-12-04T05:39:27.105910+0000","last_became_active":"2023-12-04T05:39:26.075733+0000","last_became_peered":"2023-12-04T05:39:26.075733+0000","last_unstale":"2023-12-04T05:39:27.105910+0000","last_undegraded":"2023-12-04T05:39:27.105910+0000","last_fullsized":"2023-12-04T05:39:27.105910+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:05.655015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.110446+0000","last_change":"2023-12-04T05:39:27.105372+0000","last_active":"2023-12-04T05:39:27.110446+0000","last_peered":"2023-12-04T05:39:27.110446+0000","last_clean":"2023-12-04T05:39:27.110446+0000","last_became_active":"2023-12-04T05:39:27.105036+0000","last_became_peered":"2023-12-04T05:39:27.105036+0000","last_unstale":"2023-12-04T05:39:27.110446+0000","last_undegraded":"2023-12-04T05:39:27.110446+0000","last_fullsized":"2023-12-04T05:39:27.110446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107182+0000","last_change":"2023-12-04T05:39:26.077203+0000","last_active":"2023-12-04T05:39:27.107182+0000","last_peered":"2023-12-04T05:39:27.107182+0000","last_clean":"2023-12-04T05:39:27.107182+0000","last_became_active":"2023-12-04T05:39:26.076877+0000","last_became_peered":"2023-12-04T05:39:26.076877+0000","last_unstale":"2023-12-04T05:39:27.107182+0000","last_undegraded":"2023-12-04T05:39:27.107182+0000","last_fullsized":"2023-12-04T05:39:27.107182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:14.982034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108809+0000","last_change":"2023-12-04T05:39:27.103318+0000","last_active":"2023-12-04T05:39:27.108809+0000","last_peered":"2023-12-04T05:39:27.108809+0000","last_clean":"2023-12-04T05:39:27.108809+0000","last_became_active":"2023-12-04T05:39:27.102506+0000","last_became_peered":"2023-12-04T05:39:27.102506+0000","last_unstale":"2023-12-04T05:39:27.108809+0000","last_undegraded":"2023-12-04T05:39:27.108809+0000","last_fullsized":"2023-12-04T05:39:27.108809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:48:53.558900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089332+0000","last_change":"2023-12-04T05:39:26.083745+0000","last_active":"2023-12-04T05:39:28.089332+0000","last_peered":"2023-12-04T05:39:28.089332+0000","last_clean":"2023-12-04T05:39:28.089332+0000","last_became_active":"2023-12-04T05:39:26.083470+0000","last_became_peered":"2023-12-04T05:39:26.083470+0000","last_unstale":"2023-12-04T05:39:28.089332+0000","last_undegraded":"2023-12-04T05:39:28.089332+0000","last_fullsized":"2023-12-04T05:39:28.089332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089137+0000","last_change":"2023-12-04T05:39:27.095704+0000","last_active":"2023-12-04T05:39:28.089137+0000","last_peered":"2023-12-04T05:39:28.089137+0000","last_clean":"2023-12-04T05:39:28.089137+0000","last_became_active":"2023-12-04T05:39:27.095453+0000","last_became_peered":"2023-12-04T05:39:27.095453+0000","last_unstale":"2023-12-04T05:39:28.089137+0000","last_undegraded":"2023-12-04T05:39:28.089137+0000","last_fullsized":"2023-12-04T05:39:28.089137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089025+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:28.089025+0000","last_peered":"2023-12-04T05:39:28.089025+0000","last_clean":"2023-12-04T05:39:28.089025+0000","last_became_active":"2023-12-04T05:39:26.082344+0000","last_became_peered":"2023-12-04T05:39:26.082344+0000","last_unstale":"2023-12-04T05:39:28.089025+0000","last_undegraded":"2023-12-04T05:39:28.089025+0000","last_fullsized":"2023-12-04T05:39:28.089025+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:58.593571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090865+0000","last_change":"2023-12-04T05:39:27.083885+0000","last_active":"2023-12-04T05:39:27.090865+0000","last_peered":"2023-12-04T05:39:27.090865+0000","last_clean":"2023-12-04T05:39:27.090865+0000","last_became_active":"2023-12-04T05:39:27.083258+0000","last_became_peered":"2023-12-04T05:39:27.083258+0000","last_unstale":"2023-12-04T05:39:27.090865+0000","last_undegraded":"2023-12-04T05:39:27.090865+0000","last_fullsized":"2023-12-04T05:39:27.090865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069705+0000","last_change":"2023-12-04T05:39:26.079216+0000","last_active":"2023-12-04T05:39:27.069705+0000","last_peered":"2023-12-04T05:39:27.069705+0000","last_clean":"2023-12-04T05:39:27.069705+0000","last_became_active":"2023-12-04T05:39:26.078909+0000","last_became_peered":"2023-12-04T05:39:26.078909+0000","last_unstale":"2023-12-04T05:39:27.069705+0000","last_undegraded":"2023-12-04T05:39:27.069705+0000","last_fullsized":"2023-12-04T05:39:27.069705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.099891+0000","last_change":"2023-12-04T05:39:27.088070+0000","last_active":"2023-12-04T05:39:27.099891+0000","last_peered":"2023-12-04T05:39:27.099891+0000","last_clean":"2023-12-04T05:39:27.099891+0000","last_became_active":"2023-12-04T05:39:27.087797+0000","last_became_peered":"2023-12-04T05:39:27.087797+0000","last_unstale":"2023-12-04T05:39:27.099891+0000","last_undegraded":"2023-12-04T05:39:27.099891+0000","last_fullsized":"2023-12-04T05:39:27.099891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:03.949105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.064449+0000","last_change":"2023-12-04T05:39:26.081292+0000","last_active":"2023-12-04T05:39:27.064449+0000","last_peered":"2023-12-04T05:39:27.064449+0000","last_clean":"2023-12-04T05:39:27.064449+0000","last_became_active":"2023-12-04T05:39:26.080956+0000","last_became_peered":"2023-12-04T05:39:26.080956+0000","last_unstale":"2023-12-04T05:39:27.064449+0000","last_undegraded":"2023-12-04T05:39:27.064449+0000","last_fullsized":"2023-12-04T05:39:27.064449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:59:30.549509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.099826+0000","last_change":"2023-12-04T05:39:27.086538+0000","last_active":"2023-12-04T05:39:27.099826+0000","last_peered":"2023-12-04T05:39:27.099826+0000","last_clean":"2023-12-04T05:39:27.099826+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:27.099826+0000","last_undegraded":"2023-12-04T05:39:27.099826+0000","last_fullsized":"2023-12-04T05:39:27.099826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:24:07.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089782+0000","last_change":"2023-12-04T05:39:26.079751+0000","last_active":"2023-12-04T05:39:28.089782+0000","last_peered":"2023-12-04T05:39:28.089782+0000","last_clean":"2023-12-04T05:39:28.089782+0000","last_became_active":"2023-12-04T05:39:26.079416+0000","last_became_peered":"2023-12-04T05:39:26.079416+0000","last_unstale":"2023-12-04T05:39:28.089782+0000","last_undegraded":"2023-12-04T05:39:28.089782+0000","last_fullsized":"2023-12-04T05:39:28.089782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:38.798222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.107500+0000","last_change":"2023-12-04T05:39:27.100388+0000","last_active":"2023-12-04T05:39:27.107500+0000","last_peered":"2023-12-04T05:39:27.107500+0000","last_clean":"2023-12-04T05:39:27.107500+0000","last_became_active":"2023-12-04T05:39:27.100126+0000","last_became_peered":"2023-12-04T05:39:27.100126+0000","last_unstale":"2023-12-04T05:39:27.107500+0000","last_undegraded":"2023-12-04T05:39:27.107500+0000","last_fullsized":"2023-12-04T05:39:27.107500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:01.666984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089530+0000","last_change":"2023-12-04T05:39:26.076770+0000","last_active":"2023-12-04T05:39:28.089530+0000","last_peered":"2023-12-04T05:39:28.089530+0000","last_clean":"2023-12-04T05:39:28.089530+0000","last_became_active":"2023-12-04T05:39:26.076464+0000","last_became_peered":"2023-12-04T05:39:26.076464+0000","last_unstale":"2023-12-04T05:39:28.089530+0000","last_undegraded":"2023-12-04T05:39:28.089530+0000","last_fullsized":"2023-12-04T05:39:28.089530+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.098945+0000","last_change":"2023-12-04T05:39:27.090003+0000","last_active":"2023-12-04T05:39:27.098945+0000","last_peered":"2023-12-04T05:39:27.098945+0000","last_clean":"2023-12-04T05:39:27.098945+0000","last_became_active":"2023-12-04T05:39:27.089648+0000","last_became_peered":"2023-12-04T05:39:27.089648+0000","last_unstale":"2023-12-04T05:39:27.098945+0000","last_undegraded":"2023-12-04T05:39:27.098945+0000","last_fullsized":"2023-12-04T05:39:27.098945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088403+0000","last_change":"2023-12-04T05:39:26.084259+0000","last_active":"2023-12-04T05:39:28.088403+0000","last_peered":"2023-12-04T05:39:28.088403+0000","last_clean":"2023-12-04T05:39:28.088403+0000","last_became_active":"2023-12-04T05:39:26.083846+0000","last_became_peered":"2023-12-04T05:39:26.083846+0000","last_unstale":"2023-12-04T05:39:28.088403+0000","last_undegraded":"2023-12-04T05:39:28.088403+0000","last_fullsized":"2023-12-04T05:39:28.088403+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:57.269372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088965+0000","last_change":"2023-12-04T05:39:27.079605+0000","last_active":"2023-12-04T05:39:28.088965+0000","last_peered":"2023-12-04T05:39:28.088965+0000","last_clean":"2023-12-04T05:39:28.088965+0000","last_became_active":"2023-12-04T05:39:27.079189+0000","last_became_peered":"2023-12-04T05:39:27.079189+0000","last_unstale":"2023-12-04T05:39:28.088965+0000","last_undegraded":"2023-12-04T05:39:28.088965+0000","last_fullsized":"2023-12-04T05:39:28.088965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.110362+0000","last_change":"2023-12-04T05:39:26.080958+0000","last_active":"2023-12-04T05:39:27.110362+0000","last_peered":"2023-12-04T05:39:27.110362+0000","last_clean":"2023-12-04T05:39:27.110362+0000","last_became_active":"2023-12-04T05:39:26.080666+0000","last_became_peered":"2023-12-04T05:39:26.080666+0000","last_unstale":"2023-12-04T05:39:27.110362+0000","last_undegraded":"2023-12-04T05:39:27.110362+0000","last_fullsized":"2023-12-04T05:39:27.110362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:49.072351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092313+0000","last_change":"2023-12-04T05:39:27.081943+0000","last_active":"2023-12-04T05:39:27.092313+0000","last_peered":"2023-12-04T05:39:27.092313+0000","last_clean":"2023-12-04T05:39:27.092313+0000","last_became_active":"2023-12-04T05:39:27.081675+0000","last_became_peered":"2023-12-04T05:39:27.081675+0000","last_unstale":"2023-12-04T05:39:27.092313+0000","last_undegraded":"2023-12-04T05:39:27.092313+0000","last_fullsized":"2023-12-04T05:39:27.092313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108990+0000","last_change":"2023-12-04T05:39:26.082163+0000","last_active":"2023-12-04T05:39:27.108990+0000","last_peered":"2023-12-04T05:39:27.108990+0000","last_clean":"2023-12-04T05:39:27.108990+0000","last_became_active":"2023-12-04T05:39:26.081837+0000","last_became_peered":"2023-12-04T05:39:26.081837+0000","last_unstale":"2023-12-04T05:39:27.108990+0000","last_undegraded":"2023-12-04T05:39:27.108990+0000","last_fullsized":"2023-12-04T05:39:27.108990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:58.918868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090706+0000","last_change":"2023-12-04T05:39:27.083342+0000","last_active":"2023-12-04T05:39:27.090706+0000","last_peered":"2023-12-04T05:39:27.090706+0000","last_clean":"2023-12-04T05:39:27.090706+0000","last_became_active":"2023-12-04T05:39:27.082988+0000","last_became_peered":"2023-12-04T05:39:27.082988+0000","last_unstale":"2023-12-04T05:39:27.090706+0000","last_undegraded":"2023-12-04T05:39:27.090706+0000","last_fullsized":"2023-12-04T05:39:27.090706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.089057+0000","last_change":"2023-12-04T05:39:26.087193+0000","last_active":"2023-12-04T05:39:27.089057+0000","last_peered":"2023-12-04T05:39:27.089057+0000","last_clean":"2023-12-04T05:39:27.089057+0000","last_became_active":"2023-12-04T05:39:26.086857+0000","last_became_peered":"2023-12-04T05:39:26.086857+0000","last_unstale":"2023-12-04T05:39:27.089057+0000","last_undegraded":"2023-12-04T05:39:27.089057+0000","last_fullsized":"2023-12-04T05:39:27.089057+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:50.459837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108005+0000","last_change":"2023-12-04T05:39:27.098688+0000","last_active":"2023-12-04T05:39:27.108005+0000","last_peered":"2023-12-04T05:39:27.108005+0000","last_clean":"2023-12-04T05:39:27.108005+0000","last_became_active":"2023-12-04T05:39:27.098339+0000","last_became_peered":"2023-12-04T05:39:27.098339+0000","last_unstale":"2023-12-04T05:39:27.108005+0000","last_undegraded":"2023-12-04T05:39:27.108005+0000","last_fullsized":"2023-12-04T05:39:27.108005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:16:16.818773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.075016+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:27.075016+0000","last_peered":"2023-12-04T05:39:27.075016+0000","last_clean":"2023-12-04T05:39:27.075016+0000","last_became_active":"2023-12-04T05:39:26.081807+0000","last_became_peered":"2023-12-04T05:39:26.081807+0000","last_unstale":"2023-12-04T05:39:27.075016+0000","last_undegraded":"2023-12-04T05:39:27.075016+0000","last_fullsized":"2023-12-04T05:39:27.075016+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.083508+0000","last_change":"2023-12-04T05:39:27.075983+0000","last_active":"2023-12-04T05:39:27.083508+0000","last_peered":"2023-12-04T05:39:27.083508+0000","last_clean":"2023-12-04T05:39:27.083508+0000","last_became_active":"2023-12-04T05:39:27.075631+0000","last_became_peered":"2023-12-04T05:39:27.075631+0000","last_unstale":"2023-12-04T05:39:27.083508+0000","last_undegraded":"2023-12-04T05:39:27.083508+0000","last_fullsized":"2023-12-04T05:39:27.083508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:46:26.699542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104782+0000","last_change":"2023-12-04T05:39:26.075035+0000","last_active":"2023-12-04T05:39:27.104782+0000","last_peered":"2023-12-04T05:39:27.104782+0000","last_clean":"2023-12-04T05:39:27.104782+0000","last_became_active":"2023-12-04T05:39:26.074755+0000","last_became_peered":"2023-12-04T05:39:26.074755+0000","last_unstale":"2023-12-04T05:39:27.104782+0000","last_undegraded":"2023-12-04T05:39:27.104782+0000","last_fullsized":"2023-12-04T05:39:27.104782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094351+0000","last_change":"2023-12-04T05:39:27.086542+0000","last_active":"2023-12-04T05:39:27.094351+0000","last_peered":"2023-12-04T05:39:27.094351+0000","last_clean":"2023-12-04T05:39:27.094351+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:27.094351+0000","last_undegraded":"2023-12-04T05:39:27.094351+0000","last_fullsized":"2023-12-04T05:39:27.094351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089838+0000","last_change":"2023-12-04T05:39:26.079175+0000","last_active":"2023-12-04T05:39:28.089838+0000","last_peered":"2023-12-04T05:39:28.089838+0000","last_clean":"2023-12-04T05:39:28.089838+0000","last_became_active":"2023-12-04T05:39:26.078543+0000","last_became_peered":"2023-12-04T05:39:26.078543+0000","last_unstale":"2023-12-04T05:39:28.089838+0000","last_undegraded":"2023-12-04T05:39:28.089838+0000","last_fullsized":"2023-12-04T05:39:28.089838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089720+0000","last_change":"2023-12-04T05:39:27.083002+0000","last_active":"2023-12-04T05:39:28.089720+0000","last_peered":"2023-12-04T05:39:28.089720+0000","last_clean":"2023-12-04T05:39:28.089720+0000","last_became_active":"2023-12-04T05:39:27.082167+0000","last_became_peered":"2023-12-04T05:39:27.082167+0000","last_unstale":"2023-12-04T05:39:28.089720+0000","last_undegraded":"2023-12-04T05:39:28.089720+0000","last_fullsized":"2023-12-04T05:39:28.089720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.105033+0000","last_change":"2023-12-04T05:39:26.078377+0000","last_active":"2023-12-04T05:39:27.105033+0000","last_peered":"2023-12-04T05:39:27.105033+0000","last_clean":"2023-12-04T05:39:27.105033+0000","last_became_active":"2023-12-04T05:39:26.077976+0000","last_became_peered":"2023-12-04T05:39:26.077976+0000","last_unstale":"2023-12-04T05:39:27.105033+0000","last_undegraded":"2023-12-04T05:39:27.105033+0000","last_fullsized":"2023-12-04T05:39:27.105033+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:13.700732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089118+0000","last_change":"2023-12-04T05:39:27.079741+0000","last_active":"2023-12-04T05:39:28.089118+0000","last_peered":"2023-12-04T05:39:28.089118+0000","last_clean":"2023-12-04T05:39:28.089118+0000","last_became_active":"2023-12-04T05:39:27.079309+0000","last_became_peered":"2023-12-04T05:39:27.079309+0000","last_unstale":"2023-12-04T05:39:28.089118+0000","last_undegraded":"2023-12-04T05:39:28.089118+0000","last_fullsized":"2023-12-04T05:39:28.089118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069997+0000","last_change":"2023-12-04T05:39:26.075679+0000","last_active":"2023-12-04T05:39:27.069997+0000","last_peered":"2023-12-04T05:39:27.069997+0000","last_clean":"2023-12-04T05:39:27.069997+0000","last_became_active":"2023-12-04T05:39:26.075408+0000","last_became_peered":"2023-12-04T05:39:26.075408+0000","last_unstale":"2023-12-04T05:39:27.069997+0000","last_undegraded":"2023-12-04T05:39:27.069997+0000","last_fullsized":"2023-12-04T05:39:27.069997+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087397+0000","last_change":"2023-12-04T05:39:27.096722+0000","last_active":"2023-12-04T05:39:28.087397+0000","last_peered":"2023-12-04T05:39:28.087397+0000","last_clean":"2023-12-04T05:39:28.087397+0000","last_became_active":"2023-12-04T05:39:27.089687+0000","last_became_peered":"2023-12-04T05:39:27.089687+0000","last_unstale":"2023-12-04T05:39:28.087397+0000","last_undegraded":"2023-12-04T05:39:28.087397+0000","last_fullsized":"2023-12-04T05:39:28.087397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:04:15.694056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108489+0000","last_change":"2023-12-04T05:39:26.086640+0000","last_active":"2023-12-04T05:39:27.108489+0000","last_peered":"2023-12-04T05:39:27.108489+0000","last_clean":"2023-12-04T05:39:27.108489+0000","last_became_active":"2023-12-04T05:39:26.086335+0000","last_became_peered":"2023-12-04T05:39:26.086335+0000","last_unstale":"2023-12-04T05:39:27.108489+0000","last_undegraded":"2023-12-04T05:39:27.108489+0000","last_fullsized":"2023-12-04T05:39:27.108489+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:18:07.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104455+0000","last_change":"2023-12-04T05:39:27.096615+0000","last_active":"2023-12-04T05:39:27.104455+0000","last_peered":"2023-12-04T05:39:27.104455+0000","last_clean":"2023-12-04T05:39:27.104455+0000","last_became_active":"2023-12-04T05:39:27.096318+0000","last_became_peered":"2023-12-04T05:39:27.096318+0000","last_unstale":"2023-12-04T05:39:27.104455+0000","last_undegraded":"2023-12-04T05:39:27.104455+0000","last_fullsized":"2023-12-04T05:39:27.104455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:45:15.043031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.087437+0000","last_change":"2023-12-04T05:39:26.084101+0000","last_active":"2023-12-04T05:39:28.087437+0000","last_peered":"2023-12-04T05:39:28.087437+0000","last_clean":"2023-12-04T05:39:28.087437+0000","last_became_active":"2023-12-04T05:39:26.083785+0000","last_became_peered":"2023-12-04T05:39:26.083785+0000","last_unstale":"2023-12-04T05:39:28.087437+0000","last_undegraded":"2023-12-04T05:39:28.087437+0000","last_fullsized":"2023-12-04T05:39:28.087437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:47:37.800218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086988+0000","last_change":"2023-12-04T05:39:27.082611+0000","last_active":"2023-12-04T05:39:28.086988+0000","last_peered":"2023-12-04T05:39:28.086988+0000","last_clean":"2023-12-04T05:39:28.086988+0000","last_became_active":"2023-12-04T05:39:27.082317+0000","last_became_peered":"2023-12-04T05:39:27.082317+0000","last_unstale":"2023-12-04T05:39:28.086988+0000","last_undegraded":"2023-12-04T05:39:28.086988+0000","last_fullsized":"2023-12-04T05:39:28.086988+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:24:22.060177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.086995+0000","last_change":"2023-12-04T05:39:26.080322+0000","last_active":"2023-12-04T05:39:28.086995+0000","last_peered":"2023-12-04T05:39:28.086995+0000","last_clean":"2023-12-04T05:39:28.086995+0000","last_became_active":"2023-12-04T05:39:26.079499+0000","last_became_peered":"2023-12-04T05:39:26.079499+0000","last_unstale":"2023-12-04T05:39:28.086995+0000","last_undegraded":"2023-12-04T05:39:28.086995+0000","last_fullsized":"2023-12-04T05:39:28.086995+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:57:37.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.096461+0000","last_change":"2023-12-04T05:39:27.087432+0000","last_active":"2023-12-04T05:39:27.096461+0000","last_peered":"2023-12-04T05:39:27.096461+0000","last_clean":"2023-12-04T05:39:27.096461+0000","last_became_active":"2023-12-04T05:39:27.086159+0000","last_became_peered":"2023-12-04T05:39:27.086159+0000","last_unstale":"2023-12-04T05:39:27.096461+0000","last_undegraded":"2023-12-04T05:39:27.096461+0000","last_fullsized":"2023-12-04T05:39:27.096461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:58.277677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.081461+0000","last_change":"2023-12-04T05:39:26.082897+0000","last_active":"2023-12-04T05:39:27.081461+0000","last_peered":"2023-12-04T05:39:27.081461+0000","last_clean":"2023-12-04T05:39:27.081461+0000","last_became_active":"2023-12-04T05:39:26.082589+0000","last_became_peered":"2023-12-04T05:39:26.082589+0000","last_unstale":"2023-12-04T05:39:27.081461+0000","last_undegraded":"2023-12-04T05:39:27.081461+0000","last_fullsized":"2023-12-04T05:39:27.081461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:38:35.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089527+0000","last_change":"2023-12-04T05:39:27.084628+0000","last_active":"2023-12-04T05:39:28.089527+0000","last_peered":"2023-12-04T05:39:28.089527+0000","last_clean":"2023-12-04T05:39:28.089527+0000","last_became_active":"2023-12-04T05:39:27.084326+0000","last_became_peered":"2023-12-04T05:39:27.084326+0000","last_unstale":"2023-12-04T05:39:28.089527+0000","last_undegraded":"2023-12-04T05:39:28.089527+0000","last_fullsized":"2023-12-04T05:39:28.089527+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108062+0000","last_change":"2023-12-04T05:39:26.081865+0000","last_active":"2023-12-04T05:39:27.108062+0000","last_peered":"2023-12-04T05:39:27.108062+0000","last_clean":"2023-12-04T05:39:27.108062+0000","last_became_active":"2023-12-04T05:39:26.081533+0000","last_became_peered":"2023-12-04T05:39:26.081533+0000","last_unstale":"2023-12-04T05:39:27.108062+0000","last_undegraded":"2023-12-04T05:39:27.108062+0000","last_fullsized":"2023-12-04T05:39:27.108062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:57.328933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.094522+0000","last_change":"2023-12-04T05:39:27.087533+0000","last_active":"2023-12-04T05:39:27.094522+0000","last_peered":"2023-12-04T05:39:27.094522+0000","last_clean":"2023-12-04T05:39:27.094522+0000","last_became_active":"2023-12-04T05:39:27.087076+0000","last_became_peered":"2023-12-04T05:39:27.087076+0000","last_unstale":"2023-12-04T05:39:27.094522+0000","last_undegraded":"2023-12-04T05:39:27.094522+0000","last_fullsized":"2023-12-04T05:39:27.094522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.064019+0000","last_change":"2023-12-04T05:39:26.082858+0000","last_active":"2023-12-04T05:39:27.064019+0000","last_peered":"2023-12-04T05:39:27.064019+0000","last_clean":"2023-12-04T05:39:27.064019+0000","last_became_active":"2023-12-04T05:39:26.082559+0000","last_became_peered":"2023-12-04T05:39:26.082559+0000","last_unstale":"2023-12-04T05:39:27.064019+0000","last_undegraded":"2023-12-04T05:39:27.064019+0000","last_fullsized":"2023-12-04T05:39:27.064019+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:37:14.553422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089281+0000","last_change":"2023-12-04T05:39:27.093250+0000","last_active":"2023-12-04T05:39:28.089281+0000","last_peered":"2023-12-04T05:39:28.089281+0000","last_clean":"2023-12-04T05:39:28.089281+0000","last_became_active":"2023-12-04T05:39:27.092375+0000","last_became_peered":"2023-12-04T05:39:27.092375+0000","last_unstale":"2023-12-04T05:39:28.089281+0000","last_undegraded":"2023-12-04T05:39:28.089281+0000","last_fullsized":"2023-12-04T05:39:28.089281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088584+0000","last_change":"2023-12-04T05:39:26.082662+0000","last_active":"2023-12-04T05:39:28.088584+0000","last_peered":"2023-12-04T05:39:28.088584+0000","last_clean":"2023-12-04T05:39:28.088584+0000","last_became_active":"2023-12-04T05:39:26.082131+0000","last_became_peered":"2023-12-04T05:39:26.082131+0000","last_unstale":"2023-12-04T05:39:28.088584+0000","last_undegraded":"2023-12-04T05:39:28.088584+0000","last_fullsized":"2023-12-04T05:39:28.088584+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089259+0000","last_change":"2023-12-04T05:39:27.079536+0000","last_active":"2023-12-04T05:39:28.089259+0000","last_peered":"2023-12-04T05:39:28.089259+0000","last_clean":"2023-12-04T05:39:28.089259+0000","last_became_active":"2023-12-04T05:39:27.078782+0000","last_became_peered":"2023-12-04T05:39:27.078782+0000","last_unstale":"2023-12-04T05:39:28.089259+0000","last_undegraded":"2023-12-04T05:39:28.089259+0000","last_fullsized":"2023-12-04T05:39:28.089259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089370+0000","last_change":"2023-12-04T05:39:26.080171+0000","last_active":"2023-12-04T05:39:28.089370+0000","last_peered":"2023-12-04T05:39:28.089370+0000","last_clean":"2023-12-04T05:39:28.089370+0000","last_became_active":"2023-12-04T05:39:26.079829+0000","last_became_peered":"2023-12-04T05:39:26.079829+0000","last_unstale":"2023-12-04T05:39:28.089370+0000","last_undegraded":"2023-12-04T05:39:28.089370+0000","last_fullsized":"2023-12-04T05:39:28.089370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.095839+0000","last_change":"2023-12-04T05:39:27.086155+0000","last_active":"2023-12-04T05:39:27.095839+0000","last_peered":"2023-12-04T05:39:27.095839+0000","last_clean":"2023-12-04T05:39:27.095839+0000","last_became_active":"2023-12-04T05:39:27.085887+0000","last_became_peered":"2023-12-04T05:39:27.085887+0000","last_unstale":"2023-12-04T05:39:27.095839+0000","last_undegraded":"2023-12-04T05:39:27.095839+0000","last_fullsized":"2023-12-04T05:39:27.095839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:10.220064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.069917+0000","last_change":"2023-12-04T05:39:26.079734+0000","last_active":"2023-12-04T05:39:27.069917+0000","last_peered":"2023-12-04T05:39:27.069917+0000","last_clean":"2023-12-04T05:39:27.069917+0000","last_became_active":"2023-12-04T05:39:26.079419+0000","last_became_peered":"2023-12-04T05:39:26.079419+0000","last_unstale":"2023-12-04T05:39:27.069917+0000","last_undegraded":"2023-12-04T05:39:27.069917+0000","last_fullsized":"2023-12-04T05:39:27.069917+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.092030+0000","last_change":"2023-12-04T05:39:27.081159+0000","last_active":"2023-12-04T05:39:27.092030+0000","last_peered":"2023-12-04T05:39:27.092030+0000","last_clean":"2023-12-04T05:39:27.092030+0000","last_became_active":"2023-12-04T05:39:27.080820+0000","last_became_peered":"2023-12-04T05:39:27.080820+0000","last_unstale":"2023-12-04T05:39:27.092030+0000","last_undegraded":"2023-12-04T05:39:27.092030+0000","last_fullsized":"2023-12-04T05:39:27.092030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.089163+0000","last_change":"2023-12-04T05:39:26.080928+0000","last_active":"2023-12-04T05:39:28.089163+0000","last_peered":"2023-12-04T05:39:28.089163+0000","last_clean":"2023-12-04T05:39:28.089163+0000","last_became_active":"2023-12-04T05:39:26.080474+0000","last_became_peered":"2023-12-04T05:39:26.080474+0000","last_unstale":"2023-12-04T05:39:28.089163+0000","last_undegraded":"2023-12-04T05:39:28.089163+0000","last_fullsized":"2023-12-04T05:39:28.089163+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:49.152723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.090906+0000","last_change":"2023-12-04T05:39:27.083988+0000","last_active":"2023-12-04T05:39:27.090906+0000","last_peered":"2023-12-04T05:39:27.090906+0000","last_clean":"2023-12-04T05:39:27.090906+0000","last_became_active":"2023-12-04T05:39:27.083606+0000","last_became_peered":"2023-12-04T05:39:27.083606+0000","last_unstale":"2023-12-04T05:39:27.090906+0000","last_undegraded":"2023-12-04T05:39:27.090906+0000","last_fullsized":"2023-12-04T05:39:27.090906+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088651+0000","last_change":"2023-12-04T05:39:26.079887+0000","last_active":"2023-12-04T05:39:28.088651+0000","last_peered":"2023-12-04T05:39:28.088651+0000","last_clean":"2023-12-04T05:39:28.088651+0000","last_became_active":"2023-12-04T05:39:26.079365+0000","last_became_peered":"2023-12-04T05:39:26.079365+0000","last_unstale":"2023-12-04T05:39:28.088651+0000","last_undegraded":"2023-12-04T05:39:28.088651+0000","last_fullsized":"2023-12-04T05:39:28.088651+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088554+0000","last_change":"2023-12-04T05:39:27.102361+0000","last_active":"2023-12-04T05:39:28.088554+0000","last_peered":"2023-12-04T05:39:28.088554+0000","last_clean":"2023-12-04T05:39:28.088554+0000","last_became_active":"2023-12-04T05:39:27.101931+0000","last_became_peered":"2023-12-04T05:39:27.101931+0000","last_unstale":"2023-12-04T05:39:28.088554+0000","last_undegraded":"2023-12-04T05:39:28.088554+0000","last_fullsized":"2023-12-04T05:39:28.088554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.088707+0000","last_change":"2023-12-04T05:39:26.076033+0000","last_active":"2023-12-04T05:39:28.088707+0000","last_peered":"2023-12-04T05:39:28.088707+0000","last_clean":"2023-12-04T05:39:28.088707+0000","last_became_active":"2023-12-04T05:39:26.075725+0000","last_became_peered":"2023-12-04T05:39:26.075725+0000","last_unstale":"2023-12-04T05:39:28.088707+0000","last_undegraded":"2023-12-04T05:39:28.088707+0000","last_fullsized":"2023-12-04T05:39:28.088707+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.104482+0000","last_change":"2023-12-04T05:39:27.088782+0000","last_active":"2023-12-04T05:39:27.104482+0000","last_peered":"2023-12-04T05:39:27.104482+0000","last_clean":"2023-12-04T05:39:27.104482+0000","last_became_active":"2023-12-04T05:39:27.088524+0000","last_became_peered":"2023-12-04T05:39:27.088524+0000","last_unstale":"2023-12-04T05:39:27.104482+0000","last_undegraded":"2023-12-04T05:39:27.104482+0000","last_fullsized":"2023-12-04T05:39:27.104482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:55:37.166590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-04T05:39:27.108386+0000","last_change":"2023-12-04T05:39:26.087051+0000","last_active":"2023-12-04T05:39:27.108386+0000","last_peered":"2023-12-04T05:39:27.108386+0000","last_clean":"2023-12-04T05:39:27.108386+0000","last_became_active":"2023-12-04T05:39:26.086791+0000","last_became_peered":"2023-12-04T05:39:26.086791+0000","last_unstale":"2023-12-04T05:39:27.108386+0000","last_undegraded":"2023-12-04T05:39:27.108386+0000","last_fullsized":"2023-12-04T05:39:27.108386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-04T05:39:26.070478+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:39:26.070478+0000","last_peered":"2023-12-04T05:39:26.070478+0000","last_clean":"2023-12-04T05:39:26.070478+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:39:26.070478+0000","last_undegraded":"2023-12-04T05:39:26.070478+0000","last_fullsized":"2023-12-04T05:39:26.070478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":948661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.03,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.84199999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.51900000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71599999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.85599999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.54600000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.90000000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.43099999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.46899999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:38:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.49099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":835584,"data_stored":358917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97799999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.79000000000000004,"5min":1.048,"15min":1.048},"last":0.81200000000000006}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.92800000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.875,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.78600000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.98099999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.91100000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73399999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":359857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89200000000000002,"5min":1.196,"15min":1.196},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68700000000000006}]},{"osd":1,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90800000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.83299999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70399999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79600000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98699999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94399999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.78800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94299999999999995,"5min":1.631,"15min":1.631},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79700000000000004,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89300000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":364523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86599999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.752}]},{"osd":1,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82799999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85499999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.84299999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69999999999999996,"15min":0.70299999999999996},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96499999999999997,"5min":1.03,"15min":1.03},"last":0.87}]},{"osd":5,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.44800000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":1.167,"15min":1.167},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":1.196,"15min":1.196},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98599999999999999,"5min":1.069,"15min":1.069},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96699999999999997,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":359835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27600000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.435}]},{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44500000000000001},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59799999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.63600000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.46200000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.624,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95599999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93100000000000005,"5min":1.2,"15min":1.2},"last":0.748},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.78400000000000003,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89800000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.119,"5min":1.256,"15min":1.256},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.81000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.995,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.48099999999999998,"15min":0.46400000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.7160000000000002,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.2759999999999998,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":5.4130000000000003,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.38}]},{"osd":3,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82999999999999996,"15min":0.81699999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":5.3710000000000004,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.96299999999999997,"15min":0.97099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":5.4889999999999999,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90300000000000002,"15min":0.91000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.622}]},{"osd":6,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.58799999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:38:34 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.218,"5min":4.218,"15min":4.218},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":835584,"data_stored":358417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56499999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.621}]},{"osd":4,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98599999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96699999999999997,"5min":1.345,"15min":1.345},"last":0.94099999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94699999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79800000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":0.82299999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97699999999999998,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:38:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78100000000000003,"15min":0.79400000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0169999999999999,"5min":1.119,"15min":1.119},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":948625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.96899999999999997,"15min":1.0629999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.55100000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.317},{"interface":"front","average":{"1min":0.442,"5min":1.0449999999999999,"15min":1.145},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.433}]},{"osd":2,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.873,"15min":0.94499999999999995},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.59599999999999997,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.36299999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68799999999999994,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.377}]},{"osd":3,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.90200000000000002,"15min":0.97599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74399999999999999,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.499,"5min":1.113,"15min":1.2150000000000001},"min":{"1min":0.39200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.621,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.443}]},{"osd":4,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.94399999999999995,"15min":0.99199999999999999},"min":{"1min":0.495,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.2310000000000001,"15min":1.3200000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.206,"15min":1.296},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0389999999999999,"5min":8.234,"15min":8.234},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.02,"15min":1.0680000000000001},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0760000000000001,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.69799999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.238,"15min":1.3180000000000001},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2330000000000001,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2749999999999999,"15min":1.365},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.194,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:38:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.24,"15min":1.3220000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.145,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.998,"15min":1.048},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:39:31.522 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:39:31.522 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-04T05:39:31.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.701+0000 7fc7f6079640 1 Processor -- start 2023-12-04T05:39:31.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.701+0000 7fc7f6079640 1 -- start start 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f014f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc7f014f790 0x7fc7f01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f0154e10 0x7fc7f0151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00c0bd0 con 0x7fc7f0154e10 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f0154640 con 0x7fc7f014f790 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7f6079640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014ef10 con 0x7fc7f014eb30 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f0154e10 0x7fc7f0151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc7f0154e10 0x7fc7f0151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60552/0 (socket says 172.21.15.97:60552) 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 -- 172.21.15.97:0/3572059212 learned_addr learned my addr 172.21.15.97:0/3572059212 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7e7fff640 1 --2- 172.21.15.97:0/3572059212 >> v2:172.21.15.143:3300/0 conn(0x7fc7f014f790 0x7fc7f01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 -- 172.21.15.97:0/3572059212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 msgr2=0x7fc7f014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 -- 172.21.15.97:0/3572059212 >> v2:172.21.15.143:3300/0 conn(0x7fc7f014f790 msgr2=0x7fc7f01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 --2- 172.21.15.97:0/3572059212 >> v2:172.21.15.143:3300/0 conn(0x7fc7f014f790 0x7fc7f01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7effff640 1 -- 172.21.15.97:0/3572059212 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f01535a0 con 0x7fc7f0154e10 2023-12-04T05:39:31.710 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.705+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:31.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7effff640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f0154e10 0x7fc7f0151310 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00c6f30 tx=0x7fc7e801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81743105e0ae4c6b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7eeffd640 1 -- 172.21.15.97:0/3572059212 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a7950 con 0x7fc7f0154e10 2023-12-04T05:39:31.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7eeffd640 1 -- 172.21.15.97:0/3572059212 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80a7ab0 con 0x7fc7f0154e10 2023-12-04T05:39:31.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7eeffd640 1 -- 172.21.15.97:0/3572059212 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a7e40 con 0x7fc7f0154e10 2023-12-04T05:39:31.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- 172.21.15.97:0/3572059212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f0154e10 msgr2=0x7fc7f0151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f0154e10 0x7fc7f0151310 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00c6f30 tx=0x7fc7e801ebb0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- 172.21.15.97:0/3572059212 shutdown_connections 2023-12-04T05:39:31.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f0154e10 0x7fc7f0151310 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.713 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3572059212 >> v2:172.21.15.143:3300/0 conn(0x7fc7f014f790 0x7fc7f01548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3572059212 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- 172.21.15.97:0/3572059212 >> 172.21.15.97:0/3572059212 conn(0x7fc7f00c5e70 msgr2=0x7fc7f00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:31.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- 172.21.15.97:0/3572059212 shutdown_connections 2023-12-04T05:39:31.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- 172.21.15.97:0/3572059212 wait complete. 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 Processor -- start 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- start start 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f0157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f0154e10 0x7fc7f00c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014db50 con 0x7fc7f014f790 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014e360 con 0x7fc7f0154e10 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.709+0000 7fc7f6079640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014dda0 con 0x7fc7f014eb30 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.720 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60556/0 (socket says 172.21.15.97:60556) 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 -- 172.21.15.97:0/3159674202 learned_addr learned my addr 172.21.15.97:0/3159674202 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 -- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 msgr2=0x7fc7f0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 -- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f0154e10 msgr2=0x7fc7f00c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f0154e10 0x7fc7f00c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 -- 172.21.15.97:0/3159674202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009b30 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7e7fff640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800e960 tx=0x7fc7d800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8009690 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d800ca00 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800cd70 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f014e080 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f00c47b0 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f0068440 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7d8013470 con 0x7fc7f014f790 2023-12-04T05:39:31.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.713+0000 7fc7ecff9640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 0x7fc7d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:31.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.717+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7d8084770 con 0x7fc7f014f790 2023-12-04T05:39:31.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.717+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 0x7fc7d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:31.722 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.717+0000 7fc7ef7fe640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 0x7fc7d0068dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006e90 tx=0x7fc7e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:31.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.717+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7d8051880 con 0x7fc7f014f790 2023-12-04T05:39:31.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.921+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc7f0154bf0 con 0x7fc7f014f790 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7ecff9640 1 -- 172.21.15.97:0/3159674202 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc7d80210b0 con 0x7fc7f014f790 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1lrsZqChAAYYjsS5nLr41lx6/vEjGPvg== 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:39:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T05:39:31.931 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.0 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 msgr2=0x7fc7d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 0x7fc7d0068dc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0006e90 tx=0x7fc7e0008040 comp rx=0 tx=0).stop 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 msgr2=0x7fc7f0156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800e960 tx=0x7fc7d800ee20 comp rx=0 tx=0).stop 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 shutdown_connections 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc7d0066900 0x7fc7d0068dc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc7f0154e10 0x7fc7f00c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc7f014f790 0x7fc7f0156910 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 --2- 172.21.15.97:0/3159674202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7f014eb30 0x7fc7f0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.925+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 >> 172.21.15.97:0/3159674202 conn(0x7fc7f00c5e70 msgr2=0x7fc7f006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.929+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 shutdown_connections 2023-12-04T05:39:31.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:31.929+0000 7fc7f6079640 1 -- 172.21.15.97:0/3159674202 wait complete. 2023-12-04T05:39:31.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:32.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 Processor -- start 2023-12-04T05:39:32.090 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 -- start start 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29b00af630 0x7f29b00c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 0x7f29b006b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b0154680 con 0x7f29b00c4d50 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00afa10 con 0x7f29b00af630 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29af59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b0154960 con 0x7f29b00c72b0 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29b00af630 0x7f29b00c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f29b00af630 0x7f29b00c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60560/0 (socket says 172.21.15.97:60560) 2023-12-04T05:39:32.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 -- 172.21.15.97:0/213273715 learned_addr learned my addr 172.21.15.97:0/213273715 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29add9b640 1 --2- 172.21.15.97:0/213273715 >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 0x7f29b006b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 -- 172.21.15.97:0/213273715 >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 msgr2=0x7f29b006b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 --2- 172.21.15.97:0/213273715 >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 0x7f29b006b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 -- 172.21.15.97:0/213273715 >> v1:172.21.15.97:6789/0 conn(0x7f29b00c4d50 legacy=0x7f29b006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ae59c640 1 -- 172.21.15.97:0/213273715 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0154c40 con 0x7f29b00af630 2023-12-04T05:39:32.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29ad59a640 1 -- 172.21.15.97:0/213273715 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711543458 0 0) 0x7f29b0154680 con 0x7f29b00c4d50 2023-12-04T05:39:32.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.085+0000 7f29add9b640 1 --2- 172.21.15.97:0/213273715 >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 0x7f29b006b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:32.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29ae59c640 1 --2- 172.21.15.97:0/213273715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c4810 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f29b00acb00 tx=0x7f29a001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e8d0a936141d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29ad59a640 1 -- 172.21.15.97:0/213273715 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00aa5f0 con 0x7f29b00af630 2023-12-04T05:39:32.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29ad59a640 1 -- 172.21.15.97:0/213273715 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00aa750 con 0x7f29b00af630 2023-12-04T05:39:32.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29ad59a640 1 -- 172.21.15.97:0/213273715 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00aaae0 con 0x7f29b00af630 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 -- 172.21.15.97:0/213273715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 msgr2=0x7f29b00c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 --2- 172.21.15.97:0/213273715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c4810 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f29b00acb00 tx=0x7f29a001c470 comp rx=0 tx=0).stop 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 -- 172.21.15.97:0/213273715 shutdown_connections 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 --2- 172.21.15.97:0/213273715 >> v2:172.21.15.143:3300/0 conn(0x7f29b00c72b0 0x7f29b006b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 --2- 172.21.15.97:0/213273715 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c4810 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 -- 172.21.15.97:0/213273715 >> 172.21.15.97:0/213273715 conn(0x7f29b00aba40 msgr2=0x7f29b00abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 -- 172.21.15.97:0/213273715 shutdown_connections 2023-12-04T05:39:32.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.089+0000 7f29af59e640 1 -- 172.21.15.97:0/213273715 wait complete. 2023-12-04T05:39:32.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 Processor -- start 2023-12-04T05:39:32.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- start start 2023-12-04T05:39:32.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.100 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29b00c4d50 0x7f29b00c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29b00c72b0 0x7f29b00bda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00bf630 con 0x7f29b00af630 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0157e10 con 0x7f29b00c72b0 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01586b0 con 0x7f29b00c4d50 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60566/0 (socket says 172.21.15.97:60566) 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 -- 172.21.15.97:0/3772220156 learned_addr learned my addr 172.21.15.97:0/3772220156 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 -- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29b00c4d50 msgr2=0x7f29b00c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29b00c4d50 0x7f29b00c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 -- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29b00c72b0 msgr2=0x7f29b00bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29b00c72b0 0x7f29b00bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 -- 172.21.15.97:0/3772220156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094d0 con 0x7f29b00af630 2023-12-04T05:39:32.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29ae59c640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f29a0019080 tx=0x7f29a001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b3800 con 0x7f29b00af630 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00b3960 con 0x7f29b00af630 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b01ece20 con 0x7f29b00af630 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b3cf0 con 0x7f29b00af630 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.093+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b0158060 con 0x7f29b00af630 2023-12-04T05:39:32.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b004e890 con 0x7f29b00af630 2023-12-04T05:39:32.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f29a00bd3f0 con 0x7f29b00af630 2023-12-04T05:39:32.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f299effd640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 0x7f2990068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29a00a7070 con 0x7f29b00af630 2023-12-04T05:39:32.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f29add9b640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 0x7f2990068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.097+0000 7f29add9b640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 0x7f2990068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29b0067f80 tx=0x7f29a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.101+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29a00ec2e0 con 0x7f29b00af630 2023-12-04T05:39:32.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.289+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29b01521a0 con 0x7f29b00af630 2023-12-04T05:39:32.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.289+0000 7f299effd640 1 -- 172.21.15.97:0/3772220156 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f29a00ef900 con 0x7f29b00af630 2023-12-04T05:39:32.296 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:32.296 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6489,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-04T05:39:32.296 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 48 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 msgr2=0x7f2990068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 0x7f2990068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29b0067f80 tx=0x7f29a4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 msgr2=0x7f29b00c0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f29a0019080 tx=0x7f29a001acb0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 shutdown_connections 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f29900668d0 0x7f2990068d90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29b00c72b0 0x7f29b00bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f29b00c4d50 0x7f29b00c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 --2- 172.21.15.97:0/3772220156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29b00af630 0x7f29b00c0440 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 >> 172.21.15.97:0/3772220156 conn(0x7f29b00aba40 msgr2=0x7f29b0153b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 shutdown_connections 2023-12-04T05:39:32.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.293+0000 7f29af59e640 1 -- 172.21.15.97:0/3772220156 wait complete. 2023-12-04T05:39:32.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T05:39:26.441151+0000', 'modified': '2023-12-04T05:39:29.459213+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6492': {'gid': 6492, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.97:6837/2403583657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6836', 'nonce': 2403583657}, {'type': 'v1', 'addr': '172.21.15.97:6837', 'nonce': 2403583657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T05:39:32.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T05:39:32.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-04T05:39:32.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 Processor -- start 2023-12-04T05:39:32.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 -- start start 2023-12-04T05:39:32.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2b8014f960 0x7f2b801548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b80154640 con 0x7f2b8014eb30 2023-12-04T05:39:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8014ef10 con 0x7f2b80154e10 2023-12-04T05:39:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b861d8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b800c0bd0 con 0x7f2b8014f960 2023-12-04T05:39:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b7f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2b8014eb30 0x7f2b8014f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46582/0 (socket says 172.21.15.97:46582) 2023-12-04T05:39:32.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.853+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/50944115 learned_addr learned my addr 172.21.15.97:0/50944115 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b77fff640 1 --2- 172.21.15.97:0/50944115 >> v2:172.21.15.143:3300/0 conn(0x7f2b8014f960 0x7f2b801548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457791383 0 0) 0x7f2b80154640 con 0x7f2b8014eb30 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b6c003530 con 0x7f2b8014eb30 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526172304 0 0) 0x7f2b8014ef10 con 0x7f2b80154e10 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b80154640 con 0x7f2b80154e10 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3953799462 0 0) 0x7f2b6c003530 con 0x7f2b8014eb30 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 >> v2:172.21.15.143:3300/0 conn(0x7f2b8014f960 msgr2=0x7f2b801548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 --2- 172.21.15.97:0/50944115 >> v2:172.21.15.143:3300/0 conn(0x7f2b8014f960 0x7f2b801548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 >> v1:172.21.15.143:6789/0 conn(0x7f2b80154e10 legacy=0x7f2b8015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b801535a0 con 0x7f2b8014eb30 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f2b70001680 con 0x7f2b8014eb30 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 >> v1:172.21.15.97:6789/0 conn(0x7f2b8014eb30 legacy=0x7f2b8014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b6c003b60 0x7f2b6c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c0047d0 0x7f2b6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 0x7f2b6c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c0bd0 con 0x7f2b6c005190 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c00e270 con 0x7f2b6c003b60 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c00e430 con 0x7f2b6c0047d0 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b77fff640 1 --2- 172.21.15.97:0/50944115 >> v2:172.21.15.143:3300/0 conn(0x7f2b8014f960 0x7f2b801548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 0x7f2b6c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b6c003b60 0x7f2b6c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b77fff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c0047d0 0x7f2b6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 -- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c0047d0 msgr2=0x7f2b6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c0047d0 0x7f2b6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 -- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b6c003b60 msgr2=0x7f2b6c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b6c003b60 0x7f2b6c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b7ffff640 1 -- 172.21.15.97:0/50944115 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c003530 con 0x7f2b6c005190 2023-12-04T05:39:32.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.857+0000 7f2b77fff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c0047d0 0x7f2b6c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:32.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b7ffff640 1 -- 172.21.15.97:0/50944115 reap_dead start 2023-12-04T05:39:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 0x7f2b6c00dba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2b78001fd0 tx=0x7f2b7801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfc854339307fcf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78003b80 con 0x7f2b6c005190 2023-12-04T05:39:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78003ce0 con 0x7f2b6c005190 2023-12-04T05:39:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b7effd640 1 -- 172.21.15.97:0/50944115 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78005310 con 0x7f2b6c005190 2023-12-04T05:39:32.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 msgr2=0x7f2b6c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 0x7f2b6c00dba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2b78001fd0 tx=0x7f2b7801c8e0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- 172.21.15.97:0/50944115 shutdown_connections 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 --2- 172.21.15.97:0/50944115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b6c005190 0x7f2b6c00dba0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- 172.21.15.97:0/50944115 >> 172.21.15.97:0/50944115 conn(0x7f2b800c5e70 msgr2=0x7f2b800c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- 172.21.15.97:0/50944115 shutdown_connections 2023-12-04T05:39:32.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- 172.21.15.97:0/50944115 wait complete. 2023-12-04T05:39:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 Processor -- start 2023-12-04T05:39:32.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.861+0000 7f2b861d8640 1 -- start start 2023-12-04T05:39:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c005190 0x7f2b8006c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b80142340 0x7f2b8013fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801e9ba0 con 0x7f2b8006dd50 2023-12-04T05:39:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801ea9c0 con 0x7f2b80142340 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801e9db0 con 0x7f2b6c005190 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60574/0 (socket says 172.21.15.97:60574) 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 -- 172.21.15.97:0/1825449829 learned_addr learned my addr 172.21.15.97:0/1825449829 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b80142340 0x7f2b8013fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c005190 0x7f2b8006c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 -- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c005190 msgr2=0x7f2b8006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c005190 0x7f2b8006c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 -- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b80142340 msgr2=0x7f2b8013fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b80142340 0x7f2b8013fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 -- 172.21.15.97:0/1825449829 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b801ea090 con 0x7f2b8006dd50 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b77fff640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2b68004660 tx=0x7f2b68011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7cff9640 1 -- 172.21.15.97:0/1825449829 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800fbd0 con 0x7f2b8006dd50 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7cff9640 1 -- 172.21.15.97:0/1825449829 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6800fd30 con 0x7f2b8006dd50 2023-12-04T05:39:32.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7cff9640 1 -- 172.21.15.97:0/1825449829 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68015660 con 0x7f2b8006dd50 2023-12-04T05:39:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b801ea370 con 0x7f2b8006dd50 2023-12-04T05:39:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b80140150 con 0x7f2b8006dd50 2023-12-04T05:39:32.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.865+0000 7f2b7cff9640 1 -- 172.21.15.97:0/1825449829 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2b680157c0 con 0x7f2b8006dd50 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7cff9640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 0x7f2b60068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7cff9640 1 -- 172.21.15.97:0/1825449829 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b68084c30 con 0x7f2b8006dd50 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 0x7f2b60068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 Processor -- start 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 -- start start 2023-12-04T05:39:32.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 0x7f2b60068dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2b70007ba0 tx=0x7f2b70001480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b3007a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b3007acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2ff43110 con 0x563b3007b200 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fed39a0 con 0x563b3007a8e0 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b2fed0ed0 con 0x563b30079fc0 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60576/0 (socket says 172.21.15.97:60576) 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 -- 172.21.15.97:0/3470071968 learned_addr learned my addr 172.21.15.97:0/3470071968 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b3007acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b3007a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 -- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 msgr2=0x563b3007a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b3007a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 -- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 msgr2=0x563b3007acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b3007acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 -- 172.21.15.97:0/3470071968 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2fbc4890 con 0x563b3007b200 2023-12-04T05:39:32.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2b780012f0 tx=0x7f2b780a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128d7d894423faee server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b757fa640 1 -- 172.21.15.97:0/3470071968 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b3070 con 0x563b3007b200 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b757fa640 1 -- 172.21.15.97:0/3470071968 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780b4040 con 0x563b3007b200 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.869+0000 7f2b757fa640 1 -- 172.21.15.97:0/3470071968 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78006da0 con 0x563b3007b200 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3470071968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 msgr2=0x563b300c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2b780012f0 tx=0x7f2b780a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3470071968 shutdown_connections 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007b200 0x563b300c4ad0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b3007acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3470071968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b3007a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3470071968 >> 172.21.15.97:0/3470071968 conn(0x563b300b8830 msgr2=0x563b300bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3470071968 shutdown_connections 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3470071968 wait complete. 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- start start 2023-12-04T05:39:32.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 Processor -- start 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b3007a8e0 0x563b30081360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007b200 0x563b300818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fecc7c0 con 0x563b30079fc0 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fe84bf0 con 0x563b3007b200 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b2fe8aa90 con 0x563b3007a8e0 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 10 client.0 _ll_register_callbacks cb 0x563b30067e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60584/0 (socket says 172.21.15.97:60584) 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3037545970 learned_addr learned my addr 172.21.15.97:0/3037545970 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007b200 0x563b300818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b3007a8e0 0x563b30081360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b3007a8e0 msgr2=0x563b30081360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b3007a8e0 0x563b30081360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007b200 msgr2=0x563b300818a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007b200 0x563b300818a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3037545970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c003530 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2b70015c80 tx=0x7f2b70001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b97231170e575 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70015ec0 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b7001c8d0 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b2fe8e470 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b7001ca90 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 10 client.6639 fetch_fsmap learned FSMap version 48 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.873+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x563b2fe8d190 con 0x563b30079fc0 2023-12-04T05:39:32.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b2fe8e470 con 0x563b30079fc0 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b7001cbf0 con 0x563b30079fc0 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 10 client.6639 fetch_fsmap finished waiting for FSMap version 48 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 10 client.6639 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 20 client.6639 populate_metadata read hostname 'smithi097' 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b300cde40 0x563b300d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 4 client.6639 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 --> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b2fe91b50 con 0x563b300cde40 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b300cde40 0x563b300d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 10 client.6639 ms_handle_connect on v2:172.21.15.97:6836/2403583657 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b300cde40 0x563b300d0230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4def508f7d680e85 server_cookie=3a7052295e83bbbd in_seq=0 out_seq=0 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3037545970 <== mds.0 v2:172.21.15.97:6836/2403583657 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563b2fe91b50 con 0x563b300cde40 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 10 client.6639 handle_command_reply: tid=0 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 client.6639 shutdown 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 msgr2=0x563b30080e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2b70015c80 tx=0x7f2b70001d50 comp rx=0 tx=0).stop 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 shutdown_connections 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b300cde40 0x563b300d0230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007b200 0x563b300818a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b3007a8e0 0x563b30081360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3037545970 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b30080e20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b5e7fc640 0 client.6639 ms_handle_reset on v2:172.21.15.97:6836/2403583657 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 >> 172.21.15.97:0/3037545970 conn(0x563b300b8830 msgr2=0x563b300bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 shutdown_connections 2023-12-04T05:39:32.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 1 -- 172.21.15.97:0/3037545970 wait complete. 2023-12-04T05:39:32.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.877+0000 7f2b8953a000 20 client.6639 trim_cache size 0 max 16384 2023-12-04T05:39:32.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 Processor -- start 2023-12-04T05:39:32.898 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 -- start start 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 0x563b30115450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b30115990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fb85940 con 0x563b3007a8e0 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fe53a00 con 0x563b300b8830 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b2fecd070 con 0x563b30079fc0 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60594/0 (socket says 172.21.15.97:60594) 2023-12-04T05:39:32.900 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 -- 172.21.15.97:0/69613249 learned_addr learned my addr 172.21.15.97:0/69613249 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 0x563b30115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b77fff640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b30115990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 -- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 msgr2=0x563b30115990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b30115990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 -- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 msgr2=0x563b30115450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 0x563b30115450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 -- 172.21.15.97:0/69613249 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2fe73490 con 0x563b3007a8e0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b77fff640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b30115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 0x563b30115450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2b7801d180 tx=0x7f2b78001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac80e9bdd67295 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b75ffb640 1 -- 172.21.15.97:0/69613249 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b3040 con 0x563b3007a8e0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b75ffb640 1 -- 172.21.15.97:0/69613249 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78006b60 con 0x563b3007a8e0 2023-12-04T05:39:32.901 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.893+0000 7f2b75ffb640 1 -- 172.21.15.97:0/69613249 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780050d0 con 0x563b3007a8e0 2023-12-04T05:39:32.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/69613249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 msgr2=0x563b30115ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2b7801d180 tx=0x7f2b78001660 comp rx=0 tx=0).stop 2023-12-04T05:39:32.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/69613249 shutdown_connections 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b3007a8e0 0x563b30115ed0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b30079fc0 0x563b30115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- 172.21.15.97:0/69613249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b300b8830 0x563b30115450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/69613249 >> 172.21.15.97:0/69613249 conn(0x563b3007d960 msgr2=0x563b30079860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/69613249 shutdown_connections 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/69613249 wait complete. 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- start start 2023-12-04T05:39:32.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 Processor -- start 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b300e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b300b8830 0x563b300e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fe81760 con 0x563b30079fc0 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2fe85d60 con 0x563b3007a8e0 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b2fed07c0 con 0x563b300b8830 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 10 client.0 _ll_register_callbacks cb 0x563b2fed78e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60600/0 (socket says 172.21.15.97:60600) 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3073137932 learned_addr learned my addr 172.21.15.97:0/3073137932 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:32.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b300e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7ffff640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b300b8830 0x563b300e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b300b8830 msgr2=0x563b300e37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b300b8830 0x563b300e37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 msgr2=0x563b300e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b300e32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 -- 172.21.15.97:0/3073137932 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b2fbc4890 con 0x563b30079fc0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b7f7fe640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2b70015b10 tx=0x7f2b7001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71df66a2bc1ad12b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70017c90 con 0x563b30079fc0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mon.0 v2:172.21.15.97:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b70025440 con 0x563b30079fc0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.897+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b2fecb110 con 0x563b30079fc0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b70025890 con 0x563b30079fc0 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 10 client.6645 fetch_fsmap learned FSMap version 48 2023-12-04T05:39:32.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x563b2fbc4cc0 con 0x563b30079fc0 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mon.0 v2:172.21.15.97:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b2fecb110 con 0x563b30079fc0 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mon.0 v2:172.21.15.97:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2b700259f0 con 0x563b30079fc0 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 10 client.6645 fetch_fsmap finished waiting for FSMap version 48 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 10 client.6645 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 20 client.6645 populate_metadata read hostname 'smithi097' 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b3007b200 0x563b30127530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 4 client.6645 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 --> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563b2fef9650 con 0x563b3007b200 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b3007b200 0x563b30127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b77fff640 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b3007b200 0x563b30127530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c0c5eb4500c18e0 server_cookie=58f3cd237873d89a in_seq=0 out_seq=0 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 10 client.6645 ms_handle_connect on v2:172.21.15.97:6836/2403583657 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 1 -- 172.21.15.97:0/3073137932 <== mds.0 v2:172.21.15.97:6836/2403583657 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563b2fef9650 con 0x563b3007b200 2023-12-04T05:39:32.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 10 client.6645 handle_command_reply: tid=0 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 client.6645 shutdown 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 msgr2=0x563b300e2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2b70015b10 tx=0x7f2b7001a000 comp rx=0 tx=0).stop 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 shutdown_connections 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:6836/2403583657,v1:172.21.15.97:6837/2403583657] conn(0x563b3007b200 0x563b30127530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563b300b8830 0x563b300e37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563b3007a8e0 0x563b300e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b5e7fc640 0 client.6645 ms_handle_reset on v2:172.21.15.97:6836/2403583657 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 --2- 172.21.15.97:0/3073137932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b30079fc0 0x563b300e2d60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 >> 172.21.15.97:0/3073137932 conn(0x563b3007d960 msgr2=0x563b300d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 shutdown_connections 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 1 -- 172.21.15.97:0/3073137932 wait complete. 2023-12-04T05:39:32.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b8953a000 20 client.6645 trim_cache size 0 max 16384 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_fsid": "76f28696-8109-44bf-b432-6ecc5796b8c9", 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "whoami": 0, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "id": 6492, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "want_state": "up:active", 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "state": "up:active", 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "fs_name": "cephfs", 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "rank_uptime": 5.8264940349999996, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "mdsmap_epoch": 48, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch": 68, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_epoch_barrier": 68, 2023-12-04T05:39:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "uptime": 11.78482305 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 msgr2=0x7f2b60068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 0x7f2b60068dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2b70007ba0 tx=0x7f2b70001480 comp rx=0 tx=0).stop 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 msgr2=0x7f2b8013f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2b68004660 tx=0x7f2b68011d60 comp rx=0 tx=0).stop 2023-12-04T05:39:32.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 shutdown_connections 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2b60066900 0x7f2b60068dc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b80142340 0x7f2b8013fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b8006dd50 0x7f2b8013f6d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 --2- 172.21.15.97:0/1825449829 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b6c005190 0x7f2b8006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 >> 172.21.15.97:0/1825449829 conn(0x7f2b800c5e70 msgr2=0x7f2b8014f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 shutdown_connections 2023-12-04T05:39:32.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:32.901+0000 7f2b861d8640 1 -- 172.21.15.97:0/1825449829 wait complete. 2023-12-04T05:39:32.925 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:39:33.044 INFO:tasks.ceph.mds.c.smithi097.stderr:2023-12-04T05:39:33.041+0000 7fc583772640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:39:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 Processor -- start 2023-12-04T05:39:33.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 -- start start 2023-12-04T05:39:33.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe87006e150 0x7fe87006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe870152300 con 0x7fe87014e970 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe870071580 con 0x7fe87006be00 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe874c32640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87014ed50 con 0x7fe87006e150 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe86e59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe87014e970 0x7fe870071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46590/0 (socket says 172.21.15.97:46590) 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe86e59c640 1 -- 172.21.15.97:0/3934806855 learned_addr learned my addr 172.21.15.97:0/3934806855 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.057+0000 7fe86ed9d640 1 --2- 172.21.15.97:0/3934806855 >> v2:172.21.15.143:3300/0 conn(0x7fe87006e150 0x7fe87006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989340526 0 0) 0x7fe860001120 con 0x7fe87014e970 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe858005740 con 0x7fe87014e970 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152891469 0 0) 0x7fe870071580 con 0x7fe87006be00 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860001120 con 0x7fe87006be00 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86ed9d640 1 -- 172.21.15.97:0/3934806855 >> v1:172.21.15.143:6789/0 conn(0x7fe87006be00 legacy=0x7fe8700c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86ed9d640 1 -- 172.21.15.97:0/3934806855 >> v1:172.21.15.97:6789/0 conn(0x7fe87014e970 legacy=0x7fe870071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86ed9d640 1 -- 172.21.15.97:0/3934806855 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870151d60 con 0x7fe87006e150 2023-12-04T05:39:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86ed9d640 1 --2- 172.21.15.97:0/3934806855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87006e150 0x7fe87006ca50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d90 tx=0x7fe86801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f024c45a3b23fb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:33.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a5690 con 0x7fe87006e150 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8680a57f0 con 0x7fe87006e150 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.061+0000 7fe86d59a640 1 -- 172.21.15.97:0/3934806855 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a5b60 con 0x7fe87006e150 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- 172.21.15.97:0/3934806855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87006e150 msgr2=0x7fe87006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 --2- 172.21.15.97:0/3934806855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87006e150 0x7fe87006ca50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d90 tx=0x7fe86801c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- 172.21.15.97:0/3934806855 shutdown_connections 2023-12-04T05:39:33.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 --2- 172.21.15.97:0/3934806855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87006e150 0x7fe87006ca50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- 172.21.15.97:0/3934806855 >> 172.21.15.97:0/3934806855 conn(0x7fe8700c2970 msgr2=0x7fe8700c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- 172.21.15.97:0/3934806855 shutdown_connections 2023-12-04T05:39:33.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- 172.21.15.97:0/3934806855 wait complete. 2023-12-04T05:39:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 Processor -- start 2023-12-04T05:39:33.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- start start 2023-12-04T05:39:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe87006e150 0x7fe8701f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:33.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87014e970 0x7fe8700aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701f1150 con 0x7fe87006be00 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701f0e70 con 0x7fe87014e970 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe874c32640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87014ff50 con 0x7fe87006e150 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe86e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe86e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60614/0 (socket says 172.21.15.97:60614) 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe86e59c640 1 -- 172.21.15.97:0/1430084347 learned_addr learned my addr 172.21.15.97:0/1430084347 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe86dd9b640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe87006e150 0x7fe8701f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:33.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.065+0000 7fe86ed9d640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87014e970 0x7fe8700aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 -- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe87006e150 msgr2=0x7fe8701f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe87006e150 0x7fe8701f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 -- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87014e970 msgr2=0x7fe8700aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87014e970 0x7fe8700aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 -- 172.21.15.97:0/1430084347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009a70 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86e59c640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c700 tx=0x7fe86000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860005ac0 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe860005c20 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe870150230 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860007070 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8701f09b0 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8701f0c30 con 0x7fe87006be00 2023-12-04T05:39:33.074 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8600071d0 con 0x7fe87006be00 2023-12-04T05:39:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 0x7fe850068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:33.075 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe860083820 con 0x7fe87006be00 2023-12-04T05:39:33.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.069+0000 7fe86dd9b640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 0x7fe850068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:33.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.073+0000 7fe86dd9b640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 0x7fe850068dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe870152670 tx=0x7fe864009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:33.079 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.073+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8701f0c30 con 0x7fe87006be00 2023-12-04T05:39:33.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.257+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe870152300 con 0x7fe87006be00 2023-12-04T05:39:33.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.257+0000 7fe85effd640 1 -- 172.21.15.97:0/1430084347 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe870152300 con 0x7fe87006be00 2023-12-04T05:39:33.263 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:39:33.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 msgr2=0x7fe850068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 0x7fe850068dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe870152670 tx=0x7fe864009040 comp rx=0 tx=0).stop 2023-12-04T05:39:33.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 msgr2=0x7fe870150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:33.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c700 tx=0x7fe86000cbc0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 shutdown_connections 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe850066900 0x7fe850068dc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe87014e970 0x7fe8700aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe87006e150 0x7fe8701f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 --2- 172.21.15.97:0/1430084347 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe87006be00 0x7fe870150d20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 >> 172.21.15.97:0/1430084347 conn(0x7fe8700c2970 msgr2=0x7fe870071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 shutdown_connections 2023-12-04T05:39:33.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:33.261+0000 7fe874c32640 1 -- 172.21.15.97:0/1430084347 wait complete. 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:39:33.284 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:39:33.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.285 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:33.295 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 41976sec preferred_lft 41976sec 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.296 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:39:33.297 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:33.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.298 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:39:33.358 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:39:33.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.360 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:39:33.414 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:39:33.414 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:39:33.414 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:39:33.414 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:39:33.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.415 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:39:33.415 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:39:33.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:39:33.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:39:33.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:39:33.416 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:39:33.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.506 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:39:33.516 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:39:33.517 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:39:33.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:39:33.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:33.580 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:33.611 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:39:33.629 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:39:33.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:33.632 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:33.688 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T05:39:33.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:33.780 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:33.781 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:33.793 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: 0@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:39:33.794 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:33.797 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:39:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:33.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:33.818 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:39:33.877 INFO:teuthology.orchestra.run.smithi097.stdout:client6654 2023-12-04T05:39:33.877 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:33.877 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:33.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:39:34.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.109+0000 7f0d683f8640 1 Processor -- start 2023-12-04T05:39:34.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.109+0000 7f0d683f8640 1 -- start start 2023-12-04T05:39:34.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d683f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d6006e150 0x7f0d6006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d683f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d60152300 con 0x7f0d6014e970 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d683f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d60071580 con 0x7f0d6006be00 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d683f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6014ed50 con 0x7f0d6006e150 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66194640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0d6014e970 0x7f0d60071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:46592/0 (socket says 172.21.15.97:46592) 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66194640 1 -- 172.21.15.97:0/3088024703 learned_addr learned my addr 172.21.15.97:0/3088024703 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:34.117 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66995640 1 --2- 172.21.15.97:0/3088024703 >> v2:172.21.15.143:3300/0 conn(0x7f0d6006e150 0x7f0d6006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:34.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66995640 1 -- 172.21.15.97:0/3088024703 >> v1:172.21.15.143:6789/0 conn(0x7f0d6006be00 legacy=0x7f0d600c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.118 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66995640 1 -- 172.21.15.97:0/3088024703 >> v1:172.21.15.97:6789/0 conn(0x7f0d6014e970 legacy=0x7f0d60071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.119 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.113+0000 7f0d66995640 1 -- 172.21.15.97:0/3088024703 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60151d60 con 0x7f0d6006e150 2023-12-04T05:39:34.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d66995640 1 --2- 172.21.15.97:0/3088024703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d6006ca50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ca83d4f802e342 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:34.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d65192640 1 -- 172.21.15.97:0/3088024703 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580a5890 con 0x7f0d6006e150 2023-12-04T05:39:34.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d65192640 1 -- 172.21.15.97:0/3088024703 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d580a59f0 con 0x7f0d6006e150 2023-12-04T05:39:34.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d65192640 1 -- 172.21.15.97:0/3088024703 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580a5d80 con 0x7f0d6006e150 2023-12-04T05:39:34.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- 172.21.15.97:0/3088024703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 msgr2=0x7f0d6006ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 --2- 172.21.15.97:0/3088024703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d6006ca50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5801c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- 172.21.15.97:0/3088024703 shutdown_connections 2023-12-04T05:39:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 --2- 172.21.15.97:0/3088024703 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d6006ca50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- 172.21.15.97:0/3088024703 >> 172.21.15.97:0/3088024703 conn(0x7f0d600c2970 msgr2=0x7f0d600c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- 172.21.15.97:0/3088024703 shutdown_connections 2023-12-04T05:39:34.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- 172.21.15.97:0/3088024703 wait complete. 2023-12-04T05:39:34.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 Processor -- start 2023-12-04T05:39:34.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.117+0000 7f0d683f8640 1 -- start start 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d601ec970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d6014e970 0x7f0d601eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601f08f0 con 0x7f0d6006be00 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601f0e20 con 0x7f0d6006e150 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600bfb10 con 0x7f0d6014e970 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:34.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60630/0 (socket says 172.21.15.97:60630) 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 -- 172.21.15.97:0/2839954698 learned_addr learned my addr 172.21.15.97:0/2839954698 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d65993640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d601ec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66995640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d6014e970 0x7f0d601eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 -- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d6014e970 msgr2=0x7f0d601eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d6014e970 0x7f0d601eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 -- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 msgr2=0x7f0d601ec970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d601ec970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 -- 172.21.15.97:0/2839954698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a70 con 0x7f0d6006be00 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d66194640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c430 tx=0x7f0d5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c005cf0 con 0x7f0d6006be00 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c005e50 con 0x7f0d6006be00 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d601f0b40 con 0x7f0d6006be00 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0072d0 con 0x7f0d6006be00 2023-12-04T05:39:34.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60149f40 con 0x7f0d6006be00 2023-12-04T05:39:34.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60068440 con 0x7f0d6006be00 2023-12-04T05:39:34.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.121+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0d5c007430 con 0x7f0d6006be00 2023-12-04T05:39:34.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.125+0000 7f0d56ffd640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 0x7f0d44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:34.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.125+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d5c083710 con 0x7f0d6006be00 2023-12-04T05:39:34.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.125+0000 7f0d65993640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 0x7f0d44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:34.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.125+0000 7f0d65993640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 0x7f0d44068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d601ea7b0 tx=0x7f0d50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:34.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.129+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d5c0509f0 con 0x7f0d6006be00 2023-12-04T05:39:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d60152300 con 0x7f0d6006be00 2023-12-04T05:39:34.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d56ffd640 1 -- 172.21.15.97:0/2839954698 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d60152300 con 0x7f0d6006be00 2023-12-04T05:39:34.334 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 msgr2=0x7f0d44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 0x7f0d44068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d601ea7b0 tx=0x7f0d50009040 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 msgr2=0x7f0d60149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c00c430 tx=0x7f0d5c00c8f0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 shutdown_connections 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d440668d0 0x7f0d44068d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d6014e970 0x7f0d601eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d6006e150 0x7f0d601ec970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 --2- 172.21.15.97:0/2839954698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d6006be00 0x7f0d60149a00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 >> 172.21.15.97:0/2839954698 conn(0x7f0d600c2970 msgr2=0x7f0d60148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:34.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 shutdown_connections 2023-12-04T05:39:34.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:34.329+0000 7f0d683f8640 1 -- 172.21.15.97:0/2839954698 wait complete. 2023-12-04T05:39:34.354 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:39:34.355 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:34.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.355 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.366 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 41968sec preferred_lft 41968sec 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.367 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:39:34.368 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:34.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.369 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:39:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:39:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.434 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:39:34.486 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:39:34.486 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:39:34.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:39:34.488 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:39:34.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.582 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:39:34.591 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:39:34.592 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.592 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:39:34.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:34.656 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:34.708 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:34.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:34.708 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:34.759 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-04T05:39:34.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:34.848 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:34.849 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:34.862 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:34.862 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:34.862 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:34.862 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:39:34.863 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:34.867 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:39:34.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.867 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:34.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:34.887 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:39:34.942 INFO:teuthology.orchestra.run.smithi143.stdout:client5813 2023-12-04T05:39:34.942 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:34.942 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:34.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-04T05:39:35.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 Processor -- start 2023-12-04T05:39:35.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 -- start start 2023-12-04T05:39:35.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7380c0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380c0f40 con 0x7fa738151bc0 2023-12-04T05:39:35.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380c3ab0 con 0x7fa7381545c0 2023-12-04T05:39:35.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73f3f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c3d90 con 0x7fa73806e8e0 2023-12-04T05:39:35.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73e3f6640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa738151bc0 0x7fa73806a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49708/0 (socket says 172.21.15.97:49708) 2023-12-04T05:39:35.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73e3f6640 1 -- 172.21.15.97:0/2968479048 learned_addr learned my addr 172.21.15.97:0/2968479048 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:35.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73dbf5640 1 --2- 172.21.15.97:0/2968479048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7380c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699686151 0 0) 0x7fa7380c0f40 con 0x7fa738151bc0 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa724003530 con 0x7fa738151bc0 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73dbf5640 1 -- 172.21.15.97:0/2968479048 >> v1:172.21.15.143:6789/0 conn(0x7fa7381545c0 legacy=0x7fa73815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73dbf5640 1 -- 172.21.15.97:0/2968479048 >> v1:172.21.15.97:6789/0 conn(0x7fa738151bc0 legacy=0x7fa73806a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030341017 0 0) 0x7fa7380c3ab0 con 0x7fa7381545c0 2023-12-04T05:39:35.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.141+0000 7fa73dbf5640 1 -- 172.21.15.97:0/2968479048 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73806df90 con 0x7fa73806e8e0 2023-12-04T05:39:35.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73dbf5640 1 --2- 172.21.15.97:0/2968479048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7380c0960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097f0 tx=0x7fa72801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89fce1e1cab208c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280ac620 con 0x7fa73806e8e0 2023-12-04T05:39:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280ac780 con 0x7fa73806e8e0 2023-12-04T05:39:35.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73d3f4640 1 -- 172.21.15.97:0/2968479048 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280acaf0 con 0x7fa73806e8e0 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 -- 172.21.15.97:0/2968479048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 msgr2=0x7fa7380c0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/2968479048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7380c0960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa7280097f0 tx=0x7fa72801c430 comp rx=0 tx=0).stop 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 -- 172.21.15.97:0/2968479048 shutdown_connections 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/2968479048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7380c0960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 -- 172.21.15.97:0/2968479048 >> 172.21.15.97:0/2968479048 conn(0x7fa73806d4a0 msgr2=0x7fa7380a8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 -- 172.21.15.97:0/2968479048 shutdown_connections 2023-12-04T05:39:35.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.145+0000 7fa73f3f8640 1 -- 172.21.15.97:0/2968479048 wait complete. 2023-12-04T05:39:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 Processor -- start 2023-12-04T05:39:35.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- start start 2023-12-04T05:39:35.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7381493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa738151bc0 0x7fa7381ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381ecc70 con 0x7fa7381545c0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738150e50 con 0x7fa738151bc0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381505b0 con 0x7fa73806e8e0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73e3f6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7381493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73dbf5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa738151bc0 0x7fa7381ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38416/0 (socket says 172.21.15.97:38416) 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 -- 172.21.15.97:0/486253732 learned_addr learned my addr 172.21.15.97:0/486253732 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73e3f6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7381493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:37660/0 (socket says 172.21.15.97:37660) 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 -- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 msgr2=0x7fa7381493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7381493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 -- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa738151bc0 msgr2=0x7fa7381ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa738151bc0 0x7fa7381ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 -- 172.21.15.97:0/486253732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728009420 con 0x7fa7381545c0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73ebf7640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c780 tx=0x7fa73000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730003db0 con 0x7fa7381545c0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000ce90 con 0x7fa7381545c0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738150890 con 0x7fa7381545c0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300052b0 con 0x7fa7381545c0 2023-12-04T05:39:35.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.149+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7381ece80 con 0x7fa7381545c0 2023-12-04T05:39:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73804e890 con 0x7fa7381545c0 2023-12-04T05:39:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa730005410 con 0x7fa7381545c0 2023-12-04T05:39:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa72effd640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 0x7fa71c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa730084120 con 0x7fa7381545c0 2023-12-04T05:39:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa73e3f6640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 0x7fa71c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.153+0000 7fa73e3f6640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 0x7fa71c068dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa7380c3780 tx=0x7fa734000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.157+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa730051400 con 0x7fa7381545c0 2023-12-04T05:39:35.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.369+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fa7380669f0 con 0x7fa7381545c0 2023-12-04T05:39:35.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.369+0000 7fa72effd640 1 -- 172.21.15.97:0/486253732 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v21) v1 ==== 84+0+0 (secure 0 0 0) 0x7fa730054a20 con 0x7fa7381545c0 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 msgr2=0x7fa71c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 0x7fa71c068dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa7380c3780 tx=0x7fa734000bd0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 msgr2=0x7fa7381f01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c780 tx=0x7fa73000cc40 comp rx=0 tx=0).stop 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 shutdown_connections 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa71c066900 0x7fa71c068dc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa7381545c0 0x7fa7381f01e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.377 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa738151bc0 0x7fa7381ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 --2- 172.21.15.97:0/486253732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa73806e8e0 0x7fa7381493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 >> 172.21.15.97:0/486253732 conn(0x7fa73806d4a0 msgr2=0x7fa7380a6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:35.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 shutdown_connections 2023-12-04T05:39:35.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.373+0000 7fa73f3f8640 1 -- 172.21.15.97:0/486253732 wait complete. 2023-12-04T05:39:35.396 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:35.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 Processor -- start 2023-12-04T05:39:35.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 -- start start 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9f0151bf0 0x7fa9f00abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f01547d0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f0158b80 con 0x7fa9f0155370 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f83f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00c4aa0 con 0x7fa9f0151bf0 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9f0151bf0 0x7fa9f00abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa9f0151bf0 0x7fa9f00abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38420/0 (socket says 172.21.15.97:38420) 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 -- 172.21.15.97:0/3012753775 learned_addr learned my addr 172.21.15.97:0/3012753775 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f5990640 1 --1- 172.21.15.97:0/3012753775 >> v1:172.21.15.97:6789/0 conn(0x7fa9f00c7ef0 0x7fa9f0154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49724/0 (socket says 172.21.15.97:49724) 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 -- 172.21.15.97:0/3012753775 >> v1:172.21.15.143:6789/0 conn(0x7fa9f0155370 legacy=0x7fa9f015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 -- 172.21.15.97:0/3012753775 >> v1:172.21.15.97:6789/0 conn(0x7fa9f00c7ef0 legacy=0x7fa9f0154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.529+0000 7fa9f6191640 1 -- 172.21.15.97:0/3012753775 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00c4d40 con 0x7fa9f0151bf0 2023-12-04T05:39:35.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f6191640 1 --2- 172.21.15.97:0/3012753775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0151bf0 0x7fa9f00abbb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009870 tx=0x7fa9ec01c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c45d6df49258e4b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f518f640 1 -- 172.21.15.97:0/3012753775 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0a4940 con 0x7fa9f0151bf0 2023-12-04T05:39:35.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f518f640 1 -- 172.21.15.97:0/3012753775 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0a4aa0 con 0x7fa9f0151bf0 2023-12-04T05:39:35.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f518f640 1 -- 172.21.15.97:0/3012753775 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0a4e30 con 0x7fa9f0151bf0 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 -- 172.21.15.97:0/3012753775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0151bf0 msgr2=0x7fa9f00abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/3012753775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0151bf0 0x7fa9f00abbb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009870 tx=0x7fa9ec01c100 comp rx=0 tx=0).stop 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 -- 172.21.15.97:0/3012753775 shutdown_connections 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/3012753775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0151bf0 0x7fa9f00abbb0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 -- 172.21.15.97:0/3012753775 >> 172.21.15.97:0/3012753775 conn(0x7fa9f0073550 msgr2=0x7fa9f0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 -- 172.21.15.97:0/3012753775 shutdown_connections 2023-12-04T05:39:35.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.533+0000 7fa9f83f5640 1 -- 172.21.15.97:0/3012753775 wait complete. 2023-12-04T05:39:35.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 Processor -- start 2023-12-04T05:39:35.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- start start 2023-12-04T05:39:35.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9f0151bf0 0x7fa9f014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 0x7fa9f0156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0157b60 con 0x7fa9f0155370 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f014f2c0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00c3df0 con 0x7fa9f0151bf0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6992640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 0x7fa9f0156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f5990640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9f0151bf0 0x7fa9f014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:58250/0 (socket says 172.21.15.97:58250) 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6992640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 0x7fa9f0156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38424/0 (socket says 172.21.15.97:38424) 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 -- 172.21.15.97:0/1259202115 learned_addr learned my addr 172.21.15.97:0/1259202115 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 -- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9f0151bf0 msgr2=0x7fa9f014d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9f0151bf0 0x7fa9f014d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 -- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 msgr2=0x7fa9f0156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 0x7fa9f0156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 -- 172.21.15.97:0/1259202115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0094d0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.543 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f6191640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec019030 tx=0x7fa9ec0191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0acc40 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0acda0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0b5680 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00c40b0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.537+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01ee070 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0068440 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa9ec0b3070 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9e6ffd640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 0x7fa9d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9ec11ddd0 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9f5990640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 0x7fa9d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.541+0000 7fa9f5990640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 0x7fa9d4068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0160110 tx=0x7fa9e0007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.545+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9ec0eb140 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f006c970 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9e6ffd640 1 -- 172.21.15.97:0/1259202115 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16548 (secure 0 0 0) 0x7fa9ec0b1090 con 0x7fa9f00c7ef0 2023-12-04T05:39:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:35.702 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":68,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:28.074941+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 msgr2=0x7fa9d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 0x7fa9d4068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0160110 tx=0x7fa9e0007e50 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 msgr2=0x7fa9f0157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec019030 tx=0x7fa9ec0191c0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 shutdown_connections 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa9d40668d0 0x7fa9d4068d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa9f0155370 0x7fa9f0156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9f0151bf0 0x7fa9f014d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 --2- 172.21.15.97:0/1259202115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9f00c7ef0 0x7fa9f0157620 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 >> 172.21.15.97:0/1259202115 conn(0x7fa9f0073550 msgr2=0x7fa9f0150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:35.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 shutdown_connections 2023-12-04T05:39:35.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.697+0000 7fa9f83f5640 1 -- 172.21.15.97:0/1259202115 wait complete. 2023-12-04T05:39:35.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:35.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:35.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.857+0000 7fc61fcc9640 1 Processor -- start 2023-12-04T05:39:35.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 -- start start 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6180c1e70 0x7fc6181524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc61806c440 0x7fc6180a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180aa240 con 0x7fc6180a89a0 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61806c0c0 con 0x7fc6180c1e70 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61fcc9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6180aa500 con 0x7fc61806c440 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6180c1e70 0x7fc6181524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fc6180c1e70 0x7fc6181524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38438/0 (socket says 172.21.15.97:38438) 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 -- 172.21.15.97:0/2221358905 learned_addr learned my addr 172.21.15.97:0/2221358905 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61d264640 1 --2- 172.21.15.97:0/2221358905 >> v2:172.21.15.143:3300/0 conn(0x7fc61806c440 0x7fc6180a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 -- 172.21.15.97:0/2221358905 >> v2:172.21.15.143:3300/0 conn(0x7fc61806c440 msgr2=0x7fc6180a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 --2- 172.21.15.97:0/2221358905 >> v2:172.21.15.143:3300/0 conn(0x7fc61806c440 0x7fc6180a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 -- 172.21.15.97:0/2221358905 >> v1:172.21.15.97:6789/0 conn(0x7fc6180a89a0 legacy=0x7fc61806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61da65640 1 -- 172.21.15.97:0/2221358905 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180aa7e0 con 0x7fc6180c1e70 2023-12-04T05:39:35.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.861+0000 7fc61ca63640 1 -- 172.21.15.97:0/2221358905 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055625851 0 0) 0x7fc6180aa240 con 0x7fc6180a89a0 2023-12-04T05:39:35.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61da65640 1 --2- 172.21.15.97:0/2221358905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6180c1e70 0x7fc6181524e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc618072780 tx=0x7fc61401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4314440ec2b0218 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61ca63640 1 -- 172.21.15.97:0/2221358905 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140aa430 con 0x7fc6180c1e70 2023-12-04T05:39:35.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61ca63640 1 -- 172.21.15.97:0/2221358905 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140aa590 con 0x7fc6180c1e70 2023-12-04T05:39:35.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61ca63640 1 -- 172.21.15.97:0/2221358905 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140aa920 con 0x7fc6180c1e70 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- 172.21.15.97:0/2221358905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6180c1e70 msgr2=0x7fc6181524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/2221358905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6180c1e70 0x7fc6181524e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc618072780 tx=0x7fc61401c4d0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- 172.21.15.97:0/2221358905 shutdown_connections 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/2221358905 >> v2:172.21.15.143:3300/0 conn(0x7fc61806c440 0x7fc6180a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/2221358905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc6180c1e70 0x7fc6181524e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- 172.21.15.97:0/2221358905 >> 172.21.15.97:0/2221358905 conn(0x7fc6180c5e70 msgr2=0x7fc6180c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- 172.21.15.97:0/2221358905 shutdown_connections 2023-12-04T05:39:35.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- 172.21.15.97:0/2221358905 wait complete. 2023-12-04T05:39:35.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 Processor -- start 2023-12-04T05:39:35.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.865+0000 7fc61fcc9640 1 -- start start 2023-12-04T05:39:35.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 0x7fc6181eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 0x7fc618146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61814b4f0 con 0x7fc61806c440 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61813e800 con 0x7fc6180c1e70 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181eaea0 con 0x7fc6180a89a0 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38444/0 (socket says 172.21.15.97:38444) 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 -- 172.21.15.97:0/1743053771 learned_addr learned my addr 172.21.15.97:0/1743053771 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61e266640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 0x7fc618146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61d264640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 0x7fc6181eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 -- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 msgr2=0x7fc6181eb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 0x7fc6181eb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 -- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 msgr2=0x7fc618146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 0x7fc618146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 -- 172.21.15.97:0/1743053771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140094d0 con 0x7fc61806c440 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61e266640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 0x7fc618146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61d264640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 0x7fc6181eb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61da65640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc6140190e0 tx=0x7fc61401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140aa430 con 0x7fc61806c440 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140b3820 con 0x7fc61806c440 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140b3bd0 con 0x7fc61806c440 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6180c23d0 con 0x7fc61806c440 2023-12-04T05:39:35.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6181eb140 con 0x7fc61806c440 2023-12-04T05:39:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc618068440 con 0x7fc61806c440 2023-12-04T05:39:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.869+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc6140b3d30 con 0x7fc61806c440 2023-12-04T05:39:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.873+0000 7fc60e7fc640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 0x7fc5fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.873+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc61411e5f0 con 0x7fc61806c440 2023-12-04T05:39:35.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.873+0000 7fc61d264640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 0x7fc5fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:35.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.873+0000 7fc61d264640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 0x7fc5fc068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6181ef350 tx=0x7fc608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:35.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:35.877+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6140eb970 con 0x7fc61806c440 2023-12-04T05:39:36.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.025+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6180c1890 con 0x7fc61806c440 2023-12-04T05:39:36.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.025+0000 7fc60e7fc640 1 -- 172.21.15.97:0/1743053771 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6140eef90 con 0x7fc61806c440 2023-12-04T05:39:36.031 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:36.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 msgr2=0x7fc5fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 0x7fc5fc068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc6181ef350 tx=0x7fc608008040 comp rx=0 tx=0).stop 2023-12-04T05:39:36.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 msgr2=0x7fc61814c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc6140190e0 tx=0x7fc61401ad10 comp rx=0 tx=0).stop 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 shutdown_connections 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fc5fc0668d0 0x7fc5fc068d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc6180c1e70 0x7fc618146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6180a89a0 0x7fc6181eb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 --2- 172.21.15.97:0/1743053771 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc61806c440 0x7fc61814c5d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 >> 172.21.15.97:0/1743053771 conn(0x7fc6180c5e70 msgr2=0x7fc6180c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 shutdown_connections 2023-12-04T05:39:36.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.029+0000 7fc61fcc9640 1 -- 172.21.15.97:0/1743053771 wait complete. 2023-12-04T05:39:36.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:36.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.185+0000 7f699f59e640 1 Processor -- start 2023-12-04T05:39:36.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.185+0000 7f699f59e640 1 -- start start 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699f59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f69a00c5270 0x7f69a006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699f59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a0072a20 con 0x7f69a014e400 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699f59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a006c4f0 con 0x7f69a0151400 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699f59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a00a5510 con 0x7f69a00c5270 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699ed9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f69a014e400 0x7f69a00c3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49746/0 (socket says 172.21.15.97:49746) 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699ed9d640 1 -- 172.21.15.97:0/908698474 learned_addr learned my addr 172.21.15.97:0/908698474 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:36.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699e59c640 1 --2- 172.21.15.97:0/908698474 >> v2:172.21.15.143:3300/0 conn(0x7f69a00c5270 0x7f69a006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699dd9b640 1 -- 172.21.15.97:0/908698474 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795208150 0 0) 0x7f69a0072a20 con 0x7f69a014e400 2023-12-04T05:39:36.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699dd9b640 1 -- 172.21.15.97:0/908698474 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c003530 con 0x7f69a014e400 2023-12-04T05:39:36.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699e59c640 1 -- 172.21.15.97:0/908698474 >> v1:172.21.15.143:6789/0 conn(0x7f69a0151400 legacy=0x7f69a014dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699e59c640 1 -- 172.21.15.97:0/908698474 >> v1:172.21.15.97:6789/0 conn(0x7f69a014e400 legacy=0x7f69a00c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.189+0000 7f699e59c640 1 -- 172.21.15.97:0/908698474 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a006bf30 con 0x7f69a00c5270 2023-12-04T05:39:36.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699e59c640 1 --2- 172.21.15.97:0/908698474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a00c5270 0x7f69a006da10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6990009d90 tx=0x7f699001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e2ddb021088fbb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699dd9b640 1 -- 172.21.15.97:0/908698474 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900a57f0 con 0x7f69a00c5270 2023-12-04T05:39:36.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699dd9b640 1 -- 172.21.15.97:0/908698474 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900a5950 con 0x7f69a00c5270 2023-12-04T05:39:36.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699dd9b640 1 -- 172.21.15.97:0/908698474 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900a5cc0 con 0x7f69a00c5270 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 -- 172.21.15.97:0/908698474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a00c5270 msgr2=0x7f69a006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 --2- 172.21.15.97:0/908698474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a00c5270 0x7f69a006da10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6990009d90 tx=0x7f699001c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 -- 172.21.15.97:0/908698474 shutdown_connections 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 --2- 172.21.15.97:0/908698474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a00c5270 0x7f69a006da10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 -- 172.21.15.97:0/908698474 >> 172.21.15.97:0/908698474 conn(0x7f69a006ad80 msgr2=0x7f69a00c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 -- 172.21.15.97:0/908698474 shutdown_connections 2023-12-04T05:39:36.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 -- 172.21.15.97:0/908698474 wait complete. 2023-12-04T05:39:36.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.193+0000 7f699f59e640 1 Processor -- start 2023-12-04T05:39:36.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- start start 2023-12-04T05:39:36.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69a00c5270 0x7f69a00aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a0151400 0x7f69a00a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00a93f0 con 0x7f69a014e400 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0150130 con 0x7f69a0151400 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00a6de0 con 0x7f69a00c5270 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38446/0 (socket says 172.21.15.97:38446) 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 -- 172.21.15.97:0/1007813437 learned_addr learned my addr 172.21.15.97:0/1007813437 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699e59c640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69a00c5270 0x7f69a00aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699ed9d640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a0151400 0x7f69a00a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 -- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69a00c5270 msgr2=0x7f69a00aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69a00c5270 0x7f69a00aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 -- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a0151400 msgr2=0x7f69a00a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a0151400 0x7f69a00a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 -- 172.21.15.97:0/1007813437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990009a70 con 0x7f69a014e400 2023-12-04T05:39:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f6995d9b640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f698800c370 tx=0x7f698800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69880052d0 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6988005430 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988007260 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a01ed000 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a01ed270 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.197+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a004e890 con 0x7f69a014e400 2023-12-04T05:39:36.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.201+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69880073c0 con 0x7f69a014e400 2023-12-04T05:39:36.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.201+0000 7f69977fe640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 0x7f6980068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.201+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69880836a0 con 0x7f69a014e400 2023-12-04T05:39:36.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.201+0000 7f699e59c640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 0x7f6980068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.201+0000 7f699e59c640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 0x7f6980068d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f69900af000 tx=0x7f69900a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.205+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6988050990 con 0x7f69a014e400 2023-12-04T05:39:36.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69a014e940 con 0x7f69a014e400 2023-12-04T05:39:36.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f69977fe640 1 -- 172.21.15.97:0/1007813437 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6988053fb0 con 0x7f69a014e400 2023-12-04T05:39:36.361 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 msgr2=0x7f6980068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 0x7f6980068d90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f69900af000 tx=0x7f69900a7070 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 msgr2=0x7f69a01eda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f698800c370 tx=0x7f698800c830 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 shutdown_connections 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f69800668d0 0x7f6980068d90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69a0151400 0x7f69a00a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69a014e400 0x7f69a01eda70 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 --2- 172.21.15.97:0/1007813437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69a00c5270 0x7f69a00aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 >> 172.21.15.97:0/1007813437 conn(0x7f69a006ad80 msgr2=0x7f69a00bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 shutdown_connections 2023-12-04T05:39:36.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.357+0000 7f699f59e640 1 -- 172.21.15.97:0/1007813437 wait complete. 2023-12-04T05:39:36.381 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:36.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 Processor -- start 2023-12-04T05:39:36.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 -- start start 2023-12-04T05:39:36.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fabec14fab0 0x7fabec152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0a54c0 con 0x7fabec0c2a20 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec072c20 con 0x7fabec14fab0 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabeb59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1531f0 con 0x7fabec072410 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabe1d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabe1d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:37702/0 (socket says 172.21.15.97:37702) 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabe1d9b640 1 -- 172.21.15.97:0/3636640703 learned_addr learned my addr 172.21.15.97:0/3636640703 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabead9d640 1 --1- 172.21.15.97:0/3636640703 >> v1:172.21.15.143:6789/0 conn(0x7fabec0c2a20 0x7fabec0c3950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:41750/0 (socket says 172.21.15.97:41750) 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabea59c640 1 --2- 172.21.15.97:0/3636640703 >> v2:172.21.15.143:3300/0 conn(0x7fabec14fab0 0x7fabec152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.517+0000 7fabe1d9b640 1 -- 172.21.15.97:0/3636640703 >> v2:172.21.15.143:3300/0 conn(0x7fabec14fab0 msgr2=0x7fabec152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:36.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe1d9b640 1 --2- 172.21.15.97:0/3636640703 >> v2:172.21.15.143:3300/0 conn(0x7fabec14fab0 0x7fabec152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe1d9b640 1 -- 172.21.15.97:0/3636640703 >> v1:172.21.15.143:6789/0 conn(0x7fabec0c2a20 legacy=0x7fabec0c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe1d9b640 1 -- 172.21.15.97:0/3636640703 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0aa0c0 con 0x7fabec072410 2023-12-04T05:39:36.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe1d9b640 1 --2- 172.21.15.97:0/3636640703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009870 tx=0x7fabd401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e25b96a64e30d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe9d9b640 1 -- 172.21.15.97:0/3636640703 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40ab680 con 0x7fabec072410 2023-12-04T05:39:36.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe9d9b640 1 -- 172.21.15.97:0/3636640703 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40ab7e0 con 0x7fabec072410 2023-12-04T05:39:36.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabe9d9b640 1 -- 172.21.15.97:0/3636640703 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40abb70 con 0x7fabec072410 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 -- 172.21.15.97:0/3636640703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 msgr2=0x7fabec0c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 --2- 172.21.15.97:0/3636640703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009870 tx=0x7fabd401c480 comp rx=0 tx=0).stop 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 -- 172.21.15.97:0/3636640703 shutdown_connections 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 --2- 172.21.15.97:0/3636640703 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec072410 0x7fabec0c24e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 --2- 172.21.15.97:0/3636640703 >> v2:172.21.15.143:3300/0 conn(0x7fabec14fab0 0x7fabec152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 -- 172.21.15.97:0/3636640703 >> 172.21.15.97:0/3636640703 conn(0x7fabec06ad80 msgr2=0x7fabec0c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 -- 172.21.15.97:0/3636640703 shutdown_connections 2023-12-04T05:39:36.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.521+0000 7fabeb59e640 1 -- 172.21.15.97:0/3636640703 wait complete. 2023-12-04T05:39:36.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 Processor -- start 2023-12-04T05:39:36.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 -- start start 2023-12-04T05:39:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0c2a20 0x7fabec071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec14fab0 0x7fabec1e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a75e0 con 0x7fabec072410 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a89a0 con 0x7fabec0c2a20 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabeb59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a6f20 con 0x7fabec14fab0 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38462/0 (socket says 172.21.15.97:38462) 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 -- 172.21.15.97:0/1784711757 learned_addr learned my addr 172.21.15.97:0/1784711757 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabe1d9b640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0c2a20 0x7fabec071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabead9d640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec14fab0 0x7fabec1e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 -- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec14fab0 msgr2=0x7fabec1e8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec14fab0 0x7fabec1e8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 -- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0c2a20 msgr2=0x7fabec071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0c2a20 0x7fabec071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 -- 172.21.15.97:0/1784711757 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40094d0 con 0x7fabec072410 2023-12-04T05:39:36.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.525+0000 7fabea59c640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009d10 tx=0x7fabdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc009b80 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00f040 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc014680 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec0a83e0 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec147880 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec04e890 con 0x7fabec072410 2023-12-04T05:39:36.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fabdc0147e0 con 0x7fabec072410 2023-12-04T05:39:36.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 0x7fabcc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabdc084dc0 con 0x7fabec072410 2023-12-04T05:39:36.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe1d9b640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 0x7fabcc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.529+0000 7fabe1d9b640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 0x7fabcc068dc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fabd40af000 tx=0x7fabd40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.533+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabdc0520a0 con 0x7fabec072410 2023-12-04T05:39:36.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.681+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabec0abe60 con 0x7fabec072410 2023-12-04T05:39:36.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabe37fe640 1 -- 172.21.15.97:0/1784711757 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabec0abe60 con 0x7fabec072410 2023-12-04T05:39:36.688 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 msgr2=0x7fabcc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 0x7fabcc068dc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fabd40af000 tx=0x7fabd40b6040 comp rx=0 tx=0).stop 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 msgr2=0x7fabec146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009d10 tx=0x7fabdc00c490 comp rx=0 tx=0).stop 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 shutdown_connections 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fabcc066900 0x7fabcc068dc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.690 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fabec14fab0 0x7fabec1e8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabec0c2a20 0x7fabec071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 --2- 172.21.15.97:0/1784711757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fabec072410 0x7fabec146a90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 >> 172.21.15.97:0/1784711757 conn(0x7fabec06ad80 msgr2=0x7fabec0c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 shutdown_connections 2023-12-04T05:39:36.691 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.685+0000 7fabeb59e640 1 -- 172.21.15.97:0/1784711757 wait complete. 2023-12-04T05:39:36.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T05:39:36.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 Processor -- start 2023-12-04T05:39:36.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 -- start start 2023-12-04T05:39:36.847 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2e680a8460 0x7f2e680a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680a9770 con 0x7f2e6814fbb0 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e68071730 con 0x7f2e68152490 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6f09c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6814ff90 con 0x7f2e680a8460 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6ce38640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2e6814fbb0 0x7f2e680a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49760/0 (socket says 172.21.15.97:49760) 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e6ce38640 1 -- 172.21.15.97:0/1534059366 learned_addr learned my addr 172.21.15.97:0/1534059366 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:36.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.841+0000 7f2e5ffff640 1 --2- 172.21.15.97:0/1534059366 >> v2:172.21.15.143:3300/0 conn(0x7f2e680a8460 0x7f2e680a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941682422 0 0) 0x7f2e680a9770 con 0x7f2e6814fbb0 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e50003530 con 0x7f2e6814fbb0 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313599679 0 0) 0x7f2e68071730 con 0x7f2e68152490 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e680a9770 con 0x7f2e68152490 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5ffff640 1 -- 172.21.15.97:0/1534059366 >> v1:172.21.15.143:6789/0 conn(0x7f2e68152490 legacy=0x7f2e681528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5ffff640 1 -- 172.21.15.97:0/1534059366 >> v1:172.21.15.97:6789/0 conn(0x7f2e6814fbb0 legacy=0x7f2e680a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5ffff640 1 -- 172.21.15.97:0/1534059366 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68071a10 con 0x7f2e680a8460 2023-12-04T05:39:36.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5ffff640 1 --2- 172.21.15.97:0/1534059366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e680a8460 0x7f2e680a88e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e580097c0 tx=0x7f2e5801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b1da57b4247b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580ab600 con 0x7f2e680a8460 2023-12-04T05:39:36.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580a7050 con 0x7f2e680a8460 2023-12-04T05:39:36.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.845+0000 7f2e5f7fe640 1 -- 172.21.15.97:0/1534059366 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580ab980 con 0x7f2e680a8460 2023-12-04T05:39:36.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- 172.21.15.97:0/1534059366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e680a8460 msgr2=0x7f2e680a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/1534059366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e680a8460 0x7f2e680a88e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e580097c0 tx=0x7f2e5801c330 comp rx=0 tx=0).stop 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- 172.21.15.97:0/1534059366 shutdown_connections 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/1534059366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e680a8460 0x7f2e680a88e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- 172.21.15.97:0/1534059366 >> 172.21.15.97:0/1534059366 conn(0x7f2e680c2970 msgr2=0x7f2e680c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- 172.21.15.97:0/1534059366 shutdown_connections 2023-12-04T05:39:36.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- 172.21.15.97:0/1534059366 wait complete. 2023-12-04T05:39:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 Processor -- start 2023-12-04T05:39:36.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- start start 2023-12-04T05:39:36.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e6814fbb0 0x7f2e6814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e68152490 0x7f2e6813e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680c3af0 con 0x7f2e680a8460 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6814e5f0 con 0x7f2e6814fbb0 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6f09c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681ed6c0 con 0x7f2e68152490 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38472/0 (socket says 172.21.15.97:38472) 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 -- 172.21.15.97:0/3273000683 learned_addr learned my addr 172.21.15.97:0/3273000683 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6d639640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e68152490 0x7f2e6813e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e5ffff640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e6814fbb0 0x7f2e6814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 -- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e68152490 msgr2=0x7f2e6813e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e68152490 0x7f2e6813e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 -- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e6814fbb0 msgr2=0x7f2e6814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.849+0000 7f2e6ce38640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e6814fbb0 0x7f2e6814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e6ce38640 1 -- 172.21.15.97:0/3273000683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58009420 con 0x7f2e680a8460 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e6ce38640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c420 tx=0x7f2e6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64005cf0 con 0x7f2e680a8460 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64005e50 con 0x7f2e680a8460 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6814e310 con 0x7f2e680a8460 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64007310 con 0x7f2e680a8460 2023-12-04T05:39:36.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6814df00 con 0x7f2e680a8460 2023-12-04T05:39:36.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e68068440 con 0x7f2e680a8460 2023-12-04T05:39:36.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2e64007470 con 0x7f2e680a8460 2023-12-04T05:39:36.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 0x7f2e54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:36.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e64083950 con 0x7f2e680a8460 2023-12-04T05:39:36.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.853+0000 7f2e5ffff640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 0x7f2e54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:36.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.857+0000 7f2e5ffff640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 0x7f2e54068d90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2e580ad000 tx=0x7f2e580a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:36.857+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e64050cb0 con 0x7f2e680a8460 2023-12-04T05:39:37.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.009+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2e681528a0 con 0x7f2e680a8460 2023-12-04T05:39:37.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.009+0000 7f2e5d7fa640 1 -- 172.21.15.97:0/3273000683 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+209 (secure 0 0 0) 0x7f2e64017020 con 0x7f2e680a8460 2023-12-04T05:39:37.014 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout:[ 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 1, 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": ".mgr" 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 12, 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_metadata" 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolnum": 13, 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: "poolname": "cephfs_data" 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2023-12-04T05:39:37.015 INFO:teuthology.orchestra.run.smithi097.stdout:] 2023-12-04T05:39:37.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 msgr2=0x7f2e54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 0x7f2e54068d90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2e580ad000 tx=0x7f2e580a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:37.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 msgr2=0x7f2e6814e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c420 tx=0x7f2e6400c8e0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 shutdown_connections 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2e540668d0 0x7f2e54068d90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2e68152490 0x7f2e6813e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2e6814fbb0 0x7f2e6814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 --2- 172.21.15.97:0/3273000683 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e680a8460 0x7f2e6814e800 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 >> 172.21.15.97:0/3273000683 conn(0x7f2e680c2970 msgr2=0x7f2e68145f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 shutdown_connections 2023-12-04T05:39:37.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.013+0000 7f2e6f09c640 1 -- 172.21.15.97:0/3273000683 wait complete. 2023-12-04T05:39:37.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-04T05:39:37.036 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-04T05:39:37.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.173+0000 7f126a89c640 1 Processor -- start 2023-12-04T05:39:37.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.173+0000 7f126a89c640 1 -- start start 2023-12-04T05:39:37.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f126a89c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 0x7f12640c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f126a89c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f126a89c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640c33a0 con 0x7f1264151d00 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f126a89c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12641520e0 con 0x7f12640720d0 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f126a89c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12641545f0 con 0x7f1264155000 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1263fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f1264151d00 0x7f12640c0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:41754/0 (socket says 172.21.15.97:41754) 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1263fff640 1 -- 172.21.15.97:0/3721468892 learned_addr learned my addr 172.21.15.97:0/3721468892 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f12637fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 0x7f12640c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:37726/0 (socket says 172.21.15.97:37726) 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 -- 172.21.15.97:0/3721468892 >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 msgr2=0x7f12640c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 --2- 172.21.15.97:0/3721468892 >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 0x7f12640c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 -- 172.21.15.97:0/3721468892 >> v1:172.21.15.143:6789/0 conn(0x7f1264151d00 legacy=0x7f12640c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1268e39640 1 -- 172.21.15.97:0/3721468892 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640c3680 con 0x7f1264155000 2023-12-04T05:39:37.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f12637fe640 1 --2- 172.21.15.97:0/3721468892 >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 0x7f12640c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:37.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.177+0000 7f1262ffd640 1 -- 172.21.15.97:0/3721468892 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878615548 0 0) 0x7f12640c33a0 con 0x7f1264151d00 2023-12-04T05:39:37.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f1268e39640 1 --2- 172.21.15.97:0/3721468892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f125c009d90 tx=0x7f125c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b35f2e63921f28 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:37.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f1262ffd640 1 -- 172.21.15.97:0/3721468892 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0a5950 con 0x7f1264155000 2023-12-04T05:39:37.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f1262ffd640 1 -- 172.21.15.97:0/3721468892 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c0a5ab0 con 0x7f1264155000 2023-12-04T05:39:37.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f1262ffd640 1 -- 172.21.15.97:0/3721468892 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0a5e40 con 0x7f1264155000 2023-12-04T05:39:37.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- 172.21.15.97:0/3721468892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 msgr2=0x7f126406a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- 172.21.15.97:0/3721468892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f125c009d90 tx=0x7f125c01c890 comp rx=0 tx=0).stop 2023-12-04T05:39:37.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- 172.21.15.97:0/3721468892 shutdown_connections 2023-12-04T05:39:37.185 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- 172.21.15.97:0/3721468892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126406a5f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- 172.21.15.97:0/3721468892 >> v2:172.21.15.143:3300/0 conn(0x7f12640720d0 0x7f12640c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- 172.21.15.97:0/3721468892 >> 172.21.15.97:0/3721468892 conn(0x7f12640c7060 msgr2=0x7f12640c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:37.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- 172.21.15.97:0/3721468892 shutdown_connections 2023-12-04T05:39:37.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- 172.21.15.97:0/3721468892 wait complete. 2023-12-04T05:39:37.186 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 Processor -- start 2023-12-04T05:39:37.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- start start 2023-12-04T05:39:37.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 0x7f126414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264143770 con 0x7f12640720d0 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264144140 con 0x7f1264151d00 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.181+0000 7f126a89c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12641ee0c0 con 0x7f1264155000 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38488/0 (socket says 172.21.15.97:38488) 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 -- 172.21.15.97:0/4105209954 learned_addr learned my addr 172.21.15.97:0/4105209954 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1268e39640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f12637fe640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 0x7f126414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 -- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 msgr2=0x7f126414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126414e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 -- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 msgr2=0x7f126414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 0x7f126414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 -- 172.21.15.97:0/4105209954 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1258009420 con 0x7f12640720d0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f12637fe640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 0x7f126414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1263fff640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f12540011f0 tx=0x7f125400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540074e0 con 0x7f12640720d0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254007640 con 0x7f12640720d0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254004a10 con 0x7f12640720d0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c009a70 con 0x7f12640720d0 2023-12-04T05:39:37.191 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1264143120 con 0x7f12640720d0 2023-12-04T05:39:37.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12640c2320 con 0x7f12640720d0 2023-12-04T05:39:37.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.185+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1254004b70 con 0x7f12640720d0 2023-12-04T05:39:37.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.189+0000 7f1260ff9640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 0x7f1250068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:37.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.189+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1254083560 con 0x7f12640720d0 2023-12-04T05:39:37.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.189+0000 7f12637fe640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 0x7f1250068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:37.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.189+0000 7f12637fe640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 0x7f1250068dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f126414b5d0 tx=0x7f1258009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:37.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.193+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1254050840 con 0x7f12640720d0 2023-12-04T05:39:37.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:37.341+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1264068440 con 0x7f12640720d0 2023-12-04T05:39:38.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.133+0000 7f1260ff9640 1 -- 172.21.15.97:0/4105209954 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v69) v1 ==== 140+0+0 (secure 0 0 0) 0x7f1254053e60 con 0x7f12640720d0 2023-12-04T05:39:38.138 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' created 2023-12-04T05:39:38.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 msgr2=0x7f1250068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 0x7f1250068dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f126414b5d0 tx=0x7f1258009190 comp rx=0 tx=0).stop 2023-12-04T05:39:38.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 msgr2=0x7f1264143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f12540011f0 tx=0x7f125400c9b0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 shutdown_connections 2023-12-04T05:39:38.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1250066900 0x7f1250068dc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1264155000 0x7f126414e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1264151d00 0x7f126414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 --2- 172.21.15.97:0/4105209954 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f12640720d0 0x7f1264143c00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 >> 172.21.15.97:0/4105209954 conn(0x7f12640c7060 msgr2=0x7f12641468c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:38.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 shutdown_connections 2023-12-04T05:39:38.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.137+0000 7f126a89c640 1 -- 172.21.15.97:0/4105209954 wait complete. 2023-12-04T05:39:38.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T05:39:38.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.309+0000 7fee8492a640 1 Processor -- start 2023-12-04T05:39:38.316 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee8492a640 1 -- start start 2023-12-04T05:39:38.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee8492a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee801524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee8492a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800aa240 con 0x7fee8006c440 2023-12-04T05:39:38.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee8492a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800aa500 con 0x7fee8006d210 2023-12-04T05:39:38.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee8492a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8006c0c0 con 0x7fee800c1e70 2023-12-04T05:39:38.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee77fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fee8006c440 0x7fee800a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49770/0 (socket says 172.21.15.97:49770) 2023-12-04T05:39:38.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee77fff640 1 -- 172.21.15.97:0/1985205162 learned_addr learned my addr 172.21.15.97:0/1985205162 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee801524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588762552 0 0) 0x7fee800aa240 con 0x7fee8006c440 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c003530 con 0x7fee8006c440 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929142023 0 0) 0x7fee800aa500 con 0x7fee8006d210 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee800aa240 con 0x7fee8006d210 2023-12-04T05:39:38.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070157763 0 0) 0x7fee6c003530 con 0x7fee8006c440 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 msgr2=0x7fee801524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee801524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 >> v1:172.21.15.143:6789/0 conn(0x7fee8006d210 legacy=0x7fee8006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800aa7e0 con 0x7fee8006c440 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fee68001680 con 0x7fee8006c440 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee801524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 >> v1:172.21.15.97:6789/0 conn(0x7fee8006c440 legacy=0x7fee800a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee6c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee6c004d10 0x7fee6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8006c0c0 con 0x7fee6c003b40 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00ba40 con 0x7fee6c004d10 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00bc00 con 0x7fee800c1e70 2023-12-04T05:39:38.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee6c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7ed9d640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee6c004d10 0x7fee6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee77fff640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 -- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 msgr2=0x7fee6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee800c1e70 0x7fee6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 -- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee6c004d10 msgr2=0x7fee6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee6c004d10 0x7fee6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7e59c640 1 -- 172.21.15.97:0/1985205162 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70009420 con 0x7fee6c003b40 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.313+0000 7fee7ed9d640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee6c004d10 0x7fee6c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee7e59c640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee6c003f40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fee70009cb0 tx=0x7fee7001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b393670e565afb15 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a5880 con 0x7fee6c003b40 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee700a59e0 con 0x7fee6c003b40 2023-12-04T05:39:38.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee7dd9b640 1 -- 172.21.15.97:0/1985205162 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700a5d90 con 0x7fee6c003b40 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 -- 172.21.15.97:0/1985205162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 msgr2=0x7fee6c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 --2- 172.21.15.97:0/1985205162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee6c003f40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fee70009cb0 tx=0x7fee7001cbc0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee7ed9d640 1 -- 172.21.15.97:0/1985205162 reap_dead start 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 -- 172.21.15.97:0/1985205162 shutdown_connections 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 -- 172.21.15.97:0/1985205162 >> 172.21.15.97:0/1985205162 conn(0x7fee800c5e70 msgr2=0x7fee800c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 -- 172.21.15.97:0/1985205162 shutdown_connections 2023-12-04T05:39:38.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.317+0000 7fee8492a640 1 -- 172.21.15.97:0/1985205162 wait complete. 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 Processor -- start 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- start start 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee80143a00 0x7fee801ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee8014f190 0x7fee8014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801ed2b0 con 0x7fee6c003b40 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8014e470 con 0x7fee80143a00 2023-12-04T05:39:38.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee80147ae0 con 0x7fee8014f190 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38502/0 (socket says 172.21.15.97:38502) 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 -- 172.21.15.97:0/2998695783 learned_addr learned my addr 172.21.15.97:0/2998695783 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 -- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee8014f190 msgr2=0x7fee8014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee8014f190 0x7fee8014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 -- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee80143a00 msgr2=0x7fee801ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee80143a00 0x7fee801ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 -- 172.21.15.97:0/2998695783 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80147dc0 con 0x7fee6c003b40 2023-12-04T05:39:38.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee7e59c640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fee70009cb0 tx=0x7fee6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70004020 con 0x7fee6c003b40 2023-12-04T05:39:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70004180 con 0x7fee6c003b40 2023-12-04T05:39:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70004510 con 0x7fee6c003b40 2023-12-04T05:39:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee801480a0 con 0x7fee6c003b40 2023-12-04T05:39:38.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.321+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee801eced0 con 0x7fee6c003b40 2023-12-04T05:39:38.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80068440 con 0x7fee6c003b40 2023-12-04T05:39:38.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee700b4040 con 0x7fee6c003b40 2023-12-04T05:39:38.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee76ffd640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 0x7fee60068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:38.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fee7011ecd0 con 0x7fee6c003b40 2023-12-04T05:39:38.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee77fff640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 0x7fee60068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:38.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.325+0000 7fee77fff640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 0x7fee60068dc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fee68000fe0 tx=0x7fee680011b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:38.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.329+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee700ebee0 con 0x7fee6c003b40 2023-12-04T05:39:38.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:38.481+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fee800c5ba0 con 0x7fee6c003b40 2023-12-04T05:39:39.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.141+0000 7fee76ffd640 1 -- 172.21.15.97:0/2998695783 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v70) v1 ==== 172+0+0 (secure 0 0 0) 0x7fee700b20d0 con 0x7fee6c003b40 2023-12-04T05:39:39.147 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' created 2023-12-04T05:39:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 msgr2=0x7fee60068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 0x7fee60068dc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fee68000fe0 tx=0x7fee680011b0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 msgr2=0x7fee8014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fee70009cb0 tx=0x7fee6c005800 comp rx=0 tx=0).stop 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 shutdown_connections 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fee60066900 0x7fee60068dc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fee8014f190 0x7fee8014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fee80143a00 0x7fee801ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 --2- 172.21.15.97:0/2998695783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fee6c003b40 0x7fee8014df30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 >> 172.21.15.97:0/2998695783 conn(0x7fee800c5e70 msgr2=0x7fee801528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:39.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 shutdown_connections 2023-12-04T05:39:39.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.145+0000 7fee8492a640 1 -- 172.21.15.97:0/2998695783 wait complete. 2023-12-04T05:39:39.196 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-04T05:39:39.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 Processor -- start 2023-12-04T05:39:39.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 -- start start 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb16414f960 0x7fb1641548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb164154e10 0x7fb16415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb164154640 con 0x7fb16414eb30 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640c0bd0 con 0x7fb164154e10 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16c580640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16414ef10 con 0x7fb16414f960 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16ab1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb164154e10 0x7fb16415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.333+0000 7fb16ab1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb164154e10 0x7fb16415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38512/0 (socket says 172.21.15.97:38512) 2023-12-04T05:39:39.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 -- 172.21.15.97:0/2809730750 learned_addr learned my addr 172.21.15.97:0/2809730750 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:39.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb169b1b640 1 --2- 172.21.15.97:0/2809730750 >> v2:172.21.15.143:3300/0 conn(0x7fb16414f960 0x7fb1641548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 -- 172.21.15.97:0/2809730750 >> v2:172.21.15.143:3300/0 conn(0x7fb16414f960 msgr2=0x7fb1641548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:39.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 --2- 172.21.15.97:0/2809730750 >> v2:172.21.15.143:3300/0 conn(0x7fb16414f960 0x7fb1641548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 -- 172.21.15.97:0/2809730750 >> v1:172.21.15.143:6789/0 conn(0x7fb16414eb30 legacy=0x7fb16414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 -- 172.21.15.97:0/2809730750 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1641535a0 con 0x7fb164154e10 2023-12-04T05:39:39.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16ab1d640 1 --2- 172.21.15.97:0/2809730750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb164154e10 0x7fb16415bc60 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb16406e7f0 tx=0x7fb15c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b062332f3f2694 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:39.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16931a640 1 -- 172.21.15.97:0/2809730750 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0a5770 con 0x7fb164154e10 2023-12-04T05:39:39.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16931a640 1 -- 172.21.15.97:0/2809730750 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0a58d0 con 0x7fb164154e10 2023-12-04T05:39:39.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.337+0000 7fb16931a640 1 -- 172.21.15.97:0/2809730750 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0a5c60 con 0x7fb164154e10 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- 172.21.15.97:0/2809730750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb164154e10 msgr2=0x7fb16415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- 172.21.15.97:0/2809730750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb164154e10 0x7fb16415bc60 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb16406e7f0 tx=0x7fb15c01c9a0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- 172.21.15.97:0/2809730750 shutdown_connections 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- 172.21.15.97:0/2809730750 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb164154e10 0x7fb16415bc60 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- 172.21.15.97:0/2809730750 >> v2:172.21.15.143:3300/0 conn(0x7fb16414f960 0x7fb1641548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- 172.21.15.97:0/2809730750 >> 172.21.15.97:0/2809730750 conn(0x7fb1640c5e70 msgr2=0x7fb1640c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:39.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- 172.21.15.97:0/2809730750 shutdown_connections 2023-12-04T05:39:39.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- 172.21.15.97:0/2809730750 wait complete. 2023-12-04T05:39:39.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 Processor -- start 2023-12-04T05:39:39.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- start start 2023-12-04T05:39:39.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb16414eb30 0x7fb1640a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb164154e10 0x7fb16406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640715c0 con 0x7fb16414f960 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640a9b50 con 0x7fb16414eb30 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16c580640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640aaaa0 con 0x7fb164154e10 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38524/0 (socket says 172.21.15.97:38524) 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 -- 172.21.15.97:0/790760154 learned_addr learned my addr 172.21.15.97:0/790760154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16a31c640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb16414eb30 0x7fb1640a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb16ab1d640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb164154e10 0x7fb16406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 -- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb164154e10 msgr2=0x7fb16406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb164154e10 0x7fb16406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 -- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb16414eb30 msgr2=0x7fb1640a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb16414eb30 0x7fb1640a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:39.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 -- 172.21.15.97:0/790760154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c009b30 con 0x7fb16414f960 2023-12-04T05:39:39.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.341+0000 7fb169b1b640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb15400d800 tx=0x7fb15400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:39.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400b6c0 con 0x7fb16414f960 2023-12-04T05:39:39.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15400b860 con 0x7fb16414f960 2023-12-04T05:39:39.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400bc10 con 0x7fb16414f960 2023-12-04T05:39:39.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb164070f70 con 0x7fb16414f960 2023-12-04T05:39:39.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb164141320 con 0x7fb16414f960 2023-12-04T05:39:39.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164071730 con 0x7fb16414f960 2023-12-04T05:39:39.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb15401e460 con 0x7fb16414f960 2023-12-04T05:39:39.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 0x7fb148068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:39.351 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fb154085640 con 0x7fb16414f960 2023-12-04T05:39:39.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.345+0000 7fb16a31c640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 0x7fb148068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:39.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.349+0000 7fb16a31c640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 0x7fb148068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb160001810 tx=0x7fb160009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:39.355 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.349+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1540526b0 con 0x7fb16414f960 2023-12-04T05:39:39.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:39.541+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fb164068440 con 0x7fb16414f960 2023-12-04T05:39:40.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.145+0000 7fb15affd640 1 -- 172.21.15.97:0/790760154 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v49) v1 ==== 177+0+0 (secure 0 0 0) 0x7fb154055cd0 con 0x7fb16414f960 2023-12-04T05:39:40.148 INFO:teuthology.orchestra.run.smithi097.stderr:new fs with metadata pool 14 and data pool 15 2023-12-04T05:39:40.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.145+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 msgr2=0x7fb148068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.145+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 0x7fb148068d90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb160001810 tx=0x7fb160009040 comp rx=0 tx=0).stop 2023-12-04T05:39:40.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.145+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 msgr2=0x7fb164140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.145+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb15400d800 tx=0x7fb15400dcc0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 shutdown_connections 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb1480668d0 0x7fb148068d90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb164154e10 0x7fb16406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb16414f960 0x7fb164140de0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 --2- 172.21.15.97:0/790760154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb16414eb30 0x7fb1640a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 >> 172.21.15.97:0/790760154 conn(0x7fb1640c5e70 msgr2=0x7fb16414cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 shutdown_connections 2023-12-04T05:39:40.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.149+0000 7fb16c580640 1 -- 172.21.15.97:0/790760154 wait complete. 2023-12-04T05:39:40.178 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:40.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 Processor -- start 2023-12-04T05:39:40.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 -- start start 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6de40abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de41547d0 con 0x7f6de40c7ef0 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de4158b80 con 0x7f6de4155370 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6deb1f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40c4aa0 con 0x7f6de4151bf0 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddbfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6de40c7ef0 0x7f6de4154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49774/0 (socket says 172.21.15.97:49774) 2023-12-04T05:39:40.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddbfff640 1 -- 172.21.15.97:0/3084008740 learned_addr learned my addr 172.21.15.97:0/3084008740 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:40.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6de8f91640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6de40abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978044663 0 0) 0x7f6de41547d0 con 0x7f6de40c7ef0 2023-12-04T05:39:40.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc003530 con 0x7f6de40c7ef0 2023-12-04T05:39:40.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146751166 0 0) 0x7f6de4158b80 con 0x7f6de4155370 2023-12-04T05:39:40.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de41547d0 con 0x7f6de4155370 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585322847 0 0) 0x7f6dcc003530 con 0x7f6de40c7ef0 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 msgr2=0x7f6de40abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6de40abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 >> v1:172.21.15.143:6789/0 conn(0x7f6de4155370 legacy=0x7f6de415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40c4d40 con 0x7f6de40c7ef0 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.313+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f6dd4001680 con 0x7f6de40c7ef0 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 >> v1:172.21.15.97:6789/0 conn(0x7f6de40c7ef0 legacy=0x7f6de4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dcc003b40 0x7f6dcc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6dcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dcc004d10 0x7f6dcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40c4aa0 con 0x7f6dcc004d10 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00bba0 con 0x7f6dcc003b40 2023-12-04T05:39:40.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00bd60 con 0x7f6de4151bf0 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dcc003b40 0x7f6dcc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de9792640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dcc004d10 0x7f6dcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddbfff640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6dcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 -- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 msgr2=0x7f6dcc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6de4151bf0 0x7f6dcc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 -- 172.21.15.97:0/3084008740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dcc004d10 msgr2=0x7f6dcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6dcc004d10 0x7f6dcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 -- 172.21.15.97:0/3084008740 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc003530 con 0x7f6dcc003b40 2023-12-04T05:39:40.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6de8f91640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dcc003b40 0x7f6dcc003f40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009ae0 tx=0x7f6de001c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f09b1476e8509856 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.317+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00a4a80 con 0x7f6dcc003b40 2023-12-04T05:39:40.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00a4be0 con 0x7f6dcc003b40 2023-12-04T05:39:40.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6ddb7fe640 1 -- 172.21.15.97:0/3084008740 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00ac440 con 0x7f6dcc003b40 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dcc003b40 msgr2=0x7f6dcc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/3084008740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6dcc003b40 0x7f6dcc003f40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009ae0 tx=0x7f6de001c730 comp rx=0 tx=0).stop 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6de9792640 1 -- 172.21.15.97:0/3084008740 reap_dead start 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- 172.21.15.97:0/3084008740 shutdown_connections 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- 172.21.15.97:0/3084008740 >> 172.21.15.97:0/3084008740 conn(0x7f6de4073550 msgr2=0x7f6de4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- 172.21.15.97:0/3084008740 shutdown_connections 2023-12-04T05:39:40.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- 172.21.15.97:0/3084008740 wait complete. 2023-12-04T05:39:40.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 Processor -- start 2023-12-04T05:39:40.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- start start 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 0x7f6de40ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6de40c40f0 0x7f6de41ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40acfd0 con 0x7f6de414f9a0 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de414f470 con 0x7f6de40c40f0 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6deb1f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41efe20 con 0x7f6dcc003b40 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6de9792640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6de9792640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38552/0 (socket says 172.21.15.97:38552) 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6de9792640 1 -- 172.21.15.97:0/276569731 learned_addr learned my addr 172.21.15.97:0/276569731 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:40.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6ddbfff640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6de40c40f0 0x7f6de41ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.321+0000 7f6de8f91640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 0x7f6de40ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 -- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 msgr2=0x7f6de40ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 0x7f6de40ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 -- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6de40c40f0 msgr2=0x7f6de41ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6de40c40f0 0x7f6de41ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 -- 172.21.15.97:0/276569731 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40c3540 con 0x7f6de414f9a0 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de8f91640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 0x7f6de40ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:40.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de9792640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc007fd0 tx=0x7f6ddc00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc003b90 con 0x7f6de414f9a0 2023-12-04T05:39:40.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc003d30 con 0x7f6de414f9a0 2023-12-04T05:39:40.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc003ea0 con 0x7f6de414f9a0 2023-12-04T05:39:40.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de414f6c0 con 0x7f6de414f9a0 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de41f2190 con 0x7f6de414f9a0 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de40ad110 con 0x7f6de414f9a0 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6ddc005310 con 0x7f6de414f9a0 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 0x7f6dd0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6ddc0847a0 con 0x7f6de414f9a0 2023-12-04T05:39:40.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.325+0000 7f6de8f91640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 0x7f6dd0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.329+0000 7f6de8f91640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 0x7f6dd0068dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6de00ae000 tx=0x7f6de00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.329+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6de40ad110 con 0x7f6de414f9a0 2023-12-04T05:39:40.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.481+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6de40ad110 con 0x7f6de414f9a0 2023-12-04T05:39:40.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.481+0000 7f6dd97fa640 1 -- 172.21.15.97:0/276569731 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f6de40ad110 con 0x7f6de414f9a0 2023-12-04T05:39:40.488 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:40.488 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":71,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:39.546435+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:40.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 msgr2=0x7f6dd0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 0x7f6dd0068dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6de00ae000 tx=0x7f6de00046d0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 msgr2=0x7f6de41ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc007fd0 tx=0x7f6ddc00ff70 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 shutdown_connections 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6dd0066900 0x7f6dd0068dc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6de414f9a0 0x7f6de41ef8e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6de40c40f0 0x7f6de41ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 --2- 172.21.15.97:0/276569731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6dcc003b40 0x7f6de40ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 >> 172.21.15.97:0/276569731 conn(0x7f6de4073550 msgr2=0x7f6de40bfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 shutdown_connections 2023-12-04T05:39:40.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.485+0000 7f6deb1f5640 1 -- 172.21.15.97:0/276569731 wait complete. 2023-12-04T05:39:40.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:40.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 Processor -- start 2023-12-04T05:39:40.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 -- start start 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdbc414fbb0 0x7fdbc40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc40a9770 con 0x7fdbc40a88e0 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc4071730 con 0x7fdbc40a8460 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.641+0000 7fdbca9b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc414ff90 con 0x7fdbc414fbb0 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc8f55640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fdbc40a88e0 0x7fdbc4152ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49786/0 (socket says 172.21.15.97:49786) 2023-12-04T05:39:40.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc8f55640 1 -- 172.21.15.97:0/3043789115 learned_addr learned my addr 172.21.15.97:0/3043789115 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:40.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc3fff640 1 --2- 172.21.15.97:0/3043789115 >> v2:172.21.15.143:3300/0 conn(0x7fdbc414fbb0 0x7fdbc40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254064713 0 0) 0x7fdbc40a9770 con 0x7fdbc40a88e0 2023-12-04T05:39:40.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbac003530 con 0x7fdbc40a88e0 2023-12-04T05:39:40.649 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670208739 0 0) 0x7fdbc4071730 con 0x7fdbc40a8460 2023-12-04T05:39:40.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc40a9770 con 0x7fdbc40a8460 2023-12-04T05:39:40.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 622223125 0 0) 0x7fdbac003530 con 0x7fdbc40a88e0 2023-12-04T05:39:40.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3043789115 >> v1:172.21.15.143:6789/0 conn(0x7fdbc40a8460 legacy=0x7fdbc4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3043789115 >> v1:172.21.15.97:6789/0 conn(0x7fdbc40a88e0 legacy=0x7fdbc4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3043789115 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4071a10 con 0x7fdbc414fbb0 2023-12-04T05:39:40.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.645+0000 7fdbc3fff640 1 --2- 172.21.15.97:0/3043789115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc414fbb0 0x7fdbc40a8f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097c0 tx=0x7fdbb401c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d72e77d4fc9be9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc001a00 con 0x7fdbc414fbb0 2023-12-04T05:39:40.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40a7050 con 0x7fdbc414fbb0 2023-12-04T05:39:40.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc2ffd640 1 -- 172.21.15.97:0/3043789115 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40ab620 con 0x7fdbc414fbb0 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3043789115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc414fbb0 msgr2=0x7fdbc40a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3043789115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc414fbb0 0x7fdbc40a8f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097c0 tx=0x7fdbb401c280 comp rx=0 tx=0).stop 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3043789115 shutdown_connections 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3043789115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc414fbb0 0x7fdbc40a8f20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3043789115 >> 172.21.15.97:0/3043789115 conn(0x7fdbc40c2970 msgr2=0x7fdbc40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3043789115 shutdown_connections 2023-12-04T05:39:40.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3043789115 wait complete. 2023-12-04T05:39:40.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 Processor -- start 2023-12-04T05:39:40.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- start start 2023-12-04T05:39:40.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 0x7fdbc41ec640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 0x7fdbc41ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40c58e0 con 0x7fdbc40a8460 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4155cd0 con 0x7fdbc40a88e0 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbca9b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40c5b30 con 0x7fdbc414fbb0 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38564/0 (socket says 172.21.15.97:38564) 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3057357584 learned_addr learned my addr 172.21.15.97:0/3057357584 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc37fe640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 0x7fdbc41ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc8f55640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 0x7fdbc41ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.649+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 msgr2=0x7fdbc41ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc3fff640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 0x7fdbc41ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 msgr2=0x7fdbc41ec640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc3fff640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 0x7fdbc41ec640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc3fff640 1 -- 172.21.15.97:0/3057357584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009420 con 0x7fdbc40a8460 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc37fe640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 0x7fdbc41ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc8f55640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 0x7fdbc41ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc3fff640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097c0 tx=0x7fdbb4019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004020 con 0x7fdbc40a8460 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4004180 con 0x7fdbc40a8460 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40044f0 con 0x7fdbc40a8460 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4155960 con 0x7fdbc40a8460 2023-12-04T05:39:40.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc4153f60 con 0x7fdbc40a8460 2023-12-04T05:39:40.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc4068440 con 0x7fdbc40a8460 2023-12-04T05:39:40.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdbb40b2040 con 0x7fdbc40a8460 2023-12-04T05:39:40.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 0x7fdbb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdbb411e5f0 con 0x7fdbc40a8460 2023-12-04T05:39:40.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.653+0000 7fdbc37fe640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 0x7fdbb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.657+0000 7fdbc37fe640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 0x7fdbb0068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41498e0 tx=0x7fdbb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.657+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbb40eb4c0 con 0x7fdbc40a8460 2023-12-04T05:39:40.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.809+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbc4072990 con 0x7fdbc40a8460 2023-12-04T05:39:40.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.809+0000 7fdbc0ff9640 1 -- 172.21.15.97:0/3057357584 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fdbb40eeae0 con 0x7fdbc40a8460 2023-12-04T05:39:40.815 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:40.815 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":71,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:39.546435+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 msgr2=0x7fdbb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 0x7fdbb0068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdbc41498e0 tx=0x7fdbb8009040 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 msgr2=0x7fdbc4153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097c0 tx=0x7fdbb4019020 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 shutdown_connections 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdbb00668d0 0x7fdbb0068d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbc414fbb0 0x7fdbc41ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbc40a88e0 0x7fdbc41ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 --2- 172.21.15.97:0/3057357584 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdbc40a8460 0x7fdbc4153a20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 >> 172.21.15.97:0/3057357584 conn(0x7fdbc40c2970 msgr2=0x7fdbc40c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 shutdown_connections 2023-12-04T05:39:40.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.813+0000 7fdbca9b8640 1 -- 172.21.15.97:0/3057357584 wait complete. 2023-12-04T05:39:40.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-04T05:39:40.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.969+0000 7faf8e7aa640 1 Processor -- start 2023-12-04T05:39:40.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.969+0000 7faf8e7aa640 1 -- start start 2023-12-04T05:39:40.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8e7aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faf881524e0 0x7faf8806d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8e7aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880aa240 con 0x7faf880c1e70 2023-12-04T05:39:40.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8e7aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880aa500 con 0x7faf8806c440 2023-12-04T05:39:40.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8e7aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8806c0c0 con 0x7faf881524e0 2023-12-04T05:39:40.977 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf87fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7faf880c1e70 0x7faf880a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49802/0 (socket says 172.21.15.97:49802) 2023-12-04T05:39:40.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf87fff640 1 -- 172.21.15.97:0/1293943018 learned_addr learned my addr 172.21.15.97:0/1293943018 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:40.978 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8cd47640 1 --2- 172.21.15.97:0/1293943018 >> v2:172.21.15.143:3300/0 conn(0x7faf881524e0 0x7faf8806d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121631341 0 0) 0x7faf880aa240 con 0x7faf880c1e70 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf70003530 con 0x7faf880c1e70 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327354742 0 0) 0x7faf880aa500 con 0x7faf8806c440 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf880aa240 con 0x7faf8806c440 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3235514093 0 0) 0x7faf70003530 con 0x7faf880c1e70 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8cd47640 1 -- 172.21.15.97:0/1293943018 >> v1:172.21.15.143:6789/0 conn(0x7faf8806c440 legacy=0x7faf8806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8cd47640 1 -- 172.21.15.97:0/1293943018 >> v1:172.21.15.97:6789/0 conn(0x7faf880c1e70 legacy=0x7faf880a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.973+0000 7faf8cd47640 1 -- 172.21.15.97:0/1293943018 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880aa7e0 con 0x7faf881524e0 2023-12-04T05:39:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8cd47640 1 --2- 172.21.15.97:0/1293943018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8806d920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faf80009d90 tx=0x7faf8001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abcce4fd826aa731 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78001680 con 0x7faf881524e0 2023-12-04T05:39:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800a55a0 con 0x7faf881524e0 2023-12-04T05:39:40.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf86ffd640 1 -- 172.21.15.97:0/1293943018 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800a5930 con 0x7faf881524e0 2023-12-04T05:39:40.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- 172.21.15.97:0/1293943018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 msgr2=0x7faf8806d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/1293943018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8806d920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faf80009d90 tx=0x7faf8001c870 comp rx=0 tx=0).stop 2023-12-04T05:39:40.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- 172.21.15.97:0/1293943018 shutdown_connections 2023-12-04T05:39:40.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/1293943018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8806d920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- 172.21.15.97:0/1293943018 >> 172.21.15.97:0/1293943018 conn(0x7faf880c5e70 msgr2=0x7faf880c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:40.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- 172.21.15.97:0/1293943018 shutdown_connections 2023-12-04T05:39:40.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- 172.21.15.97:0/1293943018 wait complete. 2023-12-04T05:39:40.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 Processor -- start 2023-12-04T05:39:40.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.977+0000 7faf8e7aa640 1 -- start start 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 0x7faf8813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8813b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8814f470 con 0x7faf8806c440 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf881ee680 con 0x7faf881524e0 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf881eebb0 con 0x7faf880c1e70 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38572/0 (socket says 172.21.15.97:38572) 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 -- 172.21.15.97:0/3760432242 learned_addr learned my addr 172.21.15.97:0/3760432242 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8cd47640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8813b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf877fe640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 0x7faf8813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 -- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 msgr2=0x7faf8813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 0x7faf8813b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 -- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 msgr2=0x7faf8813b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8813b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 -- 172.21.15.97:0/3760432242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009a70 con 0x7faf8806c440 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf877fe640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 0x7faf8813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8cd47640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:40.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf87fff640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c780 tx=0x7faf7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78005cf0 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78005e50 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780072b0 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8814c620 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881ee8d0 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.981+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf88068440 con 0x7faf8806c440 2023-12-04T05:39:40.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.985+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf78007410 con 0x7faf8806c440 2023-12-04T05:39:40.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.985+0000 7faf84ff9640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 0x7faf74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:40.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.985+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf78083fe0 con 0x7faf8806c440 2023-12-04T05:39:40.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.985+0000 7faf877fe640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 0x7faf74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:40.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.985+0000 7faf877fe640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 0x7faf74068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faf8806ce00 tx=0x7faf7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:40.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:40.989+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf780548f0 con 0x7faf8806c440 2023-12-04T05:39:41.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:41.177+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faf8806c220 con 0x7faf8806c440 2023-12-04T05:39:42.044 INFO:tasks.ceph.mds.a.smithi097.stderr:2023-12-04T05:39:42.040+0000 7f454a5e7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:39:42.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.156+0000 7faf84ff9640 1 -- 172.21.15.97:0/3760432242 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7faf78017020 con 0x7faf8806c440 2023-12-04T05:39:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 msgr2=0x7faf74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 0x7faf74068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faf8806ce00 tx=0x7faf7c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 msgr2=0x7faf880c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:42.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c780 tx=0x7faf7800cc40 comp rx=0 tx=0).stop 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 shutdown_connections 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faf740668d0 0x7faf74068d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf881524e0 0x7faf8813b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf880c1e70 0x7faf8813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 --2- 172.21.15.97:0/3760432242 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf8806c440 0x7faf880c31b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 >> 172.21.15.97:0/3760432242 conn(0x7faf880c5e70 msgr2=0x7faf880c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 shutdown_connections 2023-12-04T05:39:42.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.160+0000 7faf8e7aa640 1 -- 172.21.15.97:0/3760432242 wait complete. 2023-12-04T05:39:42.188 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T05:39:42.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-04T05:39:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 Processor -- start 2023-12-04T05:39:42.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 -- start start 2023-12-04T05:39:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab1814eb30 0x7fab1814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab1814f790 0x7fab181548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab18154640 con 0x7fab18154e10 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab180c0bd0 con 0x7fab1814eb30 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab1e25a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1814ef10 con 0x7fab1814f790 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab1814eb30 0x7fab1814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab1814eb30 0x7fab1814f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38582/0 (socket says 172.21.15.97:38582) 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 -- 172.21.15.97:0/710957971 learned_addr learned my addr 172.21.15.97:0/710957971 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab16ffd640 1 --2- 172.21.15.97:0/710957971 >> v2:172.21.15.143:3300/0 conn(0x7fab1814f790 0x7fab181548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 -- 172.21.15.97:0/710957971 >> v2:172.21.15.143:3300/0 conn(0x7fab1814f790 msgr2=0x7fab181548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 --2- 172.21.15.97:0/710957971 >> v2:172.21.15.143:3300/0 conn(0x7fab1814f790 0x7fab181548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 -- 172.21.15.97:0/710957971 >> v1:172.21.15.143:6789/0 conn(0x7fab18154e10 legacy=0x7fab18151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:42.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.328+0000 7fab177fe640 1 -- 172.21.15.97:0/710957971 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab181535a0 con 0x7fab1814eb30 2023-12-04T05:39:42.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab177fe640 1 --2- 172.21.15.97:0/710957971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab1814f250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fab1806e7f0 tx=0x7fab0801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d40e00707a1f04 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab167fc640 1 -- 172.21.15.97:0/710957971 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080ac600 con 0x7fab1814eb30 2023-12-04T05:39:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab167fc640 1 -- 172.21.15.97:0/710957971 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080a8050 con 0x7fab1814eb30 2023-12-04T05:39:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab167fc640 1 -- 172.21.15.97:0/710957971 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080ac980 con 0x7fab1814eb30 2023-12-04T05:39:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 -- 172.21.15.97:0/710957971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 msgr2=0x7fab1814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:42.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 --2- 172.21.15.97:0/710957971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab1814f250 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fab1806e7f0 tx=0x7fab0801c490 comp rx=0 tx=0).stop 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 -- 172.21.15.97:0/710957971 shutdown_connections 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 --2- 172.21.15.97:0/710957971 >> v2:172.21.15.143:3300/0 conn(0x7fab1814f790 0x7fab181548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 --2- 172.21.15.97:0/710957971 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab1814f250 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 -- 172.21.15.97:0/710957971 >> 172.21.15.97:0/710957971 conn(0x7fab180c5e70 msgr2=0x7fab180c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 -- 172.21.15.97:0/710957971 shutdown_connections 2023-12-04T05:39:42.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.332+0000 7fab1e25a640 1 -- 172.21.15.97:0/710957971 wait complete. 2023-12-04T05:39:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 Processor -- start 2023-12-04T05:39:42.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- start start 2023-12-04T05:39:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 0x7fab180c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab18154e10 0x7fab180bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180bf1a0 con 0x7fab1814eb30 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180bae90 con 0x7fab1814f790 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab180bc850 con 0x7fab18154e10 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38598/0 (socket says 172.21.15.97:38598) 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 -- 172.21.15.97:0/404862662 learned_addr learned my addr 172.21.15.97:0/404862662 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab16ffd640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 0x7fab180c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab17fff640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab18154e10 0x7fab180bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 -- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab18154e10 msgr2=0x7fab180bbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab18154e10 0x7fab180bbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 -- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 msgr2=0x7fab180c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 0x7fab180c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:42.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 -- 172.21.15.97:0/404862662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080094d0 con 0x7fab1814eb30 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab16ffd640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 0x7fab180c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab177fe640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fab0801a0c0 tx=0x7fab0801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b7620 con 0x7fab1814eb30 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080b7780 con 0x7fab1814eb30 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b7af0 con 0x7fab1814eb30 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1814fd20 con 0x7fab1814eb30 2023-12-04T05:39:42.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.336+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab180bb0e0 con 0x7fab1814eb30 2023-12-04T05:39:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab18068440 con 0x7fab1814eb30 2023-12-04T05:39:42.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fab080b3040 con 0x7fab1814eb30 2023-12-04T05:39:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7faafffff640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fab0811ec70 con 0x7fab1814eb30 2023-12-04T05:39:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7fab16ffd640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:42.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.340+0000 7fab16ffd640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 0x7fab04068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fab18150130 tx=0x7fab0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:42.350 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.344+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab080ebb40 con 0x7fab1814eb30 2023-12-04T05:39:42.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:42.524+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab1814ade0 con 0x7fab1814eb30 2023-12-04T05:39:43.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7faafffff640 1 -- 172.21.15.97:0/404862662 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fab080ef160 con 0x7fab1814eb30 2023-12-04T05:39:43.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 msgr2=0x7fab04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 0x7fab04068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fab18150130 tx=0x7fab0c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 msgr2=0x7fab18140200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fab0801a0c0 tx=0x7fab0801acd0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 shutdown_connections 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab040668d0 0x7fab04068d90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab18154e10 0x7fab180bbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab1814f790 0x7fab180c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 --2- 172.21.15.97:0/404862662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab1814eb30 0x7fab18140200 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 >> 172.21.15.97:0/404862662 conn(0x7fab180c5e70 msgr2=0x7fab1815c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 shutdown_connections 2023-12-04T05:39:43.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.168+0000 7fab1e25a640 1 -- 172.21.15.97:0/404862662 wait complete. 2023-12-04T05:39:43.195 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-04T05:39:43.195 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:39:43.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.328+0000 7f84ec1b8640 1 Processor -- start 2023-12-04T05:39:43.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.328+0000 7f84ec1b8640 1 -- start start 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.328+0000 7f84ec1b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.328+0000 7f84ec1b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f84e40a88e0 0x7f84e4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.328+0000 7f84ec1b8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e41530e0 con 0x7f84e40a8460 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ec1b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e414ff90 con 0x7f84e40a88e0 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ec1b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40a9770 con 0x7f84e414fbb0 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84e9753640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f84e40a8460 0x7f84e4152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49804/0 (socket says 172.21.15.97:49804) 2023-12-04T05:39:43.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84e9753640 1 -- 172.21.15.97:0/2939615543 learned_addr learned my addr 172.21.15.97:0/2939615543 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 --2- 172.21.15.97:0/2939615543 >> v2:172.21.15.143:3300/0 conn(0x7f84e40a88e0 0x7f84e4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84e9f54640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84e8f52640 1 -- 172.21.15.97:0/2939615543 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421713433 0 0) 0x7f84e41530e0 con 0x7f84e40a8460 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84e8f52640 1 -- 172.21.15.97:0/2939615543 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d0003530 con 0x7f84e40a8460 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 -- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 msgr2=0x7f84e40a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:43.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e40a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 -- 172.21.15.97:0/2939615543 >> v1:172.21.15.97:6789/0 conn(0x7f84e40a8460 legacy=0x7f84e4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 -- 172.21.15.97:0/2939615543 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4071730 con 0x7f84e40a88e0 2023-12-04T05:39:43.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.332+0000 7f84ea755640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4152ba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009d90 tx=0x7f84dc01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b26a0ef1d8677d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e8f52640 1 -- 172.21.15.97:0/2939615543 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0a58f0 con 0x7f84e40a88e0 2023-12-04T05:39:43.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e8f52640 1 -- 172.21.15.97:0/2939615543 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc0a5a50 con 0x7f84e40a88e0 2023-12-04T05:39:43.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e8f52640 1 -- 172.21.15.97:0/2939615543 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0a5de0 con 0x7f84e40a88e0 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 msgr2=0x7f84e4152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4152ba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009d90 tx=0x7f84dc01c830 comp rx=0 tx=0).stop 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2939615543 shutdown_connections 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4152ba0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2939615543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e40a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2939615543 >> 172.21.15.97:0/2939615543 conn(0x7f84e40c2970 msgr2=0x7f84e40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2939615543 shutdown_connections 2023-12-04T05:39:43.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2939615543 wait complete. 2023-12-04T05:39:43.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 Processor -- start 2023-12-04T05:39:43.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- start start 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e4140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414a870 con 0x7f84e40a8460 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e41411d0 con 0x7f84e40a88e0 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84ec1b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40c5be0 con 0x7f84e414fbb0 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e9f54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e9f54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38602/0 (socket says 172.21.15.97:38602) 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.336+0000 7f84e9f54640 1 -- 172.21.15.97:0/2499590916 learned_addr learned my addr 172.21.15.97:0/2499590916 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9753640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84ea755640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e4140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 -- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 msgr2=0x7f84e4140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e4140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 -- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 msgr2=0x7f84e4140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 -- 172.21.15.97:0/2499590916 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc009a70 con 0x7f84e40a8460 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84e9f54640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f84e000e960 tx=0x7f84e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0009690 con 0x7f84e40a8460 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000ca00 con 0x7f84e40a8460 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e41ee990 con 0x7f84e40a8460 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000cd70 con 0x7f84e40a8460 2023-12-04T05:39:43.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e414aac0 con 0x7f84e40a8460 2023-12-04T05:39:43.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4068440 con 0x7f84e40a8460 2023-12-04T05:39:43.347 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.340+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84e0013470 con 0x7f84e40a8460 2023-12-04T05:39:43.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.344+0000 7f84da7fc640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 0x7f84c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.344+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f84e0084930 con 0x7f84e40a8460 2023-12-04T05:39:43.348 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.344+0000 7f84e9753640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 0x7f84c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.349 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.344+0000 7f84e9753640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 0x7f84c8068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ab5f0 tx=0x7f84d4007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.352 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.348+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84e00518b0 con 0x7f84e40a8460 2023-12-04T05:39:43.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84e4156930 con 0x7f84e40a8460 2023-12-04T05:39:43.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84da7fc640 1 -- 172.21.15.97:0/2499590916 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f84e0054ed0 con 0x7f84e40a8460 2023-12-04T05:39:43.534 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:43.534 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:39:43.534 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 53 2023-12-04T05:39:43.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 msgr2=0x7f84c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 0x7f84c8068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ab5f0 tx=0x7f84d4007d40 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 msgr2=0x7f84e41ee140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f84e000e960 tx=0x7f84e000ee20 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 shutdown_connections 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f84c80668d0 0x7f84c8068d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f84e414fbb0 0x7f84e4140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f84e40a88e0 0x7f84e4140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 --2- 172.21.15.97:0/2499590916 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f84e40a8460 0x7f84e41ee140 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 >> 172.21.15.97:0/2499590916 conn(0x7f84e40c2970 msgr2=0x7f84e415c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 shutdown_connections 2023-12-04T05:39:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.528+0000 7f84ec1b8640 1 -- 172.21.15.97:0/2499590916 wait complete. 2023-12-04T05:39:43.555 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:43.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 Processor -- start 2023-12-04T05:39:43.692 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 -- start start 2023-12-04T05:39:43.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3094151bf0 0x7f30940abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f309415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30941547d0 con 0x7f30940c7ef0 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3094158b80 con 0x7f3094151bf0 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309906b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30940c4aa0 con 0x7f3094155370 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3094151bf0 0x7f30940abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309259c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f30940c7ef0 0x7f3094154c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49820/0 (socket says 172.21.15.97:49820) 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309259c640 1 -- 172.21.15.97:0/4044277205 learned_addr learned my addr 172.21.15.97:0/4044277205 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3094151bf0 0x7f30940abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38616/0 (socket says 172.21.15.97:38616) 2023-12-04T05:39:43.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f309359e640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f309415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 -- 172.21.15.97:0/4044277205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 msgr2=0x7f309415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f309415efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 -- 172.21.15.97:0/4044277205 >> v1:172.21.15.97:6789/0 conn(0x7f30940c7ef0 legacy=0x7f3094154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3092d9d640 1 -- 172.21.15.97:0/4044277205 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940c4d40 con 0x7f3094151bf0 2023-12-04T05:39:43.695 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.688+0000 7f3091d9b640 1 -- 172.21.15.97:0/4044277205 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62181348 0 0) 0x7f30941547d0 con 0x7f30940c7ef0 2023-12-04T05:39:43.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f3092d9d640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3094151bf0 0x7f30940abbb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f30840097c0 tx=0x7f308401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37941c515b4ea05e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f3091d9b640 1 -- 172.21.15.97:0/4044277205 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840a4880 con 0x7f3094151bf0 2023-12-04T05:39:43.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f3091d9b640 1 -- 172.21.15.97:0/4044277205 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30840a49e0 con 0x7f3094151bf0 2023-12-04T05:39:43.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f3091d9b640 1 -- 172.21.15.97:0/4044277205 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840a4d70 con 0x7f3094151bf0 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 -- 172.21.15.97:0/4044277205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3094151bf0 msgr2=0x7f30940abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3094151bf0 0x7f30940abbb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f30840097c0 tx=0x7f308401c040 comp rx=0 tx=0).stop 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 -- 172.21.15.97:0/4044277205 shutdown_connections 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f309415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 --2- 172.21.15.97:0/4044277205 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3094151bf0 0x7f30940abbb0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 -- 172.21.15.97:0/4044277205 >> 172.21.15.97:0/4044277205 conn(0x7f3094073550 msgr2=0x7f3094073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:43.698 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 -- 172.21.15.97:0/4044277205 shutdown_connections 2023-12-04T05:39:43.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 -- 172.21.15.97:0/4044277205 wait complete. 2023-12-04T05:39:43.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.692+0000 7f309906b640 1 Processor -- start 2023-12-04T05:39:43.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- start start 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 0x7f3094146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f3094146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30941f2030 con 0x7f30940c7ef0 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30941f1ba0 con 0x7f3094151bf0 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30941f1270 con 0x7f3094155370 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.702 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38620/0 (socket says 172.21.15.97:38620) 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 -- 172.21.15.97:0/230829819 learned_addr learned my addr 172.21.15.97:0/230829819 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309259c640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 0x7f3094146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 -- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 msgr2=0x7f3094146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309359e640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f3094146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f3094146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 -- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 msgr2=0x7f3094146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 0x7f3094146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 -- 172.21.15.97:0/230829819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084009420 con 0x7f30940c7ef0 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309259c640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 0x7f3094146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309359e640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f3094146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:43.703 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f3092d9d640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3084019e80 tx=0x7f3084019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840ac700 con 0x7f30940c7ef0 2023-12-04T05:39:43.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30840ac880 con 0x7f30940c7ef0 2023-12-04T05:39:43.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30840acc30 con 0x7f30940c7ef0 2023-12-04T05:39:43.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30941f1550 con 0x7f30940c7ef0 2023-12-04T05:39:43.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30940ca470 con 0x7f30940c7ef0 2023-12-04T05:39:43.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.696+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30941f13b0 con 0x7f30940c7ef0 2023-12-04T05:39:43.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.700+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30840b3040 con 0x7f30940c7ef0 2023-12-04T05:39:43.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.700+0000 7f307b7fe640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:43.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.700+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f308411de00 con 0x7f30940c7ef0 2023-12-04T05:39:43.705 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.700+0000 7f309259c640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:43.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.700+0000 7f309259c640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3088007fd0 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:43.709 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.704+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30941f13b0 con 0x7f30940c7ef0 2023-12-04T05:39:43.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.852+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30941f13b0 con 0x7f30940c7ef0 2023-12-04T05:39:43.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f307b7fe640 1 -- 172.21.15.97:0/230829819 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f30941f13b0 con 0x7f30940c7ef0 2023-12-04T05:39:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:43.910 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 msgr2=0x7f3080068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3088007fd0 tx=0x7f3088009040 comp rx=0 tx=0).stop 2023-12-04T05:39:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 msgr2=0x7f30940c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3084019e80 tx=0x7f3084019100 comp rx=0 tx=0).stop 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 shutdown_connections 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3094155370 0x7f3094146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3094151bf0 0x7f3094146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 --2- 172.21.15.97:0/230829819 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f30940c7ef0 0x7f30940c9f30 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 >> 172.21.15.97:0/230829819 conn(0x7f3094073550 msgr2=0x7f3094154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 shutdown_connections 2023-12-04T05:39:43.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:43.856+0000 7f309906b640 1 -- 172.21.15.97:0/230829819 wait complete. 2023-12-04T05:39:43.914 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T05:39:43.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:39:44.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.044+0000 7fca34f2a640 1 Processor -- start 2023-12-04T05:39:44.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.044+0000 7fca34f2a640 1 -- start start 2023-12-04T05:39:44.052 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca34f2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca300a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca34f2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca30152490 0x7fca30152900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca34f2a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300a9770 con 0x7fca3014fbb0 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca34f2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3014ff90 con 0x7fca30152490 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca34f2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca30071730 con 0x7fca300a8460 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2e59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fca3014fbb0 0x7fca300a8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:49834/0 (socket says 172.21.15.97:49834) 2023-12-04T05:39:44.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2e59c640 1 -- 172.21.15.97:0/1059882662 learned_addr learned my addr 172.21.15.97:0/1059882662 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/1059882662 >> v2:172.21.15.143:3300/0 conn(0x7fca30152490 0x7fca30152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2dd9b640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca300a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057437278 0 0) 0x7fca300a9770 con 0x7fca3014fbb0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca18003530 con 0x7fca3014fbb0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 452714353 0 0) 0x7fca18003530 con 0x7fca3014fbb0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 msgr2=0x7fca300a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca300a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 >> v2:172.21.15.143:3300/0 conn(0x7fca30152490 msgr2=0x7fca30152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 --2- 172.21.15.97:0/1059882662 >> v2:172.21.15.143:3300/0 conn(0x7fca30152490 0x7fca30152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30071a10 con 0x7fca3014fbb0 2023-12-04T05:39:44.055 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fca20001680 con 0x7fca3014fbb0 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 >> v1:172.21.15.97:6789/0 conn(0x7fca3014fbb0 legacy=0x7fca300a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18003980 0x7fca18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca18004d10 0x7fca18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014ff90 con 0x7fca18004d10 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca30071730 con 0x7fca18003980 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800ba10 con 0x7fca300a8460 2023-12-04T05:39:44.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca18004d10 0x7fca18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2dd9b640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2e59c640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18003980 0x7fca18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 -- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 msgr2=0x7fca180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca300a8460 0x7fca180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 -- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18003980 msgr2=0x7fca18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18003980 0x7fca18003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.048+0000 7fca2ed9d640 1 -- 172.21.15.97:0/1059882662 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18003530 con 0x7fca18004d10 2023-12-04T05:39:44.058 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca18004d10 0x7fca18005190 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fc0 tx=0x7fca2801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747872814d6b1da6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280a5c60 con 0x7fca18004d10 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800f040 con 0x7fca18004d10 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca2d59a640 1 -- 172.21.15.97:0/1059882662 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280ad440 con 0x7fca18004d10 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 -- 172.21.15.97:0/1059882662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca18004d10 msgr2=0x7fca18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 --2- 172.21.15.97:0/1059882662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca18004d10 0x7fca18005190 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fc0 tx=0x7fca2801cc70 comp rx=0 tx=0).stop 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca2ed9d640 1 -- 172.21.15.97:0/1059882662 reap_dead start 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 -- 172.21.15.97:0/1059882662 shutdown_connections 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 -- 172.21.15.97:0/1059882662 >> 172.21.15.97:0/1059882662 conn(0x7fca300c2970 msgr2=0x7fca300c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 -- 172.21.15.97:0/1059882662 shutdown_connections 2023-12-04T05:39:44.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.052+0000 7fca34f2a640 1 -- 172.21.15.97:0/1059882662 wait complete. 2023-12-04T05:39:44.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 Processor -- start 2023-12-04T05:39:44.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- start start 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18004d10 0x7fca30142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 0x7fca301ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014e130 con 0x7fca301518b0 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301430b0 con 0x7fca18004d10 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014f2b0 con 0x7fca301ecb20 2023-12-04T05:39:44.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38648/0 (socket says 172.21.15.97:38648) 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 -- 172.21.15.97:0/764621392 learned_addr learned my addr 172.21.15.97:0/764621392 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2e59c640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18004d10 0x7fca30142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 0x7fca301ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 -- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 msgr2=0x7fca301ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 0x7fca301ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 -- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18004d10 msgr2=0x7fca30142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18004d10 0x7fca30142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 -- 172.21.15.97:0/764621392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3014d790 con 0x7fca301518b0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2ed9d640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 0x7fca301ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca2dd9b640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fca240119d0 tx=0x7fca24011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400fb50 con 0x7fca301518b0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400fcb0 con 0x7fca301518b0 2023-12-04T05:39:44.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24014440 con 0x7fca301518b0 2023-12-04T05:39:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3014da70 con 0x7fca301518b0 2023-12-04T05:39:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3014be00 con 0x7fca301518b0 2023-12-04T05:39:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.056+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3014e270 con 0x7fca301518b0 2023-12-04T05:39:44.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.060+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fca240145a0 con 0x7fca301518b0 2023-12-04T05:39:44.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.060+0000 7fca1effd640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 0x7fca10068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.060+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca24084ff0 con 0x7fca301518b0 2023-12-04T05:39:44.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.060+0000 7fca2e59c640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 0x7fca10068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.060+0000 7fca2e59c640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 0x7fca10068dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fca20000c10 tx=0x7fca20007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.064+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca3014e270 con 0x7fca301518b0 2023-12-04T05:39:44.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.212+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca30071130 con 0x7fca10066900 2023-12-04T05:39:44.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.224+0000 7fca1effd640 1 -- 172.21.15.97:0/764621392 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+515990 (secure 0 0 0) 0x7fca20007cc0 con 0x7fca10066900 2023-12-04T05:39:44.235 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:44.239 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:39:44.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 msgr2=0x7fca10068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 0x7fca10068dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fca20000c10 tx=0x7fca20007900 comp rx=0 tx=0).stop 2023-12-04T05:39:44.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 msgr2=0x7fca30151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fca240119d0 tx=0x7fca24011e90 comp rx=0 tx=0).stop 2023-12-04T05:39:44.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 shutdown_connections 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fca10066900 0x7fca10068dc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca301ecb20 0x7fca301ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fca301518b0 0x7fca30151d30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 --2- 172.21.15.97:0/764621392 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca18004d10 0x7fca30142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 >> 172.21.15.97:0/764621392 conn(0x7fca300c2970 msgr2=0x7fca300c1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 shutdown_connections 2023-12-04T05:39:44.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.228+0000 7fca34f2a640 1 -- 172.21.15.97:0/764621392 wait complete. 2023-12-04T05:39:44.257 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-12-04T05:39:42.226855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244740,"kb_used_data":7764,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729980,"statfs":{"total":773094113280,"available":772843499520,"internally_reserved":0,"allocated":7950336,"data_stored":4111401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1495,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.087205"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235483+0000","last_change":"2023-12-04T05:39:27.075692+0000","last_active":"2023-12-04T05:39:28.235483+0000","last_peered":"2023-12-04T05:39:28.235483+0000","last_clean":"2023-12-04T05:39:28.235483+0000","last_became_active":"2023-12-04T05:39:27.075338+0000","last_became_peered":"2023-12-04T05:39:27.075338+0000","last_unstale":"2023-12-04T05:39:28.235483+0000","last_undegraded":"2023-12-04T05:39:28.235483+0000","last_fullsized":"2023-12-04T05:39:28.235483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890252+0000","last_change":"2023-12-04T05:39:27.076323+0000","last_active":"2023-12-04T05:39:28.890252+0000","last_peered":"2023-12-04T05:39:28.890252+0000","last_clean":"2023-12-04T05:39:28.890252+0000","last_became_active":"2023-12-04T05:39:27.075952+0000","last_became_peered":"2023-12-04T05:39:27.075952+0000","last_unstale":"2023-12-04T05:39:28.890252+0000","last_undegraded":"2023-12-04T05:39:28.890252+0000","last_fullsized":"2023-12-04T05:39:28.890252+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:01.666984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888475+0000","last_change":"2023-12-04T05:39:27.088405+0000","last_active":"2023-12-04T05:39:28.888475+0000","last_peered":"2023-12-04T05:39:28.888475+0000","last_clean":"2023-12-04T05:39:28.888475+0000","last_became_active":"2023-12-04T05:39:27.088123+0000","last_became_peered":"2023-12-04T05:39:27.088123+0000","last_unstale":"2023-12-04T05:39:28.888475+0000","last_undegraded":"2023-12-04T05:39:28.888475+0000","last_fullsized":"2023-12-04T05:39:28.888475+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234943+0000","last_change":"2023-12-04T05:39:27.091201+0000","last_active":"2023-12-04T05:39:28.234943+0000","last_peered":"2023-12-04T05:39:28.234943+0000","last_clean":"2023-12-04T05:39:28.234943+0000","last_became_active":"2023-12-04T05:39:27.090589+0000","last_became_peered":"2023-12-04T05:39:27.090589+0000","last_unstale":"2023-12-04T05:39:28.234943+0000","last_undegraded":"2023-12-04T05:39:28.234943+0000","last_fullsized":"2023-12-04T05:39:28.234943+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:28:23.983451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235366+0000","last_change":"2023-12-04T05:39:27.078406+0000","last_active":"2023-12-04T05:39:28.235366+0000","last_peered":"2023-12-04T05:39:28.235366+0000","last_clean":"2023-12-04T05:39:28.235366+0000","last_became_active":"2023-12-04T05:39:27.078131+0000","last_became_peered":"2023-12-04T05:39:27.078131+0000","last_unstale":"2023-12-04T05:39:28.235366+0000","last_undegraded":"2023-12-04T05:39:28.235366+0000","last_fullsized":"2023-12-04T05:39:28.235366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888393+0000","last_change":"2023-12-04T05:39:27.100515+0000","last_active":"2023-12-04T05:39:28.888393+0000","last_peered":"2023-12-04T05:39:28.888393+0000","last_clean":"2023-12-04T05:39:28.888393+0000","last_became_active":"2023-12-04T05:39:27.100182+0000","last_became_peered":"2023-12-04T05:39:27.100182+0000","last_unstale":"2023-12-04T05:39:28.888393+0000","last_undegraded":"2023-12-04T05:39:28.888393+0000","last_fullsized":"2023-12-04T05:39:28.888393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234849+0000","last_change":"2023-12-04T05:39:27.088212+0000","last_active":"2023-12-04T05:39:28.234849+0000","last_peered":"2023-12-04T05:39:28.234849+0000","last_clean":"2023-12-04T05:39:28.234849+0000","last_became_active":"2023-12-04T05:39:27.087929+0000","last_became_peered":"2023-12-04T05:39:27.087929+0000","last_unstale":"2023-12-04T05:39:28.234849+0000","last_undegraded":"2023-12-04T05:39:28.234849+0000","last_fullsized":"2023-12-04T05:39:28.234849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:40:35.762126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887865+0000","last_change":"2023-12-04T05:39:27.089681+0000","last_active":"2023-12-04T05:39:28.887865+0000","last_peered":"2023-12-04T05:39:28.887865+0000","last_clean":"2023-12-04T05:39:28.887865+0000","last_became_active":"2023-12-04T05:39:27.089288+0000","last_became_peered":"2023-12-04T05:39:27.089288+0000","last_unstale":"2023-12-04T05:39:28.887865+0000","last_undegraded":"2023-12-04T05:39:28.887865+0000","last_fullsized":"2023-12-04T05:39:28.887865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888821+0000","last_change":"2023-12-04T05:39:27.083541+0000","last_active":"2023-12-04T05:39:28.888821+0000","last_peered":"2023-12-04T05:39:28.888821+0000","last_clean":"2023-12-04T05:39:28.888821+0000","last_became_active":"2023-12-04T05:39:27.083207+0000","last_became_peered":"2023-12-04T05:39:27.083207+0000","last_unstale":"2023-12-04T05:39:28.888821+0000","last_undegraded":"2023-12-04T05:39:28.888821+0000","last_fullsized":"2023-12-04T05:39:28.888821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235451+0000","last_change":"2023-12-04T05:39:27.097340+0000","last_active":"2023-12-04T05:39:28.235451+0000","last_peered":"2023-12-04T05:39:28.235451+0000","last_clean":"2023-12-04T05:39:28.235451+0000","last_became_active":"2023-12-04T05:39:27.096699+0000","last_became_peered":"2023-12-04T05:39:27.096699+0000","last_unstale":"2023-12-04T05:39:28.235451+0000","last_undegraded":"2023-12-04T05:39:28.235451+0000","last_fullsized":"2023-12-04T05:39:28.235451+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890244+0000","last_change":"2023-12-04T05:39:27.087492+0000","last_active":"2023-12-04T05:39:28.890244+0000","last_peered":"2023-12-04T05:39:28.890244+0000","last_clean":"2023-12-04T05:39:28.890244+0000","last_became_active":"2023-12-04T05:39:27.087207+0000","last_became_peered":"2023-12-04T05:39:27.087207+0000","last_unstale":"2023-12-04T05:39:28.890244+0000","last_undegraded":"2023-12-04T05:39:28.890244+0000","last_fullsized":"2023-12-04T05:39:28.890244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:45:15.043031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235333+0000","last_change":"2023-12-04T05:39:27.088572+0000","last_active":"2023-12-04T05:39:28.235333+0000","last_peered":"2023-12-04T05:39:28.235333+0000","last_clean":"2023-12-04T05:39:28.235333+0000","last_became_active":"2023-12-04T05:39:27.088269+0000","last_became_peered":"2023-12-04T05:39:27.088269+0000","last_unstale":"2023-12-04T05:39:28.235333+0000","last_undegraded":"2023-12-04T05:39:28.235333+0000","last_fullsized":"2023-12-04T05:39:28.235333+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888395+0000","last_change":"2023-12-04T05:39:27.088085+0000","last_active":"2023-12-04T05:39:28.888395+0000","last_peered":"2023-12-04T05:39:28.888395+0000","last_clean":"2023-12-04T05:39:28.888395+0000","last_became_active":"2023-12-04T05:39:27.087726+0000","last_became_peered":"2023-12-04T05:39:27.087726+0000","last_unstale":"2023-12-04T05:39:28.888395+0000","last_undegraded":"2023-12-04T05:39:28.888395+0000","last_fullsized":"2023-12-04T05:39:28.888395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234878+0000","last_change":"2023-12-04T05:39:27.100050+0000","last_active":"2023-12-04T05:39:28.234878+0000","last_peered":"2023-12-04T05:39:28.234878+0000","last_clean":"2023-12-04T05:39:28.234878+0000","last_became_active":"2023-12-04T05:39:27.099704+0000","last_became_peered":"2023-12-04T05:39:27.099704+0000","last_unstale":"2023-12-04T05:39:28.234878+0000","last_undegraded":"2023-12-04T05:39:28.234878+0000","last_fullsized":"2023-12-04T05:39:28.234878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:26.128910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888287+0000","last_change":"2023-12-04T05:39:27.096514+0000","last_active":"2023-12-04T05:39:28.888287+0000","last_peered":"2023-12-04T05:39:28.888287+0000","last_clean":"2023-12-04T05:39:28.888287+0000","last_became_active":"2023-12-04T05:39:27.096198+0000","last_became_peered":"2023-12-04T05:39:27.096198+0000","last_unstale":"2023-12-04T05:39:28.888287+0000","last_undegraded":"2023-12-04T05:39:28.888287+0000","last_fullsized":"2023-12-04T05:39:28.888287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:19:40.462636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235271+0000","last_change":"2023-12-04T05:39:27.076053+0000","last_active":"2023-12-04T05:39:28.235271+0000","last_peered":"2023-12-04T05:39:28.235271+0000","last_clean":"2023-12-04T05:39:28.235271+0000","last_became_active":"2023-12-04T05:39:27.075664+0000","last_became_peered":"2023-12-04T05:39:27.075664+0000","last_unstale":"2023-12-04T05:39:28.235271+0000","last_undegraded":"2023-12-04T05:39:28.235271+0000","last_fullsized":"2023-12-04T05:39:28.235271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235538+0000","last_change":"2023-12-04T05:39:27.102230+0000","last_active":"2023-12-04T05:39:28.235538+0000","last_peered":"2023-12-04T05:39:28.235538+0000","last_clean":"2023-12-04T05:39:28.235538+0000","last_became_active":"2023-12-04T05:39:27.101891+0000","last_became_peered":"2023-12-04T05:39:27.101891+0000","last_unstale":"2023-12-04T05:39:28.235538+0000","last_undegraded":"2023-12-04T05:39:28.235538+0000","last_fullsized":"2023-12-04T05:39:28.235538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234977+0000","last_change":"2023-12-04T05:39:27.091794+0000","last_active":"2023-12-04T05:39:28.234977+0000","last_peered":"2023-12-04T05:39:28.234977+0000","last_clean":"2023-12-04T05:39:28.234977+0000","last_became_active":"2023-12-04T05:39:27.091435+0000","last_became_peered":"2023-12-04T05:39:27.091435+0000","last_unstale":"2023-12-04T05:39:28.234977+0000","last_undegraded":"2023-12-04T05:39:28.234977+0000","last_fullsized":"2023-12-04T05:39:28.234977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888881+0000","last_change":"2023-12-04T05:39:27.094081+0000","last_active":"2023-12-04T05:39:28.888881+0000","last_peered":"2023-12-04T05:39:28.888881+0000","last_clean":"2023-12-04T05:39:28.888881+0000","last_became_active":"2023-12-04T05:39:27.093805+0000","last_became_peered":"2023-12-04T05:39:27.093805+0000","last_unstale":"2023-12-04T05:39:28.888881+0000","last_undegraded":"2023-12-04T05:39:28.888881+0000","last_fullsized":"2023-12-04T05:39:28.888881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234959+0000","last_change":"2023-12-04T05:39:27.090956+0000","last_active":"2023-12-04T05:39:28.234959+0000","last_peered":"2023-12-04T05:39:28.234959+0000","last_clean":"2023-12-04T05:39:28.234959+0000","last_became_active":"2023-12-04T05:39:27.090277+0000","last_became_peered":"2023-12-04T05:39:27.090277+0000","last_unstale":"2023-12-04T05:39:28.234959+0000","last_undegraded":"2023-12-04T05:39:28.234959+0000","last_fullsized":"2023-12-04T05:39:28.234959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:04.080470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234925+0000","last_change":"2023-12-04T05:39:27.094421+0000","last_active":"2023-12-04T05:39:28.234925+0000","last_peered":"2023-12-04T05:39:28.234925+0000","last_clean":"2023-12-04T05:39:28.234925+0000","last_became_active":"2023-12-04T05:39:27.094055+0000","last_became_peered":"2023-12-04T05:39:27.094055+0000","last_unstale":"2023-12-04T05:39:28.234925+0000","last_undegraded":"2023-12-04T05:39:28.234925+0000","last_fullsized":"2023-12-04T05:39:28.234925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:39:31.395233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889950+0000","last_change":"2023-12-04T05:39:27.078833+0000","last_active":"2023-12-04T05:39:28.889950+0000","last_peered":"2023-12-04T05:39:28.889950+0000","last_clean":"2023-12-04T05:39:28.889950+0000","last_became_active":"2023-12-04T05:39:27.078478+0000","last_became_peered":"2023-12-04T05:39:27.078478+0000","last_unstale":"2023-12-04T05:39:28.889950+0000","last_undegraded":"2023-12-04T05:39:28.889950+0000","last_fullsized":"2023-12-04T05:39:28.889950+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:58.277677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235281+0000","last_change":"2023-12-04T05:39:27.082161+0000","last_active":"2023-12-04T05:39:28.235281+0000","last_peered":"2023-12-04T05:39:28.235281+0000","last_clean":"2023-12-04T05:39:28.235281+0000","last_became_active":"2023-12-04T05:39:27.081890+0000","last_became_peered":"2023-12-04T05:39:27.081890+0000","last_unstale":"2023-12-04T05:39:28.235281+0000","last_undegraded":"2023-12-04T05:39:28.235281+0000","last_fullsized":"2023-12-04T05:39:28.235281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234823+0000","last_change":"2023-12-04T05:39:27.099452+0000","last_active":"2023-12-04T05:39:28.234823+0000","last_peered":"2023-12-04T05:39:28.234823+0000","last_clean":"2023-12-04T05:39:28.234823+0000","last_became_active":"2023-12-04T05:39:27.099205+0000","last_became_peered":"2023-12-04T05:39:27.099205+0000","last_unstale":"2023-12-04T05:39:28.234823+0000","last_undegraded":"2023-12-04T05:39:28.234823+0000","last_fullsized":"2023-12-04T05:39:28.234823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:55:30.871506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890182+0000","last_change":"2023-12-04T05:39:27.077164+0000","last_active":"2023-12-04T05:39:28.890182+0000","last_peered":"2023-12-04T05:39:28.890182+0000","last_clean":"2023-12-04T05:39:28.890182+0000","last_became_active":"2023-12-04T05:39:27.076536+0000","last_became_peered":"2023-12-04T05:39:27.076536+0000","last_unstale":"2023-12-04T05:39:28.890182+0000","last_undegraded":"2023-12-04T05:39:28.890182+0000","last_fullsized":"2023-12-04T05:39:28.890182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:40.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888436+0000","last_change":"2023-12-04T05:39:27.082797+0000","last_active":"2023-12-04T05:39:28.888436+0000","last_peered":"2023-12-04T05:39:28.888436+0000","last_clean":"2023-12-04T05:39:28.888436+0000","last_became_active":"2023-12-04T05:39:27.081419+0000","last_became_peered":"2023-12-04T05:39:27.081419+0000","last_unstale":"2023-12-04T05:39:28.888436+0000","last_undegraded":"2023-12-04T05:39:28.888436+0000","last_fullsized":"2023-12-04T05:39:28.888436+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235415+0000","last_change":"2023-12-04T05:39:27.092222+0000","last_active":"2023-12-04T05:39:28.235415+0000","last_peered":"2023-12-04T05:39:28.235415+0000","last_clean":"2023-12-04T05:39:28.235415+0000","last_became_active":"2023-12-04T05:39:27.091888+0000","last_became_peered":"2023-12-04T05:39:27.091888+0000","last_unstale":"2023-12-04T05:39:28.235415+0000","last_undegraded":"2023-12-04T05:39:28.235415+0000","last_fullsized":"2023-12-04T05:39:28.235415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235350+0000","last_change":"2023-12-04T05:39:27.083638+0000","last_active":"2023-12-04T05:39:28.235350+0000","last_peered":"2023-12-04T05:39:28.235350+0000","last_clean":"2023-12-04T05:39:28.235350+0000","last_became_active":"2023-12-04T05:39:27.083278+0000","last_became_peered":"2023-12-04T05:39:27.083278+0000","last_unstale":"2023-12-04T05:39:28.235350+0000","last_undegraded":"2023-12-04T05:39:28.235350+0000","last_fullsized":"2023-12-04T05:39:28.235350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889944+0000","last_change":"2023-12-04T05:39:27.089048+0000","last_active":"2023-12-04T05:39:28.889944+0000","last_peered":"2023-12-04T05:39:28.889944+0000","last_clean":"2023-12-04T05:39:28.889944+0000","last_became_active":"2023-12-04T05:39:27.088751+0000","last_became_peered":"2023-12-04T05:39:27.088751+0000","last_unstale":"2023-12-04T05:39:28.889944+0000","last_undegraded":"2023-12-04T05:39:28.889944+0000","last_fullsized":"2023-12-04T05:39:28.889944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:52.895380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890170+0000","last_change":"2023-12-04T05:39:27.103464+0000","last_active":"2023-12-04T05:39:28.890170+0000","last_peered":"2023-12-04T05:39:28.890170+0000","last_clean":"2023-12-04T05:39:28.890170+0000","last_became_active":"2023-12-04T05:39:27.102812+0000","last_became_peered":"2023-12-04T05:39:27.102812+0000","last_unstale":"2023-12-04T05:39:28.890170+0000","last_undegraded":"2023-12-04T05:39:28.890170+0000","last_fullsized":"2023-12-04T05:39:28.890170+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:58:05.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235309+0000","last_change":"2023-12-04T05:39:27.077619+0000","last_active":"2023-12-04T05:39:28.235309+0000","last_peered":"2023-12-04T05:39:28.235309+0000","last_clean":"2023-12-04T05:39:28.235309+0000","last_became_active":"2023-12-04T05:39:27.077334+0000","last_became_peered":"2023-12-04T05:39:27.077334+0000","last_unstale":"2023-12-04T05:39:28.235309+0000","last_undegraded":"2023-12-04T05:39:28.235309+0000","last_fullsized":"2023-12-04T05:39:28.235309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235257+0000","last_change":"2023-12-04T05:39:27.078402+0000","last_active":"2023-12-04T05:39:28.235257+0000","last_peered":"2023-12-04T05:39:28.235257+0000","last_clean":"2023-12-04T05:39:28.235257+0000","last_became_active":"2023-12-04T05:39:27.078138+0000","last_became_peered":"2023-12-04T05:39:27.078138+0000","last_unstale":"2023-12-04T05:39:28.235257+0000","last_undegraded":"2023-12-04T05:39:28.235257+0000","last_fullsized":"2023-12-04T05:39:28.235257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.147101+0000","last_change":"2023-12-04T05:39:38.147101+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.147101+0000","last_undegraded":"2023-12-04T05:39:38.147101+0000","last_fullsized":"2023-12-04T05:39:38.147101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235485+0000","last_change":"2023-12-04T05:39:27.075620+0000","last_active":"2023-12-04T05:39:28.235485+0000","last_peered":"2023-12-04T05:39:28.235485+0000","last_clean":"2023-12-04T05:39:28.235485+0000","last_became_active":"2023-12-04T05:39:27.075284+0000","last_became_peered":"2023-12-04T05:39:27.075284+0000","last_unstale":"2023-12-04T05:39:28.235485+0000","last_undegraded":"2023-12-04T05:39:28.235485+0000","last_fullsized":"2023-12-04T05:39:28.235485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235534+0000","last_change":"2023-12-04T05:39:26.076976+0000","last_active":"2023-12-04T05:39:28.235534+0000","last_peered":"2023-12-04T05:39:28.235534+0000","last_clean":"2023-12-04T05:39:28.235534+0000","last_became_active":"2023-12-04T05:39:26.076581+0000","last_became_peered":"2023-12-04T05:39:26.076581+0000","last_unstale":"2023-12-04T05:39:28.235534+0000","last_undegraded":"2023-12-04T05:39:28.235534+0000","last_fullsized":"2023-12-04T05:39:28.235534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.146329+0000","last_change":"2023-12-04T05:39:38.146329+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.146329+0000","last_undegraded":"2023-12-04T05:39:38.146329+0000","last_fullsized":"2023-12-04T05:39:38.146329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235499+0000","last_change":"2023-12-04T05:39:27.083622+0000","last_active":"2023-12-04T05:39:28.235499+0000","last_peered":"2023-12-04T05:39:28.235499+0000","last_clean":"2023-12-04T05:39:28.235499+0000","last_became_active":"2023-12-04T05:39:27.083307+0000","last_became_peered":"2023-12-04T05:39:27.083307+0000","last_unstale":"2023-12-04T05:39:28.235499+0000","last_undegraded":"2023-12-04T05:39:28.235499+0000","last_fullsized":"2023-12-04T05:39:28.235499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235519+0000","last_change":"2023-12-04T05:39:26.078897+0000","last_active":"2023-12-04T05:39:28.235519+0000","last_peered":"2023-12-04T05:39:28.235519+0000","last_clean":"2023-12-04T05:39:28.235519+0000","last_became_active":"2023-12-04T05:39:26.078018+0000","last_became_peered":"2023-12-04T05:39:26.078018+0000","last_unstale":"2023-12-04T05:39:28.235519+0000","last_undegraded":"2023-12-04T05:39:28.235519+0000","last_fullsized":"2023-12-04T05:39:28.235519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.148134+0000","last_change":"2023-12-04T05:39:38.148134+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.148134+0000","last_undegraded":"2023-12-04T05:39:38.148134+0000","last_fullsized":"2023-12-04T05:39:38.148134+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235366+0000","last_change":"2023-12-04T05:39:27.079603+0000","last_active":"2023-12-04T05:39:28.235366+0000","last_peered":"2023-12-04T05:39:28.235366+0000","last_clean":"2023-12-04T05:39:28.235366+0000","last_became_active":"2023-12-04T05:39:27.079350+0000","last_became_peered":"2023-12-04T05:39:27.079350+0000","last_unstale":"2023-12-04T05:39:28.235366+0000","last_undegraded":"2023-12-04T05:39:28.235366+0000","last_fullsized":"2023-12-04T05:39:28.235366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889000+0000","last_change":"2023-12-04T05:39:26.076007+0000","last_active":"2023-12-04T05:39:28.889000+0000","last_peered":"2023-12-04T05:39:28.889000+0000","last_clean":"2023-12-04T05:39:28.889000+0000","last_became_active":"2023-12-04T05:39:26.075733+0000","last_became_peered":"2023-12-04T05:39:26.075733+0000","last_unstale":"2023-12-04T05:39:28.889000+0000","last_undegraded":"2023-12-04T05:39:28.889000+0000","last_fullsized":"2023-12-04T05:39:28.889000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:05.655015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.148458+0000","last_change":"2023-12-04T05:39:38.148458+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.148458+0000","last_undegraded":"2023-12-04T05:39:38.148458+0000","last_fullsized":"2023-12-04T05:39:38.148458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888621+0000","last_change":"2023-12-04T05:39:27.105372+0000","last_active":"2023-12-04T05:39:28.888621+0000","last_peered":"2023-12-04T05:39:28.888621+0000","last_clean":"2023-12-04T05:39:28.888621+0000","last_became_active":"2023-12-04T05:39:27.105036+0000","last_became_peered":"2023-12-04T05:39:27.105036+0000","last_unstale":"2023-12-04T05:39:28.888621+0000","last_undegraded":"2023-12-04T05:39:28.888621+0000","last_fullsized":"2023-12-04T05:39:28.888621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888815+0000","last_change":"2023-12-04T05:39:26.077203+0000","last_active":"2023-12-04T05:39:28.888815+0000","last_peered":"2023-12-04T05:39:28.888815+0000","last_clean":"2023-12-04T05:39:28.888815+0000","last_became_active":"2023-12-04T05:39:26.076877+0000","last_became_peered":"2023-12-04T05:39:26.076877+0000","last_unstale":"2023-12-04T05:39:28.888815+0000","last_undegraded":"2023-12-04T05:39:28.888815+0000","last_fullsized":"2023-12-04T05:39:28.888815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:14.982034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.142407+0000","last_change":"2023-12-04T05:39:38.142407+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.142407+0000","last_undegraded":"2023-12-04T05:39:38.142407+0000","last_fullsized":"2023-12-04T05:39:38.142407+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890172+0000","last_change":"2023-12-04T05:39:27.103318+0000","last_active":"2023-12-04T05:39:28.890172+0000","last_peered":"2023-12-04T05:39:28.890172+0000","last_clean":"2023-12-04T05:39:28.890172+0000","last_became_active":"2023-12-04T05:39:27.102506+0000","last_became_peered":"2023-12-04T05:39:27.102506+0000","last_unstale":"2023-12-04T05:39:28.890172+0000","last_undegraded":"2023-12-04T05:39:28.890172+0000","last_fullsized":"2023-12-04T05:39:28.890172+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:10.220064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235397+0000","last_change":"2023-12-04T05:39:26.083745+0000","last_active":"2023-12-04T05:39:28.235397+0000","last_peered":"2023-12-04T05:39:28.235397+0000","last_clean":"2023-12-04T05:39:28.235397+0000","last_became_active":"2023-12-04T05:39:26.083470+0000","last_became_peered":"2023-12-04T05:39:26.083470+0000","last_unstale":"2023-12-04T05:39:28.235397+0000","last_undegraded":"2023-12-04T05:39:28.235397+0000","last_fullsized":"2023-12-04T05:39:28.235397+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.149018+0000","last_change":"2023-12-04T05:39:38.149018+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.149018+0000","last_undegraded":"2023-12-04T05:39:38.149018+0000","last_fullsized":"2023-12-04T05:39:38.149018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235381+0000","last_change":"2023-12-04T05:39:27.095704+0000","last_active":"2023-12-04T05:39:28.235381+0000","last_peered":"2023-12-04T05:39:28.235381+0000","last_clean":"2023-12-04T05:39:28.235381+0000","last_became_active":"2023-12-04T05:39:27.095453+0000","last_became_peered":"2023-12-04T05:39:27.095453+0000","last_unstale":"2023-12-04T05:39:28.235381+0000","last_undegraded":"2023-12-04T05:39:28.235381+0000","last_fullsized":"2023-12-04T05:39:28.235381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235331+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:28.235331+0000","last_peered":"2023-12-04T05:39:28.235331+0000","last_clean":"2023-12-04T05:39:28.235331+0000","last_became_active":"2023-12-04T05:39:26.082344+0000","last_became_peered":"2023-12-04T05:39:26.082344+0000","last_unstale":"2023-12-04T05:39:28.235331+0000","last_undegraded":"2023-12-04T05:39:28.235331+0000","last_fullsized":"2023-12-04T05:39:28.235331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:58.593571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.149458+0000","last_change":"2023-12-04T05:39:38.149458+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.149458+0000","last_undegraded":"2023-12-04T05:39:38.149458+0000","last_fullsized":"2023-12-04T05:39:38.149458+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887919+0000","last_change":"2023-12-04T05:39:27.083885+0000","last_active":"2023-12-04T05:39:28.887919+0000","last_peered":"2023-12-04T05:39:28.887919+0000","last_clean":"2023-12-04T05:39:28.887919+0000","last_became_active":"2023-12-04T05:39:27.083258+0000","last_became_peered":"2023-12-04T05:39:27.083258+0000","last_unstale":"2023-12-04T05:39:28.887919+0000","last_undegraded":"2023-12-04T05:39:28.887919+0000","last_fullsized":"2023-12-04T05:39:28.887919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888595+0000","last_change":"2023-12-04T05:39:26.079216+0000","last_active":"2023-12-04T05:39:28.888595+0000","last_peered":"2023-12-04T05:39:28.888595+0000","last_clean":"2023-12-04T05:39:28.888595+0000","last_became_active":"2023-12-04T05:39:26.078909+0000","last_became_peered":"2023-12-04T05:39:26.078909+0000","last_unstale":"2023-12-04T05:39:28.888595+0000","last_undegraded":"2023-12-04T05:39:28.888595+0000","last_fullsized":"2023-12-04T05:39:28.888595+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.145823+0000","last_change":"2023-12-04T05:39:38.145823+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.145823+0000","last_undegraded":"2023-12-04T05:39:38.145823+0000","last_fullsized":"2023-12-04T05:39:38.145823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888339+0000","last_change":"2023-12-04T05:39:27.088070+0000","last_active":"2023-12-04T05:39:28.888339+0000","last_peered":"2023-12-04T05:39:28.888339+0000","last_clean":"2023-12-04T05:39:28.888339+0000","last_became_active":"2023-12-04T05:39:27.087797+0000","last_became_peered":"2023-12-04T05:39:27.087797+0000","last_unstale":"2023-12-04T05:39:28.888339+0000","last_undegraded":"2023-12-04T05:39:28.888339+0000","last_fullsized":"2023-12-04T05:39:28.888339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:21:44.408868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889733+0000","last_change":"2023-12-04T05:39:26.081292+0000","last_active":"2023-12-04T05:39:28.889733+0000","last_peered":"2023-12-04T05:39:28.889733+0000","last_clean":"2023-12-04T05:39:28.889733+0000","last_became_active":"2023-12-04T05:39:26.080956+0000","last_became_peered":"2023-12-04T05:39:26.080956+0000","last_unstale":"2023-12-04T05:39:28.889733+0000","last_undegraded":"2023-12-04T05:39:28.889733+0000","last_fullsized":"2023-12-04T05:39:28.889733+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:59:30.549509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.148507+0000","last_change":"2023-12-04T05:39:38.148507+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.148507+0000","last_undegraded":"2023-12-04T05:39:38.148507+0000","last_fullsized":"2023-12-04T05:39:38.148507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888922+0000","last_change":"2023-12-04T05:39:27.086538+0000","last_active":"2023-12-04T05:39:28.888922+0000","last_peered":"2023-12-04T05:39:28.888922+0000","last_clean":"2023-12-04T05:39:28.888922+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:28.888922+0000","last_undegraded":"2023-12-04T05:39:28.888922+0000","last_fullsized":"2023-12-04T05:39:28.888922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:14.528915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235561+0000","last_change":"2023-12-04T05:39:26.079751+0000","last_active":"2023-12-04T05:39:28.235561+0000","last_peered":"2023-12-04T05:39:28.235561+0000","last_clean":"2023-12-04T05:39:28.235561+0000","last_became_active":"2023-12-04T05:39:26.079416+0000","last_became_peered":"2023-12-04T05:39:26.079416+0000","last_unstale":"2023-12-04T05:39:28.235561+0000","last_undegraded":"2023-12-04T05:39:28.235561+0000","last_fullsized":"2023-12-04T05:39:28.235561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:38.798222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.142487+0000","last_change":"2023-12-04T05:39:38.142487+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.142487+0000","last_undegraded":"2023-12-04T05:39:38.142487+0000","last_fullsized":"2023-12-04T05:39:38.142487+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888891+0000","last_change":"2023-12-04T05:39:27.100388+0000","last_active":"2023-12-04T05:39:28.888891+0000","last_peered":"2023-12-04T05:39:28.888891+0000","last_clean":"2023-12-04T05:39:28.888891+0000","last_became_active":"2023-12-04T05:39:27.100126+0000","last_became_peered":"2023-12-04T05:39:27.100126+0000","last_unstale":"2023-12-04T05:39:28.888891+0000","last_undegraded":"2023-12-04T05:39:28.888891+0000","last_fullsized":"2023-12-04T05:39:28.888891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235466+0000","last_change":"2023-12-04T05:39:26.076770+0000","last_active":"2023-12-04T05:39:28.235466+0000","last_peered":"2023-12-04T05:39:28.235466+0000","last_clean":"2023-12-04T05:39:28.235466+0000","last_became_active":"2023-12-04T05:39:26.076464+0000","last_became_peered":"2023-12-04T05:39:26.076464+0000","last_unstale":"2023-12-04T05:39:28.235466+0000","last_undegraded":"2023-12-04T05:39:28.235466+0000","last_fullsized":"2023-12-04T05:39:28.235466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.149992+0000","last_change":"2023-12-04T05:39:38.149992+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.149992+0000","last_undegraded":"2023-12-04T05:39:38.149992+0000","last_fullsized":"2023-12-04T05:39:38.149992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888710+0000","last_change":"2023-12-04T05:39:27.090003+0000","last_active":"2023-12-04T05:39:28.888710+0000","last_peered":"2023-12-04T05:39:28.888710+0000","last_clean":"2023-12-04T05:39:28.888710+0000","last_became_active":"2023-12-04T05:39:27.089648+0000","last_became_peered":"2023-12-04T05:39:27.089648+0000","last_unstale":"2023-12-04T05:39:28.888710+0000","last_undegraded":"2023-12-04T05:39:28.888710+0000","last_fullsized":"2023-12-04T05:39:28.888710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235416+0000","last_change":"2023-12-04T05:39:26.084259+0000","last_active":"2023-12-04T05:39:28.235416+0000","last_peered":"2023-12-04T05:39:28.235416+0000","last_clean":"2023-12-04T05:39:28.235416+0000","last_became_active":"2023-12-04T05:39:26.083846+0000","last_became_peered":"2023-12-04T05:39:26.083846+0000","last_unstale":"2023-12-04T05:39:28.235416+0000","last_undegraded":"2023-12-04T05:39:28.235416+0000","last_fullsized":"2023-12-04T05:39:28.235416+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:57.269372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.146221+0000","last_change":"2023-12-04T05:39:38.146221+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.146221+0000","last_undegraded":"2023-12-04T05:39:38.146221+0000","last_fullsized":"2023-12-04T05:39:38.146221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235432+0000","last_change":"2023-12-04T05:39:27.079605+0000","last_active":"2023-12-04T05:39:28.235432+0000","last_peered":"2023-12-04T05:39:28.235432+0000","last_clean":"2023-12-04T05:39:28.235432+0000","last_became_active":"2023-12-04T05:39:27.079189+0000","last_became_peered":"2023-12-04T05:39:27.079189+0000","last_unstale":"2023-12-04T05:39:28.235432+0000","last_undegraded":"2023-12-04T05:39:28.235432+0000","last_fullsized":"2023-12-04T05:39:28.235432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:34.861124+0000","last_change":"2023-12-04T05:39:26.080958+0000","last_active":"2023-12-04T05:39:34.861124+0000","last_peered":"2023-12-04T05:39:34.861124+0000","last_clean":"2023-12-04T05:39:34.861124+0000","last_became_active":"2023-12-04T05:39:26.080666+0000","last_became_peered":"2023-12-04T05:39:26.080666+0000","last_unstale":"2023-12-04T05:39:34.861124+0000","last_undegraded":"2023-12-04T05:39:34.861124+0000","last_fullsized":"2023-12-04T05:39:34.861124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:49.072351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.143546+0000","last_change":"2023-12-04T05:39:38.143546+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.143546+0000","last_undegraded":"2023-12-04T05:39:38.143546+0000","last_fullsized":"2023-12-04T05:39:38.143546+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888722+0000","last_change":"2023-12-04T05:39:27.081943+0000","last_active":"2023-12-04T05:39:28.888722+0000","last_peered":"2023-12-04T05:39:28.888722+0000","last_clean":"2023-12-04T05:39:28.888722+0000","last_became_active":"2023-12-04T05:39:27.081675+0000","last_became_peered":"2023-12-04T05:39:27.081675+0000","last_unstale":"2023-12-04T05:39:28.888722+0000","last_undegraded":"2023-12-04T05:39:28.888722+0000","last_fullsized":"2023-12-04T05:39:28.888722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890096+0000","last_change":"2023-12-04T05:39:26.082163+0000","last_active":"2023-12-04T05:39:28.890096+0000","last_peered":"2023-12-04T05:39:28.890096+0000","last_clean":"2023-12-04T05:39:28.890096+0000","last_became_active":"2023-12-04T05:39:26.081837+0000","last_became_peered":"2023-12-04T05:39:26.081837+0000","last_unstale":"2023-12-04T05:39:28.890096+0000","last_undegraded":"2023-12-04T05:39:28.890096+0000","last_fullsized":"2023-12-04T05:39:28.890096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:58.918868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.148475+0000","last_change":"2023-12-04T05:39:38.148475+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.148475+0000","last_undegraded":"2023-12-04T05:39:38.148475+0000","last_fullsized":"2023-12-04T05:39:38.148475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888271+0000","last_change":"2023-12-04T05:39:27.083342+0000","last_active":"2023-12-04T05:39:28.888271+0000","last_peered":"2023-12-04T05:39:28.888271+0000","last_clean":"2023-12-04T05:39:28.888271+0000","last_became_active":"2023-12-04T05:39:27.082988+0000","last_became_peered":"2023-12-04T05:39:27.082988+0000","last_unstale":"2023-12-04T05:39:28.888271+0000","last_undegraded":"2023-12-04T05:39:28.888271+0000","last_fullsized":"2023-12-04T05:39:28.888271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888688+0000","last_change":"2023-12-04T05:39:26.087193+0000","last_active":"2023-12-04T05:39:28.888688+0000","last_peered":"2023-12-04T05:39:28.888688+0000","last_clean":"2023-12-04T05:39:28.888688+0000","last_became_active":"2023-12-04T05:39:26.086857+0000","last_became_peered":"2023-12-04T05:39:26.086857+0000","last_unstale":"2023-12-04T05:39:28.888688+0000","last_undegraded":"2023-12-04T05:39:28.888688+0000","last_fullsized":"2023-12-04T05:39:28.888688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:50.459837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.143745+0000","last_change":"2023-12-04T05:39:38.143745+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.143745+0000","last_undegraded":"2023-12-04T05:39:38.143745+0000","last_fullsized":"2023-12-04T05:39:38.143745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889734+0000","last_change":"2023-12-04T05:39:27.098688+0000","last_active":"2023-12-04T05:39:28.889734+0000","last_peered":"2023-12-04T05:39:28.889734+0000","last_clean":"2023-12-04T05:39:28.889734+0000","last_became_active":"2023-12-04T05:39:27.098339+0000","last_became_peered":"2023-12-04T05:39:27.098339+0000","last_unstale":"2023-12-04T05:39:28.889734+0000","last_undegraded":"2023-12-04T05:39:28.889734+0000","last_fullsized":"2023-12-04T05:39:28.889734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:10:57.765583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887961+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:28.887961+0000","last_peered":"2023-12-04T05:39:28.887961+0000","last_clean":"2023-12-04T05:39:28.887961+0000","last_became_active":"2023-12-04T05:39:26.081807+0000","last_became_peered":"2023-12-04T05:39:26.081807+0000","last_unstale":"2023-12-04T05:39:28.887961+0000","last_undegraded":"2023-12-04T05:39:28.887961+0000","last_fullsized":"2023-12-04T05:39:28.887961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.143772+0000","last_change":"2023-12-04T05:39:38.143772+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.143772+0000","last_undegraded":"2023-12-04T05:39:38.143772+0000","last_fullsized":"2023-12-04T05:39:38.143772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889726+0000","last_change":"2023-12-04T05:39:27.075983+0000","last_active":"2023-12-04T05:39:28.889726+0000","last_peered":"2023-12-04T05:39:28.889726+0000","last_clean":"2023-12-04T05:39:28.889726+0000","last_became_active":"2023-12-04T05:39:27.075631+0000","last_became_peered":"2023-12-04T05:39:27.075631+0000","last_unstale":"2023-12-04T05:39:28.889726+0000","last_undegraded":"2023-12-04T05:39:28.889726+0000","last_fullsized":"2023-12-04T05:39:28.889726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:20:04.871607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888874+0000","last_change":"2023-12-04T05:39:26.075035+0000","last_active":"2023-12-04T05:39:28.888874+0000","last_peered":"2023-12-04T05:39:28.888874+0000","last_clean":"2023-12-04T05:39:28.888874+0000","last_became_active":"2023-12-04T05:39:26.074755+0000","last_became_peered":"2023-12-04T05:39:26.074755+0000","last_unstale":"2023-12-04T05:39:28.888874+0000","last_undegraded":"2023-12-04T05:39:28.888874+0000","last_fullsized":"2023-12-04T05:39:28.888874+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.143390+0000","last_change":"2023-12-04T05:39:38.143390+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.143390+0000","last_undegraded":"2023-12-04T05:39:38.143390+0000","last_fullsized":"2023-12-04T05:39:38.143390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888619+0000","last_change":"2023-12-04T05:39:27.086542+0000","last_active":"2023-12-04T05:39:28.888619+0000","last_peered":"2023-12-04T05:39:28.888619+0000","last_clean":"2023-12-04T05:39:28.888619+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:28.888619+0000","last_undegraded":"2023-12-04T05:39:28.888619+0000","last_fullsized":"2023-12-04T05:39:28.888619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235580+0000","last_change":"2023-12-04T05:39:26.079175+0000","last_active":"2023-12-04T05:39:28.235580+0000","last_peered":"2023-12-04T05:39:28.235580+0000","last_clean":"2023-12-04T05:39:28.235580+0000","last_became_active":"2023-12-04T05:39:26.078543+0000","last_became_peered":"2023-12-04T05:39:26.078543+0000","last_unstale":"2023-12-04T05:39:28.235580+0000","last_undegraded":"2023-12-04T05:39:28.235580+0000","last_fullsized":"2023-12-04T05:39:28.235580+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.145794+0000","last_change":"2023-12-04T05:39:38.145794+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.145794+0000","last_undegraded":"2023-12-04T05:39:38.145794+0000","last_fullsized":"2023-12-04T05:39:38.145794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235517+0000","last_change":"2023-12-04T05:39:27.083002+0000","last_active":"2023-12-04T05:39:28.235517+0000","last_peered":"2023-12-04T05:39:28.235517+0000","last_clean":"2023-12-04T05:39:28.235517+0000","last_became_active":"2023-12-04T05:39:27.082167+0000","last_became_peered":"2023-12-04T05:39:27.082167+0000","last_unstale":"2023-12-04T05:39:28.235517+0000","last_undegraded":"2023-12-04T05:39:28.235517+0000","last_fullsized":"2023-12-04T05:39:28.235517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889387+0000","last_change":"2023-12-04T05:39:26.078377+0000","last_active":"2023-12-04T05:39:28.889387+0000","last_peered":"2023-12-04T05:39:28.889387+0000","last_clean":"2023-12-04T05:39:28.889387+0000","last_became_active":"2023-12-04T05:39:26.077976+0000","last_became_peered":"2023-12-04T05:39:26.077976+0000","last_unstale":"2023-12-04T05:39:28.889387+0000","last_undegraded":"2023-12-04T05:39:28.889387+0000","last_fullsized":"2023-12-04T05:39:28.889387+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:13.700732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.142536+0000","last_change":"2023-12-04T05:39:38.142536+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.142536+0000","last_undegraded":"2023-12-04T05:39:38.142536+0000","last_fullsized":"2023-12-04T05:39:38.142536+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235449+0000","last_change":"2023-12-04T05:39:27.079741+0000","last_active":"2023-12-04T05:39:28.235449+0000","last_peered":"2023-12-04T05:39:28.235449+0000","last_clean":"2023-12-04T05:39:28.235449+0000","last_became_active":"2023-12-04T05:39:27.079309+0000","last_became_peered":"2023-12-04T05:39:27.079309+0000","last_unstale":"2023-12-04T05:39:28.235449+0000","last_undegraded":"2023-12-04T05:39:28.235449+0000","last_fullsized":"2023-12-04T05:39:28.235449+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888911+0000","last_change":"2023-12-04T05:39:26.075679+0000","last_active":"2023-12-04T05:39:28.888911+0000","last_peered":"2023-12-04T05:39:28.888911+0000","last_clean":"2023-12-04T05:39:28.888911+0000","last_became_active":"2023-12-04T05:39:26.075408+0000","last_became_peered":"2023-12-04T05:39:26.075408+0000","last_unstale":"2023-12-04T05:39:28.888911+0000","last_undegraded":"2023-12-04T05:39:28.888911+0000","last_fullsized":"2023-12-04T05:39:28.888911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.147303+0000","last_change":"2023-12-04T05:39:38.147303+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.147303+0000","last_undegraded":"2023-12-04T05:39:38.147303+0000","last_fullsized":"2023-12-04T05:39:38.147303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234894+0000","last_change":"2023-12-04T05:39:27.096722+0000","last_active":"2023-12-04T05:39:28.234894+0000","last_peered":"2023-12-04T05:39:28.234894+0000","last_clean":"2023-12-04T05:39:28.234894+0000","last_became_active":"2023-12-04T05:39:27.089687+0000","last_became_peered":"2023-12-04T05:39:27.089687+0000","last_unstale":"2023-12-04T05:39:28.234894+0000","last_undegraded":"2023-12-04T05:39:28.234894+0000","last_fullsized":"2023-12-04T05:39:28.234894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:04:15.694056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889308+0000","last_change":"2023-12-04T05:39:26.086640+0000","last_active":"2023-12-04T05:39:28.889308+0000","last_peered":"2023-12-04T05:39:28.889308+0000","last_clean":"2023-12-04T05:39:28.889308+0000","last_became_active":"2023-12-04T05:39:26.086335+0000","last_became_peered":"2023-12-04T05:39:26.086335+0000","last_unstale":"2023-12-04T05:39:28.889308+0000","last_undegraded":"2023-12-04T05:39:28.889308+0000","last_fullsized":"2023-12-04T05:39:28.889308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:18:07.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.145821+0000","last_change":"2023-12-04T05:39:38.145821+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.145821+0000","last_undegraded":"2023-12-04T05:39:38.145821+0000","last_fullsized":"2023-12-04T05:39:38.145821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887933+0000","last_change":"2023-12-04T05:39:27.096615+0000","last_active":"2023-12-04T05:39:28.887933+0000","last_peered":"2023-12-04T05:39:28.887933+0000","last_clean":"2023-12-04T05:39:28.887933+0000","last_became_active":"2023-12-04T05:39:27.096318+0000","last_became_peered":"2023-12-04T05:39:27.096318+0000","last_unstale":"2023-12-04T05:39:28.887933+0000","last_undegraded":"2023-12-04T05:39:28.887933+0000","last_fullsized":"2023-12-04T05:39:28.887933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234908+0000","last_change":"2023-12-04T05:39:26.084101+0000","last_active":"2023-12-04T05:39:28.234908+0000","last_peered":"2023-12-04T05:39:28.234908+0000","last_clean":"2023-12-04T05:39:28.234908+0000","last_became_active":"2023-12-04T05:39:26.083785+0000","last_became_peered":"2023-12-04T05:39:26.083785+0000","last_unstale":"2023-12-04T05:39:28.234908+0000","last_undegraded":"2023-12-04T05:39:28.234908+0000","last_fullsized":"2023-12-04T05:39:28.234908+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:47:37.800218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.145799+0000","last_change":"2023-12-04T05:39:38.145799+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.145799+0000","last_undegraded":"2023-12-04T05:39:38.145799+0000","last_fullsized":"2023-12-04T05:39:38.145799+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234839+0000","last_change":"2023-12-04T05:39:27.082611+0000","last_active":"2023-12-04T05:39:28.234839+0000","last_peered":"2023-12-04T05:39:28.234839+0000","last_clean":"2023-12-04T05:39:28.234839+0000","last_became_active":"2023-12-04T05:39:27.082317+0000","last_became_peered":"2023-12-04T05:39:27.082317+0000","last_unstale":"2023-12-04T05:39:28.234839+0000","last_undegraded":"2023-12-04T05:39:28.234839+0000","last_fullsized":"2023-12-04T05:39:28.234839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:24:22.060177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.234860+0000","last_change":"2023-12-04T05:39:26.080322+0000","last_active":"2023-12-04T05:39:28.234860+0000","last_peered":"2023-12-04T05:39:28.234860+0000","last_clean":"2023-12-04T05:39:28.234860+0000","last_became_active":"2023-12-04T05:39:26.079499+0000","last_became_peered":"2023-12-04T05:39:26.079499+0000","last_unstale":"2023-12-04T05:39:28.234860+0000","last_undegraded":"2023-12-04T05:39:28.234860+0000","last_fullsized":"2023-12-04T05:39:28.234860+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:57:37.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.147024+0000","last_change":"2023-12-04T05:39:38.147024+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.147024+0000","last_undegraded":"2023-12-04T05:39:38.147024+0000","last_fullsized":"2023-12-04T05:39:38.147024+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887860+0000","last_change":"2023-12-04T05:39:27.087432+0000","last_active":"2023-12-04T05:39:28.887860+0000","last_peered":"2023-12-04T05:39:28.887860+0000","last_clean":"2023-12-04T05:39:28.887860+0000","last_became_active":"2023-12-04T05:39:27.086159+0000","last_became_peered":"2023-12-04T05:39:27.086159+0000","last_unstale":"2023-12-04T05:39:28.887860+0000","last_undegraded":"2023-12-04T05:39:28.887860+0000","last_fullsized":"2023-12-04T05:39:28.887860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:50.161029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888226+0000","last_change":"2023-12-04T05:39:26.082897+0000","last_active":"2023-12-04T05:39:28.888226+0000","last_peered":"2023-12-04T05:39:28.888226+0000","last_clean":"2023-12-04T05:39:28.888226+0000","last_became_active":"2023-12-04T05:39:26.082589+0000","last_became_peered":"2023-12-04T05:39:26.082589+0000","last_unstale":"2023-12-04T05:39:28.888226+0000","last_undegraded":"2023-12-04T05:39:28.888226+0000","last_fullsized":"2023-12-04T05:39:28.888226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:38:35.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.147589+0000","last_change":"2023-12-04T05:39:38.147589+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.147589+0000","last_undegraded":"2023-12-04T05:39:38.147589+0000","last_fullsized":"2023-12-04T05:39:38.147589+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235502+0000","last_change":"2023-12-04T05:39:27.084628+0000","last_active":"2023-12-04T05:39:28.235502+0000","last_peered":"2023-12-04T05:39:28.235502+0000","last_clean":"2023-12-04T05:39:28.235502+0000","last_became_active":"2023-12-04T05:39:27.084326+0000","last_became_peered":"2023-12-04T05:39:27.084326+0000","last_unstale":"2023-12-04T05:39:28.235502+0000","last_undegraded":"2023-12-04T05:39:28.235502+0000","last_fullsized":"2023-12-04T05:39:28.235502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890322+0000","last_change":"2023-12-04T05:39:26.081865+0000","last_active":"2023-12-04T05:39:28.890322+0000","last_peered":"2023-12-04T05:39:28.890322+0000","last_clean":"2023-12-04T05:39:28.890322+0000","last_became_active":"2023-12-04T05:39:26.081533+0000","last_became_peered":"2023-12-04T05:39:26.081533+0000","last_unstale":"2023-12-04T05:39:28.890322+0000","last_undegraded":"2023-12-04T05:39:28.890322+0000","last_fullsized":"2023-12-04T05:39:28.890322+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:57.328933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.142927+0000","last_change":"2023-12-04T05:39:38.142927+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.142927+0000","last_undegraded":"2023-12-04T05:39:38.142927+0000","last_fullsized":"2023-12-04T05:39:38.142927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888707+0000","last_change":"2023-12-04T05:39:27.087533+0000","last_active":"2023-12-04T05:39:28.888707+0000","last_peered":"2023-12-04T05:39:28.888707+0000","last_clean":"2023-12-04T05:39:28.888707+0000","last_became_active":"2023-12-04T05:39:27.087076+0000","last_became_peered":"2023-12-04T05:39:27.087076+0000","last_unstale":"2023-12-04T05:39:28.888707+0000","last_undegraded":"2023-12-04T05:39:28.888707+0000","last_fullsized":"2023-12-04T05:39:28.888707+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:03.949105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:31.126027+0000","last_change":"2023-12-04T05:39:26.082858+0000","last_active":"2023-12-04T05:39:31.126027+0000","last_peered":"2023-12-04T05:39:31.126027+0000","last_clean":"2023-12-04T05:39:31.126027+0000","last_became_active":"2023-12-04T05:39:26.082559+0000","last_became_peered":"2023-12-04T05:39:26.082559+0000","last_unstale":"2023-12-04T05:39:31.126027+0000","last_undegraded":"2023-12-04T05:39:31.126027+0000","last_fullsized":"2023-12-04T05:39:31.126027+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:37:14.553422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.147126+0000","last_change":"2023-12-04T05:39:38.147126+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.147126+0000","last_undegraded":"2023-12-04T05:39:38.147126+0000","last_fullsized":"2023-12-04T05:39:38.147126+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235382+0000","last_change":"2023-12-04T05:39:27.093250+0000","last_active":"2023-12-04T05:39:28.235382+0000","last_peered":"2023-12-04T05:39:28.235382+0000","last_clean":"2023-12-04T05:39:28.235382+0000","last_became_active":"2023-12-04T05:39:27.092375+0000","last_became_peered":"2023-12-04T05:39:27.092375+0000","last_unstale":"2023-12-04T05:39:28.235382+0000","last_undegraded":"2023-12-04T05:39:28.235382+0000","last_fullsized":"2023-12-04T05:39:28.235382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235434+0000","last_change":"2023-12-04T05:39:26.082662+0000","last_active":"2023-12-04T05:39:28.235434+0000","last_peered":"2023-12-04T05:39:28.235434+0000","last_clean":"2023-12-04T05:39:28.235434+0000","last_became_active":"2023-12-04T05:39:26.082131+0000","last_became_peered":"2023-12-04T05:39:26.082131+0000","last_unstale":"2023-12-04T05:39:28.235434+0000","last_undegraded":"2023-12-04T05:39:28.235434+0000","last_fullsized":"2023-12-04T05:39:28.235434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.146321+0000","last_change":"2023-12-04T05:39:38.146321+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.146321+0000","last_undegraded":"2023-12-04T05:39:38.146321+0000","last_fullsized":"2023-12-04T05:39:38.146321+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235465+0000","last_change":"2023-12-04T05:39:27.079536+0000","last_active":"2023-12-04T05:39:28.235465+0000","last_peered":"2023-12-04T05:39:28.235465+0000","last_clean":"2023-12-04T05:39:28.235465+0000","last_became_active":"2023-12-04T05:39:27.078782+0000","last_became_peered":"2023-12-04T05:39:27.078782+0000","last_unstale":"2023-12-04T05:39:28.235465+0000","last_undegraded":"2023-12-04T05:39:28.235465+0000","last_fullsized":"2023-12-04T05:39:28.235465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235399+0000","last_change":"2023-12-04T05:39:26.080171+0000","last_active":"2023-12-04T05:39:28.235399+0000","last_peered":"2023-12-04T05:39:28.235399+0000","last_clean":"2023-12-04T05:39:28.235399+0000","last_became_active":"2023-12-04T05:39:26.079829+0000","last_became_peered":"2023-12-04T05:39:26.079829+0000","last_unstale":"2023-12-04T05:39:28.235399+0000","last_undegraded":"2023-12-04T05:39:28.235399+0000","last_fullsized":"2023-12-04T05:39:28.235399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.146078+0000","last_change":"2023-12-04T05:39:38.146078+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.146078+0000","last_undegraded":"2023-12-04T05:39:38.146078+0000","last_fullsized":"2023-12-04T05:39:38.146078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888038+0000","last_change":"2023-12-04T05:39:27.086155+0000","last_active":"2023-12-04T05:39:28.888038+0000","last_peered":"2023-12-04T05:39:28.888038+0000","last_clean":"2023-12-04T05:39:28.888038+0000","last_became_active":"2023-12-04T05:39:27.085887+0000","last_became_peered":"2023-12-04T05:39:27.085887+0000","last_unstale":"2023-12-04T05:39:28.888038+0000","last_undegraded":"2023-12-04T05:39:28.888038+0000","last_fullsized":"2023-12-04T05:39:28.888038+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889419+0000","last_change":"2023-12-04T05:39:26.079734+0000","last_active":"2023-12-04T05:39:28.889419+0000","last_peered":"2023-12-04T05:39:28.889419+0000","last_clean":"2023-12-04T05:39:28.889419+0000","last_became_active":"2023-12-04T05:39:26.079419+0000","last_became_peered":"2023-12-04T05:39:26.079419+0000","last_unstale":"2023-12-04T05:39:28.889419+0000","last_undegraded":"2023-12-04T05:39:28.889419+0000","last_fullsized":"2023-12-04T05:39:28.889419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.143452+0000","last_change":"2023-12-04T05:39:38.143452+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.143452+0000","last_undegraded":"2023-12-04T05:39:38.143452+0000","last_fullsized":"2023-12-04T05:39:38.143452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.889325+0000","last_change":"2023-12-04T05:39:27.081159+0000","last_active":"2023-12-04T05:39:28.889325+0000","last_peered":"2023-12-04T05:39:28.889325+0000","last_clean":"2023-12-04T05:39:28.889325+0000","last_became_active":"2023-12-04T05:39:27.080820+0000","last_became_peered":"2023-12-04T05:39:27.080820+0000","last_unstale":"2023-12-04T05:39:28.889325+0000","last_undegraded":"2023-12-04T05:39:28.889325+0000","last_fullsized":"2023-12-04T05:39:28.889325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235350+0000","last_change":"2023-12-04T05:39:26.080928+0000","last_active":"2023-12-04T05:39:28.235350+0000","last_peered":"2023-12-04T05:39:28.235350+0000","last_clean":"2023-12-04T05:39:28.235350+0000","last_became_active":"2023-12-04T05:39:26.080474+0000","last_became_peered":"2023-12-04T05:39:26.080474+0000","last_unstale":"2023-12-04T05:39:28.235350+0000","last_undegraded":"2023-12-04T05:39:28.235350+0000","last_fullsized":"2023-12-04T05:39:28.235350+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:49.152723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.146308+0000","last_change":"2023-12-04T05:39:38.146308+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.146308+0000","last_undegraded":"2023-12-04T05:39:38.146308+0000","last_fullsized":"2023-12-04T05:39:38.146308+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.887998+0000","last_change":"2023-12-04T05:39:27.083988+0000","last_active":"2023-12-04T05:39:28.887998+0000","last_peered":"2023-12-04T05:39:28.887998+0000","last_clean":"2023-12-04T05:39:28.887998+0000","last_became_active":"2023-12-04T05:39:27.083606+0000","last_became_peered":"2023-12-04T05:39:27.083606+0000","last_unstale":"2023-12-04T05:39:28.887998+0000","last_undegraded":"2023-12-04T05:39:28.887998+0000","last_fullsized":"2023-12-04T05:39:28.887998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235316+0000","last_change":"2023-12-04T05:39:26.079887+0000","last_active":"2023-12-04T05:39:28.235316+0000","last_peered":"2023-12-04T05:39:28.235316+0000","last_clean":"2023-12-04T05:39:28.235316+0000","last_became_active":"2023-12-04T05:39:26.079365+0000","last_became_peered":"2023-12-04T05:39:26.079365+0000","last_unstale":"2023-12-04T05:39:28.235316+0000","last_undegraded":"2023-12-04T05:39:28.235316+0000","last_fullsized":"2023-12-04T05:39:28.235316+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.142551+0000","last_change":"2023-12-04T05:39:38.142551+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.142551+0000","last_undegraded":"2023-12-04T05:39:38.142551+0000","last_fullsized":"2023-12-04T05:39:38.142551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235298+0000","last_change":"2023-12-04T05:39:27.102361+0000","last_active":"2023-12-04T05:39:28.235298+0000","last_peered":"2023-12-04T05:39:28.235298+0000","last_clean":"2023-12-04T05:39:28.235298+0000","last_became_active":"2023-12-04T05:39:27.101931+0000","last_became_peered":"2023-12-04T05:39:27.101931+0000","last_unstale":"2023-12-04T05:39:28.235298+0000","last_undegraded":"2023-12-04T05:39:28.235298+0000","last_fullsized":"2023-12-04T05:39:28.235298+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.235292+0000","last_change":"2023-12-04T05:39:26.076033+0000","last_active":"2023-12-04T05:39:28.235292+0000","last_peered":"2023-12-04T05:39:28.235292+0000","last_clean":"2023-12-04T05:39:28.235292+0000","last_became_active":"2023-12-04T05:39:26.075725+0000","last_became_peered":"2023-12-04T05:39:26.075725+0000","last_unstale":"2023-12-04T05:39:28.235292+0000","last_undegraded":"2023-12-04T05:39:28.235292+0000","last_fullsized":"2023-12-04T05:39:28.235292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-04T05:39:39.139560+0000","last_change":"2023-12-04T05:39:39.139560+0000","last_active":"2023-12-04T05:39:39.139560+0000","last_peered":"2023-12-04T05:39:39.139560+0000","last_clean":"2023-12-04T05:39:39.139560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:39.139560+0000","last_undegraded":"2023-12-04T05:39:39.139560+0000","last_fullsized":"2023-12-04T05:39:39.139560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2023-12-04T05:39:38.148517+0000","last_change":"2023-12-04T05:39:38.148517+0000","last_active":"2023-12-04T05:39:38.131512+0000","last_peered":"2023-12-04T05:39:38.131512+0000","last_clean":"2023-12-04T05:39:38.131512+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-04T05:39:38.148517+0000","last_undegraded":"2023-12-04T05:39:38.148517+0000","last_fullsized":"2023-12-04T05:39:38.148517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.890387+0000","last_change":"2023-12-04T05:39:27.088782+0000","last_active":"2023-12-04T05:39:28.890387+0000","last_peered":"2023-12-04T05:39:28.890387+0000","last_clean":"2023-12-04T05:39:28.890387+0000","last_became_active":"2023-12-04T05:39:27.088524+0000","last_became_peered":"2023-12-04T05:39:27.088524+0000","last_unstale":"2023-12-04T05:39:28.890387+0000","last_undegraded":"2023-12-04T05:39:28.890387+0000","last_fullsized":"2023-12-04T05:39:28.890387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:50.080657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888578+0000","last_change":"2023-12-04T05:39:26.087051+0000","last_active":"2023-12-04T05:39:28.888578+0000","last_peered":"2023-12-04T05:39:28.888578+0000","last_clean":"2023-12-04T05:39:28.888578+0000","last_became_active":"2023-12-04T05:39:26.086791+0000","last_became_peered":"2023-12-04T05:39:26.086791+0000","last_unstale":"2023-12-04T05:39:28.888578+0000","last_undegraded":"2023-12-04T05:39:28.888578+0000","last_fullsized":"2023-12-04T05:39:28.888578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-04T05:39:28.888172+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:39:28.888172+0000","last_peered":"2023-12-04T05:39:28.888172+0000","last_clean":"2023-12-04T05:39:28.888172+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:39:28.888172+0000","last_undegraded":"2023-12-04T05:39:28.888172+0000","last_fullsized":"2023-12-04T05:39:28.888172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":954961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.48699999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.505}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.37},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.35399999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.441}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":365217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.62},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.48099999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.497}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.56999999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":367652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39600000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.496},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.374},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.47599999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.63}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":371194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.627},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68400000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.754},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.84199999999999997}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":0.82599999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":0.76600000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.878}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.85699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":847872,"data_stored":367630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.313},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.371}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.628}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.69699999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":365105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.5},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.59899999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.68300000000000005}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":364717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.438},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.499}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47899999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.89300000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.91900000000000004}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.879}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1433600,"data_stored":954925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.372}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.433},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.504}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:39:44.265 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:39:44.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 Processor -- start 2023-12-04T05:39:44.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 -- start start 2023-12-04T05:39:44.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f88580c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580739b0 con 0x7f8858157da0 2023-12-04T05:39:44.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8858155710 con 0x7f88580c1030 2023-12-04T05:39:44.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885e78d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c15a0 con 0x7f885806b860 2023-12-04T05:39:44.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885cd2a640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8858157da0 0x7f8858158230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45194/0 (socket says 172.21.15.97:45194) 2023-12-04T05:39:44.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885cd2a640 1 -- 172.21.15.97:0/25857514 learned_addr learned my addr 172.21.15.97:0/25857514 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8857fff640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f88580c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167203782 0 0) 0x7f88580739b0 con 0x7f8858157da0 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840003530 con 0x7f8858157da0 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1145681724 0 0) 0x7f8840003530 con 0x7f8858157da0 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 msgr2=0x7f88580c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f88580c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 >> v1:172.21.15.143:6789/0 conn(0x7f88580c1030 legacy=0x7f8858151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858073680 con 0x7f8858157da0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f8850001a00 con 0x7f8858157da0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 >> v1:172.21.15.97:6789/0 conn(0x7f8858157da0 legacy=0x7f8858158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88400039b0 0x7f8840003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88400047d0 0x7f8840004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f8840005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c15a0 con 0x7f88400039b0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000ba90 con 0x7f88400047d0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884000bc50 con 0x7f885806b860 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f8857fff640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88400039b0 0x7f8840003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f88577fe640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88400047d0 0x7f8840004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.432+0000 7f885cd2a640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f8840005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 -- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 msgr2=0x7f8840005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f8840005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 -- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88400047d0 msgr2=0x7f8840004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88400047d0 0x7f8840004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 -- 172.21.15.97:0/25857514 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840003530 con 0x7f88400039b0 2023-12-04T05:39:44.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885cd2a640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f885806b860 0x7f8840005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:44.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8857fff640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88400039b0 0x7f8840003d90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8848009ae0 tx=0x7f884801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0272e1cd8031f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a9450 con 0x7f88400039b0 2023-12-04T05:39:44.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88480a95b0 con 0x7f88400039b0 2023-12-04T05:39:44.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f8856ffd640 1 -- 172.21.15.97:0/25857514 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a9960 con 0x7f88400039b0 2023-12-04T05:39:44.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 -- 172.21.15.97:0/25857514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88400039b0 msgr2=0x7f8840003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 --2- 172.21.15.97:0/25857514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88400039b0 0x7f8840003d90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8848009ae0 tx=0x7f884801ca50 comp rx=0 tx=0).stop 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885cd2a640 1 -- 172.21.15.97:0/25857514 reap_dead start 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 -- 172.21.15.97:0/25857514 shutdown_connections 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 -- 172.21.15.97:0/25857514 >> 172.21.15.97:0/25857514 conn(0x7f88580c3130 msgr2=0x7f88580c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 -- 172.21.15.97:0/25857514 shutdown_connections 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.436+0000 7f885e78d640 1 -- 172.21.15.97:0/25857514 wait complete. 2023-12-04T05:39:44.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 Processor -- start 2023-12-04T05:39:44.446 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 -- start start 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88400039b0 0x7f88580c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f885814a8f0 0x7f8858152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f0bc0 con 0x7f885806e080 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f0ea0 con 0x7f885814a8f0 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88581546d0 con 0x7f88400039b0 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38836/0 (socket says 172.21.15.97:38836) 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 -- 172.21.15.97:0/2999357518 learned_addr learned my addr 172.21.15.97:0/2999357518 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f8857fff640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88400039b0 0x7f88580c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885cd2a640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f885814a8f0 0x7f8858152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 -- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88400039b0 msgr2=0x7f88580c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88400039b0 0x7f88580c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.449 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 -- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f885814a8f0 msgr2=0x7f8858152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f885814a8f0 0x7f8858152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 -- 172.21.15.97:0/2999357518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885814ad80 con 0x7f885806e080 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f88577fe640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f884c00f7f0 tx=0x7f884c00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0050d0 con 0x7f885806e080 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c005250 con 0x7f885806e080 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858154360 con 0x7f885806e080 2023-12-04T05:39:44.450 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.440+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c00d730 con 0x7f885806e080 2023-12-04T05:39:44.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8858152b50 con 0x7f885806e080 2023-12-04T05:39:44.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858154890 con 0x7f885806e080 2023-12-04T05:39:44.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f884c00d890 con 0x7f885806e080 2023-12-04T05:39:44.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f8854ff9640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 0x7f8844068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f884c0846c0 con 0x7f885806e080 2023-12-04T05:39:44.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f8857fff640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 0x7f8844068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.444+0000 7f8857fff640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 0x7f8844068dc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f88480ae000 tx=0x7f88480046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.448+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f884c051590 con 0x7f885806e080 2023-12-04T05:39:44.600 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.596+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f885806bc40 con 0x7f8844066900 2023-12-04T05:39:44.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.608+0000 7f8854ff9640 1 -- 172.21.15.97:0/2999357518 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528028 (secure 0 0 0) 0x7f884800f0c0 con 0x7f8844066900 2023-12-04T05:39:44.620 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:44.624 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 msgr2=0x7f8844068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 0x7f8844068dc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f88480ae000 tx=0x7f88480046d0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 msgr2=0x7f88580c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f884c00f7f0 tx=0x7f884c00fbf0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 shutdown_connections 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8844066900 0x7f8844068dc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f885814a8f0 0x7f8858152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f885806e080 0x7f88580c5e60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 --2- 172.21.15.97:0/2999357518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88400039b0 0x7f88580c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 >> 172.21.15.97:0/2999357518 conn(0x7f88580c3130 msgr2=0x7f8858158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 shutdown_connections 2023-12-04T05:39:44.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.612+0000 7f885e78d640 1 -- 172.21.15.97:0/2999357518 wait complete. 2023-12-04T05:39:44.639 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-12-04T05:39:44.230037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":367,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253512,"kb_used_data":8200,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721208,"statfs":{"total":773094113280,"available":772834516992,"internally_reserved":0,"allocated":8396800,"data_stored":4338278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3905,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.003924"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.011021+0000","last_change":"2023-12-04T05:39:40.038526+0000","last_active":"2023-12-04T05:39:41.011021+0000","last_peered":"2023-12-04T05:39:41.011021+0000","last_clean":"2023-12-04T05:39:41.011021+0000","last_became_active":"2023-12-04T05:39:40.038235+0000","last_became_peered":"2023-12-04T05:39:40.038235+0000","last_unstale":"2023-12-04T05:39:41.011021+0000","last_undegraded":"2023-12-04T05:39:41.011021+0000","last_fullsized":"2023-12-04T05:39:41.011021+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:17.040127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017549+0000","last_change":"2023-12-04T05:39:27.075692+0000","last_active":"2023-12-04T05:39:40.017549+0000","last_peered":"2023-12-04T05:39:40.017549+0000","last_clean":"2023-12-04T05:39:40.017549+0000","last_became_active":"2023-12-04T05:39:27.075338+0000","last_became_peered":"2023-12-04T05:39:27.075338+0000","last_unstale":"2023-12-04T05:39:40.017549+0000","last_undegraded":"2023-12-04T05:39:40.017549+0000","last_fullsized":"2023-12-04T05:39:40.017549+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585952+0000","last_change":"2023-12-04T05:39:40.033715+0000","last_active":"2023-12-04T05:39:41.585952+0000","last_peered":"2023-12-04T05:39:41.585952+0000","last_clean":"2023-12-04T05:39:41.585952+0000","last_became_active":"2023-12-04T05:39:40.032463+0000","last_became_peered":"2023-12-04T05:39:40.032463+0000","last_unstale":"2023-12-04T05:39:41.585952+0000","last_undegraded":"2023-12-04T05:39:41.585952+0000","last_fullsized":"2023-12-04T05:39:41.585952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:25.622203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009632+0000","last_change":"2023-12-04T05:39:27.076323+0000","last_active":"2023-12-04T05:39:40.009632+0000","last_peered":"2023-12-04T05:39:40.009632+0000","last_clean":"2023-12-04T05:39:40.009632+0000","last_became_active":"2023-12-04T05:39:27.075952+0000","last_became_peered":"2023-12-04T05:39:27.075952+0000","last_unstale":"2023-12-04T05:39:40.009632+0000","last_undegraded":"2023-12-04T05:39:40.009632+0000","last_fullsized":"2023-12-04T05:39:40.009632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:01.666984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.011196+0000","last_change":"2023-12-04T05:39:40.034872+0000","last_active":"2023-12-04T05:39:41.011196+0000","last_peered":"2023-12-04T05:39:41.011196+0000","last_clean":"2023-12-04T05:39:41.011196+0000","last_became_active":"2023-12-04T05:39:40.034596+0000","last_became_peered":"2023-12-04T05:39:40.034596+0000","last_unstale":"2023-12-04T05:39:41.011196+0000","last_undegraded":"2023-12-04T05:39:41.011196+0000","last_fullsized":"2023-12-04T05:39:41.011196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:24:20.387639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015176+0000","last_change":"2023-12-04T05:39:27.088405+0000","last_active":"2023-12-04T05:39:40.015176+0000","last_peered":"2023-12-04T05:39:40.015176+0000","last_clean":"2023-12-04T05:39:40.015176+0000","last_became_active":"2023-12-04T05:39:27.088123+0000","last_became_peered":"2023-12-04T05:39:27.088123+0000","last_unstale":"2023-12-04T05:39:40.015176+0000","last_undegraded":"2023-12-04T05:39:40.015176+0000","last_fullsized":"2023-12-04T05:39:40.015176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587171+0000","last_change":"2023-12-04T05:39:40.038887+0000","last_active":"2023-12-04T05:39:41.587171+0000","last_peered":"2023-12-04T05:39:41.587171+0000","last_clean":"2023-12-04T05:39:41.587171+0000","last_became_active":"2023-12-04T05:39:40.038619+0000","last_became_peered":"2023-12-04T05:39:40.038619+0000","last_unstale":"2023-12-04T05:39:41.587171+0000","last_undegraded":"2023-12-04T05:39:41.587171+0000","last_fullsized":"2023-12-04T05:39:41.587171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:18:05.439312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009221+0000","last_change":"2023-12-04T05:39:27.091201+0000","last_active":"2023-12-04T05:39:40.009221+0000","last_peered":"2023-12-04T05:39:40.009221+0000","last_clean":"2023-12-04T05:39:40.009221+0000","last_became_active":"2023-12-04T05:39:27.090589+0000","last_became_peered":"2023-12-04T05:39:27.090589+0000","last_unstale":"2023-12-04T05:39:40.009221+0000","last_undegraded":"2023-12-04T05:39:40.009221+0000","last_fullsized":"2023-12-04T05:39:40.009221+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:28:23.983451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585980+0000","last_change":"2023-12-04T05:39:40.039250+0000","last_active":"2023-12-04T05:39:41.585980+0000","last_peered":"2023-12-04T05:39:41.585980+0000","last_clean":"2023-12-04T05:39:41.585980+0000","last_became_active":"2023-12-04T05:39:40.038244+0000","last_became_peered":"2023-12-04T05:39:40.038244+0000","last_unstale":"2023-12-04T05:39:41.585980+0000","last_undegraded":"2023-12-04T05:39:41.585980+0000","last_fullsized":"2023-12-04T05:39:41.585980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:55.432219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021455+0000","last_change":"2023-12-04T05:39:27.078406+0000","last_active":"2023-12-04T05:39:40.021455+0000","last_peered":"2023-12-04T05:39:40.021455+0000","last_clean":"2023-12-04T05:39:40.021455+0000","last_became_active":"2023-12-04T05:39:27.078131+0000","last_became_peered":"2023-12-04T05:39:27.078131+0000","last_unstale":"2023-12-04T05:39:40.021455+0000","last_undegraded":"2023-12-04T05:39:40.021455+0000","last_fullsized":"2023-12-04T05:39:40.021455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585351+0000","last_change":"2023-12-04T05:39:40.024969+0000","last_active":"2023-12-04T05:39:41.585351+0000","last_peered":"2023-12-04T05:39:41.585351+0000","last_clean":"2023-12-04T05:39:41.585351+0000","last_became_active":"2023-12-04T05:39:40.024673+0000","last_became_peered":"2023-12-04T05:39:40.024673+0000","last_unstale":"2023-12-04T05:39:41.585351+0000","last_undegraded":"2023-12-04T05:39:41.585351+0000","last_fullsized":"2023-12-04T05:39:41.585351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:58:58.771648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.029854+0000","last_change":"2023-12-04T05:39:27.100515+0000","last_active":"2023-12-04T05:39:40.029854+0000","last_peered":"2023-12-04T05:39:40.029854+0000","last_clean":"2023-12-04T05:39:40.029854+0000","last_became_active":"2023-12-04T05:39:27.100182+0000","last_became_peered":"2023-12-04T05:39:27.100182+0000","last_unstale":"2023-12-04T05:39:40.029854+0000","last_undegraded":"2023-12-04T05:39:40.029854+0000","last_fullsized":"2023-12-04T05:39:40.029854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012700+0000","last_change":"2023-12-04T05:39:40.029654+0000","last_active":"2023-12-04T05:39:41.012700+0000","last_peered":"2023-12-04T05:39:41.012700+0000","last_clean":"2023-12-04T05:39:41.012700+0000","last_became_active":"2023-12-04T05:39:40.029341+0000","last_became_peered":"2023-12-04T05:39:40.029341+0000","last_unstale":"2023-12-04T05:39:41.012700+0000","last_undegraded":"2023-12-04T05:39:41.012700+0000","last_fullsized":"2023-12-04T05:39:41.012700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:58:05.595505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008985+0000","last_change":"2023-12-04T05:39:27.088212+0000","last_active":"2023-12-04T05:39:40.008985+0000","last_peered":"2023-12-04T05:39:40.008985+0000","last_clean":"2023-12-04T05:39:40.008985+0000","last_became_active":"2023-12-04T05:39:27.087929+0000","last_became_peered":"2023-12-04T05:39:27.087929+0000","last_unstale":"2023-12-04T05:39:40.008985+0000","last_undegraded":"2023-12-04T05:39:40.008985+0000","last_fullsized":"2023-12-04T05:39:40.008985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:40:35.762126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586651+0000","last_change":"2023-12-04T05:39:40.038716+0000","last_active":"2023-12-04T05:39:41.586651+0000","last_peered":"2023-12-04T05:39:41.586651+0000","last_clean":"2023-12-04T05:39:41.586651+0000","last_became_active":"2023-12-04T05:39:40.038272+0000","last_became_peered":"2023-12-04T05:39:40.038272+0000","last_unstale":"2023-12-04T05:39:41.586651+0000","last_undegraded":"2023-12-04T05:39:41.586651+0000","last_fullsized":"2023-12-04T05:39:41.586651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:16.935005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.025372+0000","last_change":"2023-12-04T05:39:27.089681+0000","last_active":"2023-12-04T05:39:40.025372+0000","last_peered":"2023-12-04T05:39:40.025372+0000","last_clean":"2023-12-04T05:39:40.025372+0000","last_became_active":"2023-12-04T05:39:27.089288+0000","last_became_peered":"2023-12-04T05:39:27.089288+0000","last_unstale":"2023-12-04T05:39:40.025372+0000","last_undegraded":"2023-12-04T05:39:40.025372+0000","last_fullsized":"2023-12-04T05:39:40.025372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:15.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586925+0000","last_change":"2023-12-04T05:39:40.029861+0000","last_active":"2023-12-04T05:39:41.586925+0000","last_peered":"2023-12-04T05:39:41.586925+0000","last_clean":"2023-12-04T05:39:41.586925+0000","last_became_active":"2023-12-04T05:39:40.029572+0000","last_became_peered":"2023-12-04T05:39:40.029572+0000","last_unstale":"2023-12-04T05:39:41.586925+0000","last_undegraded":"2023-12-04T05:39:41.586925+0000","last_fullsized":"2023-12-04T05:39:41.586925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:45:49.240614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.026308+0000","last_change":"2023-12-04T05:39:27.083541+0000","last_active":"2023-12-04T05:39:40.026308+0000","last_peered":"2023-12-04T05:39:40.026308+0000","last_clean":"2023-12-04T05:39:40.026308+0000","last_became_active":"2023-12-04T05:39:27.083207+0000","last_became_peered":"2023-12-04T05:39:27.083207+0000","last_unstale":"2023-12-04T05:39:40.026308+0000","last_undegraded":"2023-12-04T05:39:40.026308+0000","last_fullsized":"2023-12-04T05:39:40.026308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012699+0000","last_change":"2023-12-04T05:39:40.029017+0000","last_active":"2023-12-04T05:39:41.012699+0000","last_peered":"2023-12-04T05:39:41.012699+0000","last_clean":"2023-12-04T05:39:41.012699+0000","last_became_active":"2023-12-04T05:39:40.028664+0000","last_became_peered":"2023-12-04T05:39:40.028664+0000","last_unstale":"2023-12-04T05:39:41.012699+0000","last_undegraded":"2023-12-04T05:39:41.012699+0000","last_fullsized":"2023-12-04T05:39:41.012699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:44:05.490437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017223+0000","last_change":"2023-12-04T05:39:27.097340+0000","last_active":"2023-12-04T05:39:40.017223+0000","last_peered":"2023-12-04T05:39:40.017223+0000","last_clean":"2023-12-04T05:39:40.017223+0000","last_became_active":"2023-12-04T05:39:27.096699+0000","last_became_peered":"2023-12-04T05:39:27.096699+0000","last_unstale":"2023-12-04T05:39:40.017223+0000","last_undegraded":"2023-12-04T05:39:40.017223+0000","last_fullsized":"2023-12-04T05:39:40.017223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:25.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013871+0000","last_change":"2023-12-04T05:39:40.033798+0000","last_active":"2023-12-04T05:39:41.013871+0000","last_peered":"2023-12-04T05:39:41.013871+0000","last_clean":"2023-12-04T05:39:41.013871+0000","last_became_active":"2023-12-04T05:39:40.033370+0000","last_became_peered":"2023-12-04T05:39:40.033370+0000","last_unstale":"2023-12-04T05:39:41.013871+0000","last_undegraded":"2023-12-04T05:39:41.013871+0000","last_fullsized":"2023-12-04T05:39:41.013871+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:16.935005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010190+0000","last_change":"2023-12-04T05:39:27.087492+0000","last_active":"2023-12-04T05:39:40.010190+0000","last_peered":"2023-12-04T05:39:40.010190+0000","last_clean":"2023-12-04T05:39:40.010190+0000","last_became_active":"2023-12-04T05:39:27.087207+0000","last_became_peered":"2023-12-04T05:39:27.087207+0000","last_unstale":"2023-12-04T05:39:40.010190+0000","last_undegraded":"2023-12-04T05:39:40.010190+0000","last_fullsized":"2023-12-04T05:39:40.010190+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:45:15.043031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013190+0000","last_change":"2023-12-04T05:39:40.022209+0000","last_active":"2023-12-04T05:39:41.013190+0000","last_peered":"2023-12-04T05:39:41.013190+0000","last_clean":"2023-12-04T05:39:41.013190+0000","last_became_active":"2023-12-04T05:39:40.021916+0000","last_became_peered":"2023-12-04T05:39:40.021916+0000","last_unstale":"2023-12-04T05:39:41.013190+0000","last_undegraded":"2023-12-04T05:39:41.013190+0000","last_fullsized":"2023-12-04T05:39:41.013190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:17.312769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016328+0000","last_change":"2023-12-04T05:39:27.088572+0000","last_active":"2023-12-04T05:39:40.016328+0000","last_peered":"2023-12-04T05:39:40.016328+0000","last_clean":"2023-12-04T05:39:40.016328+0000","last_became_active":"2023-12-04T05:39:27.088269+0000","last_became_peered":"2023-12-04T05:39:27.088269+0000","last_unstale":"2023-12-04T05:39:40.016328+0000","last_undegraded":"2023-12-04T05:39:40.016328+0000","last_fullsized":"2023-12-04T05:39:40.016328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586089+0000","last_change":"2023-12-04T05:39:40.028513+0000","last_active":"2023-12-04T05:39:41.586089+0000","last_peered":"2023-12-04T05:39:41.586089+0000","last_clean":"2023-12-04T05:39:41.586089+0000","last_became_active":"2023-12-04T05:39:40.028049+0000","last_became_peered":"2023-12-04T05:39:40.028049+0000","last_unstale":"2023-12-04T05:39:41.586089+0000","last_undegraded":"2023-12-04T05:39:41.586089+0000","last_fullsized":"2023-12-04T05:39:41.586089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:35:24.379961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013458+0000","last_change":"2023-12-04T05:39:27.088085+0000","last_active":"2023-12-04T05:39:40.013458+0000","last_peered":"2023-12-04T05:39:40.013458+0000","last_clean":"2023-12-04T05:39:40.013458+0000","last_became_active":"2023-12-04T05:39:27.087726+0000","last_became_peered":"2023-12-04T05:39:27.087726+0000","last_unstale":"2023-12-04T05:39:40.013458+0000","last_undegraded":"2023-12-04T05:39:40.013458+0000","last_fullsized":"2023-12-04T05:39:40.013458+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586163+0000","last_change":"2023-12-04T05:39:40.024129+0000","last_active":"2023-12-04T05:39:41.586163+0000","last_peered":"2023-12-04T05:39:41.586163+0000","last_clean":"2023-12-04T05:39:41.586163+0000","last_became_active":"2023-12-04T05:39:40.023664+0000","last_became_peered":"2023-12-04T05:39:40.023664+0000","last_unstale":"2023-12-04T05:39:41.586163+0000","last_undegraded":"2023-12-04T05:39:41.586163+0000","last_fullsized":"2023-12-04T05:39:41.586163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:58:05.595505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.011235+0000","last_change":"2023-12-04T05:39:27.100050+0000","last_active":"2023-12-04T05:39:40.011235+0000","last_peered":"2023-12-04T05:39:40.011235+0000","last_clean":"2023-12-04T05:39:40.011235+0000","last_became_active":"2023-12-04T05:39:27.099704+0000","last_became_peered":"2023-12-04T05:39:27.099704+0000","last_unstale":"2023-12-04T05:39:40.011235+0000","last_undegraded":"2023-12-04T05:39:40.011235+0000","last_fullsized":"2023-12-04T05:39:40.011235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:15:26.128910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587704+0000","last_change":"2023-12-04T05:39:40.030084+0000","last_active":"2023-12-04T05:39:41.587704+0000","last_peered":"2023-12-04T05:39:41.587704+0000","last_clean":"2023-12-04T05:39:41.587704+0000","last_became_active":"2023-12-04T05:39:40.029837+0000","last_became_peered":"2023-12-04T05:39:40.029837+0000","last_unstale":"2023-12-04T05:39:41.587704+0000","last_undegraded":"2023-12-04T05:39:41.587704+0000","last_fullsized":"2023-12-04T05:39:41.587704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:40.019707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013644+0000","last_change":"2023-12-04T05:39:27.096514+0000","last_active":"2023-12-04T05:39:40.013644+0000","last_peered":"2023-12-04T05:39:40.013644+0000","last_clean":"2023-12-04T05:39:40.013644+0000","last_became_active":"2023-12-04T05:39:27.096198+0000","last_became_peered":"2023-12-04T05:39:27.096198+0000","last_unstale":"2023-12-04T05:39:40.013644+0000","last_undegraded":"2023-12-04T05:39:40.013644+0000","last_fullsized":"2023-12-04T05:39:40.013644+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:19:40.462636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586413+0000","last_change":"2023-12-04T05:39:40.027540+0000","last_active":"2023-12-04T05:39:41.586413+0000","last_peered":"2023-12-04T05:39:41.586413+0000","last_clean":"2023-12-04T05:39:41.586413+0000","last_became_active":"2023-12-04T05:39:40.027259+0000","last_became_peered":"2023-12-04T05:39:40.027259+0000","last_unstale":"2023-12-04T05:39:41.586413+0000","last_undegraded":"2023-12-04T05:39:41.586413+0000","last_fullsized":"2023-12-04T05:39:41.586413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:38:03.252051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018102+0000","last_change":"2023-12-04T05:39:27.076053+0000","last_active":"2023-12-04T05:39:40.018102+0000","last_peered":"2023-12-04T05:39:40.018102+0000","last_clean":"2023-12-04T05:39:40.018102+0000","last_became_active":"2023-12-04T05:39:27.075664+0000","last_became_peered":"2023-12-04T05:39:27.075664+0000","last_unstale":"2023-12-04T05:39:40.018102+0000","last_undegraded":"2023-12-04T05:39:40.018102+0000","last_fullsized":"2023-12-04T05:39:40.018102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586370+0000","last_change":"2023-12-04T05:39:40.018025+0000","last_active":"2023-12-04T05:39:41.586370+0000","last_peered":"2023-12-04T05:39:41.586370+0000","last_clean":"2023-12-04T05:39:41.586370+0000","last_became_active":"2023-12-04T05:39:40.017756+0000","last_became_peered":"2023-12-04T05:39:40.017756+0000","last_unstale":"2023-12-04T05:39:41.586370+0000","last_undegraded":"2023-12-04T05:39:41.586370+0000","last_fullsized":"2023-12-04T05:39:41.586370+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:32:12.692898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021019+0000","last_change":"2023-12-04T05:39:27.102230+0000","last_active":"2023-12-04T05:39:40.021019+0000","last_peered":"2023-12-04T05:39:40.021019+0000","last_clean":"2023-12-04T05:39:40.021019+0000","last_became_active":"2023-12-04T05:39:27.101891+0000","last_became_peered":"2023-12-04T05:39:27.101891+0000","last_unstale":"2023-12-04T05:39:40.021019+0000","last_undegraded":"2023-12-04T05:39:40.021019+0000","last_fullsized":"2023-12-04T05:39:40.021019+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012822+0000","last_change":"2023-12-04T05:39:40.022410+0000","last_active":"2023-12-04T05:39:41.012822+0000","last_peered":"2023-12-04T05:39:41.012822+0000","last_clean":"2023-12-04T05:39:41.012822+0000","last_became_active":"2023-12-04T05:39:40.021549+0000","last_became_peered":"2023-12-04T05:39:40.021549+0000","last_unstale":"2023-12-04T05:39:41.012822+0000","last_undegraded":"2023-12-04T05:39:41.012822+0000","last_fullsized":"2023-12-04T05:39:41.012822+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:02.153142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.012026+0000","last_change":"2023-12-04T05:39:27.091794+0000","last_active":"2023-12-04T05:39:40.012026+0000","last_peered":"2023-12-04T05:39:40.012026+0000","last_clean":"2023-12-04T05:39:40.012026+0000","last_became_active":"2023-12-04T05:39:27.091435+0000","last_became_peered":"2023-12-04T05:39:27.091435+0000","last_unstale":"2023-12-04T05:39:40.012026+0000","last_undegraded":"2023-12-04T05:39:40.012026+0000","last_fullsized":"2023-12-04T05:39:40.012026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:21.223596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587465+0000","last_change":"2023-12-04T05:39:40.028416+0000","last_active":"2023-12-04T05:39:41.587465+0000","last_peered":"2023-12-04T05:39:41.587465+0000","last_clean":"2023-12-04T05:39:41.587465+0000","last_became_active":"2023-12-04T05:39:40.028116+0000","last_became_peered":"2023-12-04T05:39:40.028116+0000","last_unstale":"2023-12-04T05:39:41.587465+0000","last_undegraded":"2023-12-04T05:39:41.587465+0000","last_fullsized":"2023-12-04T05:39:41.587465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:12:38.100714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021853+0000","last_change":"2023-12-04T05:39:27.094081+0000","last_active":"2023-12-04T05:39:40.021853+0000","last_peered":"2023-12-04T05:39:40.021853+0000","last_clean":"2023-12-04T05:39:40.021853+0000","last_became_active":"2023-12-04T05:39:27.093805+0000","last_became_peered":"2023-12-04T05:39:27.093805+0000","last_unstale":"2023-12-04T05:39:40.021853+0000","last_undegraded":"2023-12-04T05:39:40.021853+0000","last_fullsized":"2023-12-04T05:39:40.021853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:43:08.069231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587910+0000","last_change":"2023-12-04T05:39:40.028083+0000","last_active":"2023-12-04T05:39:41.587910+0000","last_peered":"2023-12-04T05:39:41.587910+0000","last_clean":"2023-12-04T05:39:41.587910+0000","last_became_active":"2023-12-04T05:39:40.027755+0000","last_became_peered":"2023-12-04T05:39:40.027755+0000","last_unstale":"2023-12-04T05:39:41.587910+0000","last_undegraded":"2023-12-04T05:39:41.587910+0000","last_fullsized":"2023-12-04T05:39:41.587910+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:55:27.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009303+0000","last_change":"2023-12-04T05:39:27.090956+0000","last_active":"2023-12-04T05:39:40.009303+0000","last_peered":"2023-12-04T05:39:40.009303+0000","last_clean":"2023-12-04T05:39:40.009303+0000","last_became_active":"2023-12-04T05:39:27.090277+0000","last_became_peered":"2023-12-04T05:39:27.090277+0000","last_unstale":"2023-12-04T05:39:40.009303+0000","last_undegraded":"2023-12-04T05:39:40.009303+0000","last_fullsized":"2023-12-04T05:39:40.009303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:04.080470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585435+0000","last_change":"2023-12-04T05:39:40.038105+0000","last_active":"2023-12-04T05:39:41.585435+0000","last_peered":"2023-12-04T05:39:41.585435+0000","last_clean":"2023-12-04T05:39:41.585435+0000","last_became_active":"2023-12-04T05:39:40.037805+0000","last_became_peered":"2023-12-04T05:39:40.037805+0000","last_unstale":"2023-12-04T05:39:41.585435+0000","last_undegraded":"2023-12-04T05:39:41.585435+0000","last_fullsized":"2023-12-04T05:39:41.585435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:35:24.379961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009583+0000","last_change":"2023-12-04T05:39:27.094421+0000","last_active":"2023-12-04T05:39:40.009583+0000","last_peered":"2023-12-04T05:39:40.009583+0000","last_clean":"2023-12-04T05:39:40.009583+0000","last_became_active":"2023-12-04T05:39:27.094055+0000","last_became_peered":"2023-12-04T05:39:27.094055+0000","last_unstale":"2023-12-04T05:39:40.009583+0000","last_undegraded":"2023-12-04T05:39:40.009583+0000","last_fullsized":"2023-12-04T05:39:40.009583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:39:31.395233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586113+0000","last_change":"2023-12-04T05:39:40.023320+0000","last_active":"2023-12-04T05:39:41.586113+0000","last_peered":"2023-12-04T05:39:41.586113+0000","last_clean":"2023-12-04T05:39:41.586113+0000","last_became_active":"2023-12-04T05:39:40.022981+0000","last_became_peered":"2023-12-04T05:39:40.022981+0000","last_unstale":"2023-12-04T05:39:41.586113+0000","last_undegraded":"2023-12-04T05:39:41.586113+0000","last_fullsized":"2023-12-04T05:39:41.586113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:36.317280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008229+0000","last_change":"2023-12-04T05:39:27.078833+0000","last_active":"2023-12-04T05:39:40.008229+0000","last_peered":"2023-12-04T05:39:40.008229+0000","last_clean":"2023-12-04T05:39:40.008229+0000","last_became_active":"2023-12-04T05:39:27.078478+0000","last_became_peered":"2023-12-04T05:39:27.078478+0000","last_unstale":"2023-12-04T05:39:40.008229+0000","last_undegraded":"2023-12-04T05:39:40.008229+0000","last_fullsized":"2023-12-04T05:39:40.008229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:58.277677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585732+0000","last_change":"2023-12-04T05:39:40.041534+0000","last_active":"2023-12-04T05:39:41.585732+0000","last_peered":"2023-12-04T05:39:41.585732+0000","last_clean":"2023-12-04T05:39:41.585732+0000","last_became_active":"2023-12-04T05:39:40.041308+0000","last_became_peered":"2023-12-04T05:39:40.041308+0000","last_unstale":"2023-12-04T05:39:41.585732+0000","last_undegraded":"2023-12-04T05:39:41.585732+0000","last_fullsized":"2023-12-04T05:39:41.585732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:14.758006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014534+0000","last_change":"2023-12-04T05:39:27.082161+0000","last_active":"2023-12-04T05:39:40.014534+0000","last_peered":"2023-12-04T05:39:40.014534+0000","last_clean":"2023-12-04T05:39:40.014534+0000","last_became_active":"2023-12-04T05:39:27.081890+0000","last_became_peered":"2023-12-04T05:39:27.081890+0000","last_unstale":"2023-12-04T05:39:40.014534+0000","last_undegraded":"2023-12-04T05:39:40.014534+0000","last_fullsized":"2023-12-04T05:39:40.014534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585460+0000","last_change":"2023-12-04T05:39:40.038842+0000","last_active":"2023-12-04T05:39:41.585460+0000","last_peered":"2023-12-04T05:39:41.585460+0000","last_clean":"2023-12-04T05:39:41.585460+0000","last_became_active":"2023-12-04T05:39:40.038561+0000","last_became_peered":"2023-12-04T05:39:40.038561+0000","last_unstale":"2023-12-04T05:39:41.585460+0000","last_undegraded":"2023-12-04T05:39:41.585460+0000","last_fullsized":"2023-12-04T05:39:41.585460+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:53:03.522750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.007849+0000","last_change":"2023-12-04T05:39:27.099452+0000","last_active":"2023-12-04T05:39:40.007849+0000","last_peered":"2023-12-04T05:39:40.007849+0000","last_clean":"2023-12-04T05:39:40.007849+0000","last_became_active":"2023-12-04T05:39:27.099205+0000","last_became_peered":"2023-12-04T05:39:27.099205+0000","last_unstale":"2023-12-04T05:39:40.007849+0000","last_undegraded":"2023-12-04T05:39:40.007849+0000","last_fullsized":"2023-12-04T05:39:40.007849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:55:30.871506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586756+0000","last_change":"2023-12-04T05:39:40.032489+0000","last_active":"2023-12-04T05:39:41.586756+0000","last_peered":"2023-12-04T05:39:41.586756+0000","last_clean":"2023-12-04T05:39:41.586756+0000","last_became_active":"2023-12-04T05:39:40.032204+0000","last_became_peered":"2023-12-04T05:39:40.032204+0000","last_unstale":"2023-12-04T05:39:41.586756+0000","last_undegraded":"2023-12-04T05:39:41.586756+0000","last_fullsized":"2023-12-04T05:39:41.586756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:28:26.544685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010944+0000","last_change":"2023-12-04T05:39:27.077164+0000","last_active":"2023-12-04T05:39:40.010944+0000","last_peered":"2023-12-04T05:39:40.010944+0000","last_clean":"2023-12-04T05:39:40.010944+0000","last_became_active":"2023-12-04T05:39:27.076536+0000","last_became_peered":"2023-12-04T05:39:27.076536+0000","last_unstale":"2023-12-04T05:39:40.010944+0000","last_undegraded":"2023-12-04T05:39:40.010944+0000","last_fullsized":"2023-12-04T05:39:40.010944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:40.367089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013379+0000","last_change":"2023-12-04T05:39:40.020841+0000","last_active":"2023-12-04T05:39:41.013379+0000","last_peered":"2023-12-04T05:39:41.013379+0000","last_clean":"2023-12-04T05:39:41.013379+0000","last_became_active":"2023-12-04T05:39:40.020362+0000","last_became_peered":"2023-12-04T05:39:40.020362+0000","last_unstale":"2023-12-04T05:39:41.013379+0000","last_undegraded":"2023-12-04T05:39:41.013379+0000","last_fullsized":"2023-12-04T05:39:41.013379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:45:49.240614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013398+0000","last_change":"2023-12-04T05:39:27.082797+0000","last_active":"2023-12-04T05:39:40.013398+0000","last_peered":"2023-12-04T05:39:40.013398+0000","last_clean":"2023-12-04T05:39:40.013398+0000","last_became_active":"2023-12-04T05:39:27.081419+0000","last_became_peered":"2023-12-04T05:39:27.081419+0000","last_unstale":"2023-12-04T05:39:40.013398+0000","last_undegraded":"2023-12-04T05:39:40.013398+0000","last_fullsized":"2023-12-04T05:39:40.013398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.014359+0000","last_change":"2023-12-04T05:39:40.030688+0000","last_active":"2023-12-04T05:39:41.014359+0000","last_peered":"2023-12-04T05:39:41.014359+0000","last_clean":"2023-12-04T05:39:41.014359+0000","last_became_active":"2023-12-04T05:39:40.029062+0000","last_became_peered":"2023-12-04T05:39:40.029062+0000","last_unstale":"2023-12-04T05:39:41.014359+0000","last_undegraded":"2023-12-04T05:39:41.014359+0000","last_fullsized":"2023-12-04T05:39:41.014359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:25.622203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.027361+0000","last_change":"2023-12-04T05:39:27.092222+0000","last_active":"2023-12-04T05:39:40.027361+0000","last_peered":"2023-12-04T05:39:40.027361+0000","last_clean":"2023-12-04T05:39:40.027361+0000","last_became_active":"2023-12-04T05:39:27.091888+0000","last_became_peered":"2023-12-04T05:39:27.091888+0000","last_unstale":"2023-12-04T05:39:40.027361+0000","last_undegraded":"2023-12-04T05:39:40.027361+0000","last_fullsized":"2023-12-04T05:39:40.027361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:28.404063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587380+0000","last_change":"2023-12-04T05:39:40.029511+0000","last_active":"2023-12-04T05:39:41.587380+0000","last_peered":"2023-12-04T05:39:41.587380+0000","last_clean":"2023-12-04T05:39:41.587380+0000","last_became_active":"2023-12-04T05:39:40.029196+0000","last_became_peered":"2023-12-04T05:39:40.029196+0000","last_unstale":"2023-12-04T05:39:41.587380+0000","last_undegraded":"2023-12-04T05:39:41.587380+0000","last_fullsized":"2023-12-04T05:39:41.587380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:34:10.256921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016408+0000","last_change":"2023-12-04T05:39:27.083638+0000","last_active":"2023-12-04T05:39:40.016408+0000","last_peered":"2023-12-04T05:39:40.016408+0000","last_clean":"2023-12-04T05:39:40.016408+0000","last_became_active":"2023-12-04T05:39:27.083278+0000","last_became_peered":"2023-12-04T05:39:27.083278+0000","last_unstale":"2023-12-04T05:39:40.016408+0000","last_undegraded":"2023-12-04T05:39:40.016408+0000","last_fullsized":"2023-12-04T05:39:40.016408+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586279+0000","last_change":"2023-12-04T05:39:40.033080+0000","last_active":"2023-12-04T05:39:41.586279+0000","last_peered":"2023-12-04T05:39:41.586279+0000","last_clean":"2023-12-04T05:39:41.586279+0000","last_became_active":"2023-12-04T05:39:40.032586+0000","last_became_peered":"2023-12-04T05:39:40.032586+0000","last_unstale":"2023-12-04T05:39:41.586279+0000","last_undegraded":"2023-12-04T05:39:41.586279+0000","last_fullsized":"2023-12-04T05:39:41.586279+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:53:03.522750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008697+0000","last_change":"2023-12-04T05:39:27.089048+0000","last_active":"2023-12-04T05:39:40.008697+0000","last_peered":"2023-12-04T05:39:40.008697+0000","last_clean":"2023-12-04T05:39:40.008697+0000","last_became_active":"2023-12-04T05:39:27.088751+0000","last_became_peered":"2023-12-04T05:39:27.088751+0000","last_unstale":"2023-12-04T05:39:40.008697+0000","last_undegraded":"2023-12-04T05:39:40.008697+0000","last_fullsized":"2023-12-04T05:39:40.008697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:52.895380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.010180+0000","last_change":"2023-12-04T05:39:40.021274+0000","last_active":"2023-12-04T05:39:41.010180+0000","last_peered":"2023-12-04T05:39:41.010180+0000","last_clean":"2023-12-04T05:39:41.010180+0000","last_became_active":"2023-12-04T05:39:40.020925+0000","last_became_peered":"2023-12-04T05:39:40.020925+0000","last_unstale":"2023-12-04T05:39:41.010180+0000","last_undegraded":"2023-12-04T05:39:41.010180+0000","last_fullsized":"2023-12-04T05:39:41.010180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:29:09.918537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008315+0000","last_change":"2023-12-04T05:39:27.103464+0000","last_active":"2023-12-04T05:39:40.008315+0000","last_peered":"2023-12-04T05:39:40.008315+0000","last_clean":"2023-12-04T05:39:40.008315+0000","last_became_active":"2023-12-04T05:39:27.102812+0000","last_became_peered":"2023-12-04T05:39:27.102812+0000","last_unstale":"2023-12-04T05:39:40.008315+0000","last_undegraded":"2023-12-04T05:39:40.008315+0000","last_fullsized":"2023-12-04T05:39:40.008315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:58:05.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586968+0000","last_change":"2023-12-04T05:39:40.027650+0000","last_active":"2023-12-04T05:39:41.586968+0000","last_peered":"2023-12-04T05:39:41.586968+0000","last_clean":"2023-12-04T05:39:41.586968+0000","last_became_active":"2023-12-04T05:39:40.027395+0000","last_became_peered":"2023-12-04T05:39:40.027395+0000","last_unstale":"2023-12-04T05:39:41.586968+0000","last_undegraded":"2023-12-04T05:39:41.586968+0000","last_fullsized":"2023-12-04T05:39:41.586968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:13.652456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018592+0000","last_change":"2023-12-04T05:39:27.077619+0000","last_active":"2023-12-04T05:39:40.018592+0000","last_peered":"2023-12-04T05:39:40.018592+0000","last_clean":"2023-12-04T05:39:40.018592+0000","last_became_active":"2023-12-04T05:39:27.077334+0000","last_became_peered":"2023-12-04T05:39:27.077334+0000","last_unstale":"2023-12-04T05:39:40.018592+0000","last_undegraded":"2023-12-04T05:39:40.018592+0000","last_fullsized":"2023-12-04T05:39:40.018592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:50.790609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587113+0000","last_change":"2023-12-04T05:39:40.018303+0000","last_active":"2023-12-04T05:39:41.587113+0000","last_peered":"2023-12-04T05:39:41.587113+0000","last_clean":"2023-12-04T05:39:41.587113+0000","last_became_active":"2023-12-04T05:39:40.018130+0000","last_became_peered":"2023-12-04T05:39:40.018130+0000","last_unstale":"2023-12-04T05:39:41.587113+0000","last_undegraded":"2023-12-04T05:39:41.587113+0000","last_fullsized":"2023-12-04T05:39:41.587113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:41.495085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014063+0000","last_change":"2023-12-04T05:39:27.078402+0000","last_active":"2023-12-04T05:39:40.014063+0000","last_peered":"2023-12-04T05:39:40.014063+0000","last_clean":"2023-12-04T05:39:40.014063+0000","last_became_active":"2023-12-04T05:39:27.078138+0000","last_became_peered":"2023-12-04T05:39:27.078138+0000","last_unstale":"2023-12-04T05:39:40.014063+0000","last_undegraded":"2023-12-04T05:39:40.014063+0000","last_fullsized":"2023-12-04T05:39:40.014063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:17.371815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.010884+0000","last_change":"2023-12-04T05:39:40.023696+0000","last_active":"2023-12-04T05:39:41.010884+0000","last_peered":"2023-12-04T05:39:41.010884+0000","last_clean":"2023-12-04T05:39:41.010884+0000","last_became_active":"2023-12-04T05:39:40.023355+0000","last_became_peered":"2023-12-04T05:39:40.023355+0000","last_unstale":"2023-12-04T05:39:41.010884+0000","last_undegraded":"2023-12-04T05:39:41.010884+0000","last_fullsized":"2023-12-04T05:39:41.010884+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:48.670614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.165484+0000","last_change":"2023-12-04T05:39:39.177976+0000","last_active":"2023-12-04T05:39:40.165484+0000","last_peered":"2023-12-04T05:39:40.165484+0000","last_clean":"2023-12-04T05:39:40.165484+0000","last_became_active":"2023-12-04T05:39:39.177715+0000","last_became_peered":"2023-12-04T05:39:39.177715+0000","last_unstale":"2023-12-04T05:39:40.165484+0000","last_undegraded":"2023-12-04T05:39:40.165484+0000","last_fullsized":"2023-12-04T05:39:40.165484+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:28:25.536637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016967+0000","last_change":"2023-12-04T05:39:27.075620+0000","last_active":"2023-12-04T05:39:40.016967+0000","last_peered":"2023-12-04T05:39:40.016967+0000","last_clean":"2023-12-04T05:39:40.016967+0000","last_became_active":"2023-12-04T05:39:27.075284+0000","last_became_peered":"2023-12-04T05:39:27.075284+0000","last_unstale":"2023-12-04T05:39:40.016967+0000","last_undegraded":"2023-12-04T05:39:40.016967+0000","last_fullsized":"2023-12-04T05:39:40.016967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017811+0000","last_change":"2023-12-04T05:39:26.076976+0000","last_active":"2023-12-04T05:39:40.017811+0000","last_peered":"2023-12-04T05:39:40.017811+0000","last_clean":"2023-12-04T05:39:40.017811+0000","last_became_active":"2023-12-04T05:39:26.076581+0000","last_became_peered":"2023-12-04T05:39:26.076581+0000","last_unstale":"2023-12-04T05:39:40.017811+0000","last_undegraded":"2023-12-04T05:39:40.017811+0000","last_fullsized":"2023-12-04T05:39:40.017811+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013722+0000","last_change":"2023-12-04T05:39:40.039837+0000","last_active":"2023-12-04T05:39:41.013722+0000","last_peered":"2023-12-04T05:39:41.013722+0000","last_clean":"2023-12-04T05:39:41.013722+0000","last_became_active":"2023-12-04T05:39:40.039132+0000","last_became_peered":"2023-12-04T05:39:40.039132+0000","last_unstale":"2023-12-04T05:39:41.013722+0000","last_undegraded":"2023-12-04T05:39:41.013722+0000","last_fullsized":"2023-12-04T05:39:41.013722+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:55.432219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.166023+0000","last_change":"2023-12-04T05:39:39.160979+0000","last_active":"2023-12-04T05:39:40.166023+0000","last_peered":"2023-12-04T05:39:40.166023+0000","last_clean":"2023-12-04T05:39:40.166023+0000","last_became_active":"2023-12-04T05:39:39.160600+0000","last_became_peered":"2023-12-04T05:39:39.160600+0000","last_unstale":"2023-12-04T05:39:40.166023+0000","last_undegraded":"2023-12-04T05:39:40.166023+0000","last_fullsized":"2023-12-04T05:39:40.166023+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:44:35.038954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017635+0000","last_change":"2023-12-04T05:39:27.083622+0000","last_active":"2023-12-04T05:39:40.017635+0000","last_peered":"2023-12-04T05:39:40.017635+0000","last_clean":"2023-12-04T05:39:40.017635+0000","last_became_active":"2023-12-04T05:39:27.083307+0000","last_became_peered":"2023-12-04T05:39:27.083307+0000","last_unstale":"2023-12-04T05:39:40.017635+0000","last_undegraded":"2023-12-04T05:39:40.017635+0000","last_fullsized":"2023-12-04T05:39:40.017635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017216+0000","last_change":"2023-12-04T05:39:26.078897+0000","last_active":"2023-12-04T05:39:40.017216+0000","last_peered":"2023-12-04T05:39:40.017216+0000","last_clean":"2023-12-04T05:39:40.017216+0000","last_became_active":"2023-12-04T05:39:26.078018+0000","last_became_peered":"2023-12-04T05:39:26.078018+0000","last_unstale":"2023-12-04T05:39:40.017216+0000","last_undegraded":"2023-12-04T05:39:40.017216+0000","last_fullsized":"2023-12-04T05:39:40.017216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586705+0000","last_change":"2023-12-04T05:39:40.022313+0000","last_active":"2023-12-04T05:39:41.586705+0000","last_peered":"2023-12-04T05:39:41.586705+0000","last_clean":"2023-12-04T05:39:41.586705+0000","last_became_active":"2023-12-04T05:39:40.021671+0000","last_became_peered":"2023-12-04T05:39:40.021671+0000","last_unstale":"2023-12-04T05:39:41.586705+0000","last_undegraded":"2023-12-04T05:39:41.586705+0000","last_fullsized":"2023-12-04T05:39:41.586705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:52.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.165844+0000","last_change":"2023-12-04T05:39:39.171430+0000","last_active":"2023-12-04T05:39:40.165844+0000","last_peered":"2023-12-04T05:39:40.165844+0000","last_clean":"2023-12-04T05:39:40.165844+0000","last_became_active":"2023-12-04T05:39:39.171144+0000","last_became_peered":"2023-12-04T05:39:39.171144+0000","last_unstale":"2023-12-04T05:39:40.165844+0000","last_undegraded":"2023-12-04T05:39:40.165844+0000","last_fullsized":"2023-12-04T05:39:40.165844+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:24.614156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018255+0000","last_change":"2023-12-04T05:39:27.079603+0000","last_active":"2023-12-04T05:39:40.018255+0000","last_peered":"2023-12-04T05:39:40.018255+0000","last_clean":"2023-12-04T05:39:40.018255+0000","last_became_active":"2023-12-04T05:39:27.079350+0000","last_became_peered":"2023-12-04T05:39:27.079350+0000","last_unstale":"2023-12-04T05:39:40.018255+0000","last_undegraded":"2023-12-04T05:39:40.018255+0000","last_fullsized":"2023-12-04T05:39:40.018255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021934+0000","last_change":"2023-12-04T05:39:26.076007+0000","last_active":"2023-12-04T05:39:40.021934+0000","last_peered":"2023-12-04T05:39:40.021934+0000","last_clean":"2023-12-04T05:39:40.021934+0000","last_became_active":"2023-12-04T05:39:26.075733+0000","last_became_peered":"2023-12-04T05:39:26.075733+0000","last_unstale":"2023-12-04T05:39:40.021934+0000","last_undegraded":"2023-12-04T05:39:40.021934+0000","last_fullsized":"2023-12-04T05:39:40.021934+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:05.655015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.588074+0000","last_change":"2023-12-04T05:39:40.032389+0000","last_active":"2023-12-04T05:39:41.588074+0000","last_peered":"2023-12-04T05:39:41.588074+0000","last_clean":"2023-12-04T05:39:41.588074+0000","last_became_active":"2023-12-04T05:39:40.032118+0000","last_became_peered":"2023-12-04T05:39:40.032118+0000","last_unstale":"2023-12-04T05:39:41.588074+0000","last_undegraded":"2023-12-04T05:39:41.588074+0000","last_fullsized":"2023-12-04T05:39:41.588074+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:13.652456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.162886+0000","last_change":"2023-12-04T05:39:39.178018+0000","last_active":"2023-12-04T05:39:40.162886+0000","last_peered":"2023-12-04T05:39:40.162886+0000","last_clean":"2023-12-04T05:39:40.162886+0000","last_became_active":"2023-12-04T05:39:39.177602+0000","last_became_peered":"2023-12-04T05:39:39.177602+0000","last_unstale":"2023-12-04T05:39:40.162886+0000","last_undegraded":"2023-12-04T05:39:40.162886+0000","last_fullsized":"2023-12-04T05:39:40.162886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:21:56.491842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015688+0000","last_change":"2023-12-04T05:39:27.105372+0000","last_active":"2023-12-04T05:39:40.015688+0000","last_peered":"2023-12-04T05:39:40.015688+0000","last_clean":"2023-12-04T05:39:40.015688+0000","last_became_active":"2023-12-04T05:39:27.105036+0000","last_became_peered":"2023-12-04T05:39:27.105036+0000","last_unstale":"2023-12-04T05:39:40.015688+0000","last_undegraded":"2023-12-04T05:39:40.015688+0000","last_fullsized":"2023-12-04T05:39:40.015688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021219+0000","last_change":"2023-12-04T05:39:26.077203+0000","last_active":"2023-12-04T05:39:40.021219+0000","last_peered":"2023-12-04T05:39:40.021219+0000","last_clean":"2023-12-04T05:39:40.021219+0000","last_became_active":"2023-12-04T05:39:26.076877+0000","last_became_peered":"2023-12-04T05:39:26.076877+0000","last_unstale":"2023-12-04T05:39:40.021219+0000","last_undegraded":"2023-12-04T05:39:40.021219+0000","last_fullsized":"2023-12-04T05:39:40.021219+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:14.982034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585823+0000","last_change":"2023-12-04T05:39:40.023381+0000","last_active":"2023-12-04T05:39:41.585823+0000","last_peered":"2023-12-04T05:39:41.585823+0000","last_clean":"2023-12-04T05:39:41.585823+0000","last_became_active":"2023-12-04T05:39:40.023116+0000","last_became_peered":"2023-12-04T05:39:40.023116+0000","last_unstale":"2023-12-04T05:39:41.585823+0000","last_undegraded":"2023-12-04T05:39:41.585823+0000","last_fullsized":"2023-12-04T05:39:41.585823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:25:48.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014451+0000","last_change":"2023-12-04T05:39:39.167940+0000","last_active":"2023-12-04T05:39:40.014451+0000","last_peered":"2023-12-04T05:39:40.014451+0000","last_clean":"2023-12-04T05:39:40.014451+0000","last_became_active":"2023-12-04T05:39:39.166821+0000","last_became_peered":"2023-12-04T05:39:39.166821+0000","last_unstale":"2023-12-04T05:39:40.014451+0000","last_undegraded":"2023-12-04T05:39:40.014451+0000","last_fullsized":"2023-12-04T05:39:40.014451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:01.145095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008417+0000","last_change":"2023-12-04T05:39:27.103318+0000","last_active":"2023-12-04T05:39:40.008417+0000","last_peered":"2023-12-04T05:39:40.008417+0000","last_clean":"2023-12-04T05:39:40.008417+0000","last_became_active":"2023-12-04T05:39:27.102506+0000","last_became_peered":"2023-12-04T05:39:27.102506+0000","last_unstale":"2023-12-04T05:39:40.008417+0000","last_undegraded":"2023-12-04T05:39:40.008417+0000","last_fullsized":"2023-12-04T05:39:40.008417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:10.220064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021918+0000","last_change":"2023-12-04T05:39:26.083745+0000","last_active":"2023-12-04T05:39:40.021918+0000","last_peered":"2023-12-04T05:39:40.021918+0000","last_clean":"2023-12-04T05:39:40.021918+0000","last_became_active":"2023-12-04T05:39:26.083470+0000","last_became_peered":"2023-12-04T05:39:26.083470+0000","last_unstale":"2023-12-04T05:39:40.021918+0000","last_undegraded":"2023-12-04T05:39:40.021918+0000","last_fullsized":"2023-12-04T05:39:40.021918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:36.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012220+0000","last_change":"2023-12-04T05:39:40.041680+0000","last_active":"2023-12-04T05:39:41.012220+0000","last_peered":"2023-12-04T05:39:41.012220+0000","last_clean":"2023-12-04T05:39:41.012220+0000","last_became_active":"2023-12-04T05:39:40.041416+0000","last_became_peered":"2023-12-04T05:39:40.041416+0000","last_unstale":"2023-12-04T05:39:41.012220+0000","last_undegraded":"2023-12-04T05:39:41.012220+0000","last_fullsized":"2023-12-04T05:39:41.012220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:33:37.411072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.007920+0000","last_change":"2023-12-04T05:39:39.181671+0000","last_active":"2023-12-04T05:39:40.007920+0000","last_peered":"2023-12-04T05:39:40.007920+0000","last_clean":"2023-12-04T05:39:40.007920+0000","last_became_active":"2023-12-04T05:39:39.176746+0000","last_became_peered":"2023-12-04T05:39:39.176746+0000","last_unstale":"2023-12-04T05:39:40.007920+0000","last_undegraded":"2023-12-04T05:39:40.007920+0000","last_fullsized":"2023-12-04T05:39:40.007920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:28.073314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021650+0000","last_change":"2023-12-04T05:39:27.095704+0000","last_active":"2023-12-04T05:39:40.021650+0000","last_peered":"2023-12-04T05:39:40.021650+0000","last_clean":"2023-12-04T05:39:40.021650+0000","last_became_active":"2023-12-04T05:39:27.095453+0000","last_became_peered":"2023-12-04T05:39:27.095453+0000","last_unstale":"2023-12-04T05:39:40.021650+0000","last_undegraded":"2023-12-04T05:39:40.021650+0000","last_fullsized":"2023-12-04T05:39:40.021650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016032+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:40.016032+0000","last_peered":"2023-12-04T05:39:40.016032+0000","last_clean":"2023-12-04T05:39:40.016032+0000","last_became_active":"2023-12-04T05:39:26.082344+0000","last_became_peered":"2023-12-04T05:39:26.082344+0000","last_unstale":"2023-12-04T05:39:40.016032+0000","last_undegraded":"2023-12-04T05:39:40.016032+0000","last_fullsized":"2023-12-04T05:39:40.016032+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:31:58.593571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.587178+0000","last_change":"2023-12-04T05:39:40.038448+0000","last_active":"2023-12-04T05:39:41.587178+0000","last_peered":"2023-12-04T05:39:41.587178+0000","last_clean":"2023-12-04T05:39:41.587178+0000","last_became_active":"2023-12-04T05:39:40.038114+0000","last_became_peered":"2023-12-04T05:39:40.038114+0000","last_unstale":"2023-12-04T05:39:41.587178+0000","last_undegraded":"2023-12-04T05:39:41.587178+0000","last_fullsized":"2023-12-04T05:39:41.587178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:17.040127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.160896+0000","last_change":"2023-12-04T05:39:39.176258+0000","last_active":"2023-12-04T05:39:40.160896+0000","last_peered":"2023-12-04T05:39:40.160896+0000","last_clean":"2023-12-04T05:39:40.160896+0000","last_became_active":"2023-12-04T05:39:39.175922+0000","last_became_peered":"2023-12-04T05:39:39.175922+0000","last_unstale":"2023-12-04T05:39:40.160896+0000","last_undegraded":"2023-12-04T05:39:40.160896+0000","last_fullsized":"2023-12-04T05:39:40.160896+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:40.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014097+0000","last_change":"2023-12-04T05:39:27.083885+0000","last_active":"2023-12-04T05:39:40.014097+0000","last_peered":"2023-12-04T05:39:40.014097+0000","last_clean":"2023-12-04T05:39:40.014097+0000","last_became_active":"2023-12-04T05:39:27.083258+0000","last_became_peered":"2023-12-04T05:39:27.083258+0000","last_unstale":"2023-12-04T05:39:40.014097+0000","last_undegraded":"2023-12-04T05:39:40.014097+0000","last_fullsized":"2023-12-04T05:39:40.014097+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.020459+0000","last_change":"2023-12-04T05:39:26.079216+0000","last_active":"2023-12-04T05:39:40.020459+0000","last_peered":"2023-12-04T05:39:40.020459+0000","last_clean":"2023-12-04T05:39:40.020459+0000","last_became_active":"2023-12-04T05:39:26.078909+0000","last_became_peered":"2023-12-04T05:39:26.078909+0000","last_unstale":"2023-12-04T05:39:40.020459+0000","last_undegraded":"2023-12-04T05:39:40.020459+0000","last_fullsized":"2023-12-04T05:39:40.020459+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586117+0000","last_change":"2023-12-04T05:39:40.022892+0000","last_active":"2023-12-04T05:39:41.586117+0000","last_peered":"2023-12-04T05:39:41.586117+0000","last_clean":"2023-12-04T05:39:41.586117+0000","last_became_active":"2023-12-04T05:39:40.022268+0000","last_became_peered":"2023-12-04T05:39:40.022268+0000","last_unstale":"2023-12-04T05:39:41.586117+0000","last_undegraded":"2023-12-04T05:39:41.586117+0000","last_fullsized":"2023-12-04T05:39:41.586117+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:44:36.047002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.163695+0000","last_change":"2023-12-04T05:39:39.171612+0000","last_active":"2023-12-04T05:39:40.163695+0000","last_peered":"2023-12-04T05:39:40.163695+0000","last_clean":"2023-12-04T05:39:40.163695+0000","last_became_active":"2023-12-04T05:39:39.171352+0000","last_became_peered":"2023-12-04T05:39:39.171352+0000","last_unstale":"2023-12-04T05:39:40.163695+0000","last_undegraded":"2023-12-04T05:39:40.163695+0000","last_fullsized":"2023-12-04T05:39:40.163695+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:35.309232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014663+0000","last_change":"2023-12-04T05:39:27.088070+0000","last_active":"2023-12-04T05:39:40.014663+0000","last_peered":"2023-12-04T05:39:40.014663+0000","last_clean":"2023-12-04T05:39:40.014663+0000","last_became_active":"2023-12-04T05:39:27.087797+0000","last_became_peered":"2023-12-04T05:39:27.087797+0000","last_unstale":"2023-12-04T05:39:40.014663+0000","last_undegraded":"2023-12-04T05:39:40.014663+0000","last_fullsized":"2023-12-04T05:39:40.014663+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:21:44.408868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008409+0000","last_change":"2023-12-04T05:39:26.081292+0000","last_active":"2023-12-04T05:39:40.008409+0000","last_peered":"2023-12-04T05:39:40.008409+0000","last_clean":"2023-12-04T05:39:40.008409+0000","last_became_active":"2023-12-04T05:39:26.080956+0000","last_became_peered":"2023-12-04T05:39:26.080956+0000","last_unstale":"2023-12-04T05:39:40.008409+0000","last_undegraded":"2023-12-04T05:39:40.008409+0000","last_fullsized":"2023-12-04T05:39:40.008409+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:59:30.549509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013062+0000","last_change":"2023-12-04T05:39:40.028687+0000","last_active":"2023-12-04T05:39:41.013062+0000","last_peered":"2023-12-04T05:39:41.013062+0000","last_clean":"2023-12-04T05:39:41.013062+0000","last_became_active":"2023-12-04T05:39:40.027750+0000","last_became_peered":"2023-12-04T05:39:40.027750+0000","last_unstale":"2023-12-04T05:39:41.013062+0000","last_undegraded":"2023-12-04T05:39:41.013062+0000","last_fullsized":"2023-12-04T05:39:41.013062+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:07.219921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.165948+0000","last_change":"2023-12-04T05:39:39.174224+0000","last_active":"2023-12-04T05:39:40.165948+0000","last_peered":"2023-12-04T05:39:40.165948+0000","last_clean":"2023-12-04T05:39:40.165948+0000","last_became_active":"2023-12-04T05:39:39.173882+0000","last_became_peered":"2023-12-04T05:39:39.173882+0000","last_unstale":"2023-12-04T05:39:40.165948+0000","last_undegraded":"2023-12-04T05:39:40.165948+0000","last_fullsized":"2023-12-04T05:39:40.165948+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:44:04.482389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015790+0000","last_change":"2023-12-04T05:39:27.086538+0000","last_active":"2023-12-04T05:39:40.015790+0000","last_peered":"2023-12-04T05:39:40.015790+0000","last_clean":"2023-12-04T05:39:40.015790+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:40.015790+0000","last_undegraded":"2023-12-04T05:39:40.015790+0000","last_fullsized":"2023-12-04T05:39:40.015790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:14.528915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017921+0000","last_change":"2023-12-04T05:39:26.079751+0000","last_active":"2023-12-04T05:39:40.017921+0000","last_peered":"2023-12-04T05:39:40.017921+0000","last_clean":"2023-12-04T05:39:40.017921+0000","last_became_active":"2023-12-04T05:39:26.079416+0000","last_became_peered":"2023-12-04T05:39:26.079416+0000","last_unstale":"2023-12-04T05:39:40.017921+0000","last_undegraded":"2023-12-04T05:39:40.017921+0000","last_fullsized":"2023-12-04T05:39:40.017921+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:38.798222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586314+0000","last_change":"2023-12-04T05:39:40.025284+0000","last_active":"2023-12-04T05:39:41.586314+0000","last_peered":"2023-12-04T05:39:41.586314+0000","last_clean":"2023-12-04T05:39:41.586314+0000","last_became_active":"2023-12-04T05:39:40.025025+0000","last_became_peered":"2023-12-04T05:39:40.025025+0000","last_unstale":"2023-12-04T05:39:41.586314+0000","last_undegraded":"2023-12-04T05:39:41.586314+0000","last_fullsized":"2023-12-04T05:39:41.586314+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:07.219921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.167544+0000","last_change":"2023-12-04T05:39:39.173568+0000","last_active":"2023-12-04T05:39:40.167544+0000","last_peered":"2023-12-04T05:39:40.167544+0000","last_clean":"2023-12-04T05:39:40.167544+0000","last_became_active":"2023-12-04T05:39:39.173233+0000","last_became_peered":"2023-12-04T05:39:39.173233+0000","last_unstale":"2023-12-04T05:39:40.167544+0000","last_undegraded":"2023-12-04T05:39:40.167544+0000","last_fullsized":"2023-12-04T05:39:40.167544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:19:52.545610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.026395+0000","last_change":"2023-12-04T05:39:27.100388+0000","last_active":"2023-12-04T05:39:40.026395+0000","last_peered":"2023-12-04T05:39:40.026395+0000","last_clean":"2023-12-04T05:39:40.026395+0000","last_became_active":"2023-12-04T05:39:27.100126+0000","last_became_peered":"2023-12-04T05:39:27.100126+0000","last_unstale":"2023-12-04T05:39:40.026395+0000","last_undegraded":"2023-12-04T05:39:40.026395+0000","last_fullsized":"2023-12-04T05:39:40.026395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:55:15.990340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017307+0000","last_change":"2023-12-04T05:39:26.076770+0000","last_active":"2023-12-04T05:39:40.017307+0000","last_peered":"2023-12-04T05:39:40.017307+0000","last_clean":"2023-12-04T05:39:40.017307+0000","last_became_active":"2023-12-04T05:39:26.076464+0000","last_became_peered":"2023-12-04T05:39:26.076464+0000","last_unstale":"2023-12-04T05:39:40.017307+0000","last_undegraded":"2023-12-04T05:39:40.017307+0000","last_fullsized":"2023-12-04T05:39:40.017307+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:14.556478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586826+0000","last_change":"2023-12-04T05:39:40.031364+0000","last_active":"2023-12-04T05:39:41.586826+0000","last_peered":"2023-12-04T05:39:41.586826+0000","last_clean":"2023-12-04T05:39:41.586826+0000","last_became_active":"2023-12-04T05:39:40.031040+0000","last_became_peered":"2023-12-04T05:39:40.031040+0000","last_unstale":"2023-12-04T05:39:41.586826+0000","last_undegraded":"2023-12-04T05:39:41.586826+0000","last_fullsized":"2023-12-04T05:39:41.586826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:43:40.019707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010710+0000","last_change":"2023-12-04T05:39:39.176263+0000","last_active":"2023-12-04T05:39:40.010710+0000","last_peered":"2023-12-04T05:39:40.010710+0000","last_clean":"2023-12-04T05:39:40.010710+0000","last_became_active":"2023-12-04T05:39:39.175977+0000","last_became_peered":"2023-12-04T05:39:39.175977+0000","last_unstale":"2023-12-04T05:39:40.010710+0000","last_undegraded":"2023-12-04T05:39:40.010710+0000","last_fullsized":"2023-12-04T05:39:40.010710+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:59.080712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021128+0000","last_change":"2023-12-04T05:39:27.090003+0000","last_active":"2023-12-04T05:39:40.021128+0000","last_peered":"2023-12-04T05:39:40.021128+0000","last_clean":"2023-12-04T05:39:40.021128+0000","last_became_active":"2023-12-04T05:39:27.089648+0000","last_became_peered":"2023-12-04T05:39:27.089648+0000","last_unstale":"2023-12-04T05:39:40.021128+0000","last_undegraded":"2023-12-04T05:39:40.021128+0000","last_fullsized":"2023-12-04T05:39:40.021128+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016703+0000","last_change":"2023-12-04T05:39:26.084259+0000","last_active":"2023-12-04T05:39:40.016703+0000","last_peered":"2023-12-04T05:39:40.016703+0000","last_clean":"2023-12-04T05:39:40.016703+0000","last_became_active":"2023-12-04T05:39:26.083846+0000","last_became_peered":"2023-12-04T05:39:26.083846+0000","last_unstale":"2023-12-04T05:39:40.016703+0000","last_undegraded":"2023-12-04T05:39:40.016703+0000","last_fullsized":"2023-12-04T05:39:40.016703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:35:57.269372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013993+0000","last_change":"2023-12-04T05:39:40.034823+0000","last_active":"2023-12-04T05:39:41.013993+0000","last_peered":"2023-12-04T05:39:41.013993+0000","last_clean":"2023-12-04T05:39:41.013993+0000","last_became_active":"2023-12-04T05:39:40.034526+0000","last_became_peered":"2023-12-04T05:39:40.034526+0000","last_unstale":"2023-12-04T05:39:41.013993+0000","last_undegraded":"2023-12-04T05:39:41.013993+0000","last_fullsized":"2023-12-04T05:39:41.013993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:36.317280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015681+0000","last_change":"2023-12-04T05:39:39.173292+0000","last_active":"2023-12-04T05:39:40.015681+0000","last_peered":"2023-12-04T05:39:40.015681+0000","last_clean":"2023-12-04T05:39:40.015681+0000","last_became_active":"2023-12-04T05:39:39.172810+0000","last_became_peered":"2023-12-04T05:39:39.172810+0000","last_unstale":"2023-12-04T05:39:40.015681+0000","last_undegraded":"2023-12-04T05:39:40.015681+0000","last_fullsized":"2023-12-04T05:39:40.015681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:28:25.536637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021443+0000","last_change":"2023-12-04T05:39:27.079605+0000","last_active":"2023-12-04T05:39:40.021443+0000","last_peered":"2023-12-04T05:39:40.021443+0000","last_clean":"2023-12-04T05:39:40.021443+0000","last_became_active":"2023-12-04T05:39:27.079189+0000","last_became_peered":"2023-12-04T05:39:27.079189+0000","last_unstale":"2023-12-04T05:39:40.021443+0000","last_undegraded":"2023-12-04T05:39:40.021443+0000","last_fullsized":"2023-12-04T05:39:40.021443+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:40.830422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.030105+0000","last_change":"2023-12-04T05:39:26.080958+0000","last_active":"2023-12-04T05:39:40.030105+0000","last_peered":"2023-12-04T05:39:40.030105+0000","last_clean":"2023-12-04T05:39:40.030105+0000","last_became_active":"2023-12-04T05:39:26.080666+0000","last_became_peered":"2023-12-04T05:39:26.080666+0000","last_unstale":"2023-12-04T05:39:40.030105+0000","last_undegraded":"2023-12-04T05:39:40.030105+0000","last_fullsized":"2023-12-04T05:39:40.030105+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:49.072351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012489+0000","last_change":"2023-12-04T05:39:40.035126+0000","last_active":"2023-12-04T05:39:41.012489+0000","last_peered":"2023-12-04T05:39:41.012489+0000","last_clean":"2023-12-04T05:39:41.012489+0000","last_became_active":"2023-12-04T05:39:40.034811+0000","last_became_peered":"2023-12-04T05:39:40.034811+0000","last_unstale":"2023-12-04T05:39:41.012489+0000","last_undegraded":"2023-12-04T05:39:41.012489+0000","last_fullsized":"2023-12-04T05:39:41.012489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:49:42.638498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018109+0000","last_change":"2023-12-04T05:39:39.171268+0000","last_active":"2023-12-04T05:39:40.018109+0000","last_peered":"2023-12-04T05:39:40.018109+0000","last_clean":"2023-12-04T05:39:40.018109+0000","last_became_active":"2023-12-04T05:39:39.170929+0000","last_became_peered":"2023-12-04T05:39:39.170929+0000","last_unstale":"2023-12-04T05:39:40.018109+0000","last_undegraded":"2023-12-04T05:39:40.018109+0000","last_fullsized":"2023-12-04T05:39:40.018109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:22:26.611889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021524+0000","last_change":"2023-12-04T05:39:27.081943+0000","last_active":"2023-12-04T05:39:40.021524+0000","last_peered":"2023-12-04T05:39:40.021524+0000","last_clean":"2023-12-04T05:39:40.021524+0000","last_became_active":"2023-12-04T05:39:27.081675+0000","last_became_peered":"2023-12-04T05:39:27.081675+0000","last_unstale":"2023-12-04T05:39:40.021524+0000","last_undegraded":"2023-12-04T05:39:40.021524+0000","last_fullsized":"2023-12-04T05:39:40.021524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008839+0000","last_change":"2023-12-04T05:39:26.082163+0000","last_active":"2023-12-04T05:39:40.008839+0000","last_peered":"2023-12-04T05:39:40.008839+0000","last_clean":"2023-12-04T05:39:40.008839+0000","last_became_active":"2023-12-04T05:39:26.081837+0000","last_became_peered":"2023-12-04T05:39:26.081837+0000","last_unstale":"2023-12-04T05:39:40.008839+0000","last_undegraded":"2023-12-04T05:39:40.008839+0000","last_fullsized":"2023-12-04T05:39:40.008839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:58.918868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586067+0000","last_change":"2023-12-04T05:39:40.029714+0000","last_active":"2023-12-04T05:39:41.586067+0000","last_peered":"2023-12-04T05:39:41.586067+0000","last_clean":"2023-12-04T05:39:41.586067+0000","last_became_active":"2023-12-04T05:39:40.029411+0000","last_became_peered":"2023-12-04T05:39:40.029411+0000","last_unstale":"2023-12-04T05:39:41.586067+0000","last_undegraded":"2023-12-04T05:39:41.586067+0000","last_fullsized":"2023-12-04T05:39:41.586067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:33.480748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.165835+0000","last_change":"2023-12-04T05:39:39.184171+0000","last_active":"2023-12-04T05:39:40.165835+0000","last_peered":"2023-12-04T05:39:40.165835+0000","last_clean":"2023-12-04T05:39:40.165835+0000","last_became_active":"2023-12-04T05:39:39.183833+0000","last_became_peered":"2023-12-04T05:39:39.183833+0000","last_unstale":"2023-12-04T05:39:40.165835+0000","last_undegraded":"2023-12-04T05:39:40.165835+0000","last_fullsized":"2023-12-04T05:39:40.165835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:52.913396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013584+0000","last_change":"2023-12-04T05:39:27.083342+0000","last_active":"2023-12-04T05:39:40.013584+0000","last_peered":"2023-12-04T05:39:40.013584+0000","last_clean":"2023-12-04T05:39:40.013584+0000","last_became_active":"2023-12-04T05:39:27.082988+0000","last_became_peered":"2023-12-04T05:39:27.082988+0000","last_unstale":"2023-12-04T05:39:40.013584+0000","last_undegraded":"2023-12-04T05:39:40.013584+0000","last_fullsized":"2023-12-04T05:39:40.013584+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014026+0000","last_change":"2023-12-04T05:39:26.087193+0000","last_active":"2023-12-04T05:39:40.014026+0000","last_peered":"2023-12-04T05:39:40.014026+0000","last_clean":"2023-12-04T05:39:40.014026+0000","last_became_active":"2023-12-04T05:39:26.086857+0000","last_became_peered":"2023-12-04T05:39:26.086857+0000","last_unstale":"2023-12-04T05:39:40.014026+0000","last_undegraded":"2023-12-04T05:39:40.014026+0000","last_fullsized":"2023-12-04T05:39:40.014026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:13:50.459837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586032+0000","last_change":"2023-12-04T05:39:40.024877+0000","last_active":"2023-12-04T05:39:41.586032+0000","last_peered":"2023-12-04T05:39:41.586032+0000","last_clean":"2023-12-04T05:39:41.586032+0000","last_became_active":"2023-12-04T05:39:40.024594+0000","last_became_peered":"2023-12-04T05:39:40.024594+0000","last_unstale":"2023-12-04T05:39:41.586032+0000","last_undegraded":"2023-12-04T05:39:41.586032+0000","last_fullsized":"2023-12-04T05:39:41.586032+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:58:58.771648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.166290+0000","last_change":"2023-12-04T05:39:39.177812+0000","last_active":"2023-12-04T05:39:40.166290+0000","last_peered":"2023-12-04T05:39:40.166290+0000","last_clean":"2023-12-04T05:39:40.166290+0000","last_became_active":"2023-12-04T05:39:39.174610+0000","last_became_peered":"2023-12-04T05:39:39.174610+0000","last_unstale":"2023-12-04T05:39:40.166290+0000","last_undegraded":"2023-12-04T05:39:40.166290+0000","last_fullsized":"2023-12-04T05:39:40.166290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:31:16.259811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.008338+0000","last_change":"2023-12-04T05:39:27.098688+0000","last_active":"2023-12-04T05:39:40.008338+0000","last_peered":"2023-12-04T05:39:40.008338+0000","last_clean":"2023-12-04T05:39:40.008338+0000","last_became_active":"2023-12-04T05:39:27.098339+0000","last_became_peered":"2023-12-04T05:39:27.098339+0000","last_unstale":"2023-12-04T05:39:40.008338+0000","last_undegraded":"2023-12-04T05:39:40.008338+0000","last_fullsized":"2023-12-04T05:39:40.008338+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:10:57.765583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.027585+0000","last_change":"2023-12-04T05:39:26.082599+0000","last_active":"2023-12-04T05:39:40.027585+0000","last_peered":"2023-12-04T05:39:40.027585+0000","last_clean":"2023-12-04T05:39:40.027585+0000","last_became_active":"2023-12-04T05:39:26.081807+0000","last_became_peered":"2023-12-04T05:39:26.081807+0000","last_unstale":"2023-12-04T05:39:40.027585+0000","last_undegraded":"2023-12-04T05:39:40.027585+0000","last_fullsized":"2023-12-04T05:39:40.027585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.010306+0000","last_change":"2023-12-04T05:39:40.023680+0000","last_active":"2023-12-04T05:39:41.010306+0000","last_peered":"2023-12-04T05:39:41.010306+0000","last_clean":"2023-12-04T05:39:41.010306+0000","last_became_active":"2023-12-04T05:39:40.023404+0000","last_became_peered":"2023-12-04T05:39:40.023404+0000","last_unstale":"2023-12-04T05:39:41.010306+0000","last_undegraded":"2023-12-04T05:39:41.010306+0000","last_fullsized":"2023-12-04T05:39:41.010306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:38.217058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010992+0000","last_change":"2023-12-04T05:39:39.180583+0000","last_active":"2023-12-04T05:39:40.010992+0000","last_peered":"2023-12-04T05:39:40.010992+0000","last_clean":"2023-12-04T05:39:40.010992+0000","last_became_active":"2023-12-04T05:39:39.180254+0000","last_became_peered":"2023-12-04T05:39:39.180254+0000","last_unstale":"2023-12-04T05:39:40.010992+0000","last_undegraded":"2023-12-04T05:39:40.010992+0000","last_fullsized":"2023-12-04T05:39:40.010992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:04.978354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.007535+0000","last_change":"2023-12-04T05:39:27.075983+0000","last_active":"2023-12-04T05:39:40.007535+0000","last_peered":"2023-12-04T05:39:40.007535+0000","last_clean":"2023-12-04T05:39:40.007535+0000","last_became_active":"2023-12-04T05:39:27.075631+0000","last_became_peered":"2023-12-04T05:39:27.075631+0000","last_unstale":"2023-12-04T05:39:40.007535+0000","last_undegraded":"2023-12-04T05:39:40.007535+0000","last_fullsized":"2023-12-04T05:39:40.007535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:20:04.871607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.020224+0000","last_change":"2023-12-04T05:39:26.075035+0000","last_active":"2023-12-04T05:39:40.020224+0000","last_peered":"2023-12-04T05:39:40.020224+0000","last_clean":"2023-12-04T05:39:40.020224+0000","last_became_active":"2023-12-04T05:39:26.074755+0000","last_became_peered":"2023-12-04T05:39:26.074755+0000","last_unstale":"2023-12-04T05:39:40.020224+0000","last_undegraded":"2023-12-04T05:39:40.020224+0000","last_fullsized":"2023-12-04T05:39:40.020224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586605+0000","last_change":"2023-12-04T05:39:40.038513+0000","last_active":"2023-12-04T05:39:41.586605+0000","last_peered":"2023-12-04T05:39:41.586605+0000","last_clean":"2023-12-04T05:39:41.586605+0000","last_became_active":"2023-12-04T05:39:40.037948+0000","last_became_peered":"2023-12-04T05:39:40.037948+0000","last_unstale":"2023-12-04T05:39:41.586605+0000","last_undegraded":"2023-12-04T05:39:41.586605+0000","last_fullsized":"2023-12-04T05:39:41.586605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:15.427794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.162785+0000","last_change":"2023-12-04T05:39:39.168978+0000","last_active":"2023-12-04T05:39:40.162785+0000","last_peered":"2023-12-04T05:39:40.162785+0000","last_clean":"2023-12-04T05:39:40.162785+0000","last_became_active":"2023-12-04T05:39:39.168711+0000","last_became_peered":"2023-12-04T05:39:39.168711+0000","last_unstale":"2023-12-04T05:39:40.162785+0000","last_undegraded":"2023-12-04T05:39:40.162785+0000","last_fullsized":"2023-12-04T05:39:40.162785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:15.926958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013637+0000","last_change":"2023-12-04T05:39:27.086542+0000","last_active":"2023-12-04T05:39:40.013637+0000","last_peered":"2023-12-04T05:39:40.013637+0000","last_clean":"2023-12-04T05:39:40.013637+0000","last_became_active":"2023-12-04T05:39:27.086211+0000","last_became_peered":"2023-12-04T05:39:27.086211+0000","last_unstale":"2023-12-04T05:39:40.013637+0000","last_undegraded":"2023-12-04T05:39:40.013637+0000","last_fullsized":"2023-12-04T05:39:40.013637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:52:35.579593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018073+0000","last_change":"2023-12-04T05:39:26.079175+0000","last_active":"2023-12-04T05:39:40.018073+0000","last_peered":"2023-12-04T05:39:40.018073+0000","last_clean":"2023-12-04T05:39:40.018073+0000","last_became_active":"2023-12-04T05:39:26.078543+0000","last_became_peered":"2023-12-04T05:39:26.078543+0000","last_unstale":"2023-12-04T05:39:40.018073+0000","last_undegraded":"2023-12-04T05:39:40.018073+0000","last_fullsized":"2023-12-04T05:39:40.018073+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:57:49.782303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586458+0000","last_change":"2023-12-04T05:39:40.031921+0000","last_active":"2023-12-04T05:39:41.586458+0000","last_peered":"2023-12-04T05:39:41.586458+0000","last_clean":"2023-12-04T05:39:41.586458+0000","last_became_active":"2023-12-04T05:39:40.031638+0000","last_became_peered":"2023-12-04T05:39:40.031638+0000","last_unstale":"2023-12-04T05:39:41.586458+0000","last_undegraded":"2023-12-04T05:39:41.586458+0000","last_fullsized":"2023-12-04T05:39:41.586458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:17.312769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.020991+0000","last_change":"2023-12-04T05:39:39.170204+0000","last_active":"2023-12-04T05:39:40.020991+0000","last_peered":"2023-12-04T05:39:40.020991+0000","last_clean":"2023-12-04T05:39:40.020991+0000","last_became_active":"2023-12-04T05:39:39.168760+0000","last_became_peered":"2023-12-04T05:39:39.168760+0000","last_unstale":"2023-12-04T05:39:40.020991+0000","last_undegraded":"2023-12-04T05:39:40.020991+0000","last_fullsized":"2023-12-04T05:39:40.020991+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:58:04.587457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017719+0000","last_change":"2023-12-04T05:39:27.083002+0000","last_active":"2023-12-04T05:39:40.017719+0000","last_peered":"2023-12-04T05:39:40.017719+0000","last_clean":"2023-12-04T05:39:40.017719+0000","last_became_active":"2023-12-04T05:39:27.082167+0000","last_became_peered":"2023-12-04T05:39:27.082167+0000","last_unstale":"2023-12-04T05:39:40.017719+0000","last_undegraded":"2023-12-04T05:39:40.017719+0000","last_fullsized":"2023-12-04T05:39:40.017719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:02.336772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.024008+0000","last_change":"2023-12-04T05:39:26.078377+0000","last_active":"2023-12-04T05:39:40.024008+0000","last_peered":"2023-12-04T05:39:40.024008+0000","last_clean":"2023-12-04T05:39:40.024008+0000","last_became_active":"2023-12-04T05:39:26.077976+0000","last_became_peered":"2023-12-04T05:39:26.077976+0000","last_unstale":"2023-12-04T05:39:40.024008+0000","last_undegraded":"2023-12-04T05:39:40.024008+0000","last_fullsized":"2023-12-04T05:39:40.024008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:13.700732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.014094+0000","last_change":"2023-12-04T05:39:40.031978+0000","last_active":"2023-12-04T05:39:41.014094+0000","last_peered":"2023-12-04T05:39:41.014094+0000","last_clean":"2023-12-04T05:39:41.014094+0000","last_became_active":"2023-12-04T05:39:40.031480+0000","last_became_peered":"2023-12-04T05:39:40.031480+0000","last_unstale":"2023-12-04T05:39:41.014094+0000","last_undegraded":"2023-12-04T05:39:41.014094+0000","last_fullsized":"2023-12-04T05:39:41.014094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:25:48.091747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.163771+0000","last_change":"2023-12-04T05:39:39.181457+0000","last_active":"2023-12-04T05:39:40.163771+0000","last_peered":"2023-12-04T05:39:40.163771+0000","last_clean":"2023-12-04T05:39:40.163771+0000","last_became_active":"2023-12-04T05:39:39.181182+0000","last_became_peered":"2023-12-04T05:39:39.181182+0000","last_unstale":"2023-12-04T05:39:40.163771+0000","last_undegraded":"2023-12-04T05:39:40.163771+0000","last_fullsized":"2023-12-04T05:39:40.163771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:00:02.579750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021542+0000","last_change":"2023-12-04T05:39:27.079741+0000","last_active":"2023-12-04T05:39:40.021542+0000","last_peered":"2023-12-04T05:39:40.021542+0000","last_clean":"2023-12-04T05:39:40.021542+0000","last_became_active":"2023-12-04T05:39:27.079309+0000","last_became_peered":"2023-12-04T05:39:27.079309+0000","last_unstale":"2023-12-04T05:39:40.021542+0000","last_undegraded":"2023-12-04T05:39:40.021542+0000","last_fullsized":"2023-12-04T05:39:40.021542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:24:06.663321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021302+0000","last_change":"2023-12-04T05:39:26.075679+0000","last_active":"2023-12-04T05:39:40.021302+0000","last_peered":"2023-12-04T05:39:40.021302+0000","last_clean":"2023-12-04T05:39:40.021302+0000","last_became_active":"2023-12-04T05:39:26.075408+0000","last_became_peered":"2023-12-04T05:39:26.075408+0000","last_unstale":"2023-12-04T05:39:40.021302+0000","last_undegraded":"2023-12-04T05:39:40.021302+0000","last_fullsized":"2023-12-04T05:39:40.021302+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585351+0000","last_change":"2023-12-04T05:39:40.024812+0000","last_active":"2023-12-04T05:39:41.585351+0000","last_peered":"2023-12-04T05:39:41.585351+0000","last_clean":"2023-12-04T05:39:41.585351+0000","last_became_active":"2023-12-04T05:39:40.022344+0000","last_became_peered":"2023-12-04T05:39:40.022344+0000","last_unstale":"2023-12-04T05:39:41.585351+0000","last_undegraded":"2023-12-04T05:39:41.585351+0000","last_fullsized":"2023-12-04T05:39:41.585351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:00:53.458111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.027357+0000","last_change":"2023-12-04T05:39:39.178119+0000","last_active":"2023-12-04T05:39:40.027357+0000","last_peered":"2023-12-04T05:39:40.027357+0000","last_clean":"2023-12-04T05:39:40.027357+0000","last_became_active":"2023-12-04T05:39:39.177780+0000","last_became_peered":"2023-12-04T05:39:39.177780+0000","last_unstale":"2023-12-04T05:39:40.027357+0000","last_undegraded":"2023-12-04T05:39:40.027357+0000","last_fullsized":"2023-12-04T05:39:40.027357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:59.080712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.011358+0000","last_change":"2023-12-04T05:39:27.096722+0000","last_active":"2023-12-04T05:39:40.011358+0000","last_peered":"2023-12-04T05:39:40.011358+0000","last_clean":"2023-12-04T05:39:40.011358+0000","last_became_active":"2023-12-04T05:39:27.089687+0000","last_became_peered":"2023-12-04T05:39:27.089687+0000","last_unstale":"2023-12-04T05:39:40.011358+0000","last_undegraded":"2023-12-04T05:39:40.011358+0000","last_fullsized":"2023-12-04T05:39:40.011358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:04:15.694056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015828+0000","last_change":"2023-12-04T05:39:26.086640+0000","last_active":"2023-12-04T05:39:40.015828+0000","last_peered":"2023-12-04T05:39:40.015828+0000","last_clean":"2023-12-04T05:39:40.015828+0000","last_became_active":"2023-12-04T05:39:26.086335+0000","last_became_peered":"2023-12-04T05:39:26.086335+0000","last_unstale":"2023-12-04T05:39:40.015828+0000","last_undegraded":"2023-12-04T05:39:40.015828+0000","last_fullsized":"2023-12-04T05:39:40.015828+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:18:07.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012089+0000","last_change":"2023-12-04T05:39:40.023011+0000","last_active":"2023-12-04T05:39:41.012089+0000","last_peered":"2023-12-04T05:39:41.012089+0000","last_clean":"2023-12-04T05:39:41.012089+0000","last_became_active":"2023-12-04T05:39:40.022549+0000","last_became_peered":"2023-12-04T05:39:40.022549+0000","last_unstale":"2023-12-04T05:39:41.012089+0000","last_undegraded":"2023-12-04T05:39:41.012089+0000","last_fullsized":"2023-12-04T05:39:41.012089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:36.317280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.020079+0000","last_change":"2023-12-04T05:39:39.176980+0000","last_active":"2023-12-04T05:39:40.020079+0000","last_peered":"2023-12-04T05:39:40.020079+0000","last_clean":"2023-12-04T05:39:40.020079+0000","last_became_active":"2023-12-04T05:39:39.176442+0000","last_became_peered":"2023-12-04T05:39:39.176442+0000","last_unstale":"2023-12-04T05:39:40.020079+0000","last_undegraded":"2023-12-04T05:39:40.020079+0000","last_fullsized":"2023-12-04T05:39:40.020079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:15.926958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.033025+0000","last_change":"2023-12-04T05:39:27.096615+0000","last_active":"2023-12-04T05:39:40.033025+0000","last_peered":"2023-12-04T05:39:40.033025+0000","last_clean":"2023-12-04T05:39:40.033025+0000","last_became_active":"2023-12-04T05:39:27.096318+0000","last_became_peered":"2023-12-04T05:39:27.096318+0000","last_unstale":"2023-12-04T05:39:40.033025+0000","last_undegraded":"2023-12-04T05:39:40.033025+0000","last_fullsized":"2023-12-04T05:39:40.033025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:37.633808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.011665+0000","last_change":"2023-12-04T05:39:26.084101+0000","last_active":"2023-12-04T05:39:40.011665+0000","last_peered":"2023-12-04T05:39:40.011665+0000","last_clean":"2023-12-04T05:39:40.011665+0000","last_became_active":"2023-12-04T05:39:26.083785+0000","last_became_peered":"2023-12-04T05:39:26.083785+0000","last_unstale":"2023-12-04T05:39:40.011665+0000","last_undegraded":"2023-12-04T05:39:40.011665+0000","last_fullsized":"2023-12-04T05:39:40.011665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:47:37.800218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586568+0000","last_change":"2023-12-04T05:39:40.026988+0000","last_active":"2023-12-04T05:39:41.586568+0000","last_peered":"2023-12-04T05:39:41.586568+0000","last_clean":"2023-12-04T05:39:41.586568+0000","last_became_active":"2023-12-04T05:39:40.023441+0000","last_became_peered":"2023-12-04T05:39:40.023441+0000","last_unstale":"2023-12-04T05:39:41.586568+0000","last_undegraded":"2023-12-04T05:39:41.586568+0000","last_fullsized":"2023-12-04T05:39:41.586568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:14:50.724830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.163843+0000","last_change":"2023-12-04T05:39:39.179355+0000","last_active":"2023-12-04T05:39:40.163843+0000","last_peered":"2023-12-04T05:39:40.163843+0000","last_clean":"2023-12-04T05:39:40.163843+0000","last_became_active":"2023-12-04T05:39:39.179093+0000","last_became_peered":"2023-12-04T05:39:39.179093+0000","last_unstale":"2023-12-04T05:39:40.163843+0000","last_undegraded":"2023-12-04T05:39:40.163843+0000","last_fullsized":"2023-12-04T05:39:40.163843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:45:48.232566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.007886+0000","last_change":"2023-12-04T05:39:27.082611+0000","last_active":"2023-12-04T05:39:40.007886+0000","last_peered":"2023-12-04T05:39:40.007886+0000","last_clean":"2023-12-04T05:39:40.007886+0000","last_became_active":"2023-12-04T05:39:27.082317+0000","last_became_peered":"2023-12-04T05:39:27.082317+0000","last_unstale":"2023-12-04T05:39:40.007886+0000","last_undegraded":"2023-12-04T05:39:40.007886+0000","last_fullsized":"2023-12-04T05:39:40.007886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:24:22.060177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009000+0000","last_change":"2023-12-04T05:39:26.080322+0000","last_active":"2023-12-04T05:39:40.009000+0000","last_peered":"2023-12-04T05:39:40.009000+0000","last_clean":"2023-12-04T05:39:40.009000+0000","last_became_active":"2023-12-04T05:39:26.079499+0000","last_became_peered":"2023-12-04T05:39:26.079499+0000","last_unstale":"2023-12-04T05:39:40.009000+0000","last_undegraded":"2023-12-04T05:39:40.009000+0000","last_fullsized":"2023-12-04T05:39:40.009000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:57:37.494733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585767+0000","last_change":"2023-12-04T05:39:40.028418+0000","last_active":"2023-12-04T05:39:41.585767+0000","last_peered":"2023-12-04T05:39:41.585767+0000","last_clean":"2023-12-04T05:39:41.585767+0000","last_became_active":"2023-12-04T05:39:40.026410+0000","last_became_peered":"2023-12-04T05:39:40.026410+0000","last_unstale":"2023-12-04T05:39:41.585767+0000","last_undegraded":"2023-12-04T05:39:41.585767+0000","last_fullsized":"2023-12-04T05:39:41.585767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:02:03.171679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.029727+0000","last_change":"2023-12-04T05:39:39.179308+0000","last_active":"2023-12-04T05:39:40.029727+0000","last_peered":"2023-12-04T05:39:40.029727+0000","last_clean":"2023-12-04T05:39:40.029727+0000","last_became_active":"2023-12-04T05:39:39.178973+0000","last_became_peered":"2023-12-04T05:39:39.178973+0000","last_unstale":"2023-12-04T05:39:40.029727+0000","last_undegraded":"2023-12-04T05:39:40.029727+0000","last_fullsized":"2023-12-04T05:39:40.029727+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:01:37.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.027441+0000","last_change":"2023-12-04T05:39:27.087432+0000","last_active":"2023-12-04T05:39:40.027441+0000","last_peered":"2023-12-04T05:39:40.027441+0000","last_clean":"2023-12-04T05:39:40.027441+0000","last_became_active":"2023-12-04T05:39:27.086159+0000","last_became_peered":"2023-12-04T05:39:27.086159+0000","last_unstale":"2023-12-04T05:39:40.027441+0000","last_undegraded":"2023-12-04T05:39:40.027441+0000","last_fullsized":"2023-12-04T05:39:40.027441+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:50.161029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014851+0000","last_change":"2023-12-04T05:39:26.082897+0000","last_active":"2023-12-04T05:39:40.014851+0000","last_peered":"2023-12-04T05:39:40.014851+0000","last_clean":"2023-12-04T05:39:40.014851+0000","last_became_active":"2023-12-04T05:39:26.082589+0000","last_became_peered":"2023-12-04T05:39:26.082589+0000","last_unstale":"2023-12-04T05:39:40.014851+0000","last_undegraded":"2023-12-04T05:39:40.014851+0000","last_fullsized":"2023-12-04T05:39:40.014851+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:38:35.169938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.010893+0000","last_change":"2023-12-04T05:39:40.023213+0000","last_active":"2023-12-04T05:39:41.010893+0000","last_peered":"2023-12-04T05:39:41.010893+0000","last_clean":"2023-12-04T05:39:41.010893+0000","last_became_active":"2023-12-04T05:39:40.022965+0000","last_became_peered":"2023-12-04T05:39:40.022965+0000","last_unstale":"2023-12-04T05:39:41.010893+0000","last_undegraded":"2023-12-04T05:39:41.010893+0000","last_fullsized":"2023-12-04T05:39:41.010893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:49:15.427794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021519+0000","last_change":"2023-12-04T05:39:39.170102+0000","last_active":"2023-12-04T05:39:40.021519+0000","last_peered":"2023-12-04T05:39:40.021519+0000","last_clean":"2023-12-04T05:39:40.021519+0000","last_became_active":"2023-12-04T05:39:39.167996+0000","last_became_peered":"2023-12-04T05:39:39.167996+0000","last_unstale":"2023-12-04T05:39:40.021519+0000","last_undegraded":"2023-12-04T05:39:40.021519+0000","last_fullsized":"2023-12-04T05:39:40.021519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:42:06.211873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.017058+0000","last_change":"2023-12-04T05:39:27.084628+0000","last_active":"2023-12-04T05:39:40.017058+0000","last_peered":"2023-12-04T05:39:40.017058+0000","last_clean":"2023-12-04T05:39:40.017058+0000","last_became_active":"2023-12-04T05:39:27.084326+0000","last_became_peered":"2023-12-04T05:39:27.084326+0000","last_unstale":"2023-12-04T05:39:40.017058+0000","last_undegraded":"2023-12-04T05:39:40.017058+0000","last_fullsized":"2023-12-04T05:39:40.017058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:09:46.997738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010944+0000","last_change":"2023-12-04T05:39:26.081865+0000","last_active":"2023-12-04T05:39:40.010944+0000","last_peered":"2023-12-04T05:39:40.010944+0000","last_clean":"2023-12-04T05:39:40.010944+0000","last_became_active":"2023-12-04T05:39:26.081533+0000","last_became_peered":"2023-12-04T05:39:26.081533+0000","last_unstale":"2023-12-04T05:39:40.010944+0000","last_undegraded":"2023-12-04T05:39:40.010944+0000","last_fullsized":"2023-12-04T05:39:40.010944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:04:57.328933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013312+0000","last_change":"2023-12-04T05:39:40.023480+0000","last_active":"2023-12-04T05:39:41.013312+0000","last_peered":"2023-12-04T05:39:41.013312+0000","last_clean":"2023-12-04T05:39:41.013312+0000","last_became_active":"2023-12-04T05:39:40.022588+0000","last_became_peered":"2023-12-04T05:39:40.022588+0000","last_unstale":"2023-12-04T05:39:41.013312+0000","last_undegraded":"2023-12-04T05:39:41.013312+0000","last_fullsized":"2023-12-04T05:39:41.013312+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:28:26.544685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016186+0000","last_change":"2023-12-04T05:39:39.171140+0000","last_active":"2023-12-04T05:39:40.016186+0000","last_peered":"2023-12-04T05:39:40.016186+0000","last_clean":"2023-12-04T05:39:40.016186+0000","last_became_active":"2023-12-04T05:39:39.170561+0000","last_became_peered":"2023-12-04T05:39:39.170561+0000","last_unstale":"2023-12-04T05:39:40.016186+0000","last_undegraded":"2023-12-04T05:39:40.016186+0000","last_fullsized":"2023-12-04T05:39:40.016186+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:54.424171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016376+0000","last_change":"2023-12-04T05:39:27.087533+0000","last_active":"2023-12-04T05:39:40.016376+0000","last_peered":"2023-12-04T05:39:40.016376+0000","last_clean":"2023-12-04T05:39:40.016376+0000","last_became_active":"2023-12-04T05:39:27.087076+0000","last_became_peered":"2023-12-04T05:39:27.087076+0000","last_unstale":"2023-12-04T05:39:40.016376+0000","last_undegraded":"2023-12-04T05:39:40.016376+0000","last_fullsized":"2023-12-04T05:39:40.016376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:42:03.949105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.009748+0000","last_change":"2023-12-04T05:39:26.082858+0000","last_active":"2023-12-04T05:39:40.009748+0000","last_peered":"2023-12-04T05:39:40.009748+0000","last_clean":"2023-12-04T05:39:40.009748+0000","last_became_active":"2023-12-04T05:39:26.082559+0000","last_became_peered":"2023-12-04T05:39:26.082559+0000","last_unstale":"2023-12-04T05:39:40.009748+0000","last_undegraded":"2023-12-04T05:39:40.009748+0000","last_fullsized":"2023-12-04T05:39:40.009748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:37:14.553422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586956+0000","last_change":"2023-12-04T05:39:40.037979+0000","last_active":"2023-12-04T05:39:41.586956+0000","last_peered":"2023-12-04T05:39:41.586956+0000","last_clean":"2023-12-04T05:39:41.586956+0000","last_became_active":"2023-12-04T05:39:40.037789+0000","last_became_peered":"2023-12-04T05:39:40.037789+0000","last_unstale":"2023-12-04T05:39:41.586956+0000","last_undegraded":"2023-12-04T05:39:41.586956+0000","last_fullsized":"2023-12-04T05:39:41.586956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:55:27.515037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.165705+0000","last_change":"2023-12-04T05:39:39.172372+0000","last_active":"2023-12-04T05:39:40.165705+0000","last_peered":"2023-12-04T05:39:40.165705+0000","last_clean":"2023-12-04T05:39:40.165705+0000","last_became_active":"2023-12-04T05:39:39.172003+0000","last_became_peered":"2023-12-04T05:39:39.172003+0000","last_unstale":"2023-12-04T05:39:40.165705+0000","last_undegraded":"2023-12-04T05:39:40.165705+0000","last_fullsized":"2023-12-04T05:39:40.165705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:19.397280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018352+0000","last_change":"2023-12-04T05:39:27.093250+0000","last_active":"2023-12-04T05:39:40.018352+0000","last_peered":"2023-12-04T05:39:40.018352+0000","last_clean":"2023-12-04T05:39:40.018352+0000","last_became_active":"2023-12-04T05:39:27.092375+0000","last_became_peered":"2023-12-04T05:39:27.092375+0000","last_unstale":"2023-12-04T05:39:40.018352+0000","last_undegraded":"2023-12-04T05:39:40.018352+0000","last_fullsized":"2023-12-04T05:39:40.018352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016847+0000","last_change":"2023-12-04T05:39:26.082662+0000","last_active":"2023-12-04T05:39:40.016847+0000","last_peered":"2023-12-04T05:39:40.016847+0000","last_clean":"2023-12-04T05:39:40.016847+0000","last_became_active":"2023-12-04T05:39:26.082131+0000","last_became_peered":"2023-12-04T05:39:26.082131+0000","last_unstale":"2023-12-04T05:39:40.016847+0000","last_undegraded":"2023-12-04T05:39:40.016847+0000","last_fullsized":"2023-12-04T05:39:40.016847+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:51:27.395758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.011263+0000","last_change":"2023-12-04T05:39:40.018502+0000","last_active":"2023-12-04T05:39:41.011263+0000","last_peered":"2023-12-04T05:39:41.011263+0000","last_clean":"2023-12-04T05:39:41.011263+0000","last_became_active":"2023-12-04T05:39:40.018253+0000","last_became_peered":"2023-12-04T05:39:40.018253+0000","last_unstale":"2023-12-04T05:39:41.011263+0000","last_undegraded":"2023-12-04T05:39:41.011263+0000","last_fullsized":"2023-12-04T05:39:41.011263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:59:42.274616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.023906+0000","last_change":"2023-12-04T05:39:39.182667+0000","last_active":"2023-12-04T05:39:40.023906+0000","last_peered":"2023-12-04T05:39:40.023906+0000","last_clean":"2023-12-04T05:39:40.023906+0000","last_became_active":"2023-12-04T05:39:39.182367+0000","last_became_peered":"2023-12-04T05:39:39.182367+0000","last_unstale":"2023-12-04T05:39:40.023906+0000","last_undegraded":"2023-12-04T05:39:40.023906+0000","last_fullsized":"2023-12-04T05:39:40.023906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:25:47.083699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021650+0000","last_change":"2023-12-04T05:39:27.079536+0000","last_active":"2023-12-04T05:39:40.021650+0000","last_peered":"2023-12-04T05:39:40.021650+0000","last_clean":"2023-12-04T05:39:40.021650+0000","last_became_active":"2023-12-04T05:39:27.078782+0000","last_became_peered":"2023-12-04T05:39:27.078782+0000","last_unstale":"2023-12-04T05:39:40.021650+0000","last_undegraded":"2023-12-04T05:39:40.021650+0000","last_fullsized":"2023-12-04T05:39:40.021650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:26:56.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018439+0000","last_change":"2023-12-04T05:39:26.080171+0000","last_active":"2023-12-04T05:39:40.018439+0000","last_peered":"2023-12-04T05:39:40.018439+0000","last_clean":"2023-12-04T05:39:40.018439+0000","last_became_active":"2023-12-04T05:39:26.079829+0000","last_became_peered":"2023-12-04T05:39:26.079829+0000","last_unstale":"2023-12-04T05:39:40.018439+0000","last_undegraded":"2023-12-04T05:39:40.018439+0000","last_fullsized":"2023-12-04T05:39:40.018439+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.585494+0000","last_change":"2023-12-04T05:39:40.022483+0000","last_active":"2023-12-04T05:39:41.585494+0000","last_peered":"2023-12-04T05:39:41.585494+0000","last_clean":"2023-12-04T05:39:41.585494+0000","last_became_active":"2023-12-04T05:39:40.021977+0000","last_became_peered":"2023-12-04T05:39:40.021977+0000","last_unstale":"2023-12-04T05:39:41.585494+0000","last_undegraded":"2023-12-04T05:39:41.585494+0000","last_fullsized":"2023-12-04T05:39:41.585494+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:45:28.134053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.013573+0000","last_change":"2023-12-04T05:39:39.180314+0000","last_active":"2023-12-04T05:39:40.013573+0000","last_peered":"2023-12-04T05:39:40.013573+0000","last_clean":"2023-12-04T05:39:40.013573+0000","last_became_active":"2023-12-04T05:39:39.180017+0000","last_became_peered":"2023-12-04T05:39:39.180017+0000","last_unstale":"2023-12-04T05:39:40.013573+0000","last_undegraded":"2023-12-04T05:39:40.013573+0000","last_fullsized":"2023-12-04T05:39:40.013573+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:53:15.926958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.029964+0000","last_change":"2023-12-04T05:39:27.086155+0000","last_active":"2023-12-04T05:39:40.029964+0000","last_peered":"2023-12-04T05:39:40.029964+0000","last_clean":"2023-12-04T05:39:40.029964+0000","last_became_active":"2023-12-04T05:39:27.085887+0000","last_became_peered":"2023-12-04T05:39:27.085887+0000","last_unstale":"2023-12-04T05:39:40.029964+0000","last_undegraded":"2023-12-04T05:39:40.029964+0000","last_fullsized":"2023-12-04T05:39:40.029964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:02:39.806528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.022101+0000","last_change":"2023-12-04T05:39:26.079734+0000","last_active":"2023-12-04T05:39:40.022101+0000","last_peered":"2023-12-04T05:39:40.022101+0000","last_clean":"2023-12-04T05:39:40.022101+0000","last_became_active":"2023-12-04T05:39:26.079419+0000","last_became_peered":"2023-12-04T05:39:26.079419+0000","last_unstale":"2023-12-04T05:39:40.022101+0000","last_undegraded":"2023-12-04T05:39:40.022101+0000","last_fullsized":"2023-12-04T05:39:40.022101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:40:39.822116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.012242+0000","last_change":"2023-12-04T05:39:40.022821+0000","last_active":"2023-12-04T05:39:41.012242+0000","last_peered":"2023-12-04T05:39:41.012242+0000","last_clean":"2023-12-04T05:39:41.012242+0000","last_became_active":"2023-12-04T05:39:40.022180+0000","last_became_peered":"2023-12-04T05:39:40.022180+0000","last_unstale":"2023-12-04T05:39:41.012242+0000","last_undegraded":"2023-12-04T05:39:41.012242+0000","last_fullsized":"2023-12-04T05:39:41.012242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:44:36.047002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.007771+0000","last_change":"2023-12-04T05:39:39.178687+0000","last_active":"2023-12-04T05:39:40.007771+0000","last_peered":"2023-12-04T05:39:40.007771+0000","last_clean":"2023-12-04T05:39:40.007771+0000","last_became_active":"2023-12-04T05:39:39.176672+0000","last_became_peered":"2023-12-04T05:39:39.176672+0000","last_unstale":"2023-12-04T05:39:40.007771+0000","last_undegraded":"2023-12-04T05:39:40.007771+0000","last_fullsized":"2023-12-04T05:39:40.007771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:05:10.420213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.022035+0000","last_change":"2023-12-04T05:39:27.081159+0000","last_active":"2023-12-04T05:39:40.022035+0000","last_peered":"2023-12-04T05:39:40.022035+0000","last_clean":"2023-12-04T05:39:40.022035+0000","last_became_active":"2023-12-04T05:39:27.080820+0000","last_became_peered":"2023-12-04T05:39:27.080820+0000","last_unstale":"2023-12-04T05:39:40.022035+0000","last_undegraded":"2023-12-04T05:39:40.022035+0000","last_fullsized":"2023-12-04T05:39:40.022035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:28:56.827516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.016137+0000","last_change":"2023-12-04T05:39:26.080928+0000","last_active":"2023-12-04T05:39:40.016137+0000","last_peered":"2023-12-04T05:39:40.016137+0000","last_clean":"2023-12-04T05:39:40.016137+0000","last_became_active":"2023-12-04T05:39:26.080474+0000","last_became_peered":"2023-12-04T05:39:26.080474+0000","last_unstale":"2023-12-04T05:39:40.016137+0000","last_undegraded":"2023-12-04T05:39:40.016137+0000","last_fullsized":"2023-12-04T05:39:40.016137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:37:49.152723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586565+0000","last_change":"2023-12-04T05:39:40.026959+0000","last_active":"2023-12-04T05:39:41.586565+0000","last_peered":"2023-12-04T05:39:41.586565+0000","last_clean":"2023-12-04T05:39:41.586565+0000","last_became_active":"2023-12-04T05:39:40.023847+0000","last_became_peered":"2023-12-04T05:39:40.023847+0000","last_unstale":"2023-12-04T05:39:41.586565+0000","last_undegraded":"2023-12-04T05:39:41.586565+0000","last_fullsized":"2023-12-04T05:39:41.586565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:47:28.655806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.021693+0000","last_change":"2023-12-04T05:39:39.173776+0000","last_active":"2023-12-04T05:39:40.021693+0000","last_peered":"2023-12-04T05:39:40.021693+0000","last_clean":"2023-12-04T05:39:40.021693+0000","last_became_active":"2023-12-04T05:39:39.172993+0000","last_became_peered":"2023-12-04T05:39:39.172993+0000","last_unstale":"2023-12-04T05:39:40.021693+0000","last_undegraded":"2023-12-04T05:39:40.021693+0000","last_fullsized":"2023-12-04T05:39:40.021693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:36:16.304722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014667+0000","last_change":"2023-12-04T05:39:27.083988+0000","last_active":"2023-12-04T05:39:40.014667+0000","last_peered":"2023-12-04T05:39:40.014667+0000","last_clean":"2023-12-04T05:39:40.014667+0000","last_became_active":"2023-12-04T05:39:27.083606+0000","last_became_peered":"2023-12-04T05:39:27.083606+0000","last_unstale":"2023-12-04T05:39:40.014667+0000","last_undegraded":"2023-12-04T05:39:40.014667+0000","last_fullsized":"2023-12-04T05:39:40.014667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T07:31:07.314306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014690+0000","last_change":"2023-12-04T05:39:26.079887+0000","last_active":"2023-12-04T05:39:40.014690+0000","last_peered":"2023-12-04T05:39:40.014690+0000","last_clean":"2023-12-04T05:39:40.014690+0000","last_became_active":"2023-12-04T05:39:26.079365+0000","last_became_peered":"2023-12-04T05:39:26.079365+0000","last_unstale":"2023-12-04T05:39:40.014690+0000","last_undegraded":"2023-12-04T05:39:40.014690+0000","last_fullsized":"2023-12-04T05:39:40.014690+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.013200+0000","last_change":"2023-12-04T05:39:40.035400+0000","last_active":"2023-12-04T05:39:41.013200+0000","last_peered":"2023-12-04T05:39:41.013200+0000","last_clean":"2023-12-04T05:39:41.013200+0000","last_became_active":"2023-12-04T05:39:40.035104+0000","last_became_peered":"2023-12-04T05:39:40.035104+0000","last_unstale":"2023-12-04T05:39:41.013200+0000","last_undegraded":"2023-12-04T05:39:41.013200+0000","last_fullsized":"2023-12-04T05:39:41.013200+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:01:44.994003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014842+0000","last_change":"2023-12-04T05:39:39.178394+0000","last_active":"2023-12-04T05:39:40.014842+0000","last_peered":"2023-12-04T05:39:40.014842+0000","last_clean":"2023-12-04T05:39:40.014842+0000","last_became_active":"2023-12-04T05:39:39.177765+0000","last_became_peered":"2023-12-04T05:39:39.177765+0000","last_unstale":"2023-12-04T05:39:40.014842+0000","last_undegraded":"2023-12-04T05:39:40.014842+0000","last_fullsized":"2023-12-04T05:39:40.014842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:01:43.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014616+0000","last_change":"2023-12-04T05:39:27.102361+0000","last_active":"2023-12-04T05:39:40.014616+0000","last_peered":"2023-12-04T05:39:40.014616+0000","last_clean":"2023-12-04T05:39:40.014616+0000","last_became_active":"2023-12-04T05:39:27.101931+0000","last_became_peered":"2023-12-04T05:39:27.101931+0000","last_unstale":"2023-12-04T05:39:40.014616+0000","last_undegraded":"2023-12-04T05:39:40.014616+0000","last_fullsized":"2023-12-04T05:39:40.014616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T08:44:14.709038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.018200+0000","last_change":"2023-12-04T05:39:26.076033+0000","last_active":"2023-12-04T05:39:40.018200+0000","last_peered":"2023-12-04T05:39:40.018200+0000","last_clean":"2023-12-04T05:39:40.018200+0000","last_became_active":"2023-12-04T05:39:26.075725+0000","last_became_peered":"2023-12-04T05:39:26.075725+0000","last_unstale":"2023-12-04T05:39:40.018200+0000","last_undegraded":"2023-12-04T05:39:40.018200+0000","last_fullsized":"2023-12-04T05:39:40.018200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T05:45:19.381420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-04T05:39:41.586816+0000","last_change":"2023-12-04T05:39:40.022489+0000","last_active":"2023-12-04T05:39:41.586816+0000","last_peered":"2023-12-04T05:39:41.586816+0000","last_clean":"2023-12-04T05:39:41.586816+0000","last_became_active":"2023-12-04T05:39:40.022053+0000","last_became_peered":"2023-12-04T05:39:40.022053+0000","last_unstale":"2023-12-04T05:39:41.586816+0000","last_undegraded":"2023-12-04T05:39:41.586816+0000","last_fullsized":"2023-12-04T05:39:41.586816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:39.139560+0000","last_clean_scrub_stamp":"2023-12-04T05:39:39.139560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:58:03.881630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.163099+0000","last_change":"2023-12-04T05:39:39.172948+0000","last_active":"2023-12-04T05:39:40.163099+0000","last_peered":"2023-12-04T05:39:40.163099+0000","last_clean":"2023-12-04T05:39:40.163099+0000","last_became_active":"2023-12-04T05:39:39.172395+0000","last_became_peered":"2023-12-04T05:39:39.172395+0000","last_unstale":"2023-12-04T05:39:40.163099+0000","last_undegraded":"2023-12-04T05:39:40.163099+0000","last_fullsized":"2023-12-04T05:39:40.163099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:38.131512+0000","last_clean_scrub_stamp":"2023-12-04T05:39:38.131512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:01.145095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.010045+0000","last_change":"2023-12-04T05:39:27.088782+0000","last_active":"2023-12-04T05:39:40.010045+0000","last_peered":"2023-12-04T05:39:40.010045+0000","last_clean":"2023-12-04T05:39:40.010045+0000","last_became_active":"2023-12-04T05:39:27.088524+0000","last_became_peered":"2023-12-04T05:39:27.088524+0000","last_unstale":"2023-12-04T05:39:40.010045+0000","last_undegraded":"2023-12-04T05:39:40.010045+0000","last_fullsized":"2023-12-04T05:39:40.010045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:26.048538+0000","last_clean_scrub_stamp":"2023-12-04T05:39:26.048538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:01:50.080657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.015912+0000","last_change":"2023-12-04T05:39:26.087051+0000","last_active":"2023-12-04T05:39:40.015912+0000","last_peered":"2023-12-04T05:39:40.015912+0000","last_clean":"2023-12-04T05:39:40.015912+0000","last_became_active":"2023-12-04T05:39:26.086791+0000","last_became_peered":"2023-12-04T05:39:26.086791+0000","last_unstale":"2023-12-04T05:39:40.015912+0000","last_undegraded":"2023-12-04T05:39:40.015912+0000","last_fullsized":"2023-12-04T05:39:40.015912+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:39:25.040232+0000","last_clean_scrub_stamp":"2023-12-04T05:39:25.040232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:32:16.363509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-12-04T05:39:40.014831+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:39:40.014831+0000","last_peered":"2023-12-04T05:39:40.014831+0000","last_clean":"2023-12-04T05:39:40.014831+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:39:40.014831+0000","last_undegraded":"2023-12-04T05:39:40.014831+0000","last_fullsized":"2023-12-04T05:39:40.014831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32644,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339196,"statfs":{"total":96636764160,"available":96603336704,"internally_reserved":0,"allocated":1490944,"data_stored":983664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.745}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.435},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.46500000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.48399999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":394460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.84299999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.88400000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.86899999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.751},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.76800000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":396313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.434},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.54300000000000004}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76000000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.628},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":394850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":0.82399999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.73799999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.88400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":397855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.65700000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.623}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":393730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.432}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.82199999999999995}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.86899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.88800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":393308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.66800000000000004}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72899999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.95299999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":1.026},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.84699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":984098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.501}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.56999999999999995}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:39:44.651 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T05:39:44.652 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-04T05:39:44.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 Processor -- start 2023-12-04T05:39:44.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 -- start start 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 0x7f25801524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f258006d210 0x7f258006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800aa240 con 0x7f25800c1e70 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258006c0c0 con 0x7f258006d210 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.820+0000 7f258769a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800aa500 con 0x7f258006c440 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f258006d210 0x7f258006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585436640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f25800c1e70 0x7f25800a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45198/0 (socket says 172.21.15.97:45198) 2023-12-04T05:39:44.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585436640 1 -- 172.21.15.97:0/1625194529 learned_addr learned my addr 172.21.15.97:0/1625194529 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2584c35640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 0x7f25801524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 -- 172.21.15.97:0/1625194529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 msgr2=0x7f25801524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 0x7f25801524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 -- 172.21.15.97:0/1625194529 >> v1:172.21.15.97:6789/0 conn(0x7f25800c1e70 legacy=0x7f25800a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 -- 172.21.15.97:0/1625194529 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800aa7e0 con 0x7f258006d210 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2577fff640 1 -- 172.21.15.97:0/1625194529 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036521669 0 0) 0x7f25800aa240 con 0x7f25800c1e70 2023-12-04T05:39:44.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2584c35640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 0x7f25801524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:44.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2585c37640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f258006d210 0x7f258006d680 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2578009d90 tx=0x7f257801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bab5bdb4fb45cc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2577fff640 1 -- 172.21.15.97:0/1625194529 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780a5a00 con 0x7f258006d210 2023-12-04T05:39:44.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2577fff640 1 -- 172.21.15.97:0/1625194529 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25780a5b60 con 0x7f258006d210 2023-12-04T05:39:44.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.824+0000 7f2577fff640 1 -- 172.21.15.97:0/1625194529 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780ad440 con 0x7f258006d210 2023-12-04T05:39:44.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- 172.21.15.97:0/1625194529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f258006d210 msgr2=0x7f258006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f258006d210 0x7f258006d680 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2578009d90 tx=0x7f257801c920 comp rx=0 tx=0).stop 2023-12-04T05:39:44.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- 172.21.15.97:0/1625194529 shutdown_connections 2023-12-04T05:39:44.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f258006d210 0x7f258006d680 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- 172.21.15.97:0/1625194529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006c440 0x7f25801524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- 172.21.15.97:0/1625194529 >> 172.21.15.97:0/1625194529 conn(0x7f25800c5e70 msgr2=0x7f25800c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:44.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- 172.21.15.97:0/1625194529 shutdown_connections 2023-12-04T05:39:44.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- 172.21.15.97:0/1625194529 wait complete. 2023-12-04T05:39:44.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 Processor -- start 2023-12-04T05:39:44.834 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- start start 2023-12-04T05:39:44.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f258006c440 0x7f258014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006d210 0x7f25801ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258014e250 con 0x7f25800c1e70 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580071d10 con 0x7f258006c440 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f258769a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258015c250 con 0x7f258006d210 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38866/0 (socket says 172.21.15.97:38866) 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 -- 172.21.15.97:0/865418154 learned_addr learned my addr 172.21.15.97:0/865418154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585436640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f258006c440 0x7f258014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2584c35640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006d210 0x7f25801ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 -- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006d210 msgr2=0x7f25801ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006d210 0x7f25801ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 -- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f258006c440 msgr2=0x7f258014cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f258006c440 0x7f258014cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:44.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 -- 172.21.15.97:0/865418154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578009a70 con 0x7f25800c1e70 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.828+0000 7f2585c37640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f257801afd0 tx=0x7f25780196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780ade40 con 0x7f25800c1e70 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25780b9450 con 0x7f25800c1e70 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780b97e0 con 0x7f25800c1e70 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580071fd0 con 0x7f25800c1e70 2023-12-04T05:39:44.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25801f0530 con 0x7f25800c1e70 2023-12-04T05:39:44.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25801f06c0 con 0x7f25800c1e70 2023-12-04T05:39:44.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25780b9940 con 0x7f25800c1e70 2023-12-04T05:39:44.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 0x7f2564068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:44.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f257811fff0 con 0x7f25800c1e70 2023-12-04T05:39:44.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.832+0000 7f2585436640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 0x7f2564068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:44.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.836+0000 7f2585436640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 0x7f2564068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f257c000f70 tx=0x7f257c007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:44.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:44.836+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25801f06c0 con 0x7f25800c1e70 2023-12-04T05:39:45.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.040+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f25801f06c0 con 0x7f25800c1e70 2023-12-04T05:39:45.047 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.040+0000 7f2575ffb640 1 -- 172.21.15.97:0/865418154 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v22) v1 ==== 185+0+142 (secure 0 0 0) 0x7f25801f06c0 con 0x7f25800c1e70 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoZW1l+wUaDhAADmfZo6E7QvTdILSxm8eZDQ== 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow" 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-04T05:39:45.048 INFO:teuthology.orchestra.run.smithi097.stderr:updated caps for client.1 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 msgr2=0x7f2564068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 0x7f2564068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f257c000f70 tx=0x7f257c007b60 comp rx=0 tx=0).stop 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 msgr2=0x7f25801eda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f257801afd0 tx=0x7f25780196c0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 shutdown_connections 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25640668d0 0x7f2564068d90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25800c1e70 0x7f25801eda90 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.050 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f258006d210 0x7f25801ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 --2- 172.21.15.97:0/865418154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f258006c440 0x7f258014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 >> 172.21.15.97:0/865418154 conn(0x7f25800c5e70 msgr2=0x7f2580148950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 shutdown_connections 2023-12-04T05:39:45.051 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.044+0000 7f258769a640 1 -- 172.21.15.97:0/865418154 wait complete. 2023-12-04T05:39:45.069 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:45.069 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:45.079 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:45.080 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:45.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:45.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 Processor -- start 2023-12-04T05:39:45.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 -- start start 2023-12-04T05:39:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa77c0a9470 0x7fa77c06dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c06c760 con 0x7fa77c154260 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0a8670 con 0x7fa77c0a9470 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa7844c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c06c550 con 0x7fa77c154d50 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:55652/0 (socket says 172.21.15.97:55652) 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 -- 172.21.15.97:0/4040315147 learned_addr learned my addr 172.21.15.97:0/4040315147 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa782a66640 1 --2- 172.21.15.97:0/4040315147 >> v2:172.21.15.143:3300/0 conn(0x7fa77c0a9470 0x7fa77c06dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 -- 172.21.15.97:0/4040315147 >> v2:172.21.15.143:3300/0 conn(0x7fa77c0a9470 msgr2=0x7fa77c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 --2- 172.21.15.97:0/4040315147 >> v2:172.21.15.143:3300/0 conn(0x7fa77c0a9470 0x7fa77c06dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 -- 172.21.15.97:0/4040315147 >> v1:172.21.15.143:6789/0 conn(0x7fa77c154260 legacy=0x7fa77c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 -- 172.21.15.97:0/4040315147 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c06ca40 con 0x7fa77c154d50 2023-12-04T05:39:45.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781263640 1 -- 172.21.15.97:0/4040315147 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684933524 0 0) 0x7fa77c06c760 con 0x7fa77c154260 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781a64640 1 --2- 172.21.15.97:0/4040315147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009870 tx=0x7fa76c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9d8c3dc24fac99 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.268+0000 7fa781263640 1 -- 172.21.15.97:0/4040315147 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0aa5f0 con 0x7fa77c154d50 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa781263640 1 -- 172.21.15.97:0/4040315147 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0aa750 con 0x7fa77c154d50 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa781263640 1 -- 172.21.15.97:0/4040315147 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0aaae0 con 0x7fa77c154d50 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- 172.21.15.97:0/4040315147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 msgr2=0x7fa77c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- 172.21.15.97:0/4040315147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009870 tx=0x7fa76c01c510 comp rx=0 tx=0).stop 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- 172.21.15.97:0/4040315147 shutdown_connections 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- 172.21.15.97:0/4040315147 >> v2:172.21.15.143:3300/0 conn(0x7fa77c0a9470 0x7fa77c06dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- 172.21.15.97:0/4040315147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c154d50 0x7fa77c06d800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- 172.21.15.97:0/4040315147 >> 172.21.15.97:0/4040315147 conn(0x7fa77c0c2970 msgr2=0x7fa77c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- 172.21.15.97:0/4040315147 shutdown_connections 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- 172.21.15.97:0/4040315147 wait complete. 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 Processor -- start 2023-12-04T05:39:45.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- start start 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c0a9470 0x7fa77c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa77c154d50 0x7fa77c13f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0aafd0 con 0x7fa77c154260 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1eff50 con 0x7fa77c154d50 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa7844c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1f0ad0 con 0x7fa77c0a9470 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa781a64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa781a64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38878/0 (socket says 172.21.15.97:38878) 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa781a64640 1 -- 172.21.15.97:0/802225716 learned_addr learned my addr 172.21.15.97:0/802225716 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa782265640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c0a9470 0x7fa77c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.272+0000 7fa782a66640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa77c154d50 0x7fa77c13f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 -- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c0a9470 msgr2=0x7fa77c14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c0a9470 0x7fa77c14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 -- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa77c154d50 msgr2=0x7fa77c13f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa77c154d50 0x7fa77c13f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 -- 172.21.15.97:0/802225716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0094d0 con 0x7fa77c154260 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa781a64640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ac040 tx=0x7fa76c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0b4810 con 0x7fa77c154260 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0b49b0 con 0x7fa77c154260 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c1f01a0 con 0x7fa77c154260 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0b4d60 con 0x7fa77c154260 2023-12-04T05:39:45.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c1f0760 con 0x7fa77c154260 2023-12-04T05:39:45.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c1f0c40 con 0x7fa77c154260 2023-12-04T05:39:45.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.276+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa76c0c83f0 con 0x7fa77c154260 2023-12-04T05:39:45.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.280+0000 7fa772ffd640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 0x7fa760068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.280+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa76c0a7070 con 0x7fa77c154260 2023-12-04T05:39:45.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.280+0000 7fa782265640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 0x7fa760068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.280+0000 7fa782265640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 0x7fa760068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa778000f70 tx=0x7fa778009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.284+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa76c0ec2a0 con 0x7fa77c154260 2023-12-04T05:39:45.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.432+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa77c068440 con 0x7fa77c154260 2023-12-04T05:39:45.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa772ffd640 1 -- 172.21.15.97:0/802225716 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7fa76c0aa5b0 con 0x7fa77c154260 2023-12-04T05:39:45.441 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:45.442 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 msgr2=0x7fa760068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 0x7fa760068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa778000f70 tx=0x7fa778009040 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 msgr2=0x7fa77c13ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0ac040 tx=0x7fa76c0192b0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 shutdown_connections 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa7600668d0 0x7fa760068d90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa77c154d50 0x7fa77c13f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa77c154260 0x7fa77c13ee20 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 --2- 172.21.15.97:0/802225716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa77c0a9470 0x7fa77c14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 >> 172.21.15.97:0/802225716 conn(0x7fa77c0c2970 msgr2=0x7fa77c14b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 shutdown_connections 2023-12-04T05:39:45.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.436+0000 7fa7844c9640 1 -- 172.21.15.97:0/802225716 wait complete. 2023-12-04T05:39:45.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:45.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:45.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.596+0000 7f2b16a17640 1 Processor -- start 2023-12-04T05:39:45.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.596+0000 7f2b16a17640 1 -- start start 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b16a17640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2b1006c000 0x7f2b100700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b16a17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2b1014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b16a17640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b10150bc0 con 0x7f2b100c1360 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b16a17640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b10154fd0 con 0x7f2b1006c000 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b16a17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10151a70 con 0x7f2b10154af0 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2b100c1360 0x7f2b10151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45210/0 (socket says 172.21.15.97:45210) 2023-12-04T05:39:45.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 -- 172.21.15.97:0/2687728252 learned_addr learned my addr 172.21.15.97:0/2687728252 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:45.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517002189 0 0) 0x7f2b10150bc0 con 0x7f2b100c1360 2023-12-04T05:39:45.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/2687728252 >> v2:172.21.15.143:3300/0 conn(0x7f2b1006c000 0x7f2b100700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b14fb4640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2b1014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af8003450 con 0x7f2b100c1360 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945214721 0 0) 0x7f2af8003450 con 0x7f2b100c1360 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 msgr2=0x7f2b1014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2b1014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 >> v2:172.21.15.143:3300/0 conn(0x7f2b1006c000 msgr2=0x7f2b100700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 --2- 172.21.15.97:0/2687728252 >> v2:172.21.15.143:3300/0 conn(0x7f2b1006c000 0x7f2b100700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b10072160 con 0x7f2b100c1360 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f2b00001680 con 0x7f2b100c1360 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 >> v1:172.21.15.97:6789/0 conn(0x7f2b100c1360 legacy=0x7f2b10151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2af8003a70 0x7f2af8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2af8008860 0x7f2af800ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2af800d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10154fd0 con 0x7f2af8008860 2023-12-04T05:39:45.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10151a70 con 0x7f2af8003a70 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af800db90 con 0x7f2b10154af0 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/2687728252 >> v2:172.21.15.143:3300/0 conn(0x7f2b1006c000 0x7f2b100700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2af8003a70 0x7f2af8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b14fb4640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2af800d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2af8008860 0x7f2af800ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 -- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 msgr2=0x7f2af800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10154af0 0x7f2af800d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 -- 172.21.15.97:0/2687728252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2af8008860 msgr2=0x7f2af800ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2af8008860 0x7f2af800ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0ffff640 1 -- 172.21.15.97:0/2687728252 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8003450 con 0x7f2af8003a70 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.600+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2af8008860 0x7f2af800ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:45.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2af8003a70 0x7f2af8003e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2b0001cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375e2879afeedd5c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000058e0 con 0x7f2af8003a70 2023-12-04T05:39:45.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00005a40 con 0x7f2af8003a70 2023-12-04T05:39:45.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b0effd640 1 -- 172.21.15.97:0/2687728252 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00005e10 con 0x7f2af8003a70 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 -- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2af8003a70 msgr2=0x7f2af8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 --2- 172.21.15.97:0/2687728252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2af8003a70 0x7f2af8003e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2b0001cc60 comp rx=0 tx=0).stop 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b14fb4640 1 -- 172.21.15.97:0/2687728252 reap_dead start 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 -- 172.21.15.97:0/2687728252 shutdown_connections 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 -- 172.21.15.97:0/2687728252 >> 172.21.15.97:0/2687728252 conn(0x7f2b100c5e70 msgr2=0x7f2b100c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 -- 172.21.15.97:0/2687728252 shutdown_connections 2023-12-04T05:39:45.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.604+0000 7f2b16a17640 1 -- 172.21.15.97:0/2687728252 wait complete. 2023-12-04T05:39:45.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 Processor -- start 2023-12-04T05:39:45.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- start start 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10150450 0x7f2b101537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 0x7f2b101449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1014ef20 con 0x7f2b100bf500 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101edad0 con 0x7f2b10144500 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10152d00 con 0x7f2b10150450 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38898/0 (socket says 172.21.15.97:38898) 2023-12-04T05:39:45.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 -- 172.21.15.97:0/1579406165 learned_addr learned my addr 172.21.15.97:0/1579406165 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10150450 0x7f2b101537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b14fb4640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 0x7f2b101449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 -- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10150450 msgr2=0x7f2b101537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10150450 0x7f2b101537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 -- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 msgr2=0x7f2b101449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 0x7f2b101449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 -- 172.21.15.97:0/1579406165 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b101edd70 con 0x7f2b100bf500 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b14fb4640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 0x7f2b101449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0ffff640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2b000ab040 tx=0x7f2af8003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00006ec0 con 0x7f2b100bf500 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b000048b0 con 0x7f2b100bf500 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00004c20 con 0x7f2b100bf500 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b10152fc0 con 0x7f2b100bf500 2023-12-04T05:39:45.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.608+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b101eabd0 con 0x7f2b100bf500 2023-12-04T05:39:45.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b10068440 con 0x7f2b100bf500 2023-12-04T05:39:45.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2b000070d0 con 0x7f2b100bf500 2023-12-04T05:39:45.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b0cff9640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 0x7f2afc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2b0011dfb0 con 0x7f2b100bf500 2023-12-04T05:39:45.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 0x7f2afc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.612+0000 7f2b0f7fe640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 0x7f2afc068dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b10070c40 tx=0x7f2b04009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.616+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b000eaf40 con 0x7f2b100bf500 2023-12-04T05:39:45.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b100c2430 con 0x7f2b100bf500 2023-12-04T05:39:45.773 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b0cff9640 1 -- 172.21.15.97:0/1579406165 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b000bd020 con 0x7f2b100bf500 2023-12-04T05:39:45.774 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:45.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 msgr2=0x7f2afc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 0x7f2afc068dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b10070c40 tx=0x7f2b04009190 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 msgr2=0x7f2b1014e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2b000ab040 tx=0x7f2af8003700 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 shutdown_connections 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2afc066900 0x7f2afc068dc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b10144500 0x7f2b101449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b10150450 0x7f2b101537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 --2- 172.21.15.97:0/1579406165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b100bf500 0x7f2b1014e9e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 >> 172.21.15.97:0/1579406165 conn(0x7f2b100c5e70 msgr2=0x7f2b10158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 shutdown_connections 2023-12-04T05:39:45.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.768+0000 7f2b16a17640 1 -- 172.21.15.97:0/1579406165 wait complete. 2023-12-04T05:39:45.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:45.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 Processor -- start 2023-12-04T05:39:45.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 -- start start 2023-12-04T05:39:45.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f986806c000 0x7f98680700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868150bc0 con 0x7f98680c1360 2023-12-04T05:39:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9868154fd0 con 0x7f986806c000 2023-12-04T05:39:45.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f986cf0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9868151a70 con 0x7f9868154af0 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:55704/0 (socket says 172.21.15.97:55704) 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 -- 172.21.15.97:0/82231737 learned_addr learned my addr 172.21.15.97:0/82231737 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f985dd9b640 1 --2- 172.21.15.97:0/82231737 >> v2:172.21.15.143:3300/0 conn(0x7f986806c000 0x7f98680700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 -- 172.21.15.97:0/82231737 >> v2:172.21.15.143:3300/0 conn(0x7f986806c000 msgr2=0x7f98680700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 --2- 172.21.15.97:0/82231737 >> v2:172.21.15.143:3300/0 conn(0x7f986806c000 0x7f98680700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 -- 172.21.15.97:0/82231737 >> v1:172.21.15.143:6789/0 conn(0x7f98680c1360 legacy=0x7f9868151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.932+0000 7f9866d9d640 1 -- 172.21.15.97:0/82231737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868072160 con 0x7f9868154af0 2023-12-04T05:39:45.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f9866d9d640 1 --2- 172.21.15.97:0/82231737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f986001e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1fe0318cf0521ef server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f9865d9b640 1 -- 172.21.15.97:0/82231737 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860004230 con 0x7f9868154af0 2023-12-04T05:39:45.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f9865d9b640 1 -- 172.21.15.97:0/82231737 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98600ab070 con 0x7f9868154af0 2023-12-04T05:39:45.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f9865d9b640 1 -- 172.21.15.97:0/82231737 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600a7700 con 0x7f9868154af0 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- 172.21.15.97:0/82231737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 msgr2=0x7f986814dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 --2- 172.21.15.97:0/82231737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f986001e940 comp rx=0 tx=0).stop 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- 172.21.15.97:0/82231737 shutdown_connections 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 --2- 172.21.15.97:0/82231737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9868154af0 0x7f986814dce0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 --2- 172.21.15.97:0/82231737 >> v2:172.21.15.143:3300/0 conn(0x7f986806c000 0x7f98680700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- 172.21.15.97:0/82231737 >> 172.21.15.97:0/82231737 conn(0x7f98680c5e70 msgr2=0x7f98680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- 172.21.15.97:0/82231737 shutdown_connections 2023-12-04T05:39:45.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- 172.21.15.97:0/82231737 wait complete. 2023-12-04T05:39:45.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 Processor -- start 2023-12-04T05:39:45.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.936+0000 7f986cf0f640 1 -- start start 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f986806c000 0x7f986814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98680c1360 0x7f986814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986814d160 con 0x7f9868154af0 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98680aad20 con 0x7f98680c1360 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986814d3b0 con 0x7f986806c000 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f986806c000 0x7f986814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38912/0 (socket says 172.21.15.97:38912) 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 -- 172.21.15.97:0/2952654547 learned_addr learned my addr 172.21.15.97:0/2952654547 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f985dd9b640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98680c1360 0x7f986814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 -- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f986806c000 msgr2=0x7f986814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f986806c000 0x7f986814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 -- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98680c1360 msgr2=0x7f986814b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98680c1360 0x7f986814b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 -- 172.21.15.97:0/2952654547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986000b780 con 0x7f9868154af0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f9866d9d640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f986001b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600a7b10 con 0x7f9868154af0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98600a7c70 con 0x7f9868154af0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9868150220 con 0x7f9868154af0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860003620 con 0x7f9868154af0 2023-12-04T05:39:45.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9868150560 con 0x7f9868154af0 2023-12-04T05:39:45.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.940+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9868153ab0 con 0x7f9868154af0 2023-12-04T05:39:45.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.944+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9860003780 con 0x7f9868154af0 2023-12-04T05:39:45.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.944+0000 7f985f7fe640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 0x7f9848068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:45.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.944+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f986011e8a0 con 0x7f9868154af0 2023-12-04T05:39:45.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.944+0000 7f986659c640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 0x7f9848068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:45.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.944+0000 7f986659c640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 0x7f9848068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f98580012f0 tx=0x7f9858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:45.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:45.948+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9868153ab0 con 0x7f9868154af0 2023-12-04T05:39:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9868153ab0 con 0x7f9868154af0 2023-12-04T05:39:46.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f985f7fe640 1 -- 172.21.15.97:0/2952654547 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9868153ab0 con 0x7f9868154af0 2023-12-04T05:39:46.102 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 msgr2=0x7f9848068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 0x7f9848068d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f98580012f0 tx=0x7f9858009040 comp rx=0 tx=0).stop 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 msgr2=0x7f98681f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f986001b6e0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 shutdown_connections 2023-12-04T05:39:46.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98480668d0 0x7f9848068d90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9868154af0 0x7f98681f07d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98680c1360 0x7f986814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 --2- 172.21.15.97:0/2952654547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f986806c000 0x7f986814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 >> 172.21.15.97:0/2952654547 conn(0x7f98680c5e70 msgr2=0x7f98680711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 shutdown_connections 2023-12-04T05:39:46.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.096+0000 7f986cf0f640 1 -- 172.21.15.97:0/2952654547 wait complete. 2023-12-04T05:39:46.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:46.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 Processor -- start 2023-12-04T05:39:46.267 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 -- start start 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 0x7fb4581524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580aa240 con 0x7fb45806c440 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580aa500 con 0x7fb45806d210 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb4606ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45806c0c0 con 0x7fb4580c1e70 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45dc85640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb45806c440 0x7fb4580a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45216/0 (socket says 172.21.15.97:45216) 2023-12-04T05:39:46.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45dc85640 1 -- 172.21.15.97:0/2559368788 learned_addr learned my addr 172.21.15.97:0/2559368788 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45e486640 1 --2- 172.21.15.97:0/2559368788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 0x7fb4581524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770984879 0 0) 0x7fb4580aa240 con 0x7fb45806c440 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb444003530 con 0x7fb45806c440 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959515260 0 0) 0x7fb4580aa500 con 0x7fb45806d210 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4580aa240 con 0x7fb45806d210 2023-12-04T05:39:46.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45e486640 1 -- 172.21.15.97:0/2559368788 >> v1:172.21.15.143:6789/0 conn(0x7fb45806d210 legacy=0x7fb45806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45e486640 1 -- 172.21.15.97:0/2559368788 >> v1:172.21.15.97:6789/0 conn(0x7fb45806c440 legacy=0x7fb4580a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45e486640 1 -- 172.21.15.97:0/2559368788 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580aa7e0 con 0x7fb4580c1e70 2023-12-04T05:39:46.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.264+0000 7fb45e486640 1 --2- 172.21.15.97:0/2559368788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 0x7fb4581524e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb45401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877398ff4eb9df6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540aa610 con 0x7fb4580c1e70 2023-12-04T05:39:46.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4540a6040 con 0x7fb4580c1e70 2023-12-04T05:39:46.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45d484640 1 -- 172.21.15.97:0/2559368788 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540aa990 con 0x7fb4580c1e70 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- 172.21.15.97:0/2559368788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 msgr2=0x7fb4581524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 --2- 172.21.15.97:0/2559368788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 0x7fb4581524e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb45401c490 comp rx=0 tx=0).stop 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- 172.21.15.97:0/2559368788 shutdown_connections 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 --2- 172.21.15.97:0/2559368788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb4580c1e70 0x7fb4581524e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- 172.21.15.97:0/2559368788 >> 172.21.15.97:0/2559368788 conn(0x7fb4580c5e70 msgr2=0x7fb4580c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- 172.21.15.97:0/2559368788 shutdown_connections 2023-12-04T05:39:46.273 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- 172.21.15.97:0/2559368788 wait complete. 2023-12-04T05:39:46.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 Processor -- start 2023-12-04T05:39:46.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- start start 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45806d210 0x7fb4581484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4580c1e70 0x7fb458145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458148a00 con 0x7fb45806c440 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458148c70 con 0x7fb4580c1e70 2023-12-04T05:39:46.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb4606ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb458154920 con 0x7fb45806d210 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45e486640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45e486640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38928/0 (socket says 172.21.15.97:38928) 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45e486640 1 -- 172.21.15.97:0/250393313 learned_addr learned my addr 172.21.15.97:0/250393313 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.268+0000 7fb45dc85640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45806d210 0x7fb4581484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45ec87640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4580c1e70 0x7fb458145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 -- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45806d210 msgr2=0x7fb4581484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45806d210 0x7fb4581484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 -- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4580c1e70 msgr2=0x7fb458145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4580c1e70 0x7fb458145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 -- 172.21.15.97:0/250393313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009420 con 0x7fb45806c440 2023-12-04T05:39:46.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45e486640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb45401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540be610 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4540be770 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458154c00 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540beb20 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458145f40 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580c1ca0 con 0x7fb45806c440 2023-12-04T05:39:46.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb4540bec80 con 0x7fb45806c440 2023-12-04T05:39:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 0x7fb43c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb45411ee90 con 0x7fb45806c440 2023-12-04T05:39:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.272+0000 7fb45dc85640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 0x7fb43c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.276+0000 7fb45dc85640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 0x7fb43c068d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb458156a60 tx=0x7fb448007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.276+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4540ebe10 con 0x7fb45806c440 2023-12-04T05:39:46.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb458068440 con 0x7fb45806c440 2023-12-04T05:39:46.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb44effd640 1 -- 172.21.15.97:0/250393313 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4540ef430 con 0x7fb45806c440 2023-12-04T05:39:46.434 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:46.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 msgr2=0x7fb43c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 0x7fb43c068d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb458156a60 tx=0x7fb448007d80 comp rx=0 tx=0).stop 2023-12-04T05:39:46.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 msgr2=0x7fb4581ebc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097f0 tx=0x7fb45401acd0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 shutdown_connections 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb43c0668d0 0x7fb43c068d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb4580c1e70 0x7fb458145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45806d210 0x7fb4581484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 --2- 172.21.15.97:0/250393313 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb45806c440 0x7fb4581ebc50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 >> 172.21.15.97:0/250393313 conn(0x7fb4580c5e70 msgr2=0x7fb4580c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 shutdown_connections 2023-12-04T05:39:46.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.428+0000 7fb4606ea640 1 -- 172.21.15.97:0/250393313 wait complete. 2023-12-04T05:39:46.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:46.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 Processor -- start 2023-12-04T05:39:46.594 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- start start 2023-12-04T05:39:46.596 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5268151f10 0x7f52680c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680ca780 con 0x7f52680cac10 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5268158720 con 0x7f52680c7f00 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5268158cc0 con 0x7f5268151f10 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526cf83640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f52680cac10 0x7f526815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45222/0 (socket says 172.21.15.97:45222) 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526cf83640 1 -- 172.21.15.97:0/2138029774 learned_addr learned my addr 172.21.15.97:0/2138029774 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:46.597 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5267fff640 1 --2- 172.21.15.97:0/2138029774 >> v2:172.21.15.143:3300/0 conn(0x7f5268151f10 0x7f52680c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042116813 0 0) 0x7f52680ca780 con 0x7f52680cac10 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5250003530 con 0x7f52680cac10 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249198076 0 0) 0x7f5268158720 con 0x7f52680c7f00 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52680ca780 con 0x7f52680c7f00 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5267fff640 1 -- 172.21.15.97:0/2138029774 >> v1:172.21.15.143:6789/0 conn(0x7f52680c7f00 legacy=0x7f5268154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.598 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652758168 0 0) 0x7f5250003530 con 0x7f52680cac10 2023-12-04T05:39:46.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5267fff640 1 -- 172.21.15.97:0/2138029774 >> v1:172.21.15.97:6789/0 conn(0x7f52680cac10 legacy=0x7f526815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.599 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5267fff640 1 -- 172.21.15.97:0/2138029774 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680bd830 con 0x7f5268151f10 2023-12-04T05:39:46.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5267fff640 1 --2- 172.21.15.97:0/2138029774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52680c4980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f52580097c0 tx=0x7f525801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9fd3bc118caba87 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260001a00 con 0x7f5268151f10 2023-12-04T05:39:46.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580a7050 con 0x7f5268151f10 2023-12-04T05:39:46.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f5266ffd640 1 -- 172.21.15.97:0/2138029774 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580ab620 con 0x7f5268151f10 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- 172.21.15.97:0/2138029774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 msgr2=0x7f52680c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 --2- 172.21.15.97:0/2138029774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52680c4980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f52580097c0 tx=0x7f525801c280 comp rx=0 tx=0).stop 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- 172.21.15.97:0/2138029774 shutdown_connections 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 --2- 172.21.15.97:0/2138029774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52680c4980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- 172.21.15.97:0/2138029774 >> 172.21.15.97:0/2138029774 conn(0x7f5268073950 msgr2=0x7f5268073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.592+0000 7f526e9e6640 1 -- 172.21.15.97:0/2138029774 shutdown_connections 2023-12-04T05:39:46.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 -- 172.21.15.97:0/2138029774 wait complete. 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 Processor -- start 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 -- start start 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52680c7f00 0x7f52681483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52681eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52681ee3a0 con 0x7f52680cac10 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52681ee960 con 0x7f5268151f10 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526e9e6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5268148900 con 0x7f52680c7f00 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38940/0 (socket says 172.21.15.97:38940) 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 -- 172.21.15.97:0/4201781164 learned_addr learned my addr 172.21.15.97:0/4201781164 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f526cf83640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52681eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f5267fff640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52680c7f00 0x7f52681483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 -- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52680c7f00 msgr2=0x7f52681483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52680c7f00 0x7f52681483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 -- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 msgr2=0x7f52681eedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52681eedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 -- 172.21.15.97:0/4201781164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009420 con 0x7f52680cac10 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f52677fe640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c430 tx=0x7f525c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.596+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c0052d0 con 0x7f52680cac10 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c005450 con 0x7f52680cac10 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c003840 con 0x7f52680cac10 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680c3ae0 con 0x7f52680cac10 2023-12-04T05:39:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681ee5f0 con 0x7f52680cac10 2023-12-04T05:39:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52680c4000 con 0x7f52680cac10 2023-12-04T05:39:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f525c0039a0 con 0x7f52680cac10 2023-12-04T05:39:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5264ff9640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 0x7f5254068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f525c083e40 con 0x7f52680cac10 2023-12-04T05:39:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5267fff640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 0x7f5254068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.600+0000 7f5267fff640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 0x7f5254068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f52580ad000 tx=0x7f5258008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.604+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f525c050ca0 con 0x7f52680cac10 2023-12-04T05:39:46.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.752+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52681eead0 con 0x7f52680cac10 2023-12-04T05:39:46.759 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.752+0000 7f5264ff9640 1 -- 172.21.15.97:0/4201781164 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f525c017020 con 0x7f52680cac10 2023-12-04T05:39:46.760 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 msgr2=0x7f5254068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 0x7f5254068d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f52580ad000 tx=0x7f5258008040 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 msgr2=0x7f526814e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c430 tx=0x7f525c00c8f0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 shutdown_connections 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f52540668d0 0x7f5254068d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5268151f10 0x7f52681eedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f52680cac10 0x7f526814e430 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 --2- 172.21.15.97:0/4201781164 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52680c7f00 0x7f52681483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.762 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 >> 172.21.15.97:0/4201781164 conn(0x7f5268073950 msgr2=0x7f5268073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 shutdown_connections 2023-12-04T05:39:46.763 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.756+0000 7f526e9e6640 1 -- 172.21.15.97:0/4201781164 wait complete. 2023-12-04T05:39:46.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:46.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 Processor -- start 2023-12-04T05:39:46.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 -- start start 2023-12-04T05:39:46.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd43414e700 0x7fd4340c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd434158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340cad70 con 0x7fd434155160 2023-12-04T05:39:46.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd434158cd0 con 0x7fd43414e700 2023-12-04T05:39:46.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd43b50f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd434155630 con 0x7fd4340bd720 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd4392ab640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd43414e700 0x7fd4340c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd438aaa640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd434155160 0x7fd434158080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45234/0 (socket says 172.21.15.97:45234) 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd438aaa640 1 -- 172.21.15.97:0/3040171325 learned_addr learned my addr 172.21.15.97:0/3040171325 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd439aac640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd434158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd4392ab640 1 -- 172.21.15.97:0/3040171325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 msgr2=0x7fd434158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd4392ab640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd434158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd4392ab640 1 -- 172.21.15.97:0/3040171325 >> v1:172.21.15.97:6789/0 conn(0x7fd434155160 legacy=0x7fd434158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd4392ab640 1 -- 172.21.15.97:0/3040171325 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340ca4d0 con 0x7fd43414e700 2023-12-04T05:39:46.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.916+0000 7fd42bfff640 1 -- 172.21.15.97:0/3040171325 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292898084 0 0) 0x7fd4340cad70 con 0x7fd434155160 2023-12-04T05:39:46.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd4392ab640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c4a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd4300097c0 tx=0x7fd43001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec70cdfa122751a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd42bfff640 1 -- 172.21.15.97:0/3040171325 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300ab600 con 0x7fd43414e700 2023-12-04T05:39:46.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd42bfff640 1 -- 172.21.15.97:0/3040171325 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4300a7050 con 0x7fd43414e700 2023-12-04T05:39:46.926 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd42bfff640 1 -- 172.21.15.97:0/3040171325 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300ab980 con 0x7fd43414e700 2023-12-04T05:39:46.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 -- 172.21.15.97:0/3040171325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 msgr2=0x7fd4340c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c4a10 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd4300097c0 tx=0x7fd43001c330 comp rx=0 tx=0).stop 2023-12-04T05:39:46.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 -- 172.21.15.97:0/3040171325 shutdown_connections 2023-12-04T05:39:46.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd434158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 --2- 172.21.15.97:0/3040171325 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c4a10 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 -- 172.21.15.97:0/3040171325 >> 172.21.15.97:0/3040171325 conn(0x7fd434073720 msgr2=0x7fd434073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:46.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 -- 172.21.15.97:0/3040171325 shutdown_connections 2023-12-04T05:39:46.928 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.920+0000 7fd43b50f640 1 -- 172.21.15.97:0/3040171325 wait complete. 2023-12-04T05:39:46.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 Processor -- start 2023-12-04T05:39:46.929 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- start start 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd4341ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 0x7fd43414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd434157b00 con 0x7fd43414e700 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c3310 con 0x7fd434155160 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341f15f0 con 0x7fd4340bd720 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.931 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38960/0 (socket says 172.21.15.97:38960) 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 -- 172.21.15.97:0/2717616559 learned_addr learned my addr 172.21.15.97:0/2717616559 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd4392ab640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd4341ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd439aac640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 0x7fd43414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 -- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 msgr2=0x7fd4341ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd4341ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 -- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 msgr2=0x7fd43414bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 0x7fd43414bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 -- 172.21.15.97:0/2717616559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430009420 con 0x7fd43414e700 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd439aac640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 0x7fd43414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd438aaa640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd424005890 tx=0x7fd42400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424005cf0 con 0x7fd43414e700 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424005e50 con 0x7fd43414e700 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240072f0 con 0x7fd43414e700 2023-12-04T05:39:46.932 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4341f0a70 con 0x7fd43414e700 2023-12-04T05:39:46.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.924+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4341f1030 con 0x7fd43414e700 2023-12-04T05:39:46.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4340c23a0 con 0x7fd43414e700 2023-12-04T05:39:46.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd424007450 con 0x7fd43414e700 2023-12-04T05:39:46.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd429ffb640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 0x7fd418068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:46.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd424083c50 con 0x7fd43414e700 2023-12-04T05:39:46.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd4392ab640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 0x7fd418068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:46.935 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.928+0000 7fd4392ab640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 0x7fd418068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd4300ad000 tx=0x7fd4300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:46.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:46.932+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd4340c23a0 con 0x7fd43414e700 2023-12-04T05:39:47.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.080+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd4340c23a0 con 0x7fd43414e700 2023-12-04T05:39:47.086 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.080+0000 7fd429ffb640 1 -- 172.21.15.97:0/2717616559 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd4340c23a0 con 0x7fd43414e700 2023-12-04T05:39:47.086 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:47.088 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 msgr2=0x7fd418068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 0x7fd418068dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd4300ad000 tx=0x7fd4300a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 msgr2=0x7fd4340c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd424005890 tx=0x7fd42400c9b0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 shutdown_connections 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd418066900 0x7fd418068dc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd434155160 0x7fd43414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd43414e700 0x7fd4340c3a10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 --2- 172.21.15.97:0/2717616559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4340bd720 0x7fd4341ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 >> 172.21.15.97:0/2717616559 conn(0x7fd434073720 msgr2=0x7fd43415e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 shutdown_connections 2023-12-04T05:39:47.089 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.084+0000 7fd43b50f640 1 -- 172.21.15.97:0/2717616559 wait complete. 2023-12-04T05:39:47.107 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:39:47.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 Processor -- start 2023-12-04T05:39:47.249 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 -- start start 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efdb00c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb00c56e0 con 0x7efdb00bd540 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb0155400 con 0x7efdb00af430 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb7103640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c7d70 con 0x7efdb006d230 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb6902640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efdb00bd540 0x7efdb00c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45244/0 (socket says 172.21.15.97:45244) 2023-12-04T05:39:47.252 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb6902640 1 -- 172.21.15.97:0/2097517267 learned_addr learned my addr 172.21.15.97:0/2097517267 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb5900640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efdb00c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598916554 0 0) 0x7efda80014a0 con 0x7efdb00bd540 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd9c003530 con 0x7efdb00bd540 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730922849 0 0) 0x7efdb0155400 con 0x7efdb00af430 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda80014a0 con 0x7efdb00af430 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121250179 0 0) 0x7efd9c003530 con 0x7efdb00bd540 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 msgr2=0x7efdb00c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efdb00c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 >> v1:172.21.15.143:6789/0 conn(0x7efdb00af430 legacy=0x7efdb006bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00c8050 con 0x7efdb00bd540 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7efda8001b90 con 0x7efdb00bd540 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 >> v1:172.21.15.97:6789/0 conn(0x7efdb00bd540 legacy=0x7efdb00c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd9c003b40 0x7efd9c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c0047d0 0x7efd9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.253 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efd9c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c7d70 con 0x7efd9c003b40 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c00baa0 con 0x7efd9c0047d0 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c00bc60 con 0x7efdb006d230 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.244+0000 7efdb6101640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd9c003b40 0x7efd9c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb5900640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c0047d0 0x7efd9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6902640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efd9c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 -- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 msgr2=0x7efd9c0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:47.254 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb006d230 0x7efd9c0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 -- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c0047d0 msgr2=0x7efd9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:47.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c0047d0 0x7efd9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.255 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 -- 172.21.15.97:0/2097517267 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c003530 con 0x7efd9c003b40 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6101640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd9c003b40 0x7efd9c003f40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7efdac0018d0 tx=0x7efdac01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2eecd492c2eb2a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0050d0 con 0x7efd9c003b40 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac005250 con 0x7efd9c003b40 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb50ff640 1 -- 172.21.15.97:0/2097517267 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac003600 con 0x7efd9c003b40 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb7103640 1 -- 172.21.15.97:0/2097517267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd9c003b40 msgr2=0x7efd9c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb7103640 1 --2- 172.21.15.97:0/2097517267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd9c003b40 0x7efd9c003f40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7efdac0018d0 tx=0x7efdac01c530 comp rx=0 tx=0).stop 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.248+0000 7efdb6902640 1 -- 172.21.15.97:0/2097517267 reap_dead start 2023-12-04T05:39:47.256 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/2097517267 shutdown_connections 2023-12-04T05:39:47.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/2097517267 >> 172.21.15.97:0/2097517267 conn(0x7efdb0073dd0 msgr2=0x7efdb00aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:47.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/2097517267 shutdown_connections 2023-12-04T05:39:47.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/2097517267 wait complete. 2023-12-04T05:39:47.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 Processor -- start 2023-12-04T05:39:47.257 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- start start 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c003b40 0x7efdb01584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 0x7efdb01f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00aeb60 con 0x7efdb0156270 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00aee00 con 0x7efd9c003b40 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0157cb0 con 0x7efdb014e4c0 2023-12-04T05:39:47.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38972/0 (socket says 172.21.15.97:38972) 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 -- 172.21.15.97:0/1734197420 learned_addr learned my addr 172.21.15.97:0/1734197420 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb6101640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c003b40 0x7efdb01584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb6902640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 0x7efdb01f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 -- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 msgr2=0x7efdb01f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 0x7efdb01f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 -- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c003b40 msgr2=0x7efdb01584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c003b40 0x7efdb01584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 -- 172.21.15.97:0/1734197420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00ae7f0 con 0x7efdb0156270 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb6902640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 0x7efdb01f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:47.260 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb5900640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7efda00119d0 tx=0x7efda0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda000fb50 con 0x7efdb0156270 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000fcb0 con 0x7efdb0156270 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0150f40 con 0x7efdb0156270 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0014440 con 0x7efdb0156270 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.252+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb00afab0 con 0x7efdb0156270 2023-12-04T05:39:47.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb0157e70 con 0x7efdb0156270 2023-12-04T05:39:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efda00145a0 con 0x7efdb0156270 2023-12-04T05:39:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efda6ffd640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 0x7efd94068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efda0085110 con 0x7efdb0156270 2023-12-04T05:39:47.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efdb6101640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 0x7efd94068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.256+0000 7efdb6101640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 0x7efd94068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efdac0ad000 tx=0x7efdac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.260+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efda00520b0 con 0x7efdb0156270 2023-12-04T05:39:47.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.420+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efdb0157b10 con 0x7efdb0156270 2023-12-04T05:39:47.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efda6ffd640 1 -- 172.21.15.97:0/1734197420 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7efdb0157b10 con 0x7efdb0156270 2023-12-04T05:39:47.428 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 msgr2=0x7efd94068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 0x7efd94068d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efdac0ad000 tx=0x7efdac0a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 msgr2=0x7efdb00ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7efda00119d0 tx=0x7efda0011e90 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 shutdown_connections 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd940668d0 0x7efd94068d90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdb014e4c0 0x7efdb01f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efdb0156270 0x7efdb00ae2b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 --2- 172.21.15.97:0/1734197420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd9c003b40 0x7efdb01584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 >> 172.21.15.97:0/1734197420 conn(0x7efdb0073dd0 msgr2=0x7efdb014f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:47.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 shutdown_connections 2023-12-04T05:39:47.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.424+0000 7efdb7103640 1 -- 172.21.15.97:0/1734197420 wait complete. 2023-12-04T05:39:47.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:39:47.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:47.449 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:47.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:39:47.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:47.478 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:39:47.533 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:47.533 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:47.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:39:47.585 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:39:47.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.720+0000 7fd0ec454640 1 Processor -- start 2023-12-04T05:39:47.723 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.720+0000 7fd0ec454640 1 -- start start 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ec454640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd0e406b860 0x7fd0e40c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ec454640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd0e40c1030 0x7fd0e4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ec454640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e40739b0 con 0x7fd0e4152090 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ec454640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40c15a0 con 0x7fd0e406b860 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ec454640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e4155220 con 0x7fd0e40c1030 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd0e406b860 0x7fd0e40c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd0e406b860 0x7fd0e40c2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38976/0 (socket says 172.21.15.97:38976) 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea9f1640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fd0e4152090 0x7fd0e4157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45254/0 (socket says 172.21.15.97:45254) 2023-12-04T05:39:47.727 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/413090068 learned_addr learned my addr 172.21.15.97:0/413090068 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0e99ef640 1 --2- 172.21.15.97:0/413090068 >> v2:172.21.15.143:3300/0 conn(0x7fd0e40c1030 0x7fd0e4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/413090068 >> v2:172.21.15.143:3300/0 conn(0x7fd0e40c1030 msgr2=0x7fd0e4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 --2- 172.21.15.97:0/413090068 >> v2:172.21.15.143:3300/0 conn(0x7fd0e40c1030 0x7fd0e4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/413090068 >> v1:172.21.15.97:6789/0 conn(0x7fd0e4152090 legacy=0x7fd0e4157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/413090068 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4155710 con 0x7fd0e406b860 2023-12-04T05:39:47.728 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.724+0000 7fd0e91ee640 1 -- 172.21.15.97:0/413090068 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473332138 0 0) 0x7fd0e40739b0 con 0x7fd0e4152090 2023-12-04T05:39:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ea1f0640 1 --2- 172.21.15.97:0/413090068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e40c2a00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40aba00 tx=0x7fd0e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941d58bb54e5fc2c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0e91ee640 1 -- 172.21.15.97:0/413090068 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab600 con 0x7fd0e406b860 2023-12-04T05:39:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0e91ee640 1 -- 172.21.15.97:0/413090068 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e00a7050 con 0x7fd0e406b860 2023-12-04T05:39:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0e91ee640 1 -- 172.21.15.97:0/413090068 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab980 con 0x7fd0e406b860 2023-12-04T05:39:47.730 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- 172.21.15.97:0/413090068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 msgr2=0x7fd0e40c2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 --2- 172.21.15.97:0/413090068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e40c2a00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40aba00 tx=0x7fd0e001c470 comp rx=0 tx=0).stop 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- 172.21.15.97:0/413090068 shutdown_connections 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 --2- 172.21.15.97:0/413090068 >> v2:172.21.15.143:3300/0 conn(0x7fd0e40c1030 0x7fd0e4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 --2- 172.21.15.97:0/413090068 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e40c2a00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- 172.21.15.97:0/413090068 >> 172.21.15.97:0/413090068 conn(0x7fd0e40c3130 msgr2=0x7fd0e40c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- 172.21.15.97:0/413090068 shutdown_connections 2023-12-04T05:39:47.731 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- 172.21.15.97:0/413090068 wait complete. 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 Processor -- start 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.728+0000 7fd0ec454640 1 -- start start 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e40c1030 0x7fd0e4071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e4152090 0x7fd0e40715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41ed430 con 0x7fd0e406b860 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41ed960 con 0x7fd0e40c1030 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4070be0 con 0x7fd0e4152090 2023-12-04T05:39:47.734 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38982/0 (socket says 172.21.15.97:38982) 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/747826134 learned_addr learned my addr 172.21.15.97:0/747826134 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0e99ef640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e40c1030 0x7fd0e4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea9f1640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e4152090 0x7fd0e40715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e4152090 msgr2=0x7fd0e40715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e4152090 0x7fd0e40715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e40c1030 msgr2=0x7fd0e4071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e40c1030 0x7fd0e4071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 -- 172.21.15.97:0/747826134 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e00094d0 con 0x7fd0e406b860 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ea1f0640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001a0a0 tx=0x7fd0e001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0004230 con 0x7fd0e406b860 2023-12-04T05:39:47.735 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0004390 con 0x7fd0e406b860 2023-12-04T05:39:47.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e40a97c0 con 0x7fd0e406b860 2023-12-04T05:39:47.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0003820 con 0x7fd0e406b860 2023-12-04T05:39:47.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e41ed680 con 0x7fd0e406b860 2023-12-04T05:39:47.736 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4068440 con 0x7fd0e406b860 2023-12-04T05:39:47.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.732+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd0e00b2050 con 0x7fd0e406b860 2023-12-04T05:39:47.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.736+0000 7fd0daffd640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:47.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.736+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd0e011ea80 con 0x7fd0e406b860 2023-12-04T05:39:47.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.736+0000 7fd0e99ef640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:47.738 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.736+0000 7fd0e99ef640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40709b0 tx=0x7fd0d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:47.740 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.740+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0e00eba70 con 0x7fd0e406b860 2023-12-04T05:39:47.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0e40c35b0 con 0x7fd0e406b860 2023-12-04T05:39:47.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0daffd640 1 -- 172.21.15.97:0/747826134 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd0e00b0070 con 0x7fd0e406b860 2023-12-04T05:39:47.922 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:39:47.922 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 msgr2=0x7fd0c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40709b0 tx=0x7fd0d4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 msgr2=0x7fd0e4072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd0e001a0a0 tx=0x7fd0e001acb0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 shutdown_connections 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd0c80668d0 0x7fd0c8068d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd0e4152090 0x7fd0e40715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd0e40c1030 0x7fd0e4071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 --2- 172.21.15.97:0/747826134 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0e406b860 0x7fd0e4072460 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:47.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 >> 172.21.15.97:0/747826134 conn(0x7fd0e40c3130 msgr2=0x7fd0e4150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:47.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 shutdown_connections 2023-12-04T05:39:47.925 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:47.920+0000 7fd0ec454640 1 -- 172.21.15.97:0/747826134 wait complete. 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T05:39:47.943 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:47.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:47.944 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:47.954 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 41954sec preferred_lft 41954sec 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.955 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:39:47.956 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:47.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:47.957 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:39:48.019 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:39:48.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.023 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:39:48.074 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:39:48.074 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:39:48.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.075 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:39:48.075 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:39:48.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:39:48.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:39:48.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:39:48.076 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:39:48.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.169 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:39:48.179 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:39:48.180 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:48.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:39:48.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:48.245 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:48.295 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:48.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:48.296 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:48.347 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-04T05:39:48.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.347 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:48.440 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:48.440 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:48.454 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:48.454 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:48.454 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:48.454 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: 1@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:39:48.454 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:48.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:39:48.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.458 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:48.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.479 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:39:48.542 INFO:teuthology.orchestra.run.smithi143.stdout:client6822 2023-12-04T05:39:48.543 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:48.543 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:48.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.593 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-04T05:39:48.609 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:48.609 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-04T05:39:48.671 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:48.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:48.672 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-04T05:39:48.689 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:48.689 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-04T05:39:48.746 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:48.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-04T05:39:48.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 Processor -- start 2023-12-04T05:39:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 -- start start 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe73806c000 0x7fe7380700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe738150bc0 con 0x7fe738154af0 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe738154fd0 con 0x7fe7380c1360 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.888+0000 7fe73da09640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe738151a70 con 0x7fe73806c000 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7377fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe738154af0 0x7fe73814dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45264/0 (socket says 172.21.15.97:45264) 2023-12-04T05:39:48.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7377fe640 1 -- 172.21.15.97:0/1117927495 learned_addr learned my addr 172.21.15.97:0/1117927495 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1117927495 >> v2:172.21.15.143:3300/0 conn(0x7fe73806c000 0x7fe7380700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654055368 0 0) 0x7fe738150bc0 con 0x7fe738154af0 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724003530 con 0x7fe738154af0 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252353633 0 0) 0x7fe738154fd0 con 0x7fe7380c1360 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe738150bc0 con 0x7fe7380c1360 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360333330 0 0) 0x7fe724003530 con 0x7fe738154af0 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 >> v2:172.21.15.143:3300/0 conn(0x7fe73806c000 msgr2=0x7fe7380700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 --2- 172.21.15.97:0/1117927495 >> v2:172.21.15.143:3300/0 conn(0x7fe73806c000 0x7fe7380700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.895 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 >> v1:172.21.15.143:6789/0 conn(0x7fe7380c1360 legacy=0x7fe738151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738072160 con 0x7fe738154af0 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fe730001680 con 0x7fe738154af0 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 >> v1:172.21.15.97:6789/0 conn(0x7fe738154af0 legacy=0x7fe73814dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe724003b10 0x7fe724003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe724004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe724005190 0x7fe72400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738151a70 con 0x7fe7240047d0 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72400c0c0 con 0x7fe724005190 2023-12-04T05:39:48.896 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72400c280 con 0x7fe724003b10 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe724004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7377fe640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe724005190 0x7fe72400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe736ffd640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe724003b10 0x7fe724003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 -- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe724003b10 msgr2=0x7fe724003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe724003b10 0x7fe724003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 -- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe724005190 msgr2=0x7fe72400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe724005190 0x7fe72400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe72e7fc640 1 -- 172.21.15.97:0/1117927495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724003530 con 0x7fe7240047d0 2023-12-04T05:39:48.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.892+0000 7fe7377fe640 1 -- 172.21.15.97:0/1117927495 reap_dead start 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe724004c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe720009ae0 tx=0x7fe72001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36a24044d1fce17 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200a5510 con 0x7fe7240047d0 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7200a5670 con 0x7fe7240047d0 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe7367fc640 1 -- 172.21.15.97:0/1117927495 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7200a5a20 con 0x7fe7240047d0 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 msgr2=0x7fe724004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:48.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe724004c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe720009ae0 tx=0x7fe72001ca50 comp rx=0 tx=0).stop 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- 172.21.15.97:0/1117927495 shutdown_connections 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 --2- 172.21.15.97:0/1117927495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe724004c50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- 172.21.15.97:0/1117927495 >> 172.21.15.97:0/1117927495 conn(0x7fe7380c5e70 msgr2=0x7fe7380c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- 172.21.15.97:0/1117927495 shutdown_connections 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- 172.21.15.97:0/1117927495 wait complete. 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 Processor -- start 2023-12-04T05:39:48.904 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.896+0000 7fe73da09640 1 -- start start 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7380a9430 0x7fe7381467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe738146cf0 0x7fe7381ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381f17d0 con 0x7fe7240047d0 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73814d750 con 0x7fe7380a9430 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe738147170 con 0x7fe738146cf0 2023-12-04T05:39:48.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39002/0 (socket says 172.21.15.97:39002) 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 -- 172.21.15.97:0/1585922811 learned_addr learned my addr 172.21.15.97:0/1585922811 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe7377fe640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe738146cf0 0x7fe7381ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7380a9430 0x7fe7381467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 -- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe738146cf0 msgr2=0x7fe7381ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe738146cf0 0x7fe7381ed8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 -- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7380a9430 msgr2=0x7fe7381467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7380a9430 0x7fe7381467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 -- 172.21.15.97:0/1585922811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738147400 con 0x7fe7240047d0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe736ffd640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe72800fa90 tx=0x7fe72800ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728006d70 con 0x7fe7240047d0 2023-12-04T05:39:48.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe728003980 con 0x7fe7240047d0 2023-12-04T05:39:48.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728003d30 con 0x7fe7240047d0 2023-12-04T05:39:48.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73814d470 con 0x7fe7240047d0 2023-12-04T05:39:48.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7381507e0 con 0x7fe7240047d0 2023-12-04T05:39:48.907 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7381f1d30 con 0x7fe7240047d0 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.900+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe72800d890 con 0x7fe7240047d0 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.904+0000 7fe734ff9640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 0x7fe718068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.904+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe728084120 con 0x7fe7240047d0 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.904+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 0x7fe718068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.904+0000 7fe72e7fc640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 0x7fe718068dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe7200af000 tx=0x7fe7200046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:48.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:48.908+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe728051010 con 0x7fe7240047d0 2023-12-04T05:39:49.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.104+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7fe7380a8e30 con 0x7fe7240047d0 2023-12-04T05:39:49.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.108+0000 7fe734ff9640 1 -- 172.21.15.97:0/1585922811 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v23) v1 ==== 272+0+0 (secure 0 0 0) 0x7fe7380a8e30 con 0x7fe7240047d0 2023-12-04T05:39:49.110 INFO:teuthology.orchestra.run.smithi097.stderr:added key for client.testuser 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 msgr2=0x7fe718068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 0x7fe718068dc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe7200af000 tx=0x7fe7200046d0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 msgr2=0x7fe7381502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe72800fa90 tx=0x7fe72800ff50 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 shutdown_connections 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe718066900 0x7fe718068dc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe738146cf0 0x7fe7381ed8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7380a9430 0x7fe7381467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 --2- 172.21.15.97:0/1585922811 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7240047d0 0x7fe7381502a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 >> 172.21.15.97:0/1585922811 conn(0x7fe7380c5e70 msgr2=0x7fe738070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 shutdown_connections 2023-12-04T05:39:49.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.112+0000 7fe73da09640 1 -- 172.21.15.97:0/1585922811 wait complete. 2023-12-04T05:39:49.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-04T05:39:49.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 Processor -- start 2023-12-04T05:39:49.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 -- start start 2023-12-04T05:39:49.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 0x7f34fc154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc150d80 0x7f34fc0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34fc0c19a0 0x7f34fc0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc151240 con 0x7f34fc0c19a0 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc151520 con 0x7f34fc06b860 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f35033d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc151800 con 0x7f34fc150d80 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34fc0c19a0 0x7f34fc0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f34fc0c19a0 0x7f34fc0709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39004/0 (socket says 172.21.15.97:39004) 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 -- 172.21.15.97:0/689784730 learned_addr learned my addr 172.21.15.97:0/689784730 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350116d640 1 --2- 172.21.15.97:0/689784730 >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 0x7f34fc154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350096c640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc150d80 0x7f34fc0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 -- 172.21.15.97:0/689784730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc150d80 msgr2=0x7f34fc0c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc150d80 0x7f34fc0c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 -- 172.21.15.97:0/689784730 >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 msgr2=0x7f34fc154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 --2- 172.21.15.97:0/689784730 >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 0x7f34fc154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350196e640 1 -- 172.21.15.97:0/689784730 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc151ae0 con 0x7f34fc0c19a0 2023-12-04T05:39:49.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.272+0000 7f350116d640 1 --2- 172.21.15.97:0/689784730 >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 0x7f34fc154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f350196e640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc0c19a0 0x7f34fc0709b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f34f400af60 tx=0x7f34f401d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f44b669733681c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f34f3fff640 1 -- 172.21.15.97:0/689784730 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400a2d0 con 0x7f34fc0c19a0 2023-12-04T05:39:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f34f3fff640 1 -- 172.21.15.97:0/689784730 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40a65d0 con 0x7f34fc0c19a0 2023-12-04T05:39:49.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f34f3fff640 1 -- 172.21.15.97:0/689784730 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a6960 con 0x7f34fc0c19a0 2023-12-04T05:39:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 -- 172.21.15.97:0/689784730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc0c19a0 msgr2=0x7f34fc0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc0c19a0 0x7f34fc0709b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f34f400af60 tx=0x7f34f401d9b0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 -- 172.21.15.97:0/689784730 shutdown_connections 2023-12-04T05:39:49.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc150d80 0x7f34fc0c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 --2- 172.21.15.97:0/689784730 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc0c19a0 0x7f34fc0709b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 --2- 172.21.15.97:0/689784730 >> v2:172.21.15.143:3300/0 conn(0x7f34fc06b860 0x7f34fc154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 -- 172.21.15.97:0/689784730 >> 172.21.15.97:0/689784730 conn(0x7f34fc0c31c0 msgr2=0x7f34fc0c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 -- 172.21.15.97:0/689784730 shutdown_connections 2023-12-04T05:39:49.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 -- 172.21.15.97:0/689784730 wait complete. 2023-12-04T05:39:49.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.276+0000 7f35033d1640 1 Processor -- start 2023-12-04T05:39:49.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- start start 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 0x7f34fc14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc0c19a0 0x7f34fc152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc066400 con 0x7f34fc150d80 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1501c0 con 0x7f34fc06b860 2023-12-04T05:39:49.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1504a0 con 0x7f34fc0c19a0 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39020/0 (socket says 172.21.15.97:39020) 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 -- 172.21.15.97:0/3389565633 learned_addr learned my addr 172.21.15.97:0/3389565633 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350116d640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 0x7f34fc14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350096c640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc0c19a0 0x7f34fc152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 -- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc0c19a0 msgr2=0x7f34fc152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc0c19a0 0x7f34fc152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 -- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 msgr2=0x7f34fc14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 0x7f34fc14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 -- 172.21.15.97:0/3389565633 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009420 con 0x7f34fc150d80 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350116d640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 0x7f34fc14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f350196e640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f34f401c060 tx=0x7f34f401a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40bc070 con 0x7f34fc150d80 2023-12-04T05:39:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40a6a50 con 0x7f34fc150d80 2023-12-04T05:39:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a6e40 con 0x7f34fc150d80 2023-12-04T05:39:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f400ac40 con 0x7f34fc150d80 2023-12-04T05:39:49.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc150a60 con 0x7f34fc150d80 2023-12-04T05:39:49.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.280+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc0c2c60 con 0x7f34fc150d80 2023-12-04T05:39:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.284+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34f40b7480 con 0x7f34fc150d80 2023-12-04T05:39:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.284+0000 7f34f1ffb640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 0x7f34e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.284+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f34f411f2d0 con 0x7f34fc150d80 2023-12-04T05:39:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.284+0000 7f350116d640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 0x7f34e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.284+0000 7f350116d640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 0x7f34e0068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0a8fb0 tx=0x7f34f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.288+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34f40ec1e0 con 0x7f34fc150d80 2023-12-04T05:39:49.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.488+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f34fc068440 con 0x7f34fc150d80 2023-12-04T05:39:49.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.488+0000 7f34f1ffb640 1 -- 172.21.15.97:0/3389565633 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v23) v1 ==== 85+0+226 (secure 0 0 0) 0x7f34f40ef800 con 0x7f34fc150d80 2023-12-04T05:39:49.491 INFO:teuthology.orchestra.run.smithi097.stdout:[client.testuser] 2023-12-04T05:39:49.491 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ== 2023-12-04T05:39:49.491 INFO:teuthology.orchestra.run.smithi097.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-04T05:39:49.492 INFO:teuthology.orchestra.run.smithi097.stdout: caps mon = "allow r" 2023-12-04T05:39:49.492 INFO:teuthology.orchestra.run.smithi097.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-04T05:39:49.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 msgr2=0x7f34e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 0x7f34e0068d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0a8fb0 tx=0x7f34f8008040 comp rx=0 tx=0).stop 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 msgr2=0x7f34fc152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f34f401c060 tx=0x7f34f401a750 comp rx=0 tx=0).stop 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 shutdown_connections 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f34e00668d0 0x7f34e0068d90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f34fc150d80 0x7f34fc152f80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f34fc0c19a0 0x7f34fc152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 --2- 172.21.15.97:0/3389565633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34fc06b860 0x7f34fc14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 >> 172.21.15.97:0/3389565633 conn(0x7f34fc0c31c0 msgr2=0x7f34fc147030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 shutdown_connections 2023-12-04T05:39:49.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.492+0000 7f35033d1640 1 -- 172.21.15.97:0/3389565633 wait complete. 2023-12-04T05:39:49.514 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-04T05:39:49.514 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:39:49.523 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.TWAFQcuqRA 2023-12-04T05:39:49.524 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:49.524 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/tmp/tmp.TWAFQcuqRA 2023-12-04T05:39:49.579 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:49.580 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:49.632 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:49.632 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:49.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:49.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 Processor -- start 2023-12-04T05:39:49.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 -- start start 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a3c151bf0 0x7f5a3c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c1547d0 con 0x7f5a3c158630 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c158b80 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a4299d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c4aa0 con 0x7f5a3c151bf0 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39026/0 (socket says 172.21.15.97:39026) 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3bfff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5a3c151bf0 0x7f5a3c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 -- 172.21.15.97:0/863755181 learned_addr learned my addr 172.21.15.97:0/863755181 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 -- 172.21.15.97:0/863755181 >> v2:172.21.15.143:3300/0 conn(0x7f5a3c151bf0 msgr2=0x7f5a3c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 --2- 172.21.15.97:0/863755181 >> v2:172.21.15.143:3300/0 conn(0x7f5a3c151bf0 0x7f5a3c0abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 -- 172.21.15.97:0/863755181 >> v1:172.21.15.143:6789/0 conn(0x7f5a3c158630 legacy=0x7f5a3c0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.868+0000 7f5a3b7fe640 1 -- 172.21.15.97:0/863755181 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0c4d40 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a3b7fe640 1 --2- 172.21.15.97:0/863755181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b01e0 tx=0x7f5a3001c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f708f6ed015262 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a3affd640 1 -- 172.21.15.97:0/863755181 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a56f0 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a3affd640 1 -- 172.21.15.97:0/863755181 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300a5850 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a3affd640 1 -- 172.21.15.97:0/863755181 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300a5be0 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 -- 172.21.15.97:0/863755181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c0c7ef0 msgr2=0x7f5a3c154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 --2- 172.21.15.97:0/863755181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b01e0 tx=0x7f5a3001c0c0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 -- 172.21.15.97:0/863755181 shutdown_connections 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 --2- 172.21.15.97:0/863755181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c154c60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 --2- 172.21.15.97:0/863755181 >> v2:172.21.15.143:3300/0 conn(0x7f5a3c151bf0 0x7f5a3c0abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 -- 172.21.15.97:0/863755181 >> 172.21.15.97:0/863755181 conn(0x7f5a3c073550 msgr2=0x7f5a3c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 -- 172.21.15.97:0/863755181 shutdown_connections 2023-12-04T05:39:49.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.872+0000 7f5a4299d640 1 -- 172.21.15.97:0/863755181 wait complete. 2023-12-04T05:39:49.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 Processor -- start 2023-12-04T05:39:49.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 -- start start 2023-12-04T05:39:49.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 0x7f5a3c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 0x7f5a3c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1ef0f0 con 0x7f5a3c158630 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1eeb70 con 0x7f5a3c0c7ef0 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a4299d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ca5f0 con 0x7f5a3c151bf0 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 0x7f5a3c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a3bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a3b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 0x7f5a3c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a3bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:34076/0 (socket says 172.21.15.97:34076) 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a3bfff640 1 -- 172.21.15.97:0/3837366591 learned_addr learned my addr 172.21.15.97:0/3837366591 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a3b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 0x7f5a3c0aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:55836/0 (socket says 172.21.15.97:55836) 2023-12-04T05:39:49.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 -- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 msgr2=0x7f5a3c0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 0x7f5a3c0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 -- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 msgr2=0x7f5a3c149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 -- 172.21.15.97:0/3837366591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300094d0 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a40f3a640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 0x7f5a3c0af480 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c700 tx=0x7f5a3400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34003b80 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34003ce0 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.876+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400aa30 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c1eee10 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c14a020 con 0x7f5a3c158630 2023-12-04T05:39:49.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c154220 con 0x7f5a3c158630 2023-12-04T05:39:49.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5a3400ab90 con 0x7f5a3c158630 2023-12-04T05:39:49.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a38ff9640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 0x7f5a28068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:49.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a34084430 con 0x7f5a3c158630 2023-12-04T05:39:49.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.880+0000 7f5a3bfff640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 0x7f5a28068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:49.884 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.884+0000 7f5a3bfff640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 0x7f5a28068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009c20 tx=0x7f5a2c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:49.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:49.884+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a340513b0 con 0x7f5a3c158630 2023-12-04T05:39:50.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.036+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a3c068440 con 0x7f5a3c158630 2023-12-04T05:39:50.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a38ff9640 1 -- 172.21.15.97:0/3837366591 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f5a340549d0 con 0x7f5a3c158630 2023-12-04T05:39:50.041 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:50.042 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:50.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 msgr2=0x7f5a28068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 0x7f5a28068d90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009c20 tx=0x7f5a2c009190 comp rx=0 tx=0).stop 2023-12-04T05:39:50.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 msgr2=0x7f5a3c0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 0x7f5a3c0af480 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c700 tx=0x7f5a3400cbc0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 shutdown_connections 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5a280668d0 0x7f5a28068d90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5a3c158630 0x7f5a3c0af480 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a3c151bf0 0x7f5a3c0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 --2- 172.21.15.97:0/3837366591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a3c0c7ef0 0x7f5a3c149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 >> 172.21.15.97:0/3837366591 conn(0x7f5a3c073550 msgr2=0x7f5a3c14c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 shutdown_connections 2023-12-04T05:39:50.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.040+0000 7f5a4299d640 1 -- 172.21.15.97:0/3837366591 wait complete. 2023-12-04T05:39:50.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:50.064 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:50.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 Processor -- start 2023-12-04T05:39:50.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 -- start start 2023-12-04T05:39:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40800c67d0 0x7f4080155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40800c6bb0 0x7f40801586c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40800c8620 con 0x7f40800c4770 2023-12-04T05:39:50.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800c5680 con 0x7f40800c6bb0 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f4084ec8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800c4c20 con 0x7f40800c67d0 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40800c6bb0 0x7f40801586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f40800c6bb0 0x7f40801586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39044/0 (socket says 172.21.15.97:39044) 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 -- 172.21.15.97:0/3485946799 learned_addr learned my addr 172.21.15.97:0/3485946799 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407f7fe640 1 --2- 172.21.15.97:0/3485946799 >> v2:172.21.15.143:3300/0 conn(0x7f40800c67d0 0x7f4080155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 -- 172.21.15.97:0/3485946799 >> v2:172.21.15.143:3300/0 conn(0x7f40800c67d0 msgr2=0x7f4080155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 --2- 172.21.15.97:0/3485946799 >> v2:172.21.15.143:3300/0 conn(0x7f40800c67d0 0x7f4080155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 -- 172.21.15.97:0/3485946799 >> v1:172.21.15.143:6789/0 conn(0x7f40800c4770 legacy=0x7f40800c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.208+0000 7f407effd640 1 -- 172.21.15.97:0/3485946799 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800c6ff0 con 0x7f40800c6bb0 2023-12-04T05:39:50.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f407effd640 1 --2- 172.21.15.97:0/3485946799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c6bb0 0x7f40801586c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f40800c4260 tx=0x7f407401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f412e8293a4824fe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f407e7fc640 1 -- 172.21.15.97:0/3485946799 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740ab5f0 con 0x7f40800c6bb0 2023-12-04T05:39:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f407e7fc640 1 -- 172.21.15.97:0/3485946799 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40740ab750 con 0x7f40800c6bb0 2023-12-04T05:39:50.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f407e7fc640 1 -- 172.21.15.97:0/3485946799 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740abae0 con 0x7f40800c6bb0 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 -- 172.21.15.97:0/3485946799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c6bb0 msgr2=0x7f40801586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 --2- 172.21.15.97:0/3485946799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c6bb0 0x7f40801586c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f40800c4260 tx=0x7f407401c500 comp rx=0 tx=0).stop 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 -- 172.21.15.97:0/3485946799 shutdown_connections 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 --2- 172.21.15.97:0/3485946799 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c6bb0 0x7f40801586c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 --2- 172.21.15.97:0/3485946799 >> v2:172.21.15.143:3300/0 conn(0x7f40800c67d0 0x7f4080155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 -- 172.21.15.97:0/3485946799 >> 172.21.15.97:0/3485946799 conn(0x7f40800ab980 msgr2=0x7f40800abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 -- 172.21.15.97:0/3485946799 shutdown_connections 2023-12-04T05:39:50.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.212+0000 7f4084ec8640 1 -- 172.21.15.97:0/3485946799 wait complete. 2023-12-04T05:39:50.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 Processor -- start 2023-12-04T05:39:50.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- start start 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40800c67d0 0x7f4080140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 0x7f408006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800bd490 con 0x7f40800c4770 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40801ecd10 con 0x7f40800c6bb0 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40801ecff0 con 0x7f40800c67d0 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39046/0 (socket says 172.21.15.97:39046) 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 -- 172.21.15.97:0/1884450796 learned_addr learned my addr 172.21.15.97:0/1884450796 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407effd640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40800c67d0 0x7f4080140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407ffff640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 0x7f408006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 -- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40800c67d0 msgr2=0x7f4080140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40800c67d0 0x7f4080140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 -- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 msgr2=0x7f408006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 0x7f408006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 -- 172.21.15.97:0/1884450796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740094d0 con 0x7f40800c4770 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407ffff640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 0x7f408006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f407f7fe640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f407000e930 tx=0x7f407000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070009690 con 0x7f40800c4770 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000ca00 con 0x7f40800c4770 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40801ed2d0 con 0x7f40800c4770 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000cd70 con 0x7f40800c4770 2023-12-04T05:39:50.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.216+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40801edad0 con 0x7f40800c4770 2023-12-04T05:39:50.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408004e890 con 0x7f40800c4770 2023-12-04T05:39:50.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4070013470 con 0x7f40800c4770 2023-12-04T05:39:50.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f4067fff640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 0x7f406c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f40700849c0 con 0x7f40800c4770 2023-12-04T05:39:50.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f407effd640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 0x7f406c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.220+0000 7f407effd640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 0x7f406c068d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40740af000 tx=0x7f40740b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.224+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4070051970 con 0x7f40800c4770 2023-12-04T05:39:50.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.376+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40800c7520 con 0x7f40800c4770 2023-12-04T05:39:50.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4067fff640 1 -- 172.21.15.97:0/1884450796 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4070054f90 con 0x7f40800c4770 2023-12-04T05:39:50.380 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 msgr2=0x7f406c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 0x7f406c068d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40740af000 tx=0x7f40740b6040 comp rx=0 tx=0).stop 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 msgr2=0x7f408014dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f407000e930 tx=0x7f407000edf0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 shutdown_connections 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f406c0668d0 0x7f406c068d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40800c6bb0 0x7f408006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f40800c67d0 0x7f4080140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 --2- 172.21.15.97:0/1884450796 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40800c4770 0x7f408014dae0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 >> 172.21.15.97:0/1884450796 conn(0x7f40800ab980 msgr2=0x7f40800c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 shutdown_connections 2023-12-04T05:39:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.380+0000 7f4084ec8640 1 -- 172.21.15.97:0/1884450796 wait complete. 2023-12-04T05:39:50.401 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:50.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 Processor -- start 2023-12-04T05:39:50.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 -- start start 2023-12-04T05:39:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f26b80c7f00 0x7f26b8154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80ca780 con 0x7f26b8151f10 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b8158cc0 con 0x7f26b80c7f00 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bff0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80c5700 con 0x7f26b80cac10 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bd4aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f26b80c7f00 0x7f26b8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bd4aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f26b80c7f00 0x7f26b8154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39056/0 (socket says 172.21.15.97:39056) 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26bd4aa640 1 -- 172.21.15.97:0/143795353 learned_addr learned my addr 172.21.15.97:0/143795353 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.540+0000 7f26be4ac640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bd4aa640 1 -- 172.21.15.97:0/143795353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 msgr2=0x7f26b8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bd4aa640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b8154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bd4aa640 1 -- 172.21.15.97:0/143795353 >> v1:172.21.15.143:6789/0 conn(0x7f26b8151f10 legacy=0x7f26b80c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bd4aa640 1 -- 172.21.15.97:0/143795353 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8158720 con 0x7f26b80c7f00 2023-12-04T05:39:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26be4ac640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bd4aa640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b8154720 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009870 tx=0x7f26a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49365e737c0db995 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bcca9640 1 -- 172.21.15.97:0/143795353 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80ab5f0 con 0x7f26b80c7f00 2023-12-04T05:39:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bcca9640 1 -- 172.21.15.97:0/143795353 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a80ab750 con 0x7f26b80c7f00 2023-12-04T05:39:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bcca9640 1 -- 172.21.15.97:0/143795353 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80abae0 con 0x7f26b80c7f00 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 -- 172.21.15.97:0/143795353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 msgr2=0x7f26b8154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b8154720 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009870 tx=0x7f26a801c3f0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 -- 172.21.15.97:0/143795353 shutdown_connections 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 --2- 172.21.15.97:0/143795353 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b8154720 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.544+0000 7f26bff0f640 1 -- 172.21.15.97:0/143795353 >> 172.21.15.97:0/143795353 conn(0x7f26b8073950 msgr2=0x7f26b8073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- 172.21.15.97:0/143795353 shutdown_connections 2023-12-04T05:39:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- 172.21.15.97:0/143795353 wait complete. 2023-12-04T05:39:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 Processor -- start 2023-12-04T05:39:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- start start 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b80c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26b8151f10 0x7f26b80c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b814e690 con 0x7f26b80c7f00 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81537e0 con 0x7f26b8151f10 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8153490 con 0x7f26b80cac10 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39060/0 (socket says 172.21.15.97:39060) 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 -- 172.21.15.97:0/549083500 learned_addr learned my addr 172.21.15.97:0/549083500 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26be4ac640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26b8151f10 0x7f26b80c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bd4aa640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b80c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 -- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 msgr2=0x7f26b80c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b80c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 -- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26b8151f10 msgr2=0x7f26b80c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26b8151f10 0x7f26b80c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 -- 172.21.15.97:0/549083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80094d0 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bdcab640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c500 tx=0x7f26b400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4005220 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4005380 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b81f0c20 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007270 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.548+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b81f0f00 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b8068440 con 0x7f26b80c7f00 2023-12-04T05:39:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f26b40073d0 con 0x7f26b80c7f00 2023-12-04T05:39:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26ae7fc640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 0x7f269c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f26b4083fa0 con 0x7f26b80c7f00 2023-12-04T05:39:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26bd4aa640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 0x7f269c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.552+0000 7f26bd4aa640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 0x7f269c068d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f26a80af000 tx=0x7f26a80b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.556+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26b4050ea0 con 0x7f26b80c7f00 2023-12-04T05:39:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.716+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26b80c76d0 con 0x7f26b80c7f00 2023-12-04T05:39:50.719 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.716+0000 7f26ae7fc640 1 -- 172.21.15.97:0/549083500 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26b40544c0 con 0x7f26b80c7f00 2023-12-04T05:39:50.719 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 msgr2=0x7f269c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 0x7f269c068d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f26a80af000 tx=0x7f26a80b6040 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 msgr2=0x7f26b81f02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f26b400c500 tx=0x7f26b400c9c0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 shutdown_connections 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f269c0668d0 0x7f269c068d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f26b8151f10 0x7f26b80c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f26b80cac10 0x7f26b80c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 --2- 172.21.15.97:0/549083500 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f26b80c7f00 0x7f26b81f02d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 >> 172.21.15.97:0/549083500 conn(0x7f26b8073950 msgr2=0x7f26b815e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 shutdown_connections 2023-12-04T05:39:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.720+0000 7f26bff0f640 1 -- 172.21.15.97:0/549083500 wait complete. 2023-12-04T05:39:50.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.876+0000 7ff4367aa640 1 Processor -- start 2023-12-04T05:39:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.876+0000 7ff4367aa640 1 -- start start 2023-12-04T05:39:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff4367aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff4300c1360 0x7ff4300700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff4367aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff430150bc0 con 0x7ff430154af0 2023-12-04T05:39:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff4367aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff430154fd0 con 0x7ff43006c000 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff4367aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff430151a70 con 0x7ff4300c1360 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff434d47640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7ff430154af0 0x7ff43014dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45268/0 (socket says 172.21.15.97:45268) 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff434d47640 1 -- 172.21.15.97:0/38169541 learned_addr learned my addr 172.21.15.97:0/38169541 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42ffff640 1 --2- 172.21.15.97:0/38169541 >> v2:172.21.15.143:3300/0 conn(0x7ff4300c1360 0x7ff4300700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42effd640 1 -- 172.21.15.97:0/38169541 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103599756 0 0) 0x7ff430150bc0 con 0x7ff430154af0 2023-12-04T05:39:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42effd640 1 -- 172.21.15.97:0/38169541 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff418003530 con 0x7ff430154af0 2023-12-04T05:39:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42ffff640 1 -- 172.21.15.97:0/38169541 >> v1:172.21.15.143:6789/0 conn(0x7ff43006c000 legacy=0x7ff430151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42ffff640 1 -- 172.21.15.97:0/38169541 >> v1:172.21.15.97:6789/0 conn(0x7ff430154af0 legacy=0x7ff43014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.880+0000 7ff42ffff640 1 -- 172.21.15.97:0/38169541 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430072160 con 0x7ff4300c1360 2023-12-04T05:39:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff42ffff640 1 --2- 172.21.15.97:0/38169541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff4300700b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097c0 tx=0x7ff42001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4855547512e3999d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff42effd640 1 -- 172.21.15.97:0/38169541 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200ab600 con 0x7ff4300c1360 2023-12-04T05:39:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff42effd640 1 -- 172.21.15.97:0/38169541 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200a7050 con 0x7ff4300c1360 2023-12-04T05:39:50.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff42effd640 1 -- 172.21.15.97:0/38169541 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200ab980 con 0x7ff4300c1360 2023-12-04T05:39:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 -- 172.21.15.97:0/38169541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 msgr2=0x7ff4300700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 --2- 172.21.15.97:0/38169541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff4300700b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097c0 tx=0x7ff42001c3f0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 -- 172.21.15.97:0/38169541 shutdown_connections 2023-12-04T05:39:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 --2- 172.21.15.97:0/38169541 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff4300700b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 -- 172.21.15.97:0/38169541 >> 172.21.15.97:0/38169541 conn(0x7ff4300c5e70 msgr2=0x7ff4300c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 -- 172.21.15.97:0/38169541 shutdown_connections 2023-12-04T05:39:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 -- 172.21.15.97:0/38169541 wait complete. 2023-12-04T05:39:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.884+0000 7ff4367aa640 1 Processor -- start 2023-12-04T05:39:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- start start 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff43006c000 0x7ff4301ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff430070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301f0db0 con 0x7ff430154af0 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43014d050 con 0x7ff4300c1360 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43014d330 con 0x7ff43006c000 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39068/0 (socket says 172.21.15.97:39068) 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 -- 172.21.15.97:0/1652034077 learned_addr learned my addr 172.21.15.97:0/1652034077 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42ffff640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff43006c000 0x7ff4301ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42f7fe640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff430070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 -- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff43006c000 msgr2=0x7ff4301ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff43006c000 0x7ff4301ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 -- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 msgr2=0x7ff430070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff430070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 -- 172.21.15.97:0/1652034077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009420 con 0x7ff430154af0 2023-12-04T05:39:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42f7fe640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff430070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff434d47640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff42800caa0 tx=0x7ff42800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42800aba0 con 0x7ff430154af0 2023-12-04T05:39:50.893 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42800ad00 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428012640 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43014d610 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff430070850 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.888+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430068440 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.892+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff428007070 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.892+0000 7ff42cff9640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 0x7ff41c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.892+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff428084660 con 0x7ff430154af0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.892+0000 7ff42ffff640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 0x7ff41c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.892+0000 7ff42ffff640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 0x7ff41c068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff4200ad000 tx=0x7ff4200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:50.897 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:50.896+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4280515e0 con 0x7ff430154af0 2023-12-04T05:39:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.044+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4301f11d0 con 0x7ff430154af0 2023-12-04T05:39:51.046 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.044+0000 7ff42cff9640 1 -- 172.21.15.97:0/1652034077 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff428054c00 con 0x7ff430154af0 2023-12-04T05:39:51.046 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 msgr2=0x7ff41c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 0x7ff41c068d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff4200ad000 tx=0x7ff4200a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 msgr2=0x7ff4301f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff42800caa0 tx=0x7ff42800cf60 comp rx=0 tx=0).stop 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 shutdown_connections 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7ff41c0668d0 0x7ff41c068d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff430154af0 0x7ff4301f1520 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4300c1360 0x7ff430070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 --2- 172.21.15.97:0/1652034077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff43006c000 0x7ff4301ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 >> 172.21.15.97:0/1652034077 conn(0x7ff4300c5e70 msgr2=0x7ff43015b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 shutdown_connections 2023-12-04T05:39:51.049 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.048+0000 7ff4367aa640 1 -- 172.21.15.97:0/1652034077 wait complete. 2023-12-04T05:39:51.067 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 Processor -- start 2023-12-04T05:39:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 -- start start 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8151a60 0x7fa3f8154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3f80c7c90 0x7fa3f80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa3f80c4c50 0x7fa3f806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f8151e40 con 0x7fa3f80c7c90 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80c7150 con 0x7fa3f80c4c50 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fdd03640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80c68b0 con 0x7fa3f8151a60 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3f80c7c90 0x7fa3f80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fa3f80c7c90 0x7fa3f80c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39078/0 (socket says 172.21.15.97:39078) 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 -- 172.21.15.97:0/2729359179 learned_addr learned my addr 172.21.15.97:0/2729359179 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fcd01640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8151a60 0x7fa3f8154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3fd502640 1 --2- 172.21.15.97:0/2729359179 >> v2:172.21.15.143:3300/0 conn(0x7fa3f80c4c50 0x7fa3f806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 -- 172.21.15.97:0/2729359179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8151a60 msgr2=0x7fa3f8154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:51.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8151a60 0x7fa3f8154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 -- 172.21.15.97:0/2729359179 >> v2:172.21.15.143:3300/0 conn(0x7fa3f80c4c50 msgr2=0x7fa3f806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:51.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 --2- 172.21.15.97:0/2729359179 >> v2:172.21.15.143:3300/0 conn(0x7fa3f80c4c50 0x7fa3f806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.216 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.212+0000 7fa3f7fff640 1 -- 172.21.15.97:0/2729359179 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80c6b90 con 0x7fa3f80c7c90 2023-12-04T05:39:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3f7fff640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f80c7c90 0x7fa3f80c4710 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80c4370 tx=0x7fa3e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78447d99d03ca64 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3f77fe640 1 -- 172.21.15.97:0/2729359179 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40ab600 con 0x7fa3f80c7c90 2023-12-04T05:39:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3f77fe640 1 -- 172.21.15.97:0/2729359179 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e40a7050 con 0x7fa3f80c7c90 2023-12-04T05:39:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3f77fe640 1 -- 172.21.15.97:0/2729359179 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40ab980 con 0x7fa3f80c7c90 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 -- 172.21.15.97:0/2729359179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f80c7c90 msgr2=0x7fa3f80c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f80c7c90 0x7fa3f80c4710 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80c4370 tx=0x7fa3e401c430 comp rx=0 tx=0).stop 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 -- 172.21.15.97:0/2729359179 shutdown_connections 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/2729359179 >> v2:172.21.15.143:3300/0 conn(0x7fa3f80c4c50 0x7fa3f806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f80c7c90 0x7fa3f80c4710 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/2729359179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f8151a60 0x7fa3f8154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 -- 172.21.15.97:0/2729359179 >> 172.21.15.97:0/2729359179 conn(0x7fa3f80abb50 msgr2=0x7fa3f80abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 -- 172.21.15.97:0/2729359179 shutdown_connections 2023-12-04T05:39:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.216+0000 7fa3fdd03640 1 -- 172.21.15.97:0/2729359179 wait complete. 2023-12-04T05:39:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 Processor -- start 2023-12-04T05:39:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- start start 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c4c50 0x7fa3f80ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c7c90 0x7fa3f81f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80aef80 con 0x7fa3f8151a60 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81eff60 con 0x7fa3f80c7c90 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8153510 con 0x7fa3f80c4c50 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39094/0 (socket says 172.21.15.97:39094) 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 -- 172.21.15.97:0/1365459869 learned_addr learned my addr 172.21.15.97:0/1365459869 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3f7fff640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c7c90 0x7fa3f81f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fcd01640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c4c50 0x7fa3f80ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 -- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c4c50 msgr2=0x7fa3f80ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c4c50 0x7fa3f80ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 -- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c7c90 msgr2=0x7fa3f81f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c7c90 0x7fa3f81f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 -- 172.21.15.97:0/1365459869 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40094d0 con 0x7fa3f8151a60 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fd502640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000efc0 tx=0x7fa3f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0014480 con 0x7fa3f8151a60 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f000f040 con 0x7fa3f8151a60 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f81541c0 con 0x7fa3f8151a60 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0014820 con 0x7fa3f8151a60 2023-12-04T05:39:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.220+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f81537b0 con 0x7fa3f8151a60 2023-12-04T05:39:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f804e890 con 0x7fa3f8151a60 2023-12-04T05:39:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa3f0014980 con 0x7fa3f8151a60 2023-12-04T05:39:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3f57fa640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 0x7fa3dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa3f0085200 con 0x7fa3f8151a60 2023-12-04T05:39:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3fcd01640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 0x7fa3dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.224+0000 7fa3fcd01640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 0x7fa3dc068dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8150f70 tx=0x7fa3ec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.228+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3f0052180 con 0x7fa3f8151a60 2023-12-04T05:39:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.376+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3f806c8d0 con 0x7fa3f8151a60 2023-12-04T05:39:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.376+0000 7fa3f57fa640 1 -- 172.21.15.97:0/1365459869 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa3f00557a0 con 0x7fa3f8151a60 2023-12-04T05:39:51.379 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 msgr2=0x7fa3dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 0x7fa3dc068dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8150f70 tx=0x7fa3ec009190 comp rx=0 tx=0).stop 2023-12-04T05:39:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 msgr2=0x7fa3f81f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000efc0 tx=0x7fa3f000c490 comp rx=0 tx=0).stop 2023-12-04T05:39:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 shutdown_connections 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa3dc066900 0x7fa3dc068dc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa3f8151a60 0x7fa3f81f0930 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3f80c7c90 0x7fa3f81f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 --2- 172.21.15.97:0/1365459869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3f80c4c50 0x7fa3f80ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 >> 172.21.15.97:0/1365459869 conn(0x7fa3f80abb50 msgr2=0x7fa3f814c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 shutdown_connections 2023-12-04T05:39:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.380+0000 7fa3fdd03640 1 -- 172.21.15.97:0/1365459869 wait complete. 2023-12-04T05:39:51.400 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:51.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.536+0000 7f1c2e71d640 1 Processor -- start 2023-12-04T05:39:51.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.536+0000 7f1c2e71d640 1 -- start start 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2e71d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c280c1e70 0x7f1c281524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2e71d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c2806d210 0x7f1c2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2e71d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c280aa240 con 0x7f1c2806c440 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2e71d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2806c0c0 con 0x7f1c2806d210 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2e71d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280aa500 con 0x7f1c280c1e70 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2ccba640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1c2806d210 0x7f1c2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c277fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f1c2806c440 0x7f1c280a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45280/0 (socket says 172.21.15.97:45280) 2023-12-04T05:39:51.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c277fe640 1 -- 172.21.15.97:0/2394575935 learned_addr learned my addr 172.21.15.97:0/2394575935 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c27fff640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c280c1e70 0x7f1c281524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2ccba640 1 -- 172.21.15.97:0/2394575935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c280c1e70 msgr2=0x7f1c281524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2ccba640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c280c1e70 0x7f1c281524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2ccba640 1 -- 172.21.15.97:0/2394575935 >> v1:172.21.15.97:6789/0 conn(0x7f1c2806c440 legacy=0x7f1c280a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c2ccba640 1 -- 172.21.15.97:0/2394575935 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280aa7e0 con 0x7f1c2806d210 2023-12-04T05:39:51.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.540+0000 7f1c26ffd640 1 -- 172.21.15.97:0/2394575935 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724187628 0 0) 0x7f1c280aa240 con 0x7f1c2806c440 2023-12-04T05:39:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2ccba640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c2806d210 0x7f1c2806d680 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009d90 tx=0x7f1c2001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5d52c06a553a86 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c26ffd640 1 -- 172.21.15.97:0/2394575935 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200a59e0 con 0x7f1c2806d210 2023-12-04T05:39:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c26ffd640 1 -- 172.21.15.97:0/2394575935 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200a5b40 con 0x7f1c2806d210 2023-12-04T05:39:51.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c26ffd640 1 -- 172.21.15.97:0/2394575935 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200ad440 con 0x7f1c2806d210 2023-12-04T05:39:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- 172.21.15.97:0/2394575935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c2806d210 msgr2=0x7f1c2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c2806d210 0x7f1c2806d680 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009d90 tx=0x7f1c2001c920 comp rx=0 tx=0).stop 2023-12-04T05:39:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- 172.21.15.97:0/2394575935 shutdown_connections 2023-12-04T05:39:51.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c2806d210 0x7f1c2806d680 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/2394575935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c280c1e70 0x7f1c281524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- 172.21.15.97:0/2394575935 >> 172.21.15.97:0/2394575935 conn(0x7f1c280c5e70 msgr2=0x7f1c280c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- 172.21.15.97:0/2394575935 shutdown_connections 2023-12-04T05:39:51.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- 172.21.15.97:0/2394575935 wait complete. 2023-12-04T05:39:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 Processor -- start 2023-12-04T05:39:51.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.544+0000 7f1c2e71d640 1 -- start start 2023-12-04T05:39:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c2806c440 0x7f1c281ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c2806d210 0x7f1c28151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c281edcc0 con 0x7f1c280c1e70 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c28151560 con 0x7f1c2806c440 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c28150b90 con 0x7f1c2806d210 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39114/0 (socket says 172.21.15.97:39114) 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 -- 172.21.15.97:0/3381190239 learned_addr learned my addr 172.21.15.97:0/3381190239 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:51.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c27fff640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c2806c440 0x7f1c281ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c277fe640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c2806d210 0x7f1c28151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 -- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c2806d210 msgr2=0x7f1c28151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c2806d210 0x7f1c28151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 -- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c2806c440 msgr2=0x7f1c281ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c2806c440 0x7f1c281ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 -- 172.21.15.97:0/3381190239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20009a70 con 0x7f1c280c1e70 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2ccba640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1c200b0040 tx=0x7f1c200196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200add90 con 0x7f1c280c1e70 2023-12-04T05:39:51.553 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20009450 con 0x7f1c280c1e70 2023-12-04T05:39:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c28150260 con 0x7f1c280c1e70 2023-12-04T05:39:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200b9670 con 0x7f1c280c1e70 2023-12-04T05:39:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c28150820 con 0x7f1c280c1e70 2023-12-04T05:39:51.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c28150d20 con 0x7f1c280c1e70 2023-12-04T05:39:51.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.548+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c200b97d0 con 0x7f1c280c1e70 2023-12-04T05:39:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.552+0000 7f1c24ff9640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 0x7f1c14068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.552+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1c2011f6e0 con 0x7f1c280c1e70 2023-12-04T05:39:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.552+0000 7f1c27fff640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 0x7f1c14068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.552+0000 7f1c27fff640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 0x7f1c14068dc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009b60 tx=0x7f1c18009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.556+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c200ec700 con 0x7f1c280c1e70 2023-12-04T05:39:51.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1c28068440 con 0x7f1c280c1e70 2023-12-04T05:39:51.704 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c24ff9640 1 -- 172.21.15.97:0/3381190239 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1c200efd20 con 0x7f1c280c1e70 2023-12-04T05:39:51.705 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:51.706 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 msgr2=0x7f1c14068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 0x7f1c14068dc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009b60 tx=0x7f1c18009190 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 msgr2=0x7f1c28071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1c200b0040 tx=0x7f1c200196c0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 shutdown_connections 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1c14066900 0x7f1c14068dc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1c280c1e70 0x7f1c28071490 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1c2806d210 0x7f1c28151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 --2- 172.21.15.97:0/3381190239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c2806c440 0x7f1c281ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 >> 172.21.15.97:0/3381190239 conn(0x7f1c280c5e70 msgr2=0x7f1c280bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 shutdown_connections 2023-12-04T05:39:51.707 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.704+0000 7f1c2e71d640 1 -- 172.21.15.97:0/3381190239 wait complete. 2023-12-04T05:39:51.725 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:39:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.860+0000 7f73ecebb640 1 Processor -- start 2023-12-04T05:39:51.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.860+0000 7f73ecebb640 1 -- start start 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ecebb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73e80c1fb0 0x7f73e80c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ecebb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8072800 0x7f73e8158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ecebb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e8154880 con 0x7f73e8155060 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ecebb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e806e160 con 0x7f73e80c1fb0 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ecebb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806e440 con 0x7f73e8072800 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73e80c1fb0 0x7f73e80c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f73e80c1fb0 0x7f73e80c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39122/0 (socket says 172.21.15.97:39122) 2023-12-04T05:39:51.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 -- 172.21.15.97:0/555289471 learned_addr learned my addr 172.21.15.97:0/555289471 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73ddd9b640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8072800 0x7f73e8158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 -- 172.21.15.97:0/555289471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8072800 msgr2=0x7f73e8158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8072800 0x7f73e8158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 -- 172.21.15.97:0/555289471 >> v1:172.21.15.143:6789/0 conn(0x7f73e8155060 legacy=0x7f73e806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.864+0000 7f73e659c640 1 -- 172.21.15.97:0/555289471 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e806e720 con 0x7f73e80c1fb0 2023-12-04T05:39:51.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73e659c640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c10c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009e50 tx=0x7f73d801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b3a03410ea4650 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73e5d9b640 1 -- 172.21.15.97:0/555289471 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80a5690 con 0x7f73e80c1fb0 2023-12-04T05:39:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73e5d9b640 1 -- 172.21.15.97:0/555289471 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d80a57f0 con 0x7f73e80c1fb0 2023-12-04T05:39:51.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73e5d9b640 1 -- 172.21.15.97:0/555289471 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80a5b80 con 0x7f73e80c1fb0 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- 172.21.15.97:0/555289471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e80c1fb0 msgr2=0x7f73e80c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c10c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009e50 tx=0x7f73d801c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- 172.21.15.97:0/555289471 shutdown_connections 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8072800 0x7f73e8158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 --2- 172.21.15.97:0/555289471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c10c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- 172.21.15.97:0/555289471 >> 172.21.15.97:0/555289471 conn(0x7f73e80c31c0 msgr2=0x7f73e80c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- 172.21.15.97:0/555289471 shutdown_connections 2023-12-04T05:39:51.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- 172.21.15.97:0/555289471 wait complete. 2023-12-04T05:39:51.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 Processor -- start 2023-12-04T05:39:51.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.868+0000 7f73ecebb640 1 -- start start 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8155060 0x7f73e8145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8151270 con 0x7f73e8072800 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80abc70 con 0x7f73e80c1fb0 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80c5980 con 0x7f73e8155060 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39128/0 (socket says 172.21.15.97:39128) 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 -- 172.21.15.97:0/2866474096 learned_addr learned my addr 172.21.15.97:0/2866474096 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ddd9b640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e6d9d640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8155060 0x7f73e8145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 -- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8155060 msgr2=0x7f73e8145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8155060 0x7f73e8145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 -- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73e80c1fb0 msgr2=0x7f73e80c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 -- 172.21.15.97:0/2866474096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009b30 con 0x7f73e8072800 2023-12-04T05:39:51.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73e659c640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f73d801a4f0 tx=0x7f73d8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80b8670 con 0x7f73e8072800 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d80b87d0 con 0x7f73e8072800 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8155850 con 0x7f73e8072800 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80b8b80 con 0x7f73e8072800 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8151460 con 0x7f73e8072800 2023-12-04T05:39:51.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8068440 con 0x7f73e8072800 2023-12-04T05:39:51.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.872+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f73d80b8ce0 con 0x7f73e8072800 2023-12-04T05:39:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.876+0000 7f73df7fe640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 0x7f73c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.876+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f73d811fb30 con 0x7f73e8072800 2023-12-04T05:39:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.876+0000 7f73ddd9b640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 0x7f73c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:51.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.876+0000 7f73ddd9b640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 0x7f73c8068d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f73e8071690 tx=0x7f73d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:51.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:51.880+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73d80ecbd0 con 0x7f73e8072800 2023-12-04T05:39:52.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.036+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73e8152c50 con 0x7f73e8072800 2023-12-04T05:39:52.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73df7fe640 1 -- 172.21.15.97:0/2866474096 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73d8009510 con 0x7f73e8072800 2023-12-04T05:39:52.040 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:39:52.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 msgr2=0x7f73c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 0x7f73c8068d90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f73e8071690 tx=0x7f73d0008040 comp rx=0 tx=0).stop 2023-12-04T05:39:52.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 msgr2=0x7f73e814a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f73d801a4f0 tx=0x7f73d8019660 comp rx=0 tx=0).stop 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 shutdown_connections 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f73c80668d0 0x7f73c8068d90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f73e8155060 0x7f73e8145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f73e80c1fb0 0x7f73e80c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 --2- 172.21.15.97:0/2866474096 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73e8072800 0x7f73e814a090 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 >> 172.21.15.97:0/2866474096 conn(0x7f73e80c31c0 msgr2=0x7f73e80c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 shutdown_connections 2023-12-04T05:39:52.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.040+0000 7f73ecebb640 1 -- 172.21.15.97:0/2866474096 wait complete. 2023-12-04T05:39:52.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T05:39:52.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:52.119 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:39:52.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.120 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T05:39:52.144 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:52.144 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:52.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:39:52.197 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:39:52.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 Processor -- start 2023-12-04T05:39:52.380 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 -- start start 2023-12-04T05:39:52.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 0x7fe7d40abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 0x7fe7d4154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d41547d0 con 0x7fe7d4158630 2023-12-04T05:39:52.381 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d4158b80 con 0x7fe7d40c7ef0 2023-12-04T05:39:52.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7dc409640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40c4aa0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da1a5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 0x7fe7d40abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7d99a4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 0x7fe7d4154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da9a6640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fe7d4158630 0x7fe7d40c6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:53472/0 (socket says 172.21.15.97:53472) 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da9a6640 1 -- 172.21.15.97:0/4213538716 learned_addr learned my addr 172.21.15.97:0/4213538716 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7d91a3640 1 -- 172.21.15.97:0/4213538716 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919861059 0 0) 0x7fe7d41547d0 con 0x7fe7d4158630 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7d91a3640 1 -- 172.21.15.97:0/4213538716 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c0003530 con 0x7fe7d4158630 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da1a5640 1 -- 172.21.15.97:0/4213538716 >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 msgr2=0x7fe7d4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da1a5640 1 --2- 172.21.15.97:0/4213538716 >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 0x7fe7d4154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da1a5640 1 -- 172.21.15.97:0/4213538716 >> v1:172.21.15.143:6789/0 conn(0x7fe7d4158630 legacy=0x7fe7d40c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7da1a5640 1 -- 172.21.15.97:0/4213538716 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40c4d40 con 0x7fe7d4151bf0 2023-12-04T05:39:52.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.380+0000 7fe7d99a4640 1 --2- 172.21.15.97:0/4213538716 >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 0x7fe7d4154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:52.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7da1a5640 1 --2- 172.21.15.97:0/4213538716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 0x7fe7d40abbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097c0 tx=0x7fe7d001c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baa4dbb65018b2e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:52.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7d91a3640 1 -- 172.21.15.97:0/4213538716 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00a5670 con 0x7fe7d4151bf0 2023-12-04T05:39:52.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7d91a3640 1 -- 172.21.15.97:0/4213538716 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00a57d0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7d91a3640 1 -- 172.21.15.97:0/4213538716 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00a5b60 con 0x7fe7d4151bf0 2023-12-04T05:39:52.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 -- 172.21.15.97:0/4213538716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 msgr2=0x7fe7d40abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.386 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 --2- 172.21.15.97:0/4213538716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 0x7fe7d40abbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097c0 tx=0x7fe7d001c040 comp rx=0 tx=0).stop 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 -- 172.21.15.97:0/4213538716 shutdown_connections 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 --2- 172.21.15.97:0/4213538716 >> v2:172.21.15.143:3300/0 conn(0x7fe7d40c7ef0 0x7fe7d4154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 --2- 172.21.15.97:0/4213538716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d4151bf0 0x7fe7d40abbb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 -- 172.21.15.97:0/4213538716 >> 172.21.15.97:0/4213538716 conn(0x7fe7d4073550 msgr2=0x7fe7d4073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 -- 172.21.15.97:0/4213538716 shutdown_connections 2023-12-04T05:39:52.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.384+0000 7fe7dc409640 1 -- 172.21.15.97:0/4213538716 wait complete. 2023-12-04T05:39:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 Processor -- start 2023-12-04T05:39:52.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- start start 2023-12-04T05:39:52.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d40c7ef0 0x7fe7d4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 0x7fe7d4143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41ee4a0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40ab7c0 con 0x7fe7d4158630 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40abaa0 con 0x7fe7d40c7ef0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39142/0 (socket says 172.21.15.97:39142) 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 -- 172.21.15.97:0/1008858493 learned_addr learned my addr 172.21.15.97:0/1008858493 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7da1a5640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d40c7ef0 0x7fe7d4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7da9a6640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 0x7fe7d4143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 -- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d40c7ef0 msgr2=0x7fe7d4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d40c7ef0 0x7fe7d4156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 -- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 msgr2=0x7fe7d4143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 0x7fe7d4143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 -- 172.21.15.97:0/1008858493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009420 con 0x7fe7d4151bf0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7da9a6640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 0x7fe7d4143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7d99a4640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e930 tx=0x7fe7c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400ca00 con 0x7fe7d4151bf0 2023-12-04T05:39:52.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400cb60 con 0x7fe7d4151bf0 2023-12-04T05:39:52.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d0009420 con 0x7fe7d4151bf0 2023-12-04T05:39:52.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4013470 con 0x7fe7d4151bf0 2023-12-04T05:39:52.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d41571c0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.388+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d40abf50 con 0x7fe7d4151bf0 2023-12-04T05:39:52.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.392+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7c40135d0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.392+0000 7fe7caffd640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:52.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.392+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7c4084890 con 0x7fe7d4151bf0 2023-12-04T05:39:52.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.392+0000 7fe7da1a5640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:52.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.392+0000 7fe7da1a5640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 0x7fe7b8068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00ad000 tx=0x7fe7d00b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:52.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.396+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7d40abf50 con 0x7fe7d4151bf0 2023-12-04T05:39:52.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe7d40abf50 con 0x7fe7d4151bf0 2023-12-04T05:39:52.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7caffd640 1 -- 172.21.15.97:0/1008858493 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fe7c40170b0 con 0x7fe7d4151bf0 2023-12-04T05:39:52.582 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:39:52.582 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 msgr2=0x7fe7b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 0x7fe7b8068d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00ad000 tx=0x7fe7d00b2040 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 msgr2=0x7fe7d4142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e930 tx=0x7fe7c400edf0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 shutdown_connections 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe7b80668d0 0x7fe7b8068d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7d4158630 0x7fe7d4143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe7d4151bf0 0x7fe7d4142bd0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 --2- 172.21.15.97:0/1008858493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7d40c7ef0 0x7fe7d4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.580+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 >> 172.21.15.97:0/1008858493 conn(0x7fe7d4073550 msgr2=0x7fe7d415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.584+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 shutdown_connections 2023-12-04T05:39:52.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:52.584+0000 7fe7dc409640 1 -- 172.21.15.97:0/1008858493 wait complete. 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi097.front.sepia.ceph.com 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T05:39:52.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:39:52.603 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.TWAFQcuqRA 2023-12-04T05:39:52.603 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:39:52.612 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.0Gv5QLjpzE 2023-12-04T05:39:52.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /tmp/tmp.TWAFQcuqRA /tmp/tmp.0Gv5QLjpzE 2023-12-04T05:39:52.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.0Gv5QLjpzE 2023-12-04T05:39:52.800 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.0Gv5QLjpzE is 226B 2023-12-04T05:39:52.816 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.0Gv5QLjpzE 2023-12-04T05:39:52.825 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-04T05:39:52.825 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:39:52.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.825 DEBUG:teuthology.orchestra.run.smithi097:> ip addr 2023-12-04T05:39:52.876 INFO:teuthology.orchestra.run.smithi097.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:39:52.876 INFO:teuthology.orchestra.run.smithi097.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:39:52.876 INFO:teuthology.orchestra.run.smithi097.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:39:52.876 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 ::1/128 scope host 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0e brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f0 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:d8:a2:0f brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: altname enp7s0f1 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:04 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0c:c4:7a:8f:d8:05 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.21.15.97/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:39:52.877 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft 41956sec preferred_lft 41956sec 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::ec4:7aff:fe8f:d805/64 scope link 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 02:42:c2:29:6f:d9 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:39:52.878 INFO:teuthology.orchestra.run.smithi097.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:39:52.879 INFO:teuthology.orchestra.run.smithi097.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:52.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.879 DEBUG:teuthology.orchestra.run.smithi097:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:39:52.938 INFO:teuthology.orchestra.run.smithi097.stdout:1 2023-12-04T05:39:52.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.940 DEBUG:teuthology.orchestra.run.smithi097:> route 2023-12-04T05:39:52.994 INFO:teuthology.orchestra.run.smithi097.stdout:Kernel IP routing table 2023-12-04T05:39:52.994 INFO:teuthology.orchestra.run.smithi097.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:39:52.994 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:39:52.994 INFO:teuthology.orchestra.run.smithi097.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:52.995 INFO:teuthology.orchestra.run.smithi097.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:39:52.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> (cd / && exec bash -c ' 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> set -e 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:39:52.996 DEBUG:teuthology.orchestra.run.smithi097:> ') 2023-12-04T05:39:53.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:53.091 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:39:53.100 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:39:53.101 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:39:53.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:53.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link set brx.0 up 2023-12-04T05:39:53.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:53.164 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:53.216 INFO:teuthology.orchestra.run.smithi097.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T05:39:53.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:53.217 DEBUG:teuthology.orchestra.run.smithi097:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:53.267 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:53.267 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/tmp/tmp.TWAFQcuqRA of=/dev/stdout 2023-12-04T05:39:53.323 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-04T05:39:53.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:53.324 DEBUG:teuthology.orchestra.run.smithi097:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:53.417 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:53.417 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:53.417 INFO:teuthology.orchestra.run.smithi097.stdout:keyring.get_secret failed 2023-12-04T05:39:53.430 INFO:teuthology.orchestra.run.smithi097.stdout:parsing options: rw,norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:53.431 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:53.431 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:53.431 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: trying mount with new device syntax: testuser@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs=/ 2023-12-04T05:39:53.431 INFO:teuthology.orchestra.run.smithi097.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:53.435 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:39:53.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:53.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T05:39:53.453 INFO:teuthology.orchestra.run.smithi097.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-04T05:39:53.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:39:53.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:53.455 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:39:53.514 INFO:teuthology.orchestra.run.smithi097.stdout:client5972 2023-12-04T05:39:53.515 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:53.515 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:53.564 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-04T05:39:53.573 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.12pKSYIkSz 2023-12-04T05:39:53.574 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:53.574 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/tmp/tmp.12pKSYIkSz 2023-12-04T05:39:53.623 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:53.624 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:53.676 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:53.676 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:53.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:53.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 Processor -- start 2023-12-04T05:39:53.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 -- start start 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ef80c4740 0x7f8ef80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 0x7f8ef815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef81550f0 con 0x7f8ef8151cb0 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80c52b0 con 0x7f8ef80c4740 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8eff0bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80c5590 con 0x7f8ef80c4c50 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe0b9640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8ef8151cb0 0x7f8ef806aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:45288/0 (socket says 172.21.15.97:45288) 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe0b9640 1 -- 172.21.15.97:0/4133869811 learned_addr learned my addr 172.21.15.97:0/4133869811 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efd8b8640 1 --2- 172.21.15.97:0/4133869811 >> v2:172.21.15.143:3300/0 conn(0x7f8ef80c4740 0x7f8ef80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe8ba640 1 --2- 172.21.15.97:0/4133869811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 0x7f8ef815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efd0b7640 1 -- 172.21.15.97:0/4133869811 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552744963 0 0) 0x7f8ef81550f0 con 0x7f8ef8151cb0 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efd0b7640 1 -- 172.21.15.97:0/4133869811 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee4003530 con 0x7f8ef8151cb0 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe8ba640 1 -- 172.21.15.97:0/4133869811 >> v2:172.21.15.143:3300/0 conn(0x7f8ef80c4740 msgr2=0x7f8ef80c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe8ba640 1 --2- 172.21.15.97:0/4133869811 >> v2:172.21.15.143:3300/0 conn(0x7f8ef80c4740 0x7f8ef80c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe8ba640 1 -- 172.21.15.97:0/4133869811 >> v1:172.21.15.97:6789/0 conn(0x7f8ef8151cb0 legacy=0x7f8ef806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:53.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.864+0000 7f8efe8ba640 1 -- 172.21.15.97:0/4133869811 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80c5870 con 0x7f8ef80c4c50 2023-12-04T05:39:53.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8efe8ba640 1 --2- 172.21.15.97:0/4133869811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 0x7f8ef815ee50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009d90 tx=0x7f8ef001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59d149840f47301 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:53.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8efd0b7640 1 -- 172.21.15.97:0/4133869811 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00a5800 con 0x7f8ef80c4c50 2023-12-04T05:39:53.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8efd0b7640 1 -- 172.21.15.97:0/4133869811 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef00a5960 con 0x7f8ef80c4c50 2023-12-04T05:39:53.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8efd0b7640 1 -- 172.21.15.97:0/4133869811 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00a5cf0 con 0x7f8ef80c4c50 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 -- 172.21.15.97:0/4133869811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 msgr2=0x7f8ef815ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/4133869811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 0x7f8ef815ee50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009d90 tx=0x7f8ef001c830 comp rx=0 tx=0).stop 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 -- 172.21.15.97:0/4133869811 shutdown_connections 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/4133869811 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef80c4c50 0x7f8ef815ee50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/4133869811 >> v2:172.21.15.143:3300/0 conn(0x7f8ef80c4740 0x7f8ef80c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 -- 172.21.15.97:0/4133869811 >> 172.21.15.97:0/4133869811 conn(0x7f8ef80ab8b0 msgr2=0x7f8ef80abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 -- 172.21.15.97:0/4133869811 shutdown_connections 2023-12-04T05:39:53.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.868+0000 7f8eff0bb640 1 -- 172.21.15.97:0/4133869811 wait complete. 2023-12-04T05:39:53.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 Processor -- start 2023-12-04T05:39:53.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- start start 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef80c4c50 0x7f8ef8158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef8151cb0 0x7f8ef80c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80c1650 con 0x7f8ef80c4740 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80c2340 con 0x7f8ef80c4c50 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef814dfd0 con 0x7f8ef8151cb0 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:39152/0 (socket says 172.21.15.97:39152) 2023-12-04T05:39:53.874 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 -- 172.21.15.97:0/780161391 learned_addr learned my addr 172.21.15.97:0/780161391 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe8ba640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef8151cb0 0x7f8ef80c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efd8b8640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef80c4c50 0x7f8ef8158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 -- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef8151cb0 msgr2=0x7f8ef80c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef8151cb0 0x7f8ef80c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 -- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef80c4c50 msgr2=0x7f8ef8158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef80c4c50 0x7f8ef8158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 -- 172.21.15.97:0/780161391 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0009a70 con 0x7f8ef80c4740 2023-12-04T05:39:53.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8efe0b9640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c3c0 tx=0x7f8ef400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4005cf0 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4005e50 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef40072f0 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef80c7ed0 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef814e590 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.872+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef80ab220 con 0x7f8ef80c4740 2023-12-04T05:39:53.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.876+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ef4007450 con 0x7f8ef80c4740 2023-12-04T05:39:53.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.876+0000 7f8eeeffd640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 0x7f8edc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:53.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.876+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ef4083e20 con 0x7f8ef80c4740 2023-12-04T05:39:53.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.876+0000 7f8efd8b8640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 0x7f8edc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:53.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.876+0000 7f8efd8b8640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 0x7f8edc068dc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80c1c20 tx=0x7f8ee8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:53.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:53.880+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ef4050bd0 con 0x7f8ef80c4740 2023-12-04T05:39:54.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef804e890 con 0x7f8ef80c4740 2023-12-04T05:39:54.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eeeffd640 1 -- 172.21.15.97:0/780161391 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f8ef4017030 con 0x7f8ef80c4740 2023-12-04T05:39:54.034 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:54.034 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:54.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 msgr2=0x7f8edc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 0x7f8edc068dc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80c1c20 tx=0x7f8ee8008040 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 msgr2=0x7f8ef8145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400c3c0 tx=0x7f8ef400c880 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 shutdown_connections 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8edc066900 0x7f8edc068dc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ef8151cb0 0x7f8ef80c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ef80c4c50 0x7f8ef8158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 --2- 172.21.15.97:0/780161391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ef80c4740 0x7f8ef8145b40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 >> 172.21.15.97:0/780161391 conn(0x7f8ef80ab8b0 msgr2=0x7f8ef814afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 shutdown_connections 2023-12-04T05:39:54.036 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.032+0000 7f8eff0bb640 1 -- 172.21.15.97:0/780161391 wait complete. 2023-12-04T05:39:54.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:54.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:54.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 Processor -- start 2023-12-04T05:39:54.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 -- start start 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 0x7fcc901524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc9006c440 0x7fcc900a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900aa240 con 0x7fcc900a89a0 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9006c0c0 con 0x7fcc9006c440 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc95972640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900aa500 con 0x7fcc900c1e70 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc9006c440 0x7fcc900a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fcc9006c440 0x7fcc900a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60424/0 (socket says 172.21.15.97:60424) 2023-12-04T05:39:54.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 -- 172.21.15.97:0/1523996566 learned_addr learned my addr 172.21.15.97:0/1523996566 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc8effd640 1 --2- 172.21.15.97:0/1523996566 >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 0x7fcc901524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 -- 172.21.15.97:0/1523996566 >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 msgr2=0x7fcc901524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 --2- 172.21.15.97:0/1523996566 >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 0x7fcc901524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 -- 172.21.15.97:0/1523996566 >> v1:172.21.15.143:6789/0 conn(0x7fcc900a89a0 legacy=0x7fcc9006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc87fff640 1 -- 172.21.15.97:0/1523996566 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900aa7e0 con 0x7fcc9006c440 2023-12-04T05:39:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.196+0000 7fcc8effd640 1 --2- 172.21.15.97:0/1523996566 >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 0x7fcc901524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:54.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc87fff640 1 --2- 172.21.15.97:0/1523996566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9006c440 0x7fcc900a8460 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcc90072510 tx=0x7fcc7801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cf193eafca4e67 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc8e7fc640 1 -- 172.21.15.97:0/1523996566 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780aa5f0 con 0x7fcc9006c440 2023-12-04T05:39:54.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc8e7fc640 1 -- 172.21.15.97:0/1523996566 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc780aa750 con 0x7fcc9006c440 2023-12-04T05:39:54.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc8e7fc640 1 -- 172.21.15.97:0/1523996566 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780aaae0 con 0x7fcc9006c440 2023-12-04T05:39:54.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 -- 172.21.15.97:0/1523996566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9006c440 msgr2=0x7fcc900a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 --2- 172.21.15.97:0/1523996566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9006c440 0x7fcc900a8460 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcc90072510 tx=0x7fcc7801c490 comp rx=0 tx=0).stop 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 -- 172.21.15.97:0/1523996566 shutdown_connections 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 --2- 172.21.15.97:0/1523996566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc9006c440 0x7fcc900a8460 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 --2- 172.21.15.97:0/1523996566 >> v2:172.21.15.143:3300/0 conn(0x7fcc900c1e70 0x7fcc901524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 -- 172.21.15.97:0/1523996566 >> 172.21.15.97:0/1523996566 conn(0x7fcc900c5e70 msgr2=0x7fcc900c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 -- 172.21.15.97:0/1523996566 shutdown_connections 2023-12-04T05:39:54.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.200+0000 7fcc95972640 1 -- 172.21.15.97:0/1523996566 wait complete. 2023-12-04T05:39:54.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 Processor -- start 2023-12-04T05:39:54.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- start start 2023-12-04T05:39:54.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 0x7fcc901ec140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc900a89a0 0x7fcc90140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc90145af0 con 0x7fcc900c1e70 2023-12-04T05:39:54.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900c47f0 con 0x7fcc9006c440 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc901ec680 con 0x7fcc900a89a0 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60430/0 (socket says 172.21.15.97:60430) 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 -- 172.21.15.97:0/2120247047 learned_addr learned my addr 172.21.15.97:0/2120247047 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc87fff640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc900a89a0 0x7fcc90140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8effd640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 0x7fcc901ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 -- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc900a89a0 msgr2=0x7fcc90140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc900a89a0 0x7fcc90140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 -- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 msgr2=0x7fcc901ec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 0x7fcc901ec140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 -- 172.21.15.97:0/2120247047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780094d0 con 0x7fcc900c1e70 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8effd640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 0x7fcc901ec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8f7fe640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c780 tx=0x7fcc8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004b70 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800ce90 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800a850 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900c23d0 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.204+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc900c2aa0 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc90068440 con 0x7fcc900c1e70 2023-12-04T05:39:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc8800a9b0 con 0x7fcc900c1e70 2023-12-04T05:39:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc8cff9640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 0x7fcc70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc88084970 con 0x7fcc900c1e70 2023-12-04T05:39:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc8effd640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 0x7fcc70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.211 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.208+0000 7fcc8effd640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 0x7fcc70068d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006fd0 tx=0x7fcc80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.212+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc880517b0 con 0x7fcc900c1e70 2023-12-04T05:39:54.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.364+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc9006c220 con 0x7fcc900c1e70 2023-12-04T05:39:54.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.364+0000 7fcc8cff9640 1 -- 172.21.15.97:0/2120247047 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc88054dd0 con 0x7fcc900c1e70 2023-12-04T05:39:54.367 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 msgr2=0x7fcc70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 0x7fcc70068d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006fd0 tx=0x7fcc80008040 comp rx=0 tx=0).stop 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 msgr2=0x7fcc90141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800c780 tx=0x7fcc8800cc40 comp rx=0 tx=0).stop 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 shutdown_connections 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcc700668d0 0x7fcc70068d90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc900c1e70 0x7fcc90141050 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcc900a89a0 0x7fcc90140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 --2- 172.21.15.97:0/2120247047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcc9006c440 0x7fcc901ec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 >> 172.21.15.97:0/2120247047 conn(0x7fcc900c5e70 msgr2=0x7fcc90148bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 shutdown_connections 2023-12-04T05:39:54.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.368+0000 7fcc95972640 1 -- 172.21.15.97:0/2120247047 wait complete. 2023-12-04T05:39:54.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:54.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 Processor -- start 2023-12-04T05:39:54.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 -- start start 2023-12-04T05:39:54.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7facb40c1360 0x7facb40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 0x7facb4151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 0x7facb414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb4150bc0 con 0x7facb40c1360 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb4154fd0 con 0x7facb406c000 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facba5b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb4072160 con 0x7facb41518a0 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7facb40c1360 0x7facb40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7facb40c1360 0x7facb40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60438/0 (socket says 172.21.15.97:60438) 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 -- 172.21.15.97:0/828781417 learned_addr learned my addr 172.21.15.97:0/828781417 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb8b55640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 0x7facb414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 -- 172.21.15.97:0/828781417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 msgr2=0x7facb414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb37fe640 1 --2- 172.21.15.97:0/828781417 >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 0x7facb4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 0x7facb414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 -- 172.21.15.97:0/828781417 >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 msgr2=0x7facb4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 --2- 172.21.15.97:0/828781417 >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 0x7facb4151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb3fff640 1 -- 172.21.15.97:0/828781417 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4072440 con 0x7facb40c1360 2023-12-04T05:39:54.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb8b55640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 0x7facb414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:54.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.528+0000 7facb37fe640 1 --2- 172.21.15.97:0/828781417 >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 0x7facb4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:54.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facb3fff640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb40c1360 0x7facb40700b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7facb40abe70 tx=0x7faca401d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ca5989e651dff4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facb2ffd640 1 -- 172.21.15.97:0/828781417 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40ac660 con 0x7facb40c1360 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facb2ffd640 1 -- 172.21.15.97:0/828781417 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca40ac7c0 con 0x7facb40c1360 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facb2ffd640 1 -- 172.21.15.97:0/828781417 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40acb50 con 0x7facb40c1360 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 -- 172.21.15.97:0/828781417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb40c1360 msgr2=0x7facb40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb40c1360 0x7facb40700b0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7facb40abe70 tx=0x7faca401d580 comp rx=0 tx=0).stop 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 -- 172.21.15.97:0/828781417 shutdown_connections 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb41518a0 0x7facb414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 --2- 172.21.15.97:0/828781417 >> v2:172.21.15.143:3300/0 conn(0x7facb406c000 0x7facb4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.534 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 --2- 172.21.15.97:0/828781417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb40c1360 0x7facb40700b0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 -- 172.21.15.97:0/828781417 >> 172.21.15.97:0/828781417 conn(0x7facb40c5e70 msgr2=0x7facb40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 -- 172.21.15.97:0/828781417 shutdown_connections 2023-12-04T05:39:54.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 -- 172.21.15.97:0/828781417 wait complete. 2023-12-04T05:39:54.535 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.532+0000 7facba5b8640 1 Processor -- start 2023-12-04T05:39:54.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- start start 2023-12-04T05:39:54.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb406c000 0x7facb40bf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facb40c1360 0x7facb41ee390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41ee8d0 con 0x7facb41f18f0 2023-12-04T05:39:54.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41f0ea0 con 0x7facb40c1360 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb41f1460 con 0x7facb406c000 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60450/0 (socket says 172.21.15.97:60450) 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 -- 172.21.15.97:0/1907177105 learned_addr learned my addr 172.21.15.97:0/1907177105 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb3fff640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb406c000 0x7facb40bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb37fe640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facb40c1360 0x7facb41ee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 -- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb406c000 msgr2=0x7facb40bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb406c000 0x7facb40bf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 -- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facb40c1360 msgr2=0x7facb41ee390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facb40c1360 0x7facb41ee390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 -- 172.21.15.97:0/1907177105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40094d0 con 0x7facb41f18f0 2023-12-04T05:39:54.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb8b55640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7facac00cd50 tx=0x7facac00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac00f680 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac00f800 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac00fbb0 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb40bfd70 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb41f10f0 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.536+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb40c0290 con 0x7facb41f18f0 2023-12-04T05:39:54.540 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.540+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7facac00b040 con 0x7facb41f18f0 2023-12-04T05:39:54.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.540+0000 7facb0ff9640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 0x7faca0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.540+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7facac085090 con 0x7facb41f18f0 2023-12-04T05:39:54.541 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.540+0000 7facb3fff640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 0x7faca0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.540+0000 7facb3fff640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 0x7faca0068dc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faca40b0000 tx=0x7faca4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.544+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facac051f60 con 0x7facb41f18f0 2023-12-04T05:39:54.693 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facb4068440 con 0x7facb41f18f0 2023-12-04T05:39:54.694 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facb0ff9640 1 -- 172.21.15.97:0/1907177105 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7facac01d020 con 0x7facb41f18f0 2023-12-04T05:39:54.694 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 msgr2=0x7faca0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 0x7faca0068dc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faca40b0000 tx=0x7faca4008040 comp rx=0 tx=0).stop 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 msgr2=0x7facb40a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.692+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7facac00cd50 tx=0x7facac00a650 comp rx=0 tx=0).stop 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 shutdown_connections 2023-12-04T05:39:54.696 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7faca0066900 0x7faca0068dc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7facb41f18f0 0x7facb40a8de0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7facb40c1360 0x7facb41ee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 --2- 172.21.15.97:0/1907177105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7facb406c000 0x7facb40bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 >> 172.21.15.97:0/1907177105 conn(0x7facb40c5e70 msgr2=0x7facb414a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 shutdown_connections 2023-12-04T05:39:54.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.696+0000 7facba5b8640 1 -- 172.21.15.97:0/1907177105 wait complete. 2023-12-04T05:39:54.716 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:54.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 Processor -- start 2023-12-04T05:39:54.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 -- start start 2023-12-04T05:39:54.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe2ac06c440 0x7fe2ac1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac0aa240 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac0aa500 con 0x7fe2ac06d210 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2b0b1d640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac06c0c0 con 0x7fe2ac06c440 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2a3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe2ac06c440 0x7fe2ac1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2aa59c640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe2ac0c1e70 0x7fe2ac0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40728/0 (socket says 172.21.15.97:40728) 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2aa59c640 1 -- 172.21.15.97:0/1232673045 learned_addr learned my addr 172.21.15.97:0/1232673045 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2a3fff640 1 -- 172.21.15.97:0/1232673045 >> v1:172.21.15.143:6789/0 conn(0x7fe2ac06d210 legacy=0x7fe2ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2a3fff640 1 -- 172.21.15.97:0/1232673045 >> v1:172.21.15.97:6789/0 conn(0x7fe2ac0c1e70 legacy=0x7fe2ac0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.856+0000 7fe2a3fff640 1 -- 172.21.15.97:0/1232673045 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac0aa7e0 con 0x7fe2ac06c440 2023-12-04T05:39:54.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2a3fff640 1 --2- 172.21.15.97:0/1232673045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac06c440 0x7fe2ac1524e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe2940097c0 tx=0x7fe29401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aae683c95c1c611 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2a9d9b640 1 -- 172.21.15.97:0/1232673045 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940ab650 con 0x7fe2ac06c440 2023-12-04T05:39:54.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2a9d9b640 1 -- 172.21.15.97:0/1232673045 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2940ab7b0 con 0x7fe2ac06c440 2023-12-04T05:39:54.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2a9d9b640 1 -- 172.21.15.97:0/1232673045 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940abb40 con 0x7fe2ac06c440 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/1232673045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac06c440 msgr2=0x7fe2ac1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/1232673045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac06c440 0x7fe2ac1524e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe2940097c0 tx=0x7fe29401c450 comp rx=0 tx=0).stop 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/1232673045 shutdown_connections 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/1232673045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac06c440 0x7fe2ac1524e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/1232673045 >> 172.21.15.97:0/1232673045 conn(0x7fe2ac0c5e70 msgr2=0x7fe2ac0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/1232673045 shutdown_connections 2023-12-04T05:39:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/1232673045 wait complete. 2023-12-04T05:39:54.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.860+0000 7fe2b0b1d640 1 Processor -- start 2023-12-04T05:39:54.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- start start 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2ac06c440 0x7fe2ac14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2ac06d210 0x7fe2ac155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c4e80 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c2620 con 0x7fe2ac06d210 2023-12-04T05:39:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac0c2b50 con 0x7fe2ac06c440 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60472/0 (socket says 172.21.15.97:60472) 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 -- 172.21.15.97:0/3757845523 learned_addr learned my addr 172.21.15.97:0/3757845523 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2a3fff640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2ac06d210 0x7fe2ac155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aa59c640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2ac06c440 0x7fe2ac14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 -- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2ac06c440 msgr2=0x7fe2ac14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2ac06c440 0x7fe2ac14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 -- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2ac06d210 msgr2=0x7fe2ac155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2ac06d210 0x7fe2ac155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 -- 172.21.15.97:0/3757845523 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294009420 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2aad9d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c7a0 tx=0x7fe2a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4003b80 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4003ce0 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac1eb300 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400aa90 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac1eb5a0 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.864+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac146540 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.868+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2a400abf0 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.868+0000 7fe2a2ffd640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 0x7fe28c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:54.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.868+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe2a40844b0 con 0x7fe2ac0c1e70 2023-12-04T05:39:54.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.868+0000 7fe2aa59c640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 0x7fe28c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:54.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.868+0000 7fe2aa59c640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 0x7fe28c068dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe29c005890 tx=0x7fe29c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:54.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:54.872+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2ac146540 con 0x7fe2ac0c1e70 2023-12-04T05:39:55.023 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.020+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2ac146540 con 0x7fe2ac0c1e70 2023-12-04T05:39:55.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.020+0000 7fe2a2ffd640 1 -- 172.21.15.97:0/3757845523 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2ac146540 con 0x7fe2ac0c1e70 2023-12-04T05:39:55.024 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 msgr2=0x7fe28c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 0x7fe28c068dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe29c005890 tx=0x7fe29c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 msgr2=0x7fe2ac146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c7a0 tx=0x7fe2a400cc60 comp rx=0 tx=0).stop 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 shutdown_connections 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe28c066900 0x7fe28c068dc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe2ac0c1e70 0x7fe2ac146820 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.026 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2ac06d210 0x7fe2ac155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 --2- 172.21.15.97:0/3757845523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2ac06c440 0x7fe2ac14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 >> 172.21.15.97:0/3757845523 conn(0x7fe2ac0c5e70 msgr2=0x7fe2ac14ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 shutdown_connections 2023-12-04T05:39:55.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.024+0000 7fe2b0b1d640 1 -- 172.21.15.97:0/3757845523 wait complete. 2023-12-04T05:39:55.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:55.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.184+0000 7f08aa92a640 1 Processor -- start 2023-12-04T05:39:55.188 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.184+0000 7f08aa92a640 1 -- start start 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08aa92a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08a414eb30 0x7f08a414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08aa92a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a4154640 con 0x7f08a414f790 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08aa92a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a414ef10 con 0x7f08a4154fe0 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08aa92a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40c0bd0 con 0x7f08a414eb30 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08a414eb30 0x7f08a414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a37fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f08a414f790 0x7f08a41548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40730/0 (socket says 172.21.15.97:40730) 2023-12-04T05:39:55.189 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a3fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f08a414eb30 0x7f08a414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60480/0 (socket says 172.21.15.97:60480) 2023-12-04T05:39:55.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a37fe640 1 -- 172.21.15.97:0/2675557924 learned_addr learned my addr 172.21.15.97:0/2675557924 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:55.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a3fff640 1 -- 172.21.15.97:0/2675557924 >> v1:172.21.15.143:6789/0 conn(0x7f08a4154fe0 legacy=0x7f08a415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a3fff640 1 -- 172.21.15.97:0/2675557924 >> v1:172.21.15.97:6789/0 conn(0x7f08a414f790 legacy=0x7f08a41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.188+0000 7f08a3fff640 1 -- 172.21.15.97:0/2675557924 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a41535a0 con 0x7f08a414eb30 2023-12-04T05:39:55.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08a3fff640 1 --2- 172.21.15.97:0/2675557924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a414eb30 0x7f08a414f250 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f08940097c0 tx=0x7f089401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4680b75d3f0ae6cc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08a2ffd640 1 -- 172.21.15.97:0/2675557924 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08940ab650 con 0x7f08a414eb30 2023-12-04T05:39:55.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08a2ffd640 1 -- 172.21.15.97:0/2675557924 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08940ab7b0 con 0x7f08a414eb30 2023-12-04T05:39:55.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08a2ffd640 1 -- 172.21.15.97:0/2675557924 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08940abb40 con 0x7f08a414eb30 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- 172.21.15.97:0/2675557924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a414eb30 msgr2=0x7f08a414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 --2- 172.21.15.97:0/2675557924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a414eb30 0x7f08a414f250 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f08940097c0 tx=0x7f089401c450 comp rx=0 tx=0).stop 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- 172.21.15.97:0/2675557924 shutdown_connections 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 --2- 172.21.15.97:0/2675557924 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a414eb30 0x7f08a414f250 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- 172.21.15.97:0/2675557924 >> 172.21.15.97:0/2675557924 conn(0x7f08a40c5e70 msgr2=0x7f08a40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- 172.21.15.97:0/2675557924 shutdown_connections 2023-12-04T05:39:55.194 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- 172.21.15.97:0/2675557924 wait complete. 2023-12-04T05:39:55.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 Processor -- start 2023-12-04T05:39:55.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.192+0000 7f08aa92a640 1 -- start start 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08a414eb30 0x7f08a4148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08a414f790 0x7f08a41424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41eb200 con 0x7f08a4154fe0 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41eb4e0 con 0x7f08a414f790 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41eb7c0 con 0x7f08a414eb30 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60482/0 (socket says 172.21.15.97:60482) 2023-12-04T05:39:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 -- 172.21.15.97:0/1367989424 learned_addr learned my addr 172.21.15.97:0/1367989424 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a3fff640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08a414eb30 0x7f08a4148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a37fe640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08a414f790 0x7f08a41424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 -- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08a414eb30 msgr2=0x7f08a4148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08a414eb30 0x7f08a4148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 -- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08a414f790 msgr2=0x7f08a41424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08a414f790 0x7f08a41424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 -- 172.21.15.97:0/1367989424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894009420 con 0x7f08a4154fe0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a8ec7640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c730 tx=0x7f089c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c003b80 con 0x7f08a4154fe0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c003ce0 con 0x7f08a4154fe0 2023-12-04T05:39:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c00aa30 con 0x7f08a4154fe0 2023-12-04T05:39:55.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a414fd20 con 0x7f08a4154fe0 2023-12-04T05:39:55.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a41ebd80 con 0x7f08a4154fe0 2023-12-04T05:39:55.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.196+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a41ebfa0 con 0x7f08a4154fe0 2023-12-04T05:39:55.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.200+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f089c00ab90 con 0x7f08a4154fe0 2023-12-04T05:39:55.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.200+0000 7f08a0ff9640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 0x7f0890068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.200+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f089c0844b0 con 0x7f08a4154fe0 2023-12-04T05:39:55.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.200+0000 7f08a3fff640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 0x7f0890068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.200+0000 7f08a3fff640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 0x7f0890068d90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f08940af000 tx=0x7f08940a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.204+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f089c0513a0 con 0x7f08a4154fe0 2023-12-04T05:39:55.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08a4068440 con 0x7f08a4154fe0 2023-12-04T05:39:55.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08a0ff9640 1 -- 172.21.15.97:0/1367989424 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f089c0549c0 con 0x7f08a4154fe0 2023-12-04T05:39:55.357 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 msgr2=0x7f0890068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 0x7f0890068d90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f08940af000 tx=0x7f08940a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 msgr2=0x7f08a4142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c730 tx=0x7f089c00cbf0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 shutdown_connections 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f08900668d0 0x7f0890068d90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08a4154fe0 0x7f08a4142a00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08a414f790 0x7f08a41424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 --2- 172.21.15.97:0/1367989424 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f08a414eb30 0x7f08a4148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 >> 172.21.15.97:0/1367989424 conn(0x7f08a40c5e70 msgr2=0x7f08a406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 shutdown_connections 2023-12-04T05:39:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.356+0000 7f08aa92a640 1 -- 172.21.15.97:0/1367989424 wait complete. 2023-12-04T05:39:55.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.516+0000 7f41707b8640 1 Processor -- start 2023-12-04T05:39:55.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.516+0000 7f41707b8640 1 -- start start 2023-12-04T05:39:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f41707b8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f416814eb30 0x7f416814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f41707b8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f416814f790 0x7f41681548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f41707b8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4168154640 con 0x7f4168154e10 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f41707b8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41680c0bd0 con 0x7f416814f790 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f41707b8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416814ef10 con 0x7f416814eb30 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f416814f790 0x7f41681548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f416814f790 0x7f41681548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60486/0 (socket says 172.21.15.97:60486) 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 -- 172.21.15.97:0/1040862407 learned_addr learned my addr 172.21.15.97:0/1040862407 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416e554640 1 --2- 172.21.15.97:0/1040862407 >> v2:172.21.15.143:3300/0 conn(0x7f416814eb30 0x7f416814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 -- 172.21.15.97:0/1040862407 >> v2:172.21.15.143:3300/0 conn(0x7f416814eb30 msgr2=0x7f416814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 --2- 172.21.15.97:0/1040862407 >> v2:172.21.15.143:3300/0 conn(0x7f416814eb30 0x7f416814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 -- 172.21.15.97:0/1040862407 >> v1:172.21.15.143:6789/0 conn(0x7f4168154e10 legacy=0x7f4168151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:55.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.520+0000 7f416dd53640 1 -- 172.21.15.97:0/1040862407 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41681535a0 con 0x7f416814f790 2023-12-04T05:39:55.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f416dd53640 1 --2- 172.21.15.97:0/1040862407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41681548d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f41680c0a80 tx=0x7f415801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b916466466789198 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f416d552640 1 -- 172.21.15.97:0/1040862407 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580a7b80 con 0x7f416814f790 2023-12-04T05:39:55.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f416d552640 1 -- 172.21.15.97:0/1040862407 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580a7ce0 con 0x7f416814f790 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f416d552640 1 -- 172.21.15.97:0/1040862407 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580af660 con 0x7f416814f790 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- 172.21.15.97:0/1040862407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 msgr2=0x7f41681548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 --2- 172.21.15.97:0/1040862407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41681548d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f41680c0a80 tx=0x7f415801eba0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- 172.21.15.97:0/1040862407 shutdown_connections 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 --2- 172.21.15.97:0/1040862407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41681548d0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 --2- 172.21.15.97:0/1040862407 >> v2:172.21.15.143:3300/0 conn(0x7f416814eb30 0x7f416814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- 172.21.15.97:0/1040862407 >> 172.21.15.97:0/1040862407 conn(0x7f41680c5e70 msgr2=0x7f41680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- 172.21.15.97:0/1040862407 shutdown_connections 2023-12-04T05:39:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- 172.21.15.97:0/1040862407 wait complete. 2023-12-04T05:39:55.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 Processor -- start 2023-12-04T05:39:55.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 -- start start 2023-12-04T05:39:55.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f416814eb30 0x7f416814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.524+0000 7f41707b8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 0x7f4168142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680ab3d0 con 0x7f416814f790 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41681ed740 con 0x7f416814eb30 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416814a7a0 con 0x7f4168154e10 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60498/0 (socket says 172.21.15.97:60498) 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 -- 172.21.15.97:0/193862520 learned_addr learned my addr 172.21.15.97:0/193862520 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416e554640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f416814eb30 0x7f416814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416ed55640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 0x7f4168142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 -- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 msgr2=0x7f4168142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 0x7f4168142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 -- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f416814eb30 msgr2=0x7f416814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f416814eb30 0x7f416814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 -- 172.21.15.97:0/193862520 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415800b770 con 0x7f416814f790 2023-12-04T05:39:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416ed55640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 0x7f4168142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f416dd53640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f415801b7b0 tx=0x7f415801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580ba660 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580ba7c0 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41681eda00 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580bab70 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41681edfc0 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4168068440 con 0x7f416814f790 2023-12-04T05:39:55.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.528+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41580c33b0 con 0x7f416814f790 2023-12-04T05:39:55.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.532+0000 7f415effd640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 0x7f414c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.532+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f415811f8b0 con 0x7f416814f790 2023-12-04T05:39:55.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.532+0000 7f416e554640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 0x7f414c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.532+0000 7f416e554640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 0x7f414c068d90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f41640079c0 tx=0x7f4164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.536+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41580ec830 con 0x7f416814f790 2023-12-04T05:39:55.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f41681ee1b0 con 0x7f416814f790 2023-12-04T05:39:55.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f415effd640 1 -- 172.21.15.97:0/193862520 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f41580bf020 con 0x7f416814f790 2023-12-04T05:39:55.686 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:55.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 msgr2=0x7f414c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 0x7f414c068d90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f41640079c0 tx=0x7f4164008040 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 msgr2=0x7f41680aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f415801b7b0 tx=0x7f415801b940 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 shutdown_connections 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f414c0668d0 0x7f414c068d90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4168154e10 0x7f4168142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f416814f790 0x7f41680aae90 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 --2- 172.21.15.97:0/193862520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f416814eb30 0x7f416814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 >> 172.21.15.97:0/193862520 conn(0x7f41680c5e70 msgr2=0x7f41680c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 shutdown_connections 2023-12-04T05:39:55.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.684+0000 7f41707b8640 1 -- 172.21.15.97:0/193862520 wait complete. 2023-12-04T05:39:55.707 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:39:55.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 Processor -- start 2023-12-04T05:39:55.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 -- start start 2023-12-04T05:39:55.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd6e0156070 0x7fd6e00c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e0071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6e00c0db0 0x7fd6e0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e0071380 con 0x7fd6e00c0db0 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e006cc20 con 0x7fd6e0156070 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e7701640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e006cf00 con 0x7fd6e006e410 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.844+0000 7fd6e5c9e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6e00c0db0 0x7fd6e0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fd6e00c0db0 0x7fd6e0158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60508/0 (socket says 172.21.15.97:60508) 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/3648189851 learned_addr learned my addr 172.21.15.97:0/3648189851 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e549d640 1 --2- 172.21.15.97:0/3648189851 >> v2:172.21.15.143:3300/0 conn(0x7fd6e0156070 0x7fd6e00c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e4c9c640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e0071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/3648189851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 msgr2=0x7fd6e0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e0071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/3648189851 >> v2:172.21.15.143:3300/0 conn(0x7fd6e0156070 msgr2=0x7fd6e00c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/3648189851 >> v2:172.21.15.143:3300/0 conn(0x7fd6e0156070 0x7fd6e00c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/3648189851 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e015cbb0 con 0x7fd6e00c0db0 2023-12-04T05:39:55.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e00c0db0 0x7fd6e0158a70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006e870 tx=0x7fd6d801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e25c8d72cb3cc60 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6d7fff640 1 -- 172.21.15.97:0/3648189851 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80a57e0 con 0x7fd6e00c0db0 2023-12-04T05:39:55.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6d7fff640 1 -- 172.21.15.97:0/3648189851 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d80a5940 con 0x7fd6e00c0db0 2023-12-04T05:39:55.851 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.848+0000 7fd6d7fff640 1 -- 172.21.15.97:0/3648189851 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80a5cd0 con 0x7fd6e00c0db0 2023-12-04T05:39:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- 172.21.15.97:0/3648189851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e00c0db0 msgr2=0x7fd6e0158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e00c0db0 0x7fd6e0158a70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006e870 tx=0x7fd6d801c9d0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- 172.21.15.97:0/3648189851 shutdown_connections 2023-12-04T05:39:55.852 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e0071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- 172.21.15.97:0/3648189851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e00c0db0 0x7fd6e0158a70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- 172.21.15.97:0/3648189851 >> v2:172.21.15.143:3300/0 conn(0x7fd6e0156070 0x7fd6e00c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- 172.21.15.97:0/3648189851 >> 172.21.15.97:0/3648189851 conn(0x7fd6e00c5e70 msgr2=0x7fd6e00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- 172.21.15.97:0/3648189851 shutdown_connections 2023-12-04T05:39:55.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- 172.21.15.97:0/3648189851 wait complete. 2023-12-04T05:39:55.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 Processor -- start 2023-12-04T05:39:55.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- start start 2023-12-04T05:39:55.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e01469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 0x7fd6e00c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00a9f80 con 0x7fd6e0156070 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00aaf50 con 0x7fd6e00c0db0 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e7701640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0147f20 con 0x7fd6e006e410 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60520/0 (socket says 172.21.15.97:60520) 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/1607740882 learned_addr learned my addr 172.21.15.97:0/1607740882 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e549d640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e01469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e4c9c640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 0x7fd6e00c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 msgr2=0x7fd6e01469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e01469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 msgr2=0x7fd6e00c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:55.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 0x7fd6e00c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e5c9e640 1 -- 172.21.15.97:0/1607740882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009b30 con 0x7fd6e0156070 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.852+0000 7fd6e4c9c640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 0x7fd6e00c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6e5c9e640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80af040 tx=0x7fd6e0156660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80b8670 con 0x7fd6e0156070 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d80b87d0 con 0x7fd6e0156070 2023-12-04T05:39:55.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e01481c0 con 0x7fd6e0156070 2023-12-04T05:39:55.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80b8b60 con 0x7fd6e0156070 2023-12-04T05:39:55.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e015aca0 con 0x7fd6e0156070 2023-12-04T05:39:55.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e0148670 con 0x7fd6e0156070 2023-12-04T05:39:55.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd6d80b8cc0 con 0x7fd6e0156070 2023-12-04T05:39:55.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 0x7fd6c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:55.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd6d811fd20 con 0x7fd6e0156070 2023-12-04T05:39:55.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.856+0000 7fd6e549d640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 0x7fd6c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:55.860 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.860+0000 7fd6e549d640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 0x7fd6c4068d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc007940 tx=0x7fd6dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:55.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:55.860+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6d80ecd10 con 0x7fd6e0156070 2023-12-04T05:39:56.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6e0068440 con 0x7fd6e0156070 2023-12-04T05:39:56.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6d5ffb640 1 -- 172.21.15.97:0/1607740882 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6d80bc080 con 0x7fd6e0156070 2023-12-04T05:39:56.025 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 msgr2=0x7fd6c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 0x7fd6c4068d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc007940 tx=0x7fd6dc008040 comp rx=0 tx=0).stop 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 msgr2=0x7fd6e00c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80af040 tx=0x7fd6e0156660 comp rx=0 tx=0).stop 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 shutdown_connections 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd6c40668d0 0x7fd6c4068d90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd6e0156070 0x7fd6e00c4e20 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd6e00c0db0 0x7fd6e00c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 --2- 172.21.15.97:0/1607740882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd6e006e410 0x7fd6e01469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 >> 172.21.15.97:0/1607740882 conn(0x7fd6e00c5e70 msgr2=0x7fd6e014bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:56.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 shutdown_connections 2023-12-04T05:39:56.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.024+0000 7fd6e7701640 1 -- 172.21.15.97:0/1607740882 wait complete. 2023-12-04T05:39:56.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T05:39:56.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.047 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:56.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:39:56.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.102 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:39:56.129 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:56.129 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:56.180 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:39:56.181 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T05:39:56.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 Processor -- start 2023-12-04T05:39:56.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 -- start start 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5060151e10 0x7f50600c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50600c5d40 0x7f5060158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5060157dc0 con 0x7f50600a7290 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50600c3cd0 con 0x7f50600c5d40 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f506849c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50601521f0 con 0x7f5060151e10 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50600c5d40 0x7f5060158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5066a39640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f50600a7290 0x7f50600c4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40744/0 (socket says 172.21.15.97:40744) 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f50600c5d40 0x7f5060158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60528/0 (socket says 172.21.15.97:60528) 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5066a39640 1 -- 172.21.15.97:0/1655381625 learned_addr learned my addr 172.21.15.97:0/1655381625 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5066238640 1 --2- 172.21.15.97:0/1655381625 >> v2:172.21.15.143:3300/0 conn(0x7f5060151e10 0x7f50600c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 -- 172.21.15.97:0/1655381625 >> v2:172.21.15.143:3300/0 conn(0x7f5060151e10 msgr2=0x7f50600c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 --2- 172.21.15.97:0/1655381625 >> v2:172.21.15.143:3300/0 conn(0x7f5060151e10 0x7f50600c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 -- 172.21.15.97:0/1655381625 >> v1:172.21.15.97:6789/0 conn(0x7f50600a7290 legacy=0x7f50600c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065a37640 1 -- 172.21.15.97:0/1655381625 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600704a0 con 0x7f50600c5d40 2023-12-04T05:39:56.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.320+0000 7f5065236640 1 -- 172.21.15.97:0/1655381625 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089185448 0 0) 0x7f5060157dc0 con 0x7f50600a7290 2023-12-04T05:39:56.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f5065a37640 1 --2- 172.21.15.97:0/1655381625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50600c5d40 0x7f5060158550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f50600c2610 tx=0x7f505001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b89e02ec39ee38 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:56.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f5065236640 1 -- 172.21.15.97:0/1655381625 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500ac600 con 0x7f50600c5d40 2023-12-04T05:39:56.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f5065236640 1 -- 172.21.15.97:0/1655381625 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50500a8050 con 0x7f50600c5d40 2023-12-04T05:39:56.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f5065236640 1 -- 172.21.15.97:0/1655381625 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500ac980 con 0x7f50600c5d40 2023-12-04T05:39:56.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 -- 172.21.15.97:0/1655381625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50600c5d40 msgr2=0x7f5060158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 --2- 172.21.15.97:0/1655381625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50600c5d40 0x7f5060158550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f50600c2610 tx=0x7f505001c3a0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 -- 172.21.15.97:0/1655381625 shutdown_connections 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 --2- 172.21.15.97:0/1655381625 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f50600c5d40 0x7f5060158550 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 --2- 172.21.15.97:0/1655381625 >> v2:172.21.15.143:3300/0 conn(0x7f5060151e10 0x7f50600c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 -- 172.21.15.97:0/1655381625 >> 172.21.15.97:0/1655381625 conn(0x7f50600c7e40 msgr2=0x7f50600c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 -- 172.21.15.97:0/1655381625 shutdown_connections 2023-12-04T05:39:56.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.324+0000 7f506849c640 1 -- 172.21.15.97:0/1655381625 wait complete. 2023-12-04T05:39:56.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 Processor -- start 2023-12-04T05:39:56.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- start start 2023-12-04T05:39:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 0x7f5060154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 0x7f50600aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060154040 con 0x7f5060151e10 2023-12-04T05:39:56.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50600a9e10 con 0x7f50600a7290 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50600aa0f0 con 0x7f50600c5d40 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066238640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 0x7f5060154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60540/0 (socket says 172.21.15.97:60540) 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 -- 172.21.15.97:0/3918353245 learned_addr learned my addr 172.21.15.97:0/3918353245 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5065a37640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 0x7f50600aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 -- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 msgr2=0x7f50600aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 0x7f50600aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 -- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 msgr2=0x7f5060154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 0x7f5060154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 -- 172.21.15.97:0/3918353245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050009420 con 0x7f5060151e10 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5065a37640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 0x7f50600aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066238640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 0x7f5060154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:56.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5066a39640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f505800c780 tx=0x7f505800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800ce90 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800a640 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800a9d0 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50600aa3d0 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5060154570 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.328+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5060154760 con 0x7f5060151e10 2023-12-04T05:39:56.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.332+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f505800ab30 con 0x7f5060151e10 2023-12-04T05:39:56.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.332+0000 7f5056ffd640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 0x7f5044068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:56.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.332+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5058083aa0 con 0x7f5060151e10 2023-12-04T05:39:56.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.332+0000 7f5066238640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 0x7f5044068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:56.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.332+0000 7f5066238640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 0x7f5044068dc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f505c009f50 tx=0x7f505c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:56.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.336+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5058050ac0 con 0x7f5060151e10 2023-12-04T05:39:56.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5060068440 con 0x7f5060151e10 2023-12-04T05:39:56.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f5056ffd640 1 -- 172.21.15.97:0/3918353245 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5058018070 con 0x7f5060151e10 2023-12-04T05:39:56.517 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T05:39:56.518 INFO:teuthology.orchestra.run.smithi097.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-04T05:39:56.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 msgr2=0x7f5044068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 0x7f5044068dc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f505c009f50 tx=0x7f505c009190 comp rx=0 tx=0).stop 2023-12-04T05:39:56.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 msgr2=0x7f5060151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:56.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f505800c780 tx=0x7f505800cc40 comp rx=0 tx=0).stop 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 shutdown_connections 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f5044066900 0x7f5044068dc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5060151e10 0x7f5060151080 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50600c5d40 0x7f50600aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 --2- 172.21.15.97:0/3918353245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f50600a7290 0x7f5060154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 >> 172.21.15.97:0/3918353245 conn(0x7f50600c7e40 msgr2=0x7f50600c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 shutdown_connections 2023-12-04T05:39:56.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:56.516+0000 7f506849c640 1 -- 172.21.15.97:0/3918353245 wait complete. 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T05:39:56.538 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.12pKSYIkSz 2023-12-04T05:39:56.539 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-04T05:39:56.549 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.oqB0IzKPCF 2023-12-04T05:39:56.549 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /tmp/tmp.12pKSYIkSz /tmp/tmp.oqB0IzKPCF 2023-12-04T05:39:56.617 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.oqB0IzKPCF 2023-12-04T05:39:56.740 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.oqB0IzKPCF is 226B 2023-12-04T05:39:56.758 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.oqB0IzKPCF 2023-12-04T05:39:56.767 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-04T05:39:56.767 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:56.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.767 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.820 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 41945sec preferred_lft 41945sec 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 02:42:22:3c:e2:0a brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-04T05:39:56.821 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-04T05:39:56.822 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2023-12-04T05:39:56.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.823 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T05:39:56.890 INFO:teuthology.orchestra.run.smithi143.stdout:1 2023-12-04T05:39:56.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.893 DEBUG:teuthology.orchestra.run.smithi143:> route 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-04T05:39:56.946 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T05:39:56.947 INFO:teuthology.orchestra.run.smithi143.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:56.947 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:56.947 INFO:teuthology.orchestra.run.smithi143.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-04T05:39:56.947 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T05:39:56.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:56.947 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec bash -c ' 2023-12-04T05:39:56.947 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2023-12-04T05:39:56.947 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T05:39:56.947 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T05:39:56.947 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T05:39:56.948 DEBUG:teuthology.orchestra.run.smithi143:> ') 2023-12-04T05:39:57.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.044 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:39:57.055 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:39:57.055 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:57.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.055 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2023-12-04T05:39:57.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:57.120 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:57.176 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T05:39:57.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T05:39:57.176 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:57.228 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:57.228 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/tmp/tmp.12pKSYIkSz of=/dev/stdout 2023-12-04T05:39:57.283 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-04T05:39:57.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.284 DEBUG:teuthology.orchestra.run.smithi143:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:57.378 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:57.379 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:57.379 INFO:teuthology.orchestra.run.smithi143.stdout:keyring.get_secret failed 2023-12-04T05:39:57.391 INFO:teuthology.orchestra.run.smithi143.stdout:parsing options: rw,norequire_active_mds,secret=AQAlZm1ljQV/BhAA+2CHf4pLeEZjo6wRsrfqXQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T05:39:57.392 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T05:39:57.392 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: resolved to: "172.21.15.97:3300,172.21.15.143:3300,172.21.15.143:3301" 2023-12-04T05:39:57.392 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: trying mount with new device syntax: testuser@76f28696-8109-44bf-b432-6ecc5796b8c9.cephfs2=/ 2023-12-04T05:39:57.392 INFO:teuthology.orchestra.run.smithi143.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.97:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2023-12-04T05:39:57.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T05:39:57.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.396 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T05:39:57.414 INFO:teuthology.orchestra.run.smithi143.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-04T05:39:57.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:39:57.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.416 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T05:39:57.474 INFO:teuthology.orchestra.run.smithi143.stdout:client6005 2023-12-04T05:39:57.475 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:39:57.475 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:57.524 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-04T05:39:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:39:57.524 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-04T05:39:57.535 INFO:teuthology.orchestra.run.smithi097.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-04T05:39:57.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:39:57.536 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:57.536 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:57.589 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:39:57.589 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:39:57.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:39:57.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 Processor -- start 2023-12-04T05:39:57.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 -- start start 2023-12-04T05:39:57.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 0x7f356806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:57.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3568152300 con 0x7f356806be00 2023-12-04T05:39:57.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3568071580 con 0x7f356806ca50 2023-12-04T05:39:57.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f356e91d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356814ed50 con 0x7f356814e970 2023-12-04T05:39:57.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f35677fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f356806be00 0x7f3568071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40752/0 (socket says 172.21.15.97:40752) 2023-12-04T05:39:57.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f35677fe640 1 -- 172.21.15.97:0/2862316008 learned_addr learned my addr 172.21.15.97:0/2862316008 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:57.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3567fff640 1 --2- 172.21.15.97:0/2862316008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 0x7f356806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:57.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476356708 0 0) 0x7f355c001120 con 0x7f356806be00 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3550003530 con 0x7f356806be00 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030111456 0 0) 0x7f3568071580 con 0x7f356806ca50 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c001120 con 0x7f356806ca50 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3567fff640 1 -- 172.21.15.97:0/2862316008 >> v1:172.21.15.143:6789/0 conn(0x7f356806ca50 legacy=0x7f35680c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3567fff640 1 -- 172.21.15.97:0/2862316008 >> v1:172.21.15.97:6789/0 conn(0x7f356806be00 legacy=0x7f3568071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.828 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.824+0000 7f3567fff640 1 -- 172.21.15.97:0/2862316008 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356806cea0 con 0x7f356814e970 2023-12-04T05:39:57.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f3567fff640 1 --2- 172.21.15.97:0/2862316008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 0x7f356806e150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35580097f0 tx=0x7f355801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12407d3a46b976c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:57.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580ac400 con 0x7f356814e970 2023-12-04T05:39:57.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35580a8050 con 0x7f356814e970 2023-12-04T05:39:57.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f3566ffd640 1 -- 172.21.15.97:0/2862316008 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580ac760 con 0x7f356814e970 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 -- 172.21.15.97:0/2862316008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 msgr2=0x7f356806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 --2- 172.21.15.97:0/2862316008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 0x7f356806e150 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35580097f0 tx=0x7f355801c3a0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 -- 172.21.15.97:0/2862316008 shutdown_connections 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 --2- 172.21.15.97:0/2862316008 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356814e970 0x7f356806e150 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 -- 172.21.15.97:0/2862316008 >> 172.21.15.97:0/2862316008 conn(0x7f35680c2970 msgr2=0x7f35680c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:57.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 -- 172.21.15.97:0/2862316008 shutdown_connections 2023-12-04T05:39:57.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.828+0000 7f356e91d640 1 -- 172.21.15.97:0/2862316008 wait complete. 2023-12-04T05:39:57.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 Processor -- start 2023-12-04T05:39:57.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- start start 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356806be00 0x7f35681416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f356814e970 0x7f3568144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568144730 con 0x7f356806ca50 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568141c20 con 0x7f356814e970 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3568141440 con 0x7f356806be00 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:57.835 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60550/0 (socket says 172.21.15.97:60550) 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 -- 172.21.15.97:0/294597740 learned_addr learned my addr 172.21.15.97:0/294597740 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f3567fff640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356806be00 0x7f35681416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356ceba640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f356814e970 0x7f3568144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 -- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356806be00 msgr2=0x7f35681416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356806be00 0x7f35681416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 -- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f356814e970 msgr2=0x7f3568144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f356814e970 0x7f3568144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 -- 172.21.15.97:0/294597740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009420 con 0x7f356806ca50 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f35677fe640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c700 tx=0x7f355c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c005ac0 con 0x7f356806ca50 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c005c40 con 0x7f356806ca50 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c007070 con 0x7f356806ca50 2023-12-04T05:39:57.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3568150f50 con 0x7f356806ca50 2023-12-04T05:39:57.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.832+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35681511f0 con 0x7f356806ca50 2023-12-04T05:39:57.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35681448a0 con 0x7f356806ca50 2023-12-04T05:39:57.837 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f355c0071f0 con 0x7f356806ca50 2023-12-04T05:39:57.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f3564ff9640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 0x7f3554068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:57.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f355c083bf0 con 0x7f356806ca50 2023-12-04T05:39:57.838 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f3567fff640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 0x7f3554068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:57.839 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.836+0000 7f3567fff640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 0x7f3554068dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f35580ae000 tx=0x7f35580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:57.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.840+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f355c050c10 con 0x7f356806ca50 2023-12-04T05:39:57.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.992+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3568152300 con 0x7f356806ca50 2023-12-04T05:39:57.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f3564ff9640 1 -- 172.21.15.97:0/294597740 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f3568152300 con 0x7f356806ca50 2023-12-04T05:39:57.997 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:39:57.997 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 msgr2=0x7f3554068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 0x7f3554068dc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f35580ae000 tx=0x7f35580a7000 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 msgr2=0x7f35680bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c700 tx=0x7f355c00cbc0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 shutdown_connections 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3554066900 0x7f3554068dc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f356814e970 0x7f3568144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f356806ca50 0x7f35680bf500 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 --2- 172.21.15.97:0/294597740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f356806be00 0x7f35681416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 >> 172.21.15.97:0/294597740 conn(0x7f35680c2970 msgr2=0x7f3568070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 shutdown_connections 2023-12-04T05:39:57.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:57.996+0000 7f356e91d640 1 -- 172.21.15.97:0/294597740 wait complete. 2023-12-04T05:39:58.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:39:58.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:39:58.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 Processor -- start 2023-12-04T05:39:58.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 -- start start 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f40c1360 0x7fb0f40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f4150bc0 con 0x7fb0f406c000 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4154fd0 con 0x7fb0f40c1360 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f9bc3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4151a70 con 0x7fb0f4154af0 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f40c1360 0x7fb0f40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb0f40c1360 0x7fb0f40700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60562/0 (socket says 172.21.15.97:60562) 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2426027432 learned_addr learned my addr 172.21.15.97:0/2426027432 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0ebfff640 1 --1- 172.21.15.97:0/2426027432 >> v1:172.21.15.97:6789/0 conn(0x7fb0f406c000 0x7fb0f4151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40766/0 (socket says 172.21.15.97:40766) 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2426027432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 msgr2=0x7fb0f414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2426027432 >> v1:172.21.15.97:6789/0 conn(0x7fb0f406c000 legacy=0x7fb0f4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/2426027432 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111746910 0 0) 0x7fb0f4150bc0 con 0x7fb0f406c000 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2426027432 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4072160 con 0x7fb0f40c1360 2023-12-04T05:39:58.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.160+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:39:58.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1360 0x7fb0f40700b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400bb10 tx=0x7fb0e401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a7a6657a9d111c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/2426027432 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40a7b40 con 0x7fb0f40c1360 2023-12-04T05:39:58.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/2426027432 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40a7ca0 con 0x7fb0f40c1360 2023-12-04T05:39:58.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f2ffd640 1 -- 172.21.15.97:0/2426027432 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40af660 con 0x7fb0f40c1360 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2426027432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1360 msgr2=0x7fb0f40700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1360 0x7fb0f40700b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400bb10 tx=0x7fb0e401eb80 comp rx=0 tx=0).stop 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2426027432 shutdown_connections 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2426027432 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f40c1360 0x7fb0f40700b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2426027432 >> 172.21.15.97:0/2426027432 conn(0x7fb0f40c5e70 msgr2=0x7fb0f40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2426027432 shutdown_connections 2023-12-04T05:39:58.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.164+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2426027432 wait complete. 2023-12-04T05:39:58.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 Processor -- start 2023-12-04T05:39:58.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- start start 2023-12-04T05:39:58.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 0x7fb0f40a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f4145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4147390 con 0x7fb0f406c000 2023-12-04T05:39:58.171 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40c57e0 con 0x7fb0f40c1360 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4155de0 con 0x7fb0f4154af0 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60570/0 (socket says 172.21.15.97:60570) 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2455718636 learned_addr learned my addr 172.21.15.97:0/2455718636 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0ebfff640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 0x7fb0f40a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f3fff640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f4145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 msgr2=0x7fb0f4145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f4145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 msgr2=0x7fb0f40a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 0x7fb0f40a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 -- 172.21.15.97:0/2455718636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e400b770 con 0x7fb0f406c000 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0ebfff640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 0x7fb0f40a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f37fe640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401c7b0 tx=0x7fb0e401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40ba480 con 0x7fb0f406c000 2023-12-04T05:39:58.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40ba600 con 0x7fb0f406c000 2023-12-04T05:39:58.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40ba9b0 con 0x7fb0f406c000 2023-12-04T05:39:58.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4153cc0 con 0x7fb0f406c000 2023-12-04T05:39:58.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.168+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4146fb0 con 0x7fb0f406c000 2023-12-04T05:39:58.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f4068440 con 0x7fb0f406c000 2023-12-04T05:39:58.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb0e40bab10 con 0x7fb0f406c000 2023-12-04T05:39:58.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0f0ff9640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 0x7fb0d4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb0e411fef0 con 0x7fb0f406c000 2023-12-04T05:39:58.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0ebfff640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 0x7fb0d4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.174 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.172+0000 7fb0ebfff640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 0x7fb0d4068dc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0f41496c0 tx=0x7fb0dc007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.176+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0e40ece60 con 0x7fb0f406c000 2023-12-04T05:39:58.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0f4149020 con 0x7fb0f406c000 2023-12-04T05:39:58.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f0ff9640 1 -- 172.21.15.97:0/2455718636 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0e40f0480 con 0x7fb0f406c000 2023-12-04T05:39:58.333 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:39:58.334 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 msgr2=0x7fb0d4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 0x7fb0d4068dc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb0f41496c0 tx=0x7fb0dc007c40 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 msgr2=0x7fb0f4147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401c7b0 tx=0x7fb0e401d3c0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 shutdown_connections 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb0d4066900 0x7fb0d4068dc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0f4154af0 0x7fb0f4145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0f40c1360 0x7fb0f40a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 --2- 172.21.15.97:0/2455718636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb0f406c000 0x7fb0f4147720 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 >> 172.21.15.97:0/2455718636 conn(0x7fb0f40c5e70 msgr2=0x7fb0f414cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 shutdown_connections 2023-12-04T05:39:58.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.332+0000 7fb0f9bc3640 1 -- 172.21.15.97:0/2455718636 wait complete. 2023-12-04T05:39:58.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:39:58.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 Processor -- start 2023-12-04T05:39:58.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 -- start start 2023-12-04T05:39:58.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17cc0c4590 0x7f17cc0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0c3b60 con 0x7f17cc0a5290 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc072970 con 0x7f17cc0c0660 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17d08fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc155b40 con 0x7f17cc0c4590 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17ca59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17cc0c4590 0x7f17cc0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17c9d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f17cc0a5290 0x7f17cc155f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40776/0 (socket says 172.21.15.97:40776) 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17c9d9b640 1 -- 172.21.15.97:0/1239286163 learned_addr learned my addr 172.21.15.97:0/1239286163 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.492+0000 7f17ca59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f17cc0c4590 0x7f17cc0a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60578/0 (socket says 172.21.15.97:60578) 2023-12-04T05:39:58.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17ca59c640 1 -- 172.21.15.97:0/1239286163 >> v1:172.21.15.143:6789/0 conn(0x7f17cc0c0660 legacy=0x7f17cc15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17ca59c640 1 -- 172.21.15.97:0/1239286163 >> v1:172.21.15.97:6789/0 conn(0x7f17cc0a5290 legacy=0x7f17cc155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17ca59c640 1 -- 172.21.15.97:0/1239286163 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0c5520 con 0x7f17cc0c4590 2023-12-04T05:39:58.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17c959a640 1 -- 172.21.15.97:0/1239286163 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983798212 0 0) 0x7f17cc0c3b60 con 0x7f17cc0a5290 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17ca59c640 1 --2- 172.21.15.97:0/1239286163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc0a4d50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec31c3f5bdad09e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17c959a640 1 -- 172.21.15.97:0/1239286163 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0ab600 con 0x7f17cc0c4590 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17c959a640 1 -- 172.21.15.97:0/1239286163 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0a7050 con 0x7f17cc0c4590 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.496+0000 7f17c959a640 1 -- 172.21.15.97:0/1239286163 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0ab980 con 0x7f17cc0c4590 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- 172.21.15.97:0/1239286163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 msgr2=0x7f17cc0a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 --2- 172.21.15.97:0/1239286163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc0a4d50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc01c3c0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- 172.21.15.97:0/1239286163 shutdown_connections 2023-12-04T05:39:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 --2- 172.21.15.97:0/1239286163 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc0a4d50 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- 172.21.15.97:0/1239286163 >> 172.21.15.97:0/1239286163 conn(0x7f17cc0c5c60 msgr2=0x7f17cc0c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- 172.21.15.97:0/1239286163 shutdown_connections 2023-12-04T05:39:58.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- 172.21.15.97:0/1239286163 wait complete. 2023-12-04T05:39:58.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 Processor -- start 2023-12-04T05:39:58.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- start start 2023-12-04T05:39:58.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17cc0c0660 0x7f17cc0bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc1ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc14d960 con 0x7f17cc0c4590 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0a9350 con 0x7f17cc0c0660 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17d08fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc14f530 con 0x7f17cc0a5290 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc1ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17ca59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17c9d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17cc0c0660 0x7f17cc0bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17ca59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:60164/0 (socket says 172.21.15.97:60164) 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17ca59c640 1 -- 172.21.15.97:0/469537636 learned_addr learned my addr 172.21.15.97:0/469537636 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 -- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 msgr2=0x7f17cc0a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 -- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17cc0c0660 msgr2=0x7f17cc0bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17cc0c0660 0x7f17cc0bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17cad9d640 1 -- 172.21.15.97:0/469537636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009420 con 0x7f17cc0c4590 2023-12-04T05:39:58.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.500+0000 7f17ca59c640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:39:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17cad9d640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc1ed110 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c700 tx=0x7f17c400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4003b80 con 0x7f17cc0c4590 2023-12-04T05:39:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4003ce0 con 0x7f17cc0c4590 2023-12-04T05:39:58.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4005310 con 0x7f17cc0c4590 2023-12-04T05:39:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc0a9580 con 0x7f17cc0c4590 2023-12-04T05:39:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc14eee0 con 0x7f17cc0c4590 2023-12-04T05:39:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc14f6c0 con 0x7f17cc0c4590 2023-12-04T05:39:58.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f17c4005470 con 0x7f17cc0c4590 2023-12-04T05:39:58.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 0x7f17ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f17c4084360 con 0x7f17cc0c4590 2023-12-04T05:39:58.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.504+0000 7f17ca59c640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 0x7f17ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.508+0000 7f17ca59c640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 0x7f17ac068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.508+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17c40512e0 con 0x7f17cc0c4590 2023-12-04T05:39:58.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.656+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17cc068440 con 0x7f17cc0c4590 2023-12-04T05:39:58.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.656+0000 7f17baffd640 1 -- 172.21.15.97:0/469537636 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17c4054900 con 0x7f17cc0c4590 2023-12-04T05:39:58.659 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:58.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 msgr2=0x7f17ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 0x7f17ac068d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc0a6000 comp rx=0 tx=0).stop 2023-12-04T05:39:58.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 msgr2=0x7f17cc1ed110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc1ed110 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c700 tx=0x7f17c400cbc0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 shutdown_connections 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f17ac0668d0 0x7f17ac068d90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f17cc0c4590 0x7f17cc1ed110 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17cc0c0660 0x7f17cc0bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 --2- 172.21.15.97:0/469537636 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17cc0a5290 0x7f17cc0a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 >> 172.21.15.97:0/469537636 conn(0x7f17cc0c5c60 msgr2=0x7f17cc155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 shutdown_connections 2023-12-04T05:39:58.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.660+0000 7f17d08fe640 1 -- 172.21.15.97:0/469537636 wait complete. 2023-12-04T05:39:58.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:39:58.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.816+0000 7f2b11df8640 1 Processor -- start 2023-12-04T05:39:58.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.816+0000 7f2b11df8640 1 -- start start 2023-12-04T05:39:58.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b11df8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b11df8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c072800 0x7f2b0c158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b11df8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0c154880 con 0x7f2b0c155060 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b11df8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0c06e160 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b11df8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c06e440 con 0x7f2b0c072800 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60596/0 (socket says 172.21.15.97:60596) 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2492062154 learned_addr learned my addr 172.21.15.97:0/2492062154 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2492062154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c072800 msgr2=0x7f2b0c158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 --2- 172.21.15.97:0/2492062154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c072800 0x7f2b0c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2492062154 >> v1:172.21.15.97:6789/0 conn(0x7f2b0c155060 legacy=0x7f2b0c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2492062154 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c06e720 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.820+0000 7f2b0a7fc640 1 -- 172.21.15.97:0/2492062154 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548031667 0 0) 0x7f2b0c154880 con 0x7f2b0c155060 2023-12-04T05:39:58.824 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b0b7fe640 1 --2- 172.21.15.97:0/2492062154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009e50 tx=0x7f2afc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241e18e7d77251c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b0a7fc640 1 -- 172.21.15.97:0/2492062154 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a5690 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b0a7fc640 1 -- 172.21.15.97:0/2492062154 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc0a57f0 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b0a7fc640 1 -- 172.21.15.97:0/2492062154 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a5b80 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- 172.21.15.97:0/2492062154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c0c1fb0 msgr2=0x7f2b0c0c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2492062154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009e50 tx=0x7f2afc01c8c0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- 172.21.15.97:0/2492062154 shutdown_connections 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2492062154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c072800 0x7f2b0c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2492062154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c10c0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- 172.21.15.97:0/2492062154 >> 172.21.15.97:0/2492062154 conn(0x7f2b0c0c31c0 msgr2=0x7f2b0c0c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- 172.21.15.97:0/2492062154 shutdown_connections 2023-12-04T05:39:58.826 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- 172.21.15.97:0/2492062154 wait complete. 2023-12-04T05:39:58.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 Processor -- start 2023-12-04T05:39:58.827 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.824+0000 7f2b11df8640 1 -- start start 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c155060 0x7f2b0c0aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0aa9d0 con 0x7f2b0c072800 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0c5360 con 0x7f2b0c0c1fb0 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0c0aa730 con 0x7f2b0c155060 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.829 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60604/0 (socket says 172.21.15.97:60604) 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2774565774 learned_addr learned my addr 172.21.15.97:0/2774565774 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c155060 msgr2=0x7f2b0c0aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c155060 0x7f2b0c0aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b0c0c1fb0 msgr2=0x7f2b0c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 -- 172.21.15.97:0/2774565774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009b30 con 0x7f2b0c072800 2023-12-04T05:39:58.830 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b0b7fe640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2afc01a4f0 tx=0x7f2afc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0b8670 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc0b87d0 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0b8b80 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c0c4a30 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0c0c4ff0 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0c0c5180 con 0x7f2b0c072800 2023-12-04T05:39:58.831 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.828+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2afc0b8ce0 con 0x7f2b0c072800 2023-12-04T05:39:58.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.832+0000 7f2af3fff640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 0x7f2af8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:58.832 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.832+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2afc11fdc0 con 0x7f2b0c072800 2023-12-04T05:39:58.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.832+0000 7f2b0affd640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 0x7f2af8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:58.833 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.832+0000 7f2b0affd640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 0x7f2af8068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c148b00 tx=0x7f2b00006c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:58.836 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.836+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2afc0ecc90 con 0x7f2b0c072800 2023-12-04T05:39:58.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.984+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b0c068440 con 0x7f2b0c072800 2023-12-04T05:39:58.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.984+0000 7f2af3fff640 1 -- 172.21.15.97:0/2774565774 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2afc0bc020 con 0x7f2b0c072800 2023-12-04T05:39:58.986 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 msgr2=0x7f2af8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 0x7f2af8068d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c148b00 tx=0x7f2b00006c00 comp rx=0 tx=0).stop 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 msgr2=0x7f2b0c1edc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2afc01a4f0 tx=0x7f2afc019660 comp rx=0 tx=0).stop 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 shutdown_connections 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2af80668d0 0x7f2af8068d90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.988 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b0c155060 0x7f2b0c0aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b0c0c1fb0 0x7f2b0c0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 --2- 172.21.15.97:0/2774565774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b0c072800 0x7f2b0c1edc50 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:58.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 >> 172.21.15.97:0/2774565774 conn(0x7f2b0c0c31c0 msgr2=0x7f2b0c0c0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:58.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 shutdown_connections 2023-12-04T05:39:58.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:58.988+0000 7f2b11df8640 1 -- 172.21.15.97:0/2774565774 wait complete. 2023-12-04T05:39:59.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:39:59.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 Processor -- start 2023-12-04T05:39:59.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 -- start start 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 0x7f3d041548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d04154640 con 0x7f3d04154e10 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0414ef10 con 0x7f3d0414eb30 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d09d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d040c0bd0 con 0x7f3d0414f960 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d03fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3d04154e10 0x7f3d0415bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40784/0 (socket says 172.21.15.97:40784) 2023-12-04T05:39:59.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d03fff640 1 -- 172.21.15.97:0/2308566088 learned_addr learned my addr 172.21.15.97:0/2308566088 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:39:59.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3cfbfff640 1 --2- 172.21.15.97:0/2308566088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 0x7f3d041548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457406448 0 0) 0x7f3d04154640 con 0x7f3d04154e10 2023-12-04T05:39:59.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf0003530 con 0x7f3d04154e10 2023-12-04T05:39:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539493493 0 0) 0x7f3d0414ef10 con 0x7f3d0414eb30 2023-12-04T05:39:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04154640 con 0x7f3d0414eb30 2023-12-04T05:39:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3cfbfff640 1 -- 172.21.15.97:0/2308566088 >> v1:172.21.15.143:6789/0 conn(0x7f3d0414eb30 legacy=0x7f3d0414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3cfbfff640 1 -- 172.21.15.97:0/2308566088 >> v1:172.21.15.97:6789/0 conn(0x7f3d04154e10 legacy=0x7f3d0415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.156 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.152+0000 7f3cfbfff640 1 -- 172.21.15.97:0/2308566088 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d041535a0 con 0x7f3d0414f960 2023-12-04T05:39:59.157 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3cfbfff640 1 --2- 172.21.15.97:0/2308566088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 0x7f3d041548d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0097f0 tx=0x7f3cec01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2a778ae772d8619 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0ab600 con 0x7f3d0414f960 2023-12-04T05:39:59.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0a7050 con 0x7f3d0414f960 2023-12-04T05:39:59.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d02ffd640 1 -- 172.21.15.97:0/2308566088 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0ab980 con 0x7f3d0414f960 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 -- 172.21.15.97:0/2308566088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 msgr2=0x7f3d041548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/2308566088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 0x7f3d041548d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0097f0 tx=0x7f3cec01c4c0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 -- 172.21.15.97:0/2308566088 shutdown_connections 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/2308566088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414f960 0x7f3d041548d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 -- 172.21.15.97:0/2308566088 >> 172.21.15.97:0/2308566088 conn(0x7f3d040c5e70 msgr2=0x7f3d040c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 -- 172.21.15.97:0/2308566088 shutdown_connections 2023-12-04T05:39:59.160 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.156+0000 7f3d09d1d640 1 -- 172.21.15.97:0/2308566088 wait complete. 2023-12-04T05:39:59.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 Processor -- start 2023-12-04T05:39:59.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- start start 2023-12-04T05:39:59.162 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414eb30 0x7f3d04144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d04154e10 0x7f3d04143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04145360 con 0x7f3d0414f960 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041e9370 con 0x7f3d04154e10 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041e9630 con 0x7f3d0414eb30 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60612/0 (socket says 172.21.15.97:60612) 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 -- 172.21.15.97:0/854027614 learned_addr learned my addr 172.21.15.97:0/854027614 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d037fe640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414eb30 0x7f3d04144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d03fff640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d04154e10 0x7f3d04143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 -- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414eb30 msgr2=0x7f3d04144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414eb30 0x7f3d04144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 -- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d04154e10 msgr2=0x7f3d04143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d04154e10 0x7f3d04143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 -- 172.21.15.97:0/854027614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009420 con 0x7f3d0414f960 2023-12-04T05:39:59.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3cfbfff640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0190d0 tx=0x7f3cec019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b4430 con 0x7f3d0414f960 2023-12-04T05:39:59.164 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0b45b0 con 0x7f3d0414f960 2023-12-04T05:39:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d041e9910 con 0x7f3d0414f960 2023-12-04T05:39:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b4960 con 0x7f3d0414f960 2023-12-04T05:39:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.160+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d041e9ed0 con 0x7f3d0414f960 2023-12-04T05:39:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d04068440 con 0x7f3d0414f960 2023-12-04T05:39:59.165 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3cec0b2040 con 0x7f3d0414f960 2023-12-04T05:39:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d00ff9640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 0x7f3ce4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3cec11e510 con 0x7f3d0414f960 2023-12-04T05:39:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d037fe640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 0x7f3ce4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.164+0000 7f3d037fe640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 0x7f3ce4068d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40011f0 tx=0x7f3cf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.169 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.168+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cec0eb490 con 0x7f3d0414f960 2023-12-04T05:39:59.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.320+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d040a8ac0 con 0x7f3d0414f960 2023-12-04T05:39:59.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.320+0000 7f3d00ff9640 1 -- 172.21.15.97:0/854027614 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3cec0eeab0 con 0x7f3d0414f960 2023-12-04T05:39:59.322 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 msgr2=0x7f3ce4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 0x7f3ce4068d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40011f0 tx=0x7f3cf4009040 comp rx=0 tx=0).stop 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 msgr2=0x7f3d040c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0190d0 tx=0x7f3cec019260 comp rx=0 tx=0).stop 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 shutdown_connections 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ce40668d0 0x7f3ce4068d90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.324 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3d04154e10 0x7f3d04143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d0414f960 0x7f3d040c4890 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 --2- 172.21.15.97:0/854027614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3d0414eb30 0x7f3d04144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 >> 172.21.15.97:0/854027614 conn(0x7f3d040c5e70 msgr2=0x7f3d040663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 shutdown_connections 2023-12-04T05:39:59.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.324+0000 7f3d09d1d640 1 -- 172.21.15.97:0/854027614 wait complete. 2023-12-04T05:39:59.343 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:39:59.483 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.480+0000 7f1eb1417640 1 Processor -- start 2023-12-04T05:39:59.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.480+0000 7f1eb1417640 1 -- start start 2023-12-04T05:39:59.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eb1417640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eb1417640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1eac154af0 0x7f1eac14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eb1417640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac150bc0 con 0x7f1eac0c1360 2023-12-04T05:39:59.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eb1417640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac154fd0 con 0x7f1eac154af0 2023-12-04T05:39:59.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eb1417640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac151a70 con 0x7f1eac06c000 2023-12-04T05:39:59.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:60198/0 (socket says 172.21.15.97:60198) 2023-12-04T05:39:59.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 -- 172.21.15.97:0/3856343031 learned_addr learned my addr 172.21.15.97:0/3856343031 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:59.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eaaffd640 1 --1- 172.21.15.97:0/3856343031 >> v1:172.21.15.143:6789/0 conn(0x7f1eac0c1360 0x7f1eac151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:42802/0 (socket says 172.21.15.97:42802) 2023-12-04T05:39:59.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eab7fe640 1 --2- 172.21.15.97:0/3856343031 >> v2:172.21.15.143:3300/0 conn(0x7f1eac154af0 0x7f1eac14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eaa7fc640 1 -- 172.21.15.97:0/3856343031 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377360685 0 0) 0x7f1eac150bc0 con 0x7f1eac0c1360 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1eaa7fc640 1 -- 172.21.15.97:0/3856343031 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e98003530 con 0x7f1eac0c1360 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 -- 172.21.15.97:0/3856343031 >> v2:172.21.15.143:3300/0 conn(0x7f1eac154af0 msgr2=0x7f1eac14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 --2- 172.21.15.97:0/3856343031 >> v2:172.21.15.143:3300/0 conn(0x7f1eac154af0 0x7f1eac14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 -- 172.21.15.97:0/3856343031 >> v1:172.21.15.143:6789/0 conn(0x7f1eac0c1360 legacy=0x7f1eac151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.484+0000 7f1ea27fc640 1 -- 172.21.15.97:0/3856343031 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac072160 con 0x7f1eac06c000 2023-12-04T05:39:59.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1ea27fc640 1 --2- 172.21.15.97:0/3856343031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009870 tx=0x7f1e9401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2e2c0db1e3f8b2b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eaa7fc640 1 -- 172.21.15.97:0/3856343031 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940ac600 con 0x7f1eac06c000 2023-12-04T05:39:59.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eaa7fc640 1 -- 172.21.15.97:0/3856343031 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e940a8050 con 0x7f1eac06c000 2023-12-04T05:39:59.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eaa7fc640 1 -- 172.21.15.97:0/3856343031 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940ac980 con 0x7f1eac06c000 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- 172.21.15.97:0/3856343031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 msgr2=0x7f1eac0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 --2- 172.21.15.97:0/3856343031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009870 tx=0x7f1e9401c4b0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- 172.21.15.97:0/3856343031 shutdown_connections 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 --2- 172.21.15.97:0/3856343031 >> v2:172.21.15.143:3300/0 conn(0x7f1eac154af0 0x7f1eac14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 --2- 172.21.15.97:0/3856343031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac06c000 0x7f1eac0700b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- 172.21.15.97:0/3856343031 >> 172.21.15.97:0/3856343031 conn(0x7f1eac0c5e70 msgr2=0x7f1eac0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- 172.21.15.97:0/3856343031 shutdown_connections 2023-12-04T05:39:59.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- 172.21.15.97:0/3856343031 wait complete. 2023-12-04T05:39:59.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 Processor -- start 2023-12-04T05:39:59.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.488+0000 7f1eb1417640 1 -- start start 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1eac06c000 0x7f1eac159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac154af0 0x7f1eac141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1422a0 con 0x7f1eac0c1360 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac147280 con 0x7f1eac06c000 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac147560 con 0x7f1eac154af0 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60618/0 (socket says 172.21.15.97:60618) 2023-12-04T05:39:59.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 -- 172.21.15.97:0/2933596126 learned_addr learned my addr 172.21.15.97:0/2933596126 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eaaffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1eac06c000 0x7f1eac159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eab7fe640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac154af0 0x7f1eac141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 -- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac154af0 msgr2=0x7f1eac141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac154af0 0x7f1eac141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 -- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1eac06c000 msgr2=0x7f1eac159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1eac06c000 0x7f1eac159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 -- 172.21.15.97:0/2933596126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e940094d0 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea27fc640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1e9401a0e0 tx=0x7f1e9401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940b7450 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e940b75b0 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac147840 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940b7920 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac147e00 con 0x7f1eac0c1360 2023-12-04T05:39:59.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.492+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac068440 con 0x7f1eac0c1360 2023-12-04T05:39:59.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.496+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e940b3070 con 0x7f1eac0c1360 2023-12-04T05:39:59.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.496+0000 7f1ea3fff640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 0x7f1e8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.496+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1e9411eaa0 con 0x7f1eac0c1360 2023-12-04T05:39:59.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.496+0000 7f1eaaffd640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 0x7f1e8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.496+0000 7f1eaaffd640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 0x7f1e8c068d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0011f0 tx=0x7f1e9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.500 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.500+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e940ebac0 con 0x7f1eac0c1360 2023-12-04T05:39:59.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.648+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1eac0c2430 con 0x7f1eac0c1360 2023-12-04T05:39:59.650 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.648+0000 7f1ea3fff640 1 -- 172.21.15.97:0/2933596126 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1e940ef0e0 con 0x7f1eac0c1360 2023-12-04T05:39:59.650 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:39:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 msgr2=0x7f1e8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 0x7f1e8c068d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0011f0 tx=0x7f1e9c009040 comp rx=0 tx=0).stop 2023-12-04T05:39:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 msgr2=0x7f1eac141820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f1e9401a0e0 tx=0x7f1e9401acf0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 shutdown_connections 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e8c0668d0 0x7f1e8c068d90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1eac154af0 0x7f1eac141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1eac0c1360 0x7f1eac141820 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 --2- 172.21.15.97:0/2933596126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1eac06c000 0x7f1eac159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 >> 172.21.15.97:0/2933596126 conn(0x7f1eac0c5e70 msgr2=0x7f1eac15ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 shutdown_connections 2023-12-04T05:39:59.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.652+0000 7f1eb1417640 1 -- 172.21.15.97:0/2933596126 wait complete. 2023-12-04T05:39:59.671 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 Processor -- start 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 -- start start 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f139814f960 0x7f13981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1398154e10 0x7f139815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1398154640 con 0x7f139814eb30 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980c0bd0 con 0x7f139814f960 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f139df57640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139814ef10 con 0x7f1398154e10 2023-12-04T05:39:59.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f139814f960 0x7f13981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f139814f960 0x7f13981548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60622/0 (socket says 172.21.15.97:60622) 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 -- 172.21.15.97:0/2399445705 learned_addr learned my addr 172.21.15.97:0/2399445705 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1397fff640 1 --2- 172.21.15.97:0/2399445705 >> v2:172.21.15.143:3300/0 conn(0x7f1398154e10 0x7f139815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 -- 172.21.15.97:0/2399445705 >> v2:172.21.15.143:3300/0 conn(0x7f1398154e10 msgr2=0x7f139815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 --2- 172.21.15.97:0/2399445705 >> v2:172.21.15.143:3300/0 conn(0x7f1398154e10 0x7f139815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 -- 172.21.15.97:0/2399445705 >> v1:172.21.15.97:6789/0 conn(0x7f139814eb30 legacy=0x7f139814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f1396ffd640 1 -- 172.21.15.97:0/2399445705 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13981535a0 con 0x7f139814f960 2023-12-04T05:39:59.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.808+0000 7f13967fc640 1 -- 172.21.15.97:0/2399445705 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717309277 0 0) 0x7f1398154640 con 0x7f139814eb30 2023-12-04T05:39:59.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f1396ffd640 1 --2- 172.21.15.97:0/2399445705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814f960 0x7f13981548d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f13980a8950 tx=0x7f138c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e14ffdb90fffa84 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f13967fc640 1 -- 172.21.15.97:0/2399445705 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0ac640 con 0x7f139814f960 2023-12-04T05:39:59.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f13967fc640 1 -- 172.21.15.97:0/2399445705 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0ac7a0 con 0x7f139814f960 2023-12-04T05:39:59.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f13967fc640 1 -- 172.21.15.97:0/2399445705 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0acb30 con 0x7f139814f960 2023-12-04T05:39:59.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 -- 172.21.15.97:0/2399445705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814f960 msgr2=0x7f13981548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 --2- 172.21.15.97:0/2399445705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814f960 0x7f13981548d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f13980a8950 tx=0x7f138c01c4d0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 -- 172.21.15.97:0/2399445705 shutdown_connections 2023-12-04T05:39:59.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 --2- 172.21.15.97:0/2399445705 >> v2:172.21.15.143:3300/0 conn(0x7f1398154e10 0x7f139815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 --2- 172.21.15.97:0/2399445705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814f960 0x7f13981548d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 -- 172.21.15.97:0/2399445705 >> 172.21.15.97:0/2399445705 conn(0x7f13980c5e70 msgr2=0x7f13980c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 -- 172.21.15.97:0/2399445705 shutdown_connections 2023-12-04T05:39:59.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.812+0000 7f139df57640 1 -- 172.21.15.97:0/2399445705 wait complete. 2023-12-04T05:39:59.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 Processor -- start 2023-12-04T05:39:59.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- start start 2023-12-04T05:39:59.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139814f960 0x7f13980bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1398154e10 0x7f13981ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13981ed4c0 con 0x7f139814eb30 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980aa460 con 0x7f1398154e10 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13981ed100 con 0x7f139814f960 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60638/0 (socket says 172.21.15.97:60638) 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 -- 172.21.15.97:0/3183390497 learned_addr learned my addr 172.21.15.97:0/3183390497 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f1396ffd640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139814f960 0x7f13980bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f1397fff640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1398154e10 0x7f13981ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 -- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139814f960 msgr2=0x7f13980bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.820 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139814f960 0x7f13980bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 -- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1398154e10 msgr2=0x7f13981ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1398154e10 0x7f13981ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 -- 172.21.15.97:0/3183390497 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0094d0 con 0x7f139814eb30 2023-12-04T05:39:59.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f13977fe640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f138800c4d0 tx=0x7f138800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388005480 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388003600 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1398142ce0 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880039b0 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.816+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13981432a0 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13981ed730 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1388003b10 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f137ffff640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 0x7f1384068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1388083d30 con 0x7f139814eb30 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f1396ffd640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 0x7f1384068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:39:59.823 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.820+0000 7f1396ffd640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 0x7f1384068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ae000 tx=0x7f138c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:39:59.825 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.824+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1388050d70 con 0x7f139814eb30 2023-12-04T05:39:59.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.984+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f139814f6c0 con 0x7f139814eb30 2023-12-04T05:39:59.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.984+0000 7f137ffff640 1 -- 172.21.15.97:0/3183390497 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1388017070 con 0x7f139814eb30 2023-12-04T05:39:59.987 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:39:59.989 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 msgr2=0x7f1384068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 0x7f1384068d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ae000 tx=0x7f138c008040 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 msgr2=0x7f1398141860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f138800c4d0 tx=0x7f138800c990 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 shutdown_connections 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13840668d0 0x7f1384068d90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1398154e10 0x7f13981ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139814f960 0x7f13980bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 --2- 172.21.15.97:0/3183390497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f139814eb30 0x7f1398141860 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 >> 172.21.15.97:0/3183390497 conn(0x7f13980c5e70 msgr2=0x7f1398149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 shutdown_connections 2023-12-04T05:39:59.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:39:59.988+0000 7f139df57640 1 -- 172.21.15.97:0/3183390497 wait complete. 2023-12-04T05:40:00.009 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-04T05:40:00.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:00.009 DEBUG:teuthology.orchestra.run.smithi097:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-04T05:40:00.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:40:00.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:00.037 DEBUG:teuthology.orchestra.run.smithi097:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T05:40:00.089 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:40:00.089 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:00.098 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:40:00.099 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:00.147 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:00.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.284+0000 7f1307d0f640 1 Processor -- start 2023-12-04T05:40:00.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.284+0000 7f1307d0f640 1 -- start start 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f130006b860 0x7f13000c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13000c1030 0x7f1300151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1300152090 0x7f1300157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000c15a0 con 0x7f13000c1030 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1300155220 con 0x7f130006b860 2023-12-04T05:40:00.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1307d0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000739b0 con 0x7f1300152090 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13000c1030 0x7f1300151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f13000c1030 0x7f1300151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60654/0 (socket says 172.21.15.97:60654) 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 -- 172.21.15.97:0/3090280167 learned_addr learned my addr 172.21.15.97:0/3090280167 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f1305aab640 1 --2- 172.21.15.97:0/3090280167 >> v2:172.21.15.143:3300/0 conn(0x7f130006b860 0x7f13000c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13062ac640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1300152090 0x7f1300157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 -- 172.21.15.97:0/3090280167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1300152090 msgr2=0x7f1300157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1300152090 0x7f1300157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 -- 172.21.15.97:0/3090280167 >> v2:172.21.15.143:3300/0 conn(0x7f130006b860 msgr2=0x7f13000c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 --2- 172.21.15.97:0/3090280167 >> v2:172.21.15.143:3300/0 conn(0x7f130006b860 0x7f13000c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.288+0000 7f13052aa640 1 -- 172.21.15.97:0/3090280167 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300155710 con 0x7f13000c1030 2023-12-04T05:40:00.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f13052aa640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13000c1030 0x7f1300151b50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f130006c040 tx=0x7f12f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50ae83aca00cd7c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1304aa9640 1 -- 172.21.15.97:0/3090280167 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300158af0 con 0x7f13000c1030 2023-12-04T05:40:00.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1304aa9640 1 -- 172.21.15.97:0/3090280167 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f00a7050 con 0x7f13000c1030 2023-12-04T05:40:00.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1304aa9640 1 -- 172.21.15.97:0/3090280167 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00ab820 con 0x7f13000c1030 2023-12-04T05:40:00.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- 172.21.15.97:0/3090280167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13000c1030 msgr2=0x7f1300151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13000c1030 0x7f1300151b50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f130006c040 tx=0x7f12f001c470 comp rx=0 tx=0).stop 2023-12-04T05:40:00.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- 172.21.15.97:0/3090280167 shutdown_connections 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1300152090 0x7f1300157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 --2- 172.21.15.97:0/3090280167 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f13000c1030 0x7f1300151b50 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 --2- 172.21.15.97:0/3090280167 >> v2:172.21.15.143:3300/0 conn(0x7f130006b860 0x7f13000c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- 172.21.15.97:0/3090280167 >> 172.21.15.97:0/3090280167 conn(0x7f13000c3130 msgr2=0x7f13000c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- 172.21.15.97:0/3090280167 shutdown_connections 2023-12-04T05:40:00.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- 172.21.15.97:0/3090280167 wait complete. 2023-12-04T05:40:00.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 Processor -- start 2023-12-04T05:40:00.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.292+0000 7f1307d0f640 1 -- start start 2023-12-04T05:40:00.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13000c1030 0x7f13000c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1300152090 0x7f1300070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c4c30 con 0x7f130006b860 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c4e80 con 0x7f1300152090 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001f0ed0 con 0x7f13000c1030 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60662/0 (socket says 172.21.15.97:60662) 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 -- 172.21.15.97:0/2026076999 learned_addr learned my addr 172.21.15.97:0/2026076999 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f13052aa640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13000c1030 0x7f13000c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f13062ac640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1300152090 0x7f1300070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 -- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13000c1030 msgr2=0x7f13000c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13000c1030 0x7f13000c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 -- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1300152090 msgr2=0x7f1300070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1300152090 0x7f1300070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 -- 172.21.15.97:0/2026076999 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00094d0 con 0x7f130006b860 2023-12-04T05:40:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1305aab640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00e8b0 tx=0x7f12fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00c940 con 0x7f130006b860 2023-12-04T05:40:00.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc00caa0 con 0x7f130006b860 2023-12-04T05:40:00.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000c6050 con 0x7f130006b860 2023-12-04T05:40:00.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00ce30 con 0x7f130006b860 2023-12-04T05:40:00.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000aa280 con 0x7f130006b860 2023-12-04T05:40:00.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13000c5040 con 0x7f130006b860 2023-12-04T05:40:00.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.296+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f12fc013470 con 0x7f130006b860 2023-12-04T05:40:00.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.300+0000 7f12f67fc640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 0x7f12e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.300+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f12fc084cc0 con 0x7f130006b860 2023-12-04T05:40:00.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.300+0000 7f13052aa640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 0x7f12e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.300 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.300+0000 7f13052aa640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 0x7f12e4068d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f12f00ad000 tx=0x7f12f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.304 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.304+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12fc08b080 con 0x7f130006b860 2023-12-04T05:40:00.453 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.452+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1300068440 con 0x7f130006b860 2023-12-04T05:40:00.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.452+0000 7f12f67fc640 1 -- 172.21.15.97:0/2026076999 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f12fc017090 con 0x7f130006b860 2023-12-04T05:40:00.455 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:00.455 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:00.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 msgr2=0x7f12e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 0x7f12e4068d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f12f00ad000 tx=0x7f12f0008040 comp rx=0 tx=0).stop 2023-12-04T05:40:00.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 msgr2=0x7f13000a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00e8b0 tx=0x7f12fc00ed70 comp rx=0 tx=0).stop 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 shutdown_connections 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f12e40668d0 0x7f12e4068d90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1300152090 0x7f1300070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f13000c1030 0x7f13000c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 --2- 172.21.15.97:0/2026076999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f130006b860 0x7f13000a9ac0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 >> 172.21.15.97:0/2026076999 conn(0x7f13000c3130 msgr2=0x7f1300150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 shutdown_connections 2023-12-04T05:40:00.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.456+0000 7f1307d0f640 1 -- 172.21.15.97:0/2026076999 wait complete. 2023-12-04T05:40:00.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:40:00.476 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:40:00.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.612+0000 7f30a2cea640 1 Processor -- start 2023-12-04T05:40:00.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.612+0000 7f30a2cea640 1 -- start start 2023-12-04T05:40:00.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a2cea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 0x7f309c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a2cea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 0x7f309c0a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a2cea640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c0aa240 con 0x7f309c0a89a0 2023-12-04T05:40:00.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a2cea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c06c0c0 con 0x7f309c0c1e70 2023-12-04T05:40:00.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a2cea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0aa500 con 0x7f309c06c440 2023-12-04T05:40:00.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a1287640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f309c0a89a0 0x7f309c06d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40804/0 (socket says 172.21.15.97:40804) 2023-12-04T05:40:00.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a1287640 1 -- 172.21.15.97:0/80679348 learned_addr learned my addr 172.21.15.97:0/80679348 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a0a86640 1 --2- 172.21.15.97:0/80679348 >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 0x7f309c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309bfff640 1 --2- 172.21.15.97:0/80679348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 0x7f309c0a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282961760 0 0) 0x7f309c0aa240 con 0x7f309c0a89a0 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308c003530 con 0x7f309c0a89a0 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061228066 0 0) 0x7f308c003530 con 0x7f309c0a89a0 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309bfff640 1 -- 172.21.15.97:0/80679348 >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 msgr2=0x7f309c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309bfff640 1 --2- 172.21.15.97:0/80679348 >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 0x7f309c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309bfff640 1 -- 172.21.15.97:0/80679348 >> v1:172.21.15.97:6789/0 conn(0x7f309c0a89a0 legacy=0x7f309c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f309bfff640 1 -- 172.21.15.97:0/80679348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c0aa7e0 con 0x7f309c06c440 2023-12-04T05:40:00.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.616+0000 7f30a0a86640 1 --2- 172.21.15.97:0/80679348 >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 0x7f309c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:00.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f309bfff640 1 --2- 172.21.15.97:0/80679348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 0x7f309c0a8460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30880097c0 tx=0x7f308801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcbd81bec864017 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094001a00 con 0x7f309c06c440 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880a7050 con 0x7f309c06c440 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f309b7fe640 1 -- 172.21.15.97:0/80679348 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880ab620 con 0x7f309c06c440 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- 172.21.15.97:0/80679348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 msgr2=0x7f309c0a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 --2- 172.21.15.97:0/80679348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 0x7f309c0a8460 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30880097c0 tx=0x7f308801c370 comp rx=0 tx=0).stop 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- 172.21.15.97:0/80679348 shutdown_connections 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 --2- 172.21.15.97:0/80679348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c06c440 0x7f309c0a8460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 --2- 172.21.15.97:0/80679348 >> v2:172.21.15.143:3300/0 conn(0x7f309c0c1e70 0x7f309c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- 172.21.15.97:0/80679348 >> 172.21.15.97:0/80679348 conn(0x7f309c0c5e70 msgr2=0x7f309c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- 172.21.15.97:0/80679348 shutdown_connections 2023-12-04T05:40:00.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- 172.21.15.97:0/80679348 wait complete. 2023-12-04T05:40:00.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 Processor -- start 2023-12-04T05:40:00.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.620+0000 7f30a2cea640 1 -- start start 2023-12-04T05:40:00.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 0x7f309c1ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 0x7f309c1eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c140b10 con 0x7f309c06c440 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c14f8c0 con 0x7f309c0c1e70 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c142db0 con 0x7f309c0a89a0 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60666/0 (socket says 172.21.15.97:60666) 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 -- 172.21.15.97:0/1016209121 learned_addr learned my addr 172.21.15.97:0/1016209121 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a1287640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 0x7f309c1eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f309bfff640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 0x7f309c1ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 -- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 msgr2=0x7f309c1ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 0x7f309c1ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 -- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 msgr2=0x7f309c1eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 0x7f309c1eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 -- 172.21.15.97:0/1016209121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009420 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f309bfff640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 0x7f309c1ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a1287640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 0x7f309c1eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a0a86640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f309000ebe0 tx=0x7f309000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000eee0 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000cc30 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3088009420 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090013470 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c0c23d0 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c068440 con 0x7f309c06c440 2023-12-04T05:40:00.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.624+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30900135d0 con 0x7f309c06c440 2023-12-04T05:40:00.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.628+0000 7f30997fa640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.628+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3090084a10 con 0x7f309c06c440 2023-12-04T05:40:00.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.628+0000 7f309bfff640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.628+0000 7f309bfff640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30880ad000 tx=0x7f3088008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.632+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3090051980 con 0x7f309c06c440 2023-12-04T05:40:00.782 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.780+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f309c06c220 con 0x7f309c06c440 2023-12-04T05:40:00.783 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.780+0000 7f30997fa640 1 -- 172.21.15.97:0/1016209121 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3090054fa0 con 0x7f309c06c440 2023-12-04T05:40:00.783 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 msgr2=0x7f3080068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30880ad000 tx=0x7f3088008040 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 msgr2=0x7f309c1422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f309000ebe0 tx=0x7f309000c520 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 shutdown_connections 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f30800668d0 0x7f3080068d90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f309c0c1e70 0x7f309c1eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f309c0a89a0 0x7f309c1ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 --2- 172.21.15.97:0/1016209121 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f309c06c440 0x7f309c1422a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 >> 172.21.15.97:0/1016209121 conn(0x7f309c0c5e70 msgr2=0x7f309c0c1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:00.785 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 shutdown_connections 2023-12-04T05:40:00.786 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.784+0000 7f30a2cea640 1 -- 172.21.15.97:0/1016209121 wait complete. 2023-12-04T05:40:00.804 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:40:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 Processor -- start 2023-12-04T05:40:00.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 -- start start 2023-12-04T05:40:00.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5141548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe514154640 con 0x7fe514154e10 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51414ef10 con 0x7fe51414eb30 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe519d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140c0bd0 con 0x7fe51414f960 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe513fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe514154e10 0x7fe51415bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40818/0 (socket says 172.21.15.97:40818) 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe513fff640 1 -- 172.21.15.97:0/3878988503 learned_addr learned my addr 172.21.15.97:0/3878988503 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe50bfff640 1 --2- 172.21.15.97:0/3878988503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5141548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127045408 0 0) 0x7fe514154640 con 0x7fe514154e10 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe500003530 con 0x7fe514154e10 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357055690 0 0) 0x7fe51414ef10 con 0x7fe51414eb30 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe514154640 con 0x7fe51414eb30 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe50bfff640 1 -- 172.21.15.97:0/3878988503 >> v1:172.21.15.143:6789/0 conn(0x7fe51414eb30 legacy=0x7fe51414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe50bfff640 1 -- 172.21.15.97:0/3878988503 >> v1:172.21.15.97:6789/0 conn(0x7fe514154e10 legacy=0x7fe51415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.944+0000 7fe50bfff640 1 -- 172.21.15.97:0/3878988503 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5141535a0 con 0x7fe51414f960 2023-12-04T05:40:00.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe50bfff640 1 --2- 172.21.15.97:0/3878988503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5141548d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0097f0 tx=0x7fe4fc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd477852c97b5a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0ab600 con 0x7fe51414f960 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0a7050 con 0x7fe51414f960 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe512ffd640 1 -- 172.21.15.97:0/3878988503 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0ab980 con 0x7fe51414f960 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 -- 172.21.15.97:0/3878988503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 msgr2=0x7fe5141548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 --2- 172.21.15.97:0/3878988503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5141548d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0097f0 tx=0x7fe4fc01c4c0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 -- 172.21.15.97:0/3878988503 shutdown_connections 2023-12-04T05:40:00.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 --2- 172.21.15.97:0/3878988503 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5141548d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 -- 172.21.15.97:0/3878988503 >> 172.21.15.97:0/3878988503 conn(0x7fe5140c5e70 msgr2=0x7fe5140c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:00.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 -- 172.21.15.97:0/3878988503 shutdown_connections 2023-12-04T05:40:00.953 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.948+0000 7fe519d1d640 1 -- 172.21.15.97:0/3878988503 wait complete. 2023-12-04T05:40:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 Processor -- start 2023-12-04T05:40:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- start start 2023-12-04T05:40:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5140c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe514154e10 0x7fe5140c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514145a70 con 0x7fe51414eb30 2023-12-04T05:40:00.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51406c930 con 0x7fe514154e10 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51406ce90 con 0x7fe51414f960 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60674/0 (socket says 172.21.15.97:60674) 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 -- 172.21.15.97:0/571369768 learned_addr learned my addr 172.21.15.97:0/571369768 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 -- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 msgr2=0x7fe5140c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5140c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 -- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe514154e10 msgr2=0x7fe5140c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe514154e10 0x7fe5140c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:00.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 -- 172.21.15.97:0/571369768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc009420 con 0x7fe51414eb30 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe5137fe640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe50400c490 tx=0x7fe50400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040052d0 con 0x7fe51414eb30 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504005430 con 0x7fe51414eb30 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51406d430 con 0x7fe51414eb30 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504012870 con 0x7fe51414eb30 2023-12-04T05:40:00.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.952+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51406d6d0 con 0x7fe51414eb30 2023-12-04T05:40:00.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51406d2a0 con 0x7fe51414eb30 2023-12-04T05:40:00.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe5040129d0 con 0x7fe51414eb30 2023-12-04T05:40:00.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe510ff9640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 0x7fe4f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:00.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe504084390 con 0x7fe51414eb30 2023-12-04T05:40:00.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe50bfff640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 0x7fe4f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:00.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.956+0000 7fe50bfff640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 0x7fe4f4068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0ad000 tx=0x7fe4fc004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:00.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:00.960+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe504051260 con 0x7fe51414eb30 2023-12-04T05:40:01.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe51406d8c0 con 0x7fe51414eb30 2023-12-04T05:40:01.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe510ff9640 1 -- 172.21.15.97:0/571369768 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe504054880 con 0x7fe51414eb30 2023-12-04T05:40:01.114 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:40:01.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 msgr2=0x7fe4f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 0x7fe4f4068d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0ad000 tx=0x7fe4fc004740 comp rx=0 tx=0).stop 2023-12-04T05:40:01.115 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 msgr2=0x7fe5140bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe50400c490 tx=0x7fe50400c950 comp rx=0 tx=0).stop 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 shutdown_connections 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe4f40668d0 0x7fe4f4068d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe514154e10 0x7fe5140c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe51414f960 0x7fe5140c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 --2- 172.21.15.97:0/571369768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe51414eb30 0x7fe5140bf500 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 >> 172.21.15.97:0/571369768 conn(0x7fe5140c5e70 msgr2=0x7fe51414cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 shutdown_connections 2023-12-04T05:40:01.116 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.112+0000 7fe519d1d640 1 -- 172.21.15.97:0/571369768 wait complete. 2023-12-04T05:40:01.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:40:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 Processor -- start 2023-12-04T05:40:01.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 -- start start 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 0x7f094c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f094c14f790 0x7f094c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c154640 con 0x7f094c154e10 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c0c0bd0 con 0x7f094c14f790 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.276+0000 7f0950c5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c14ef10 con 0x7f094c14eb30 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094ad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f094c154e10 0x7f094c151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40832/0 (socket says 172.21.15.97:40832) 2023-12-04T05:40:01.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094ad9d640 1 -- 172.21.15.97:0/354544060 learned_addr learned my addr 172.21.15.97:0/354544060 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094a59c640 1 --2- 172.21.15.97:0/354544060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 0x7f094c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f0941d9b640 1 --2- 172.21.15.97:0/354544060 >> v2:172.21.15.143:3300/0 conn(0x7f094c14f790 0x7f094c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f0949d9b640 1 -- 172.21.15.97:0/354544060 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925176912 0 0) 0x7f094c154640 con 0x7f094c154e10 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f0949d9b640 1 -- 172.21.15.97:0/354544060 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938003530 con 0x7f094c154e10 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094a59c640 1 -- 172.21.15.97:0/354544060 >> v2:172.21.15.143:3300/0 conn(0x7f094c14f790 msgr2=0x7f094c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094a59c640 1 --2- 172.21.15.97:0/354544060 >> v2:172.21.15.143:3300/0 conn(0x7f094c14f790 0x7f094c1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094a59c640 1 -- 172.21.15.97:0/354544060 >> v1:172.21.15.97:6789/0 conn(0x7f094c154e10 legacy=0x7f094c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.280+0000 7f094a59c640 1 -- 172.21.15.97:0/354544060 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1535a0 con 0x7f094c14eb30 2023-12-04T05:40:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f094a59c640 1 --2- 172.21.15.97:0/354544060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 0x7f094c14f250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f093c009d90 tx=0x7f093c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67f4723e234c4cb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0949d9b640 1 -- 172.21.15.97:0/354544060 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0a58f0 con 0x7f094c14eb30 2023-12-04T05:40:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0949d9b640 1 -- 172.21.15.97:0/354544060 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c0a5a50 con 0x7f094c14eb30 2023-12-04T05:40:01.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0949d9b640 1 -- 172.21.15.97:0/354544060 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0a5de0 con 0x7f094c14eb30 2023-12-04T05:40:01.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- 172.21.15.97:0/354544060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 msgr2=0x7f094c14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 --2- 172.21.15.97:0/354544060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 0x7f094c14f250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f093c009d90 tx=0x7f093c01c920 comp rx=0 tx=0).stop 2023-12-04T05:40:01.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- 172.21.15.97:0/354544060 shutdown_connections 2023-12-04T05:40:01.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 --2- 172.21.15.97:0/354544060 >> v2:172.21.15.143:3300/0 conn(0x7f094c14f790 0x7f094c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 --2- 172.21.15.97:0/354544060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c14eb30 0x7f094c14f250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- 172.21.15.97:0/354544060 >> 172.21.15.97:0/354544060 conn(0x7f094c0c5e70 msgr2=0x7f094c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- 172.21.15.97:0/354544060 shutdown_connections 2023-12-04T05:40:01.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- 172.21.15.97:0/354544060 wait complete. 2023-12-04T05:40:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 Processor -- start 2023-12-04T05:40:01.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.284+0000 7f0950c5f640 1 -- start start 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 0x7f094c1f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c154e10 0x7f094c13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1493c0 con 0x7f094c14eb30 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c144880 con 0x7f094c14f790 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c14ae70 con 0x7f094c154e10 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60686/0 (socket says 172.21.15.97:60686) 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 -- 172.21.15.97:0/3841402989 learned_addr learned my addr 172.21.15.97:0/3841402989 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0941d9b640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 0x7f094c1f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094ad9d640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c154e10 0x7f094c13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 -- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c154e10 msgr2=0x7f094c13d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c154e10 0x7f094c13d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 -- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 msgr2=0x7f094c1f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 0x7f094c1f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 -- 172.21.15.97:0/3841402989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009a70 con 0x7f094c14eb30 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0941d9b640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 0x7f094c1f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f094a59c640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f093c01a550 tx=0x7f093c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0ad850 con 0x7f094c14eb30 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c0ad9b0 con 0x7f094c14eb30 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0add40 con 0x7f094c14eb30 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1f0d70 con 0x7f094c14eb30 2023-12-04T05:40:01.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c071a60 con 0x7f094c14eb30 2023-12-04T05:40:01.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c1f0b40 con 0x7f094c14eb30 2023-12-04T05:40:01.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.288+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f093c0b4050 con 0x7f094c14eb30 2023-12-04T05:40:01.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.292+0000 7f09437fe640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.292+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f093c11f600 con 0x7f094c14eb30 2023-12-04T05:40:01.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.292+0000 7f0941d9b640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.293 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.292+0000 7f0941d9b640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 0x7f092c068d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f094c149c70 tx=0x7f0934008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.296+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f094c1f0b40 con 0x7f094c14eb30 2023-12-04T05:40:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f094c1f0b40 con 0x7f094c14eb30 2023-12-04T05:40:01.445 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f09437fe640 1 -- 172.21.15.97:0/3841402989 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f094c1f0b40 con 0x7f094c14eb30 2023-12-04T05:40:01.446 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 msgr2=0x7f092c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 0x7f092c068d90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f094c149c70 tx=0x7f0934008040 comp rx=0 tx=0).stop 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 msgr2=0x7f094c142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f093c01a550 tx=0x7f093c0196c0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 shutdown_connections 2023-12-04T05:40:01.447 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f092c0668d0 0x7f092c068d90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f094c154e10 0x7f094c13d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f094c14f790 0x7f094c1f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 --2- 172.21.15.97:0/3841402989 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f094c14eb30 0x7f094c142c20 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 >> 172.21.15.97:0/3841402989 conn(0x7f094c0c5e70 msgr2=0x7f094c0c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 shutdown_connections 2023-12-04T05:40:01.448 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.444+0000 7f0950c5f640 1 -- 172.21.15.97:0/3841402989 wait complete. 2023-12-04T05:40:01.469 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:40:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 Processor -- start 2023-12-04T05:40:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 -- start start 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e6006c440 0x7f9e601524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e6006d210 0x7f9e6006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e600aa240 con 0x7f9e600c1e70 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6006c0c0 con 0x7f9e6006c440 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.608+0000 7f9e67b2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600aa500 con 0x7f9e6006d210 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e6006c440 0x7f9e601524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e660c7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9e6006d210 0x7f9e6006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9e6006c440 0x7f9e601524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60698/0 (socket says 172.21.15.97:60698) 2023-12-04T05:40:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 -- 172.21.15.97:0/1319446448 learned_addr learned my addr 172.21.15.97:0/1319446448 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 -- 172.21.15.97:0/1319446448 >> v2:172.21.15.143:3300/0 conn(0x7f9e6006d210 msgr2=0x7f9e6006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 --2- 172.21.15.97:0/1319446448 >> v2:172.21.15.143:3300/0 conn(0x7f9e6006d210 0x7f9e6006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 -- 172.21.15.97:0/1319446448 >> v1:172.21.15.143:6789/0 conn(0x7f9e600c1e70 legacy=0x7f9e600a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 -- 172.21.15.97:0/1319446448 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600aa7e0 con 0x7f9e6006c440 2023-12-04T05:40:01.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e650c5640 1 --2- 172.21.15.97:0/1319446448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006c440 0x7f9e601524e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9e60150020 tx=0x7f9e5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdf8ea79ca2aab1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e648c4640 1 -- 172.21.15.97:0/1319446448 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500ac640 con 0x7f9e6006c440 2023-12-04T05:40:01.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e648c4640 1 -- 172.21.15.97:0/1319446448 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500ac7a0 con 0x7f9e6006c440 2023-12-04T05:40:01.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.612+0000 7f9e648c4640 1 -- 172.21.15.97:0/1319446448 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500acb30 con 0x7f9e6006c440 2023-12-04T05:40:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1319446448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006c440 msgr2=0x7f9e601524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1319446448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006c440 0x7f9e601524e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9e60150020 tx=0x7f9e5001c4d0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1319446448 shutdown_connections 2023-12-04T05:40:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1319446448 >> v2:172.21.15.143:3300/0 conn(0x7f9e6006d210 0x7f9e6006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1319446448 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006c440 0x7f9e601524e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1319446448 >> 172.21.15.97:0/1319446448 conn(0x7f9e600c5e70 msgr2=0x7f9e600c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1319446448 shutdown_connections 2023-12-04T05:40:01.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1319446448 wait complete. 2023-12-04T05:40:01.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 Processor -- start 2023-12-04T05:40:01.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- start start 2023-12-04T05:40:01.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6006c440 0x7f9e601435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e600c1e70 0x7f9e6014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601454f0 con 0x7f9e6006d210 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60144f30 con 0x7f9e6006c440 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e67b2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e60145210 con 0x7f9e600c1e70 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60704/0 (socket says 172.21.15.97:60704) 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 -- 172.21.15.97:0/1433741042 learned_addr learned my addr 172.21.15.97:0/1433741042 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e658c6640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6006c440 0x7f9e601435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e660c7640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e600c1e70 0x7f9e6014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 -- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e600c1e70 msgr2=0x7f9e6014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e600c1e70 0x7f9e6014cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 -- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6006c440 msgr2=0x7f9e601435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6006c440 0x7f9e601435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.616+0000 7f9e650c5640 1 -- 172.21.15.97:0/1433741042 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500094d0 con 0x7f9e6006d210 2023-12-04T05:40:01.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e650c5640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9e5001a100 tx=0x7f9e5001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500bc070 con 0x7f9e6006d210 2023-12-04T05:40:01.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500b7450 con 0x7f9e6006d210 2023-12-04T05:40:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e601ecee0 con 0x7f9e6006d210 2023-12-04T05:40:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500b77e0 con 0x7f9e6006d210 2023-12-04T05:40:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e60146450 con 0x7f9e6006d210 2023-12-04T05:40:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e60068440 con 0x7f9e6006d210 2023-12-04T05:40:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e500b3070 con 0x7f9e6006d210 2023-12-04T05:40:01.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 0x7f9e44068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e5011e440 con 0x7f9e6006d210 2023-12-04T05:40:01.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.620+0000 7f9e658c6640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 0x7f9e44068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.624+0000 7f9e658c6640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 0x7f9e44068dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9e600729c0 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.624+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e500eb310 con 0x7f9e6006d210 2023-12-04T05:40:01.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.772+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e6006c220 con 0x7f9e6006d210 2023-12-04T05:40:01.776 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e567fc640 1 -- 172.21.15.97:0/1433741042 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9e500f3e60 con 0x7f9e6006d210 2023-12-04T05:40:01.776 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:40:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 msgr2=0x7f9e44068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 0x7f9e44068dc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9e600729c0 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-12-04T05:40:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 msgr2=0x7f9e60145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9e5001a100 tx=0x7f9e5001ad10 comp rx=0 tx=0).stop 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 shutdown_connections 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9e44066900 0x7f9e44068dc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e600c1e70 0x7f9e6014cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e6006d210 0x7f9e60145f10 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 --2- 172.21.15.97:0/1433741042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6006c440 0x7f9e601435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 >> 172.21.15.97:0/1433741042 conn(0x7f9e600c5e70 msgr2=0x7f9e600bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 shutdown_connections 2023-12-04T05:40:01.779 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.776+0000 7f9e67b2a640 1 -- 172.21.15.97:0/1433741042 wait complete. 2023-12-04T05:40:01.796 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:40:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 Processor -- start 2023-12-04T05:40:01.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 -- start start 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e3c14eb30 0x7f1e3c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c154640 con 0x7f1e3c14f790 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c0bd0 con 0x7f1e3c14eb30 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e40ce3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c14ef10 con 0x7f1e3c154fe0 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e3c14eb30 0x7f1e3c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f1e3c14eb30 0x7f1e3c14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60714/0 (socket says 172.21.15.97:60714) 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 -- 172.21.15.97:0/300933355 learned_addr learned my addr 172.21.15.97:0/300933355 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e31d9b640 1 --1- 172.21.15.97:0/300933355 >> v1:172.21.15.97:6789/0 conn(0x7f1e3c14f790 0x7f1e3c1548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40844/0 (socket says 172.21.15.97:40844) 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 -- 172.21.15.97:0/300933355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 msgr2=0x7f1e3c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 --2- 172.21.15.97:0/300933355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 -- 172.21.15.97:0/300933355 >> v1:172.21.15.97:6789/0 conn(0x7f1e3c14f790 legacy=0x7f1e3c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.936+0000 7f1e3a59c640 1 -- 172.21.15.97:0/300933355 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c1535a0 con 0x7f1e3c14eb30 2023-12-04T05:40:01.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e3a59c640 1 --2- 172.21.15.97:0/300933355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c14f250 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e50 tx=0x7f1e2c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2509a41da3c53251 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e39d9b640 1 -- 172.21.15.97:0/300933355 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0a58a0 con 0x7f1e3c14eb30 2023-12-04T05:40:01.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e39d9b640 1 -- 172.21.15.97:0/300933355 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0a5a00 con 0x7f1e3c14eb30 2023-12-04T05:40:01.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e39d9b640 1 -- 172.21.15.97:0/300933355 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0a5d90 con 0x7f1e3c14eb30 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- 172.21.15.97:0/300933355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 msgr2=0x7f1e3c14f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/300933355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c14f250 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e50 tx=0x7f1e2c01c9e0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- 172.21.15.97:0/300933355 shutdown_connections 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/300933355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/300933355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c14f250 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- 172.21.15.97:0/300933355 >> 172.21.15.97:0/300933355 conn(0x7f1e3c0c5e70 msgr2=0x7f1e3c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- 172.21.15.97:0/300933355 shutdown_connections 2023-12-04T05:40:01.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- 172.21.15.97:0/300933355 wait complete. 2023-12-04T05:40:01.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 Processor -- start 2023-12-04T05:40:01.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.940+0000 7f1e40ce3640 1 -- start start 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e3c14f790 0x7f1e3c1ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c1ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0a9d60 con 0x7f1e3c14eb30 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c071a40 con 0x7f1e3c14f790 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c071f70 con 0x7f1e3c154fe0 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60718/0 (socket says 172.21.15.97:60718) 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 -- 172.21.15.97:0/1848668243 learned_addr learned my addr 172.21.15.97:0/1848668243 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e31d9b640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e3c14f790 0x7f1e3c1ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3ad9d640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c1ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 -- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 msgr2=0x7f1e3c1ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c1ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 -- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e3c14f790 msgr2=0x7f1e3c1ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e3c14f790 0x7f1e3c1ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 -- 172.21.15.97:0/1848668243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009b30 con 0x7f1e3c14eb30 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3ad9d640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c1ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e3a59c640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c01a610 tx=0x7f1e2c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0b8880 con 0x7f1e3c14eb30 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0b8a00 con 0x7f1e3c14eb30 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0b8db0 con 0x7f1e3c14eb30 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c14fd20 con 0x7f1e3c14eb30 2023-12-04T05:40:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c1f0a20 con 0x7f1e3c14eb30 2023-12-04T05:40:01.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.944+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c068440 con 0x7f1e3c14eb30 2023-12-04T05:40:01.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.948+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e2c0b6440 con 0x7f1e3c14eb30 2023-12-04T05:40:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.948+0000 7f1e337fe640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 0x7f1e1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.948+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1e2c11ff50 con 0x7f1e3c14eb30 2023-12-04T05:40:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.948+0000 7f1e31d9b640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 0x7f1e1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.948+0000 7f1e31d9b640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 0x7f1e1c068d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0c6d50 tx=0x7f1e24007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:01.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:01.952+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e2c0ecf40 con 0x7f1e3c14eb30 2023-12-04T05:40:02.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1e3c0a8ac0 con 0x7f1e3c14eb30 2023-12-04T05:40:02.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e337fe640 1 -- 172.21.15.97:0/1848668243 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1e2c0bc0a0 con 0x7f1e3c14eb30 2023-12-04T05:40:02.102 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:40:02.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 msgr2=0x7f1e1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 0x7f1e1c068d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0c6d50 tx=0x7f1e24007e50 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 msgr2=0x7f1e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c01a610 tx=0x7f1e2c019780 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 shutdown_connections 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f1e1c0668d0 0x7f1e1c068d90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e3c154fe0 0x7f1e3c1ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e3c14f790 0x7f1e3c1ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 --2- 172.21.15.97:0/1848668243 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e3c14eb30 0x7f1e3c06d330 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 >> 172.21.15.97:0/1848668243 conn(0x7f1e3c0c5e70 msgr2=0x7f1e3c0c1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 shutdown_connections 2023-12-04T05:40:02.104 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.100+0000 7f1e40ce3640 1 -- 172.21.15.97:0/1848668243 wait complete. 2023-12-04T05:40:02.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T05:40:02.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 Processor -- start 2023-12-04T05:40:02.263 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 -- start start 2023-12-04T05:40:02.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20d406c440 0x7f20d41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d40aa240 con 0x7f20d406d210 2023-12-04T05:40:02.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d40aa500 con 0x7f20d40c1e70 2023-12-04T05:40:02.264 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20da8fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d406c0c0 con 0x7f20d406c440 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20d37fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f20d406c440 0x7f20d41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20d8e9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f20d406d210 0x7f20d406d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40846/0 (socket says 172.21.15.97:40846) 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.260+0000 7f20d8e9b640 1 -- 172.21.15.97:0/3202387610 learned_addr learned my addr 172.21.15.97:0/3202387610 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d37fe640 1 -- 172.21.15.97:0/3202387610 >> v1:172.21.15.143:6789/0 conn(0x7f20d40c1e70 legacy=0x7f20d40a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d37fe640 1 -- 172.21.15.97:0/3202387610 >> v1:172.21.15.97:6789/0 conn(0x7f20d406d210 legacy=0x7f20d406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.265 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d37fe640 1 -- 172.21.15.97:0/3202387610 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d40aa7e0 con 0x7f20d406c440 2023-12-04T05:40:02.266 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d2ffd640 1 -- 172.21.15.97:0/3202387610 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595433064 0 0) 0x7f20d40aa240 con 0x7f20d406d210 2023-12-04T05:40:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d37fe640 1 --2- 172.21.15.97:0/3202387610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d406c440 0x7f20d41524e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f20c80097c0 tx=0x7f20c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a68c72c6069d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d2ffd640 1 -- 172.21.15.97:0/3202387610 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80ab650 con 0x7f20d406c440 2023-12-04T05:40:02.268 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d2ffd640 1 -- 172.21.15.97:0/3202387610 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80ab7b0 con 0x7f20d406c440 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.264+0000 7f20d2ffd640 1 -- 172.21.15.97:0/3202387610 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80abb40 con 0x7f20d406c440 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- 172.21.15.97:0/3202387610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d406c440 msgr2=0x7f20d41524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 --2- 172.21.15.97:0/3202387610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d406c440 0x7f20d41524e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f20c80097c0 tx=0x7f20c801c450 comp rx=0 tx=0).stop 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- 172.21.15.97:0/3202387610 shutdown_connections 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 --2- 172.21.15.97:0/3202387610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d406c440 0x7f20d41524e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- 172.21.15.97:0/3202387610 >> 172.21.15.97:0/3202387610 conn(0x7f20d40c5e70 msgr2=0x7f20d40c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:02.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- 172.21.15.97:0/3202387610 shutdown_connections 2023-12-04T05:40:02.270 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- 172.21.15.97:0/3202387610 wait complete. 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 Processor -- start 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- start start 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20d406c440 0x7f20d40c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20d406d210 0x7f20d40c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c3d50 con 0x7f20d40c1e70 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c46b0 con 0x7f20d406d210 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20da8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c5820 con 0x7f20d406c440 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60750/0 (socket says 172.21.15.97:60750) 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 -- 172.21.15.97:0/1805005701 learned_addr learned my addr 172.21.15.97:0/1805005701 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d37fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20d406d210 0x7f20d40c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d3fff640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20d406c440 0x7f20d40c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 -- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20d406c440 msgr2=0x7f20d40c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20d406c440 0x7f20d40c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 -- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20d406d210 msgr2=0x7f20d40c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20d406d210 0x7f20d40c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 -- 172.21.15.97:0/1805005701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009420 con 0x7f20d40c1e70 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.268+0000 7f20d8e9b640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001570 tx=0x7f20cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00a640 con 0x7f20d40c1e70 2023-12-04T05:40:02.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc00a7c0 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00ab70 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d40c3690 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d41edbf0 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d40c3e90 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f20cc00acd0 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 0x7f20c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f20cc083ba0 con 0x7f20d40c1e70 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d3fff640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 0x7f20c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.272+0000 7f20d3fff640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 0x7f20c0068dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f20d40c1910 tx=0x7f20c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.276+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20cc050b20 con 0x7f20d40c1e70 2023-12-04T05:40:02.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.436+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20d4068440 con 0x7f20d40c1e70 2023-12-04T05:40:02.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.436+0000 7f20d0ff9640 1 -- 172.21.15.97:0/1805005701 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20cc018020 con 0x7f20d40c1e70 2023-12-04T05:40:02.440 INFO:teuthology.orchestra.run.smithi097.stderr:listed 0 entries 2023-12-04T05:40:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 msgr2=0x7f20c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 0x7f20c0068dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f20d40c1910 tx=0x7f20c4009040 comp rx=0 tx=0).stop 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 msgr2=0x7f20d41ed6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001570 tx=0x7f20cc00cca0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 shutdown_connections 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f20c0066900 0x7f20c0068dc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f20d40c1e70 0x7f20d41ed6b0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20d406d210 0x7f20d40c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 --2- 172.21.15.97:0/1805005701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f20d406c440 0x7f20d40c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 >> 172.21.15.97:0/1805005701 conn(0x7f20d40c5e70 msgr2=0x7f20d40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 shutdown_connections 2023-12-04T05:40:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.440+0000 7f20da8fe640 1 -- 172.21.15.97:0/1805005701 wait complete. 2023-12-04T05:40:02.460 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-04T05:40:02.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:02.461 DEBUG:teuthology.orchestra.run.smithi143:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-04T05:40:02.493 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:40:02.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:02.494 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T05:40:02.546 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T05:40:02.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:40:02.603 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T05:40:02.674 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T05:40:02.674 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:40:02.674 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:02.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:40:02.684 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:40:02.684 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:02.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:40:02.698 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 Processor -- start 2023-12-04T05:40:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 -- start start 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0050151bf0 0x7f00500abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0050155370 0x7f005015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00501547d0 con 0x7f00500c7ef0 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0050158b80 con 0x7f0050155370 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f0055832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500c4aa0 con 0x7f0050151bf0 2023-12-04T05:40:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0050155370 0x7f005015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0050155370 0x7f005015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60756/0 (socket says 172.21.15.97:60756) 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 -- 172.21.15.97:0/3526911237 learned_addr learned my addr 172.21.15.97:0/3526911237 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004effd640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0050151bf0 0x7f00500abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 -- 172.21.15.97:0/3526911237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0050151bf0 msgr2=0x7f00500abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0050151bf0 0x7f00500abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 -- 172.21.15.97:0/3526911237 >> v1:172.21.15.143:6789/0 conn(0x7f00500c7ef0 legacy=0x7f0050154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.864+0000 7f004f7fe640 1 -- 172.21.15.97:0/3526911237 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500c4d40 con 0x7f0050155370 2023-12-04T05:40:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f004f7fe640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005015efb0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0048009e80 tx=0x7f004801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689bfad80e74bdfc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f004e7fc640 1 -- 172.21.15.97:0/3526911237 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480090d0 con 0x7f0050155370 2023-12-04T05:40:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f004e7fc640 1 -- 172.21.15.97:0/3526911237 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0048009230 con 0x7f0050155370 2023-12-04T05:40:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f004e7fc640 1 -- 172.21.15.97:0/3526911237 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480ac610 con 0x7f0050155370 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 -- 172.21.15.97:0/3526911237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 msgr2=0x7f005015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005015efb0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f0048009e80 tx=0x7f004801c5b0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 -- 172.21.15.97:0/3526911237 shutdown_connections 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005015efb0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 --2- 172.21.15.97:0/3526911237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0050151bf0 0x7f00500abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 -- 172.21.15.97:0/3526911237 >> 172.21.15.97:0/3526911237 conn(0x7f0050073550 msgr2=0x7f0050073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:02.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 -- 172.21.15.97:0/3526911237 shutdown_connections 2023-12-04T05:40:02.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.868+0000 7f0055832640 1 -- 172.21.15.97:0/3526911237 wait complete. 2023-12-04T05:40:02.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 Processor -- start 2023-12-04T05:40:02.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- start start 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00500c7ef0 0x7f00501ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050151bf0 0x7f00500aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005014b1a0 con 0x7f0050155370 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00501563c0 con 0x7f0050151bf0 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500aba00 con 0x7f00500c7ef0 2023-12-04T05:40:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60758/0 (socket says 172.21.15.97:60758) 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 -- 172.21.15.97:0/686877434 learned_addr learned my addr 172.21.15.97:0/686877434 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f00467fc640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050151bf0 0x7f00500aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004effd640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00500c7ef0 0x7f00501ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 -- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00500c7ef0 msgr2=0x7f00501ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00500c7ef0 0x7f00501ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 -- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050151bf0 msgr2=0x7f00500aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050151bf0 0x7f00500aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 -- 172.21.15.97:0/686877434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009b30 con 0x7f0050155370 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004f7fe640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f004801a3f0 tx=0x7f0048019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480090d0 con 0x7f0050155370 2023-12-04T05:40:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0048007e80 con 0x7f0050155370 2023-12-04T05:40:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00501f1980 con 0x7f0050155370 2023-12-04T05:40:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480b76b0 con 0x7f0050155370 2023-12-04T05:40:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.872+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00501f1f40 con 0x7f0050155370 2023-12-04T05:40:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050156550 con 0x7f0050155370 2023-12-04T05:40:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f00480b78d0 con 0x7f0050155370 2023-12-04T05:40:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f004cff9640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 0x7f0030068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f004811f150 con 0x7f0050155370 2023-12-04T05:40:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f004effd640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 0x7f0030068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.876+0000 7f004effd640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 0x7f0030068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00380079c0 tx=0x7f0038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:02.880+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00480ec0d0 con 0x7f0050155370 2023-12-04T05:40:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.064+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00501f22e0 con 0x7f0050155370 2023-12-04T05:40:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.064+0000 7f004cff9640 1 -- 172.21.15.97:0/686877434 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f0048009510 con 0x7f0050155370 2023-12-04T05:40:03.066 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:03.066 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 53 2023-12-04T05:40:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 msgr2=0x7f0030068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 0x7f0030068d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f00380079c0 tx=0x7f0038008040 comp rx=0 tx=0).stop 2023-12-04T05:40:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 msgr2=0x7f005014a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f004801a3f0 tx=0x7f0048019670 comp rx=0 tx=0).stop 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 shutdown_connections 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f00300668d0 0x7f0030068d90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0050155370 0x7f005014a440 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0050151bf0 0x7f00500aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 --2- 172.21.15.97:0/686877434 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00500c7ef0 0x7f00501ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 >> 172.21.15.97:0/686877434 conn(0x7f0050073550 msgr2=0x7f0050073930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 shutdown_connections 2023-12-04T05:40:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.068+0000 7f0055832640 1 -- 172.21.15.97:0/686877434 wait complete. 2023-12-04T05:40:03.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.224+0000 7f626b8fe640 1 Processor -- start 2023-12-04T05:40:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.224+0000 7f626b8fe640 1 -- start start 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f626414fbb0 0x7f62640a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62640a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6264152490 0x7f6264152900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626414ff90 con 0x7f626414fbb0 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640a9770 con 0x7f6264152490 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626b8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6264071730 con 0x7f62640a8460 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f626414fbb0 0x7f62640a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f626414fbb0 0x7f62640a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60768/0 (socket says 172.21.15.97:60768) 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 -- 172.21.15.97:0/5153932 learned_addr learned my addr 172.21.15.97:0/5153932 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f6268e99640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62640a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f6269e9b640 1 --2- 172.21.15.97:0/5153932 >> v2:172.21.15.143:3300/0 conn(0x7f6264152490 0x7f6264152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 -- 172.21.15.97:0/5153932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 msgr2=0x7f62640a88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62640a88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 -- 172.21.15.97:0/5153932 >> v2:172.21.15.143:3300/0 conn(0x7f6264152490 msgr2=0x7f6264152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 --2- 172.21.15.97:0/5153932 >> v2:172.21.15.143:3300/0 conn(0x7f6264152490 0x7f6264152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.230 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 -- 172.21.15.97:0/5153932 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264071a10 con 0x7f626414fbb0 2023-12-04T05:40:03.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.228+0000 7f626969a640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f626414fbb0 0x7f62640a8f20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f626406f8a0 tx=0x7f626001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b211790269fccb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f625bfff640 1 -- 172.21.15.97:0/5153932 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600a5700 con 0x7f626414fbb0 2023-12-04T05:40:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f625bfff640 1 -- 172.21.15.97:0/5153932 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62600a5860 con 0x7f626414fbb0 2023-12-04T05:40:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f625bfff640 1 -- 172.21.15.97:0/5153932 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600a5bf0 con 0x7f626414fbb0 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- 172.21.15.97:0/5153932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f626414fbb0 msgr2=0x7f62640a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f626414fbb0 0x7f62640a8f20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f626406f8a0 tx=0x7f626001c880 comp rx=0 tx=0).stop 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- 172.21.15.97:0/5153932 shutdown_connections 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62640a88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- 172.21.15.97:0/5153932 >> v2:172.21.15.143:3300/0 conn(0x7f6264152490 0x7f6264152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- 172.21.15.97:0/5153932 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f626414fbb0 0x7f62640a8f20 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- 172.21.15.97:0/5153932 >> 172.21.15.97:0/5153932 conn(0x7f62640c2970 msgr2=0x7f62640c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- 172.21.15.97:0/5153932 shutdown_connections 2023-12-04T05:40:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- 172.21.15.97:0/5153932 wait complete. 2023-12-04T05:40:03.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 Processor -- start 2023-12-04T05:40:03.234 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- start start 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62641548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 0x7f6264149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264146960 con 0x7f6264152490 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641ead10 con 0x7f626414fbb0 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626b8fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6264147620 con 0x7f62640a8460 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f6269e9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f6269e9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60778/0 (socket says 172.21.15.97:60778) 2023-12-04T05:40:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f6269e9b640 1 -- 172.21.15.97:0/3493015526 learned_addr learned my addr 172.21.15.97:0/3493015526 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f626969a640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62641548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.232+0000 7f6268e99640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 0x7f6264149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 -- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 msgr2=0x7f62641548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62641548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 -- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 msgr2=0x7f6264149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 0x7f6264149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 -- 172.21.15.97:0/3493015526 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260009b30 con 0x7f6264152490 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6268e99640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 0x7f6264149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6269e9b640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e820 tx=0x7f625c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c009530 con 0x7f6264152490 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c00eed0 con 0x7f6264152490 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62641eaf20 con 0x7f6264152490 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00cb60 con 0x7f6264152490 2023-12-04T05:40:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641eb7c0 con 0x7f6264152490 2023-12-04T05:40:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62641eb320 con 0x7f6264152490 2023-12-04T05:40:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.236+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f625c00cce0 con 0x7f6264152490 2023-12-04T05:40:03.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.240+0000 7f6259ffb640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 0x7f6248068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.240+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f625c084730 con 0x7f6264152490 2023-12-04T05:40:03.240 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.240+0000 7f626969a640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 0x7f6248068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.241 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.240+0000 7f626969a640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 0x7f6248068d90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f62600ae000 tx=0x7f62600a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.244+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f625c051730 con 0x7f6264152490 2023-12-04T05:40:03.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6264068440 con 0x7f6264152490 2023-12-04T05:40:03.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f6259ffb640 1 -- 172.21.15.97:0/3493015526 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f625c054d50 con 0x7f6264152490 2023-12-04T05:40:03.397 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:03.398 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 msgr2=0x7f6248068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 0x7f6248068d90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f62600ae000 tx=0x7f62600a7070 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 msgr2=0x7f626414d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e820 tx=0x7f625c00ece0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 shutdown_connections 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f62480668d0 0x7f6248068d90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6264152490 0x7f626414d540 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f626414fbb0 0x7f6264149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 --2- 172.21.15.97:0/3493015526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62640a8460 0x7f62641548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 >> 172.21.15.97:0/3493015526 conn(0x7f62640c2970 msgr2=0x7f62641454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 shutdown_connections 2023-12-04T05:40:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.396+0000 7f626b8fe640 1 -- 172.21.15.97:0/3493015526 wait complete. 2023-12-04T05:40:03.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T05:39:24.181958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T05:39:25.434038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:40:03.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:40:03.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.556+0000 7f3f2d809640 1 Processor -- start 2023-12-04T05:40:03.559 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.556+0000 7f3f2d809640 1 -- start start 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f2d809640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f2815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f2d809640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f28154640 con 0x7f3f2814f960 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f2d809640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2814ef10 con 0x7f3f2814eb30 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f2d809640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280c0bd0 con 0x7f3f28154fe0 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3f2814f960 0x7f3f281548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40862/0 (socket says 172.21.15.97:40862) 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/1992488580 learned_addr learned my addr 172.21.15.97:0/1992488580 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:03.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f277fe640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f2815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563213009 0 0) 0x7f3f28154640 con 0x7f3f2814f960 2023-12-04T05:40:03.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f14003530 con 0x7f3f2814f960 2023-12-04T05:40:03.562 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987562459 0 0) 0x7f3f2814ef10 con 0x7f3f2814eb30 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f28154640 con 0x7f3f2814eb30 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878208006 0 0) 0x7f3f14003530 con 0x7f3f2814f960 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 msgr2=0x7f3f2815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f2815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 >> v1:172.21.15.143:6789/0 conn(0x7f3f2814eb30 legacy=0x7f3f2814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f281535a0 con 0x7f3f2814f960 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f3f18001680 con 0x7f3f2814f960 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 >> v1:172.21.15.97:6789/0 conn(0x7f3f2814f960 legacy=0x7f3f281548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f14003b40 0x7f3f14003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f140047d0 0x7f3f14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280c0bd0 con 0x7f3f140047d0 2023-12-04T05:40:03.563 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1400ba70 con 0x7f3f14003b40 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1400bc30 con 0x7f3f28154fe0 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f140047d0 0x7f3f14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f26ffd640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f14003b40 0x7f3f14003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f277fe640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 msgr2=0x7f3f14005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f14005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f14003b40 msgr2=0x7f3f14003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f14003b40 0x7f3f14003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/1992488580 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14003530 con 0x7f3f140047d0 2023-12-04T05:40:03.564 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.560+0000 7f3f277fe640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28154fe0 0x7f3f14005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f140047d0 0x7f3f14004c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007fa0 tx=0x7f3f1801cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33524a9ff2362bf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005ae0 con 0x7f3f140047d0 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18005c40 con 0x7f3f140047d0 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f267fc640 1 -- 172.21.15.97:0/1992488580 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180a57e0 con 0x7f3f140047d0 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- 172.21.15.97:0/1992488580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f140047d0 msgr2=0x7f3f14004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 --2- 172.21.15.97:0/1992488580 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f140047d0 0x7f3f14004c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007fa0 tx=0x7f3f1801cae0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f277fe640 1 -- 172.21.15.97:0/1992488580 reap_dead start 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- 172.21.15.97:0/1992488580 shutdown_connections 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- 172.21.15.97:0/1992488580 >> 172.21.15.97:0/1992488580 conn(0x7f3f280c5e70 msgr2=0x7f3f280c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- 172.21.15.97:0/1992488580 shutdown_connections 2023-12-04T05:40:03.566 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- 172.21.15.97:0/1992488580 wait complete. 2023-12-04T05:40:03.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 Processor -- start 2023-12-04T05:40:03.567 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.564+0000 7f3f2d809640 1 -- start start 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f140047d0 0x7f3f28070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 0x7f3f28144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28151a70 con 0x7f3f281eb8c0 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281443d0 con 0x7f3f140047d0 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28071a60 con 0x7f3f28144560 2023-12-04T05:40:03.569 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60804/0 (socket says 172.21.15.97:60804) 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/2228692651 learned_addr learned my addr 172.21.15.97:0/2228692651 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f26ffd640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f140047d0 0x7f3f28070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f277fe640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 0x7f3f28144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 msgr2=0x7f3f28144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 0x7f3f28144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f140047d0 msgr2=0x7f3f28070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f140047d0 0x7f3f28070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 -- 172.21.15.97:0/2228692651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28071f90 con 0x7f3f281eb8c0 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f277fe640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 0x7f3f28144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:03.570 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f1e7fc640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007fa0 tx=0x7f3f14005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180b4070 con 0x7f3f281eb8c0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18005a90 con 0x7f3f281eb8c0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180a59e0 con 0x7f3f281eb8c0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f281ec110 con 0x7f3f281eb8c0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f28071cb0 con 0x7f3f281eb8c0 2023-12-04T05:40:03.571 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f281ec5c0 con 0x7f3f281eb8c0 2023-12-04T05:40:03.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.568+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3f180a5b40 con 0x7f3f281eb8c0 2023-12-04T05:40:03.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.572+0000 7f3f24ff9640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 0x7f3f08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.572+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3f10001d30 con 0x7f3f281eb8c0 2023-12-04T05:40:03.572 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.572+0000 7f3f26ffd640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 0x7f3f08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.573 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.572+0000 7f3f26ffd640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 0x7f3f08068d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3f100014f0 tx=0x7f3f100013e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.576 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.576+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f180eb590 con 0x7f3f281eb8c0 2023-12-04T05:40:03.702 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:40:03.706 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:40:03.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f28068440 con 0x7f3f281eb8c0 2023-12-04T05:40:03.729 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f24ff9640 1 -- 172.21.15.97:0/2228692651 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f180eebb0 con 0x7f3f281eb8c0 2023-12-04T05:40:03.730 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 msgr2=0x7f3f08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 0x7f3f08068d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3f100014f0 tx=0x7f3f100013e0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 msgr2=0x7f3f281dd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007fa0 tx=0x7f3f14005800 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 shutdown_connections 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3f080668d0 0x7f3f08068d90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f28144560 0x7f3f28144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3f281eb8c0 0x7f3f281dd580 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 --2- 172.21.15.97:0/2228692651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f140047d0 0x7f3f28070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.728+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 >> 172.21.15.97:0/2228692651 conn(0x7f3f280c5e70 msgr2=0x7f3f280c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.732+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 shutdown_connections 2023-12-04T05:40:03.733 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.732+0000 7f3f2d809640 1 -- 172.21.15.97:0/2228692651 wait complete. 2023-12-04T05:40:03.750 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T05:40:03.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 Processor -- start 2023-12-04T05:40:03.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 -- start start 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d94151f10 0x7f0d940c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d94154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d940ca780 con 0x7f0d940cac10 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d94158cc0 con 0x7f0d94151f10 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d9a501640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940c5700 con 0x7f0d940c7f00 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d98a9e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0d940cac10 0x7f0d940c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:40874/0 (socket says 172.21.15.97:40874) 2023-12-04T05:40:03.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d98a9e640 1 -- 172.21.15.97:0/1253861413 learned_addr learned my addr 172.21.15.97:0/1253861413 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d93fff640 1 --2- 172.21.15.97:0/1253861413 >> v2:172.21.15.143:3300/0 conn(0x7f0d94151f10 0x7f0d940c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d937fe640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d94154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362202795 0 0) 0x7f0d940ca780 con 0x7f0d940cac10 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.936+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c003530 con 0x7f0d940cac10 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d93fff640 1 -- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 msgr2=0x7f0d94154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d93fff640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d94154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d93fff640 1 -- 172.21.15.97:0/1253861413 >> v1:172.21.15.97:6789/0 conn(0x7f0d940cac10 legacy=0x7f0d940c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2115347494 0 0) 0x7f0d7c003530 con 0x7f0d940cac10 2023-12-04T05:40:03.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d93fff640 1 -- 172.21.15.97:0/1253861413 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94158720 con 0x7f0d94151f10 2023-12-04T05:40:03.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d93fff640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d940c4980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097c0 tx=0x7f0d8401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12a5ccd43be6cc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840ab600 con 0x7f0d94151f10 2023-12-04T05:40:03.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d840a7050 con 0x7f0d94151f10 2023-12-04T05:40:03.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d92ffd640 1 -- 172.21.15.97:0/1253861413 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840ab980 con 0x7f0d94151f10 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d9a501640 1 -- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 msgr2=0x7f0d940c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.940+0000 7f0d9a501640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d940c4980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0d840097c0 tx=0x7f0d8401c330 comp rx=0 tx=0).stop 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- 172.21.15.97:0/1253861413 shutdown_connections 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d94154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 --2- 172.21.15.97:0/1253861413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d940c4980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- 172.21.15.97:0/1253861413 >> 172.21.15.97:0/1253861413 conn(0x7f0d94073950 msgr2=0x7f0d94073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:03.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- 172.21.15.97:0/1253861413 shutdown_connections 2023-12-04T05:40:03.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- 172.21.15.97:0/1253861413 wait complete. 2023-12-04T05:40:03.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 Processor -- start 2023-12-04T05:40:03.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- start start 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d9415f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d9414b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941f1540 con 0x7f0d940cac10 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9414bf70 con 0x7f0d94151f10 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d9a501640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941f09c0 con 0x7f0d940c7f00 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60818/0 (socket says 172.21.15.97:60818) 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 -- 172.21.15.97:0/2962045927 learned_addr learned my addr 172.21.15.97:0/2962045927 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d93fff640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d9415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d98a9e640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d9414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 -- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 msgr2=0x7f0d9415f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d9415f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 -- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 msgr2=0x7f0d9414b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d9414b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 -- 172.21.15.97:0/2962045927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84009420 con 0x7f0d940cac10 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d98a9e640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d9414b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.944+0000 7f0d937fe640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e930 tx=0x7f0d8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88009690 con 0x7f0d940cac10 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800ca00 con 0x7f0d940cac10 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800cd70 con 0x7f0d940cac10 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d941f0ca0 con 0x7f0d940cac10 2023-12-04T05:40:03.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d941f1260 con 0x7f0d940cac10 2023-12-04T05:40:03.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94068440 con 0x7f0d940cac10 2023-12-04T05:40:03.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0d88013470 con 0x7f0d940cac10 2023-12-04T05:40:03.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 0x7f0d80068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:03.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0d880849c0 con 0x7f0d940cac10 2023-12-04T05:40:03.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d93fff640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 0x7f0d80068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:03.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.948+0000 7f0d93fff640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 0x7f0d80068dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ad000 tx=0x7f0d840a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:03.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:03.952+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d88051970 con 0x7f0d940cac10 2023-12-04T05:40:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d9406c9c0 con 0x7f0d940cac10 2023-12-04T05:40:04.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d90ff9640 1 -- 172.21.15.97:0/2962045927 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d88054f90 con 0x7f0d940cac10 2023-12-04T05:40:04.109 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:40:04.110 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 msgr2=0x7f0d80068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 0x7f0d80068dc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ad000 tx=0x7f0d840a6000 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 msgr2=0x7f0d9414add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800e930 tx=0x7f0d8800edf0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 shutdown_connections 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d80066900 0x7f0d80068dc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d94151f10 0x7f0d9414b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d940cac10 0x7f0d9414add0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 --2- 172.21.15.97:0/2962045927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d940c7f00 0x7f0d9415f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 >> 172.21.15.97:0/2962045927 conn(0x7f0d94073950 msgr2=0x7f0d940aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 shutdown_connections 2023-12-04T05:40:04.111 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.108+0000 7f0d9a501640 1 -- 172.21.15.97:0/2962045927 wait complete. 2023-12-04T05:40:04.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T05:40:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 Processor -- start 2023-12-04T05:40:04.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 -- start start 2023-12-04T05:40:04.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f503414f960 0x7f50341548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034154640 con 0x7f5034154e10 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503414ef10 con 0x7f503414eb30 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f503ad72640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340c0bd0 con 0x7f503414f960 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.272+0000 7f5033fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f503414f960 0x7f50341548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f503930f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f5034154e10 0x7f503415bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53546/0 (socket says 172.21.15.97:53546) 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f503930f640 1 -- 172.21.15.97:0/3330738610 learned_addr learned my addr 172.21.15.97:0/3330738610 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:04.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f5038b0e640 1 --1- 172.21.15.97:0/3330738610 >> v1:172.21.15.143:6789/0 conn(0x7f503414eb30 0x7f503414f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52284/0 (socket says 172.21.15.97:52284) 2023-12-04T05:40:04.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f5033fff640 1 -- 172.21.15.97:0/3330738610 >> v1:172.21.15.143:6789/0 conn(0x7f503414eb30 legacy=0x7f503414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f5033fff640 1 -- 172.21.15.97:0/3330738610 >> v1:172.21.15.97:6789/0 conn(0x7f5034154e10 legacy=0x7f503415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f5033fff640 1 -- 172.21.15.97:0/3330738610 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50341535a0 con 0x7f503414f960 2023-12-04T05:40:04.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f50337fe640 1 -- 172.21.15.97:0/3330738610 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063193014 0 0) 0x7f5034154640 con 0x7f5034154e10 2023-12-04T05:40:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f5033fff640 1 --2- 172.21.15.97:0/3330738610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414f960 0x7f50341548d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f50200097c0 tx=0x7f502001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afea107d201b7cc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f50337fe640 1 -- 172.21.15.97:0/3330738610 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200ad660 con 0x7f503414f960 2023-12-04T05:40:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f50337fe640 1 -- 172.21.15.97:0/3330738610 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50200ad7c0 con 0x7f503414f960 2023-12-04T05:40:04.279 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.276+0000 7f50337fe640 1 -- 172.21.15.97:0/3330738610 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200adb50 con 0x7f503414f960 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- 172.21.15.97:0/3330738610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414f960 msgr2=0x7f50341548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 --2- 172.21.15.97:0/3330738610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414f960 0x7f50341548d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f50200097c0 tx=0x7f502001c450 comp rx=0 tx=0).stop 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- 172.21.15.97:0/3330738610 shutdown_connections 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 --2- 172.21.15.97:0/3330738610 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414f960 0x7f50341548d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- 172.21.15.97:0/3330738610 >> 172.21.15.97:0/3330738610 conn(0x7f50340c5e70 msgr2=0x7f50340c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- 172.21.15.97:0/3330738610 shutdown_connections 2023-12-04T05:40:04.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- 172.21.15.97:0/3330738610 wait complete. 2023-12-04T05:40:04.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 Processor -- start 2023-12-04T05:40:04.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- start start 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 0x7f50340bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 0x7f5034144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340a9a40 con 0x7f503414eb30 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340aaf40 con 0x7f503414f960 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503ad72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340a9ca0 con 0x7f5034154e10 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46212/0 (socket says 172.21.15.97:46212) 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 -- 172.21.15.97:0/3198082592 learned_addr learned my addr 172.21.15.97:0/3198082592 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5033fff640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 0x7f50340bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.284 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503930f640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 0x7f5034144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 -- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 msgr2=0x7f5034144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 0x7f5034144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 -- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 msgr2=0x7f50340bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 0x7f50340bf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5038b0e640 1 -- 172.21.15.97:0/3198082592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009420 con 0x7f503414eb30 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f503930f640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 0x7f5034144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.280+0000 7f5033fff640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 0x7f50340bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f5038b0e640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f502800c490 tx=0x7f502800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028007480 con 0x7f503414eb30 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280075e0 con 0x7f503414eb30 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028004a10 con 0x7f503414eb30 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340aa180 con 0x7f503414eb30 2023-12-04T05:40:04.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340aa740 con 0x7f503414eb30 2023-12-04T05:40:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034068440 con 0x7f503414eb30 2023-12-04T05:40:04.286 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5028004b70 con 0x7f503414eb30 2023-12-04T05:40:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 0x7f5018068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f50280839b0 con 0x7f503414eb30 2023-12-04T05:40:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f5033fff640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 0x7f5018068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.284+0000 7f5033fff640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 0x7f5018068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50200af000 tx=0x7f50200a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.288+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5028050880 con 0x7f503414eb30 2023-12-04T05:40:04.440 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f503415d160 con 0x7f503414eb30 2023-12-04T05:40:04.441 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f50317fa640 1 -- 172.21.15.97:0/3198082592 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50280180a0 con 0x7f503414eb30 2023-12-04T05:40:04.441 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 msgr2=0x7f5018068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 0x7f5018068d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f50200af000 tx=0x7f50200a7000 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 msgr2=0x7f50340a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f502800c490 tx=0x7f502800c950 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 shutdown_connections 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f50180668d0 0x7f5018068d90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5034154e10 0x7f5034144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f503414f960 0x7f50340bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 --2- 172.21.15.97:0/3198082592 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f503414eb30 0x7f50340a9500 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 >> 172.21.15.97:0/3198082592 conn(0x7f50340c5e70 msgr2=0x7f503414db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.443 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 shutdown_connections 2023-12-04T05:40:04.444 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.440+0000 7f503ad72640 1 -- 172.21.15.97:0/3198082592 wait complete. 2023-12-04T05:40:04.461 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:40:04.601 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 Processor -- start 2023-12-04T05:40:04.602 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 -- start start 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5d80c1e70 0x7fb5d81524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 0x7fb5d806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d80aa240 con 0x7fb5d806c440 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d806c0c0 con 0x7fb5d80c1e70 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5de196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80aa500 con 0x7fb5d806d210 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d77fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fb5d80c1e70 0x7fb5d81524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5cffff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fb5d806c440 0x7fb5d80a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53552/0 (socket says 172.21.15.97:53552) 2023-12-04T05:40:04.603 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5cffff640 1 -- 172.21.15.97:0/1847371011 learned_addr learned my addr 172.21.15.97:0/1847371011 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d77fe640 1 -- 172.21.15.97:0/1847371011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 msgr2=0x7fb5d806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d7fff640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 0x7fb5d806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d77fe640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 0x7fb5d806d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d77fe640 1 -- 172.21.15.97:0/1847371011 >> v1:172.21.15.97:6789/0 conn(0x7fb5d806c440 legacy=0x7fb5d80a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d77fe640 1 -- 172.21.15.97:0/1847371011 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80aa7e0 con 0x7fb5d80c1e70 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d7fff640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 0x7fb5d806d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:04.604 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.600+0000 7fb5d6ffd640 1 -- 172.21.15.97:0/1847371011 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080105499 0 0) 0x7fb5d80aa240 con 0x7fb5d806c440 2023-12-04T05:40:04.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5d77fe640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d80c1e70 0x7fb5d81524e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca80450e2ca774d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.606 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5d6ffd640 1 -- 172.21.15.97:0/1847371011 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ad660 con 0x7fb5d80c1e70 2023-12-04T05:40:04.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5d6ffd640 1 -- 172.21.15.97:0/1847371011 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80ad7c0 con 0x7fb5d80c1e70 2023-12-04T05:40:04.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5d6ffd640 1 -- 172.21.15.97:0/1847371011 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80adb50 con 0x7fb5d80c1e70 2023-12-04T05:40:04.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 -- 172.21.15.97:0/1847371011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d80c1e70 msgr2=0x7fb5d81524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.607 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d80c1e70 0x7fb5d81524e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c450 comp rx=0 tx=0).stop 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 -- 172.21.15.97:0/1847371011 shutdown_connections 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806d210 0x7fb5d806d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 --2- 172.21.15.97:0/1847371011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d80c1e70 0x7fb5d81524e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 -- 172.21.15.97:0/1847371011 >> 172.21.15.97:0/1847371011 conn(0x7fb5d80c5e70 msgr2=0x7fb5d80c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 -- 172.21.15.97:0/1847371011 shutdown_connections 2023-12-04T05:40:04.608 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.604+0000 7fb5de196640 1 -- 172.21.15.97:0/1847371011 wait complete. 2023-12-04T05:40:04.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 Processor -- start 2023-12-04T05:40:04.609 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- start start 2023-12-04T05:40:04.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806c440 0x7fb5d814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 0x7fb5d814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d814eaf0 con 0x7fb5d806d210 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d814fa20 con 0x7fb5d80c1e70 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81edaa0 con 0x7fb5d806c440 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46242/0 (socket says 172.21.15.97:46242) 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 -- 172.21.15.97:0/1484302091 learned_addr learned my addr 172.21.15.97:0/1484302091 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d77fe640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806c440 0x7fb5d814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d7fff640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 0x7fb5d814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 -- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806c440 msgr2=0x7fb5d814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806c440 0x7fb5d814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 -- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 msgr2=0x7fb5d814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 0x7fb5d814cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 -- 172.21.15.97:0/1484302091 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009420 con 0x7fb5d806d210 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d7fff640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 0x7fb5d814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:04.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5cffff640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c480 tx=0x7fb5c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00074e0 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0007660 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0004a30 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d814ece0 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.608+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d80705f0 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d814f200 con 0x7fb5d806d210 2023-12-04T05:40:04.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb5c0004b90 con 0x7fb5d806d210 2023-12-04T05:40:04.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5d4ff9640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 0x7fb5b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb5c00837f0 con 0x7fb5d806d210 2023-12-04T05:40:04.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5d77fe640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 0x7fb5b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.612+0000 7fb5d77fe640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 0x7fb5b8068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80af000 tx=0x7fb5c80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.618 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.616+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5d814f200 con 0x7fb5d806d210 2023-12-04T05:40:04.767 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.764+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5d814f200 con 0x7fb5d806d210 2023-12-04T05:40:04.768 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5d4ff9640 1 -- 172.21.15.97:0/1484302091 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb5c0018020 con 0x7fb5d806d210 2023-12-04T05:40:04.768 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:40:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 msgr2=0x7fb5b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 0x7fb5b8068d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80af000 tx=0x7fb5c80a7000 comp rx=0 tx=0).stop 2023-12-04T05:40:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 msgr2=0x7fb5d80700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c480 tx=0x7fb5c000c940 comp rx=0 tx=0).stop 2023-12-04T05:40:04.770 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 shutdown_connections 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fb5b80668d0 0x7fb5b8068d90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb5d80c1e70 0x7fb5d814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb5d806d210 0x7fb5d80700b0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 --2- 172.21.15.97:0/1484302091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5d806c440 0x7fb5d814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 >> 172.21.15.97:0/1484302091 conn(0x7fb5d80c5e70 msgr2=0x7fb5d8148af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 shutdown_connections 2023-12-04T05:40:04.771 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.768+0000 7fb5de196640 1 -- 172.21.15.97:0/1484302091 wait complete. 2023-12-04T05:40:04.789 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:40:04.940 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 Processor -- start 2023-12-04T05:40:04.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 -- start start 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3b040c3b70 0x7f3b040c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b04152170 con 0x7f3b040c1b80 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040c0ae0 con 0x7f3b0414ea10 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b092c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0406dfe0 con 0x7f3b040c3b70 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3afa7fc640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3b040c1b80 0x7f3b04070b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53560/0 (socket says 172.21.15.97:53560) 2023-12-04T05:40:04.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3afa7fc640 1 -- 172.21.15.97:0/1564760615 learned_addr learned my addr 172.21.15.97:0/1564760615 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b037fe640 1 --2- 172.21.15.97:0/1564760615 >> v2:172.21.15.143:3300/0 conn(0x7f3b040c3b70 0x7f3b040c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143601168 0 0) 0x7f3b04152170 con 0x7f3b040c1b80 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af0003530 con 0x7f3b040c1b80 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506662327 0 0) 0x7f3b040c0ae0 con 0x7f3b0414ea10 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04152170 con 0x7f3b0414ea10 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b037fe640 1 -- 172.21.15.97:0/1564760615 >> v1:172.21.15.143:6789/0 conn(0x7f3b0414ea10 legacy=0x7f3b040a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b037fe640 1 -- 172.21.15.97:0/1564760615 >> v1:172.21.15.97:6789/0 conn(0x7f3b040c1b80 legacy=0x7f3b04070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768484674 0 0) 0x7f3af0003530 con 0x7f3b040c1b80 2023-12-04T05:40:04.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.940+0000 7f3b037fe640 1 -- 172.21.15.97:0/1564760615 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040c0dc0 con 0x7f3b040c3b70 2023-12-04T05:40:04.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b037fe640 1 --2- 172.21.15.97:0/1564760615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b040c0450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff34a393b525754 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec001a00 con 0x7f3b040c3b70 2023-12-04T05:40:04.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0a8610 con 0x7f3b040c3b70 2023-12-04T05:40:04.946 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b027fc640 1 -- 172.21.15.97:0/1564760615 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0a89a0 con 0x7f3b040c3b70 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 -- 172.21.15.97:0/1564760615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 msgr2=0x7f3b040c0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 --2- 172.21.15.97:0/1564760615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b040c0450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01eb90 comp rx=0 tx=0).stop 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 -- 172.21.15.97:0/1564760615 shutdown_connections 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 --2- 172.21.15.97:0/1564760615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b040c0450 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 -- 172.21.15.97:0/1564760615 >> 172.21.15.97:0/1564760615 conn(0x7f3b040a7800 msgr2=0x7f3b040a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 -- 172.21.15.97:0/1564760615 shutdown_connections 2023-12-04T05:40:04.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.944+0000 7f3b092c9640 1 -- 172.21.15.97:0/1564760615 wait complete. 2023-12-04T05:40:04.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 Processor -- start 2023-12-04T05:40:04.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- start start 2023-12-04T05:40:04.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b040c1b80 0x7f3b041e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.954 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b04153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041e8e70 con 0x7f3b0414ea10 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0414dd80 con 0x7f3b040c3b70 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040a8500 con 0x7f3b040c1b80 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46246/0 (socket says 172.21.15.97:46246) 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 -- 172.21.15.97:0/261008198 learned_addr learned my addr 172.21.15.97:0/261008198 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 -- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b040c1b80 msgr2=0x7f3b041e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b040c1b80 0x7f3b041e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 -- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 msgr2=0x7f3b04153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b04153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 -- 172.21.15.97:0/261008198 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009420 con 0x7f3b0414ea10 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b037fe640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc004220 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc004380 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b04153ea0 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc003820 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.948+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b040a8a80 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404e890 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3afc0b7040 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3afbfff640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3afc121380 con 0x7f3b0414ea10 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3b02ffd640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:04.956 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.952+0000 7f3b02ffd640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 0x7f3ae4068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:04.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:04.956+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3afc0ee2f0 con 0x7f3b0414ea10 2023-12-04T05:40:05.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3b040c5600 con 0x7f3b0414ea10 2023-12-04T05:40:05.109 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3afbfff640 1 -- 172.21.15.97:0/261008198 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3afc0044f0 con 0x7f3b0414ea10 2023-12-04T05:40:05.110 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 msgr2=0x7f3ae4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 0x7f3ae4068d90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4007960 comp rx=0 tx=0).stop 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 msgr2=0x7f3b04147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0097c0 tx=0x7f3afc01b930 comp rx=0 tx=0).stop 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 shutdown_connections 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3b0414ea10 0x7f3b04147a30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.112 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3b040c3b70 0x7f3b04153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 --2- 172.21.15.97:0/261008198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3b040c1b80 0x7f3b041e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 >> 172.21.15.97:0/261008198 conn(0x7f3b040a7800 msgr2=0x7f3b0414b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 shutdown_connections 2023-12-04T05:40:05.113 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.108+0000 7f3b092c9640 1 -- 172.21.15.97:0/261008198 wait complete. 2023-12-04T05:40:05.131 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:05.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 Processor -- start 2023-12-04T05:40:05.269 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 -- start start 2023-12-04T05:40:05.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f936c0af630 0x7f936c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.271 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936c154680 con 0x7f936c0c4d50 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936c0afa10 con 0x7f936c0af630 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9371667640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c154960 con 0x7f936c0c72b0 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9370e66640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f936c0c4d50 0x7f936c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53564/0 (socket says 172.21.15.97:53564) 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f9370e66640 1 -- 172.21.15.97:0/3098809384 learned_addr learned my addr 172.21.15.97:0/3098809384 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936bfff640 1 --2- 172.21.15.97:0/3098809384 >> v2:172.21.15.143:3300/0 conn(0x7f936c0af630 0x7f936c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936b7fe640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936affd640 1 -- 172.21.15.97:0/3098809384 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432219614 0 0) 0x7f936c154680 con 0x7f936c0c4d50 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936affd640 1 -- 172.21.15.97:0/3098809384 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9354003530 con 0x7f936c0c4d50 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936bfff640 1 -- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 msgr2=0x7f936c06b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936bfff640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c06b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936bfff640 1 -- 172.21.15.97:0/3098809384 >> v1:172.21.15.97:6789/0 conn(0x7f936c0c4d50 legacy=0x7f936c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936bfff640 1 -- 172.21.15.97:0/3098809384 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c154c40 con 0x7f936c0af630 2023-12-04T05:40:05.272 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.268+0000 7f936b7fe640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c06b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:05.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f936bfff640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0af630 0x7f936c0c4810 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f935c0097c0 tx=0x7f935c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6990a76b897f22c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f936affd640 1 -- 172.21.15.97:0/3098809384 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0ab610 con 0x7f936c0af630 2023-12-04T05:40:05.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f936affd640 1 -- 172.21.15.97:0/3098809384 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c0ab770 con 0x7f936c0af630 2023-12-04T05:40:05.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f936affd640 1 -- 172.21.15.97:0/3098809384 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0abb00 con 0x7f936c0af630 2023-12-04T05:40:05.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 -- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0af630 msgr2=0x7f936c0c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.275 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0af630 0x7f936c0c4810 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f935c0097c0 tx=0x7f935c01c3f0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 -- 172.21.15.97:0/3098809384 shutdown_connections 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c06b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 --2- 172.21.15.97:0/3098809384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0af630 0x7f936c0c4810 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 -- 172.21.15.97:0/3098809384 >> 172.21.15.97:0/3098809384 conn(0x7f936c0aba40 msgr2=0x7f936c0abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 -- 172.21.15.97:0/3098809384 shutdown_connections 2023-12-04T05:40:05.276 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.272+0000 7f9371667640 1 -- 172.21.15.97:0/3098809384 wait complete. 2023-12-04T05:40:05.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 Processor -- start 2023-12-04T05:40:05.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- start start 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0c4d50 0x7f936c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c14fb50 con 0x7f936c0af630 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936c1f1220 con 0x7f936c0c4d50 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936c0be790 con 0x7f936c0c72b0 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46252/0 (socket says 172.21.15.97:46252) 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 -- 172.21.15.97:0/1040843475 learned_addr learned my addr 172.21.15.97:0/1040843475 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936b7fe640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0c4d50 0x7f936c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.280 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9370e66640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 -- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 msgr2=0x7f936c14f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c14f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 -- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0c4d50 msgr2=0x7f936c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0c4d50 0x7f936c14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 -- 172.21.15.97:0/1040843475 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009420 con 0x7f936c0af630 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f936bfff640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f935c0ad040 tx=0x7f935c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0bf610 con 0x7f936c0af630 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c0bf7b0 con 0x7f936c0af630 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c009420 con 0x7f936c0af630 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0bfb60 con 0x7f936c0af630 2023-12-04T05:40:05.281 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.276+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936c0bed50 con 0x7f936c0af630 2023-12-04T05:40:05.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936c0be8d0 con 0x7f936c0af630 2023-12-04T05:40:05.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f935c0b5400 con 0x7f936c0af630 2023-12-04T05:40:05.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f9368ff9640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 0x7f9358068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.282 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f935c11f330 con 0x7f936c0af630 2023-12-04T05:40:05.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f936b7fe640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 0x7f9358068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.283 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.280+0000 7f936b7fe640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 0x7f9358068dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f936c153990 tx=0x7f9360008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.287 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.284+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f936c0be8d0 con 0x7f936c0af630 2023-12-04T05:40:05.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.464+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f936c0be8d0 con 0x7f936c0af630 2023-12-04T05:40:05.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9368ff9640 1 -- 172.21.15.97:0/1040843475 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f935c0f3810 con 0x7f936c0af630 2023-12-04T05:40:05.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:05.468 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:05.469 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 53 2023-12-04T05:40:05.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 msgr2=0x7f9358068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 0x7f9358068dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f936c153990 tx=0x7f9360008040 comp rx=0 tx=0).stop 2023-12-04T05:40:05.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 msgr2=0x7f936c1f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f935c0ad040 tx=0x7f935c01ac30 comp rx=0 tx=0).stop 2023-12-04T05:40:05.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 shutdown_connections 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9358066900 0x7f9358068dc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f936c0c72b0 0x7f936c14f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f936c0c4d50 0x7f936c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 --2- 172.21.15.97:0/1040843475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f936c0af630 0x7f936c1f0790 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 >> 172.21.15.97:0/1040843475 conn(0x7f936c0aba40 msgr2=0x7f936c152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 shutdown_connections 2023-12-04T05:40:05.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.468+0000 7f9371667640 1 -- 172.21.15.97:0/1040843475 wait complete. 2023-12-04T05:40:05.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:05.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.624+0000 7f0bd5679640 1 Processor -- start 2023-12-04T05:40:05.628 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.624+0000 7f0bd5679640 1 -- start start 2023-12-04T05:40:05.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 0x7f0bd006ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0bd0071a10 0x7f0bd00c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd0152300 con 0x7f0bd0071a10 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd0071580 con 0x7f0bd006be00 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bd5679640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd014ed50 con 0x7f0bd014e970 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0bd0071a10 0x7f0bd00c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0bd0071a10 0x7f0bd00c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46262/0 (socket says 172.21.15.97:46262) 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 -- 172.21.15.97:0/3733162153 learned_addr learned my addr 172.21.15.97:0/3733162153 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bc67fc640 1 --2- 172.21.15.97:0/3733162153 >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 0x7f0bd006ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bceffd640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 -- 172.21.15.97:0/3733162153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 msgr2=0x7f0bd006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.630 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 -- 172.21.15.97:0/3733162153 >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 msgr2=0x7f0bd006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:05.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 --2- 172.21.15.97:0/3733162153 >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 0x7f0bd006ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bcf7fe640 1 -- 172.21.15.97:0/3733162153 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0151d60 con 0x7f0bd0071a10 2023-12-04T05:40:05.631 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.628+0000 7f0bc67fc640 1 --2- 172.21.15.97:0/3733162153 >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 0x7f0bd006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:05.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bcf7fe640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0071a10 0x7f0bd00c1880 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00c6f10 tx=0x7f0bc801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec04860889f52b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.632 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bce7fc640 1 -- 172.21.15.97:0/3733162153 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80a5700 con 0x7f0bd0071a10 2023-12-04T05:40:05.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bce7fc640 1 -- 172.21.15.97:0/3733162153 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc80a5860 con 0x7f0bd0071a10 2023-12-04T05:40:05.633 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bce7fc640 1 -- 172.21.15.97:0/3733162153 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80a5bf0 con 0x7f0bd0071a10 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- 172.21.15.97:0/3733162153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0071a10 msgr2=0x7f0bd00c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0071a10 0x7f0bd00c1880 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00c6f10 tx=0x7f0bc801c880 comp rx=0 tx=0).stop 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- 172.21.15.97:0/3733162153 shutdown_connections 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd0071a10 0x7f0bd00c1880 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 --2- 172.21.15.97:0/3733162153 >> v2:172.21.15.143:3300/0 conn(0x7f0bd006be00 0x7f0bd006ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 --2- 172.21.15.97:0/3733162153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- 172.21.15.97:0/3733162153 >> 172.21.15.97:0/3733162153 conn(0x7f0bd00c2970 msgr2=0x7f0bd00c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- 172.21.15.97:0/3733162153 shutdown_connections 2023-12-04T05:40:05.634 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- 172.21.15.97:0/3733162153 wait complete. 2023-12-04T05:40:05.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 Processor -- start 2023-12-04T05:40:05.635 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.632+0000 7f0bd5679640 1 -- start start 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bd0071a10 0x7f0bd00a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd00aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00ab510 con 0x7f0bd006be00 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01ece70 con 0x7f0bd0071a10 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01ed150 con 0x7f0bd014e970 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46266/0 (socket says 172.21.15.97:46266) 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 -- 172.21.15.97:0/192820616 learned_addr learned my addr 172.21.15.97:0/192820616 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bcf7fe640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd00aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bc67fc640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bd0071a10 0x7f0bd00a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 -- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 msgr2=0x7f0bd00aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.638 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd00aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 -- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bd0071a10 msgr2=0x7f0bd00a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bd0071a10 0x7f0bd00a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 -- 172.21.15.97:0/192820616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009b30 con 0x7f0bd006be00 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bceffd640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000d5f0 tx=0x7f0bc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00125f0 con 0x7f0bd006be00 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0012750 con 0x7f0bd006be00 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0012ae0 con 0x7f0bd006be00 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd01ed430 con 0x7f0bd006be00 2023-12-04T05:40:05.639 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd015a2d0 con 0x7f0bd006be00 2023-12-04T05:40:05.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0068440 con 0x7f0bd006be00 2023-12-04T05:40:05.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.636+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0bc0012c40 con 0x7f0bd006be00 2023-12-04T05:40:05.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.640+0000 7f0bc7fff640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 0x7f0bb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.640+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0bc0084bf0 con 0x7f0bd006be00 2023-12-04T05:40:05.640 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.640+0000 7f0bc67fc640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 0x7f0bb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.642 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.640+0000 7f0bc67fc640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 0x7f0bb0068d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0bd014c8b0 tx=0x7f0bb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.644+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bc0051ac0 con 0x7f0bd006be00 2023-12-04T05:40:05.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.792+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bd00c03c0 con 0x7f0bd006be00 2023-12-04T05:40:05.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bc7fff640 1 -- 172.21.15.97:0/192820616 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7f0bc0007380 con 0x7f0bd006be00 2023-12-04T05:40:05.797 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:05.797 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 msgr2=0x7f0bb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 0x7f0bb0068d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0bd014c8b0 tx=0x7f0bb8008040 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 msgr2=0x7f0bd015b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000d5f0 tx=0x7f0bc000dab0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 shutdown_connections 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0bb00668d0 0x7f0bb0068d90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0bd014e970 0x7f0bd00aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0bd0071a10 0x7f0bd00a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 --2- 172.21.15.97:0/192820616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0bd006be00 0x7f0bd015b010 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 >> 172.21.15.97:0/192820616 conn(0x7f0bd00c2970 msgr2=0x7f0bd006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 shutdown_connections 2023-12-04T05:40:05.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.796+0000 7f0bd5679640 1 -- 172.21.15.97:0/192820616 wait complete. 2023-12-04T05:40:05.818 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T05:40:05.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:05.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.952+0000 7fe69732a640 1 Processor -- start 2023-12-04T05:40:05.955 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.952+0000 7fe69732a640 1 -- start start 2023-12-04T05:40:05.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe69732a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6900c1880 0x7fe6900c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe69732a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 0x7fe690163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.957 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe69732a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900707c0 con 0x7fe690071e10 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe69732a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69006dd10 con 0x7fe6900c1880 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe69732a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69006ff60 con 0x7fe690071390 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6900c1880 0x7fe6900c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fe6900c1880 0x7fe6900c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46282/0 (socket says 172.21.15.97:46282) 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6948c5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fe690071e10 0x7fe69006be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53574/0 (socket says 172.21.15.97:53574) 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 -- 172.21.15.97:0/2334066433 learned_addr learned my addr 172.21.15.97:0/2334066433 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 -- 172.21.15.97:0/2334066433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 msgr2=0x7fe690163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6958c7640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 0x7fe690163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 0x7fe690163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 -- 172.21.15.97:0/2334066433 >> v1:172.21.15.97:6789/0 conn(0x7fe690071e10 legacy=0x7fe69006be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6950c6640 1 -- 172.21.15.97:0/2334066433 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690159470 con 0x7fe6900c1880 2023-12-04T05:40:05.958 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe687fff640 1 -- 172.21.15.97:0/2334066433 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818706913 0 0) 0x7fe6900707c0 con 0x7fe690071e10 2023-12-04T05:40:05.959 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.956+0000 7fe6958c7640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 0x7fe690163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:05.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe6950c6640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6900c1880 0x7fe6900c1c60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009870 tx=0x7fe68c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d91c710853dd0e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe687fff640 1 -- 172.21.15.97:0/2334066433 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0ab600 con 0x7fe6900c1880 2023-12-04T05:40:05.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe687fff640 1 -- 172.21.15.97:0/2334066433 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0a7050 con 0x7fe6900c1880 2023-12-04T05:40:05.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe687fff640 1 -- 172.21.15.97:0/2334066433 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0ab980 con 0x7fe6900c1880 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- 172.21.15.97:0/2334066433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6900c1880 msgr2=0x7fe6900c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6900c1880 0x7fe6900c1c60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009870 tx=0x7fe68c01c4b0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- 172.21.15.97:0/2334066433 shutdown_connections 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe690071390 0x7fe690163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 --2- 172.21.15.97:0/2334066433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6900c1880 0x7fe6900c1c60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- 172.21.15.97:0/2334066433 >> 172.21.15.97:0/2334066433 conn(0x7fe6900c2970 msgr2=0x7fe6900c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- 172.21.15.97:0/2334066433 shutdown_connections 2023-12-04T05:40:05.961 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- 172.21.15.97:0/2334066433 wait complete. 2023-12-04T05:40:05.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 Processor -- start 2023-12-04T05:40:05.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.960+0000 7fe69732a640 1 -- start start 2023-12-04T05:40:05.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe690071390 0x7fe6900c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6900c1880 0x7fe6900c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900c3ad0 con 0x7fe690071e10 2023-12-04T05:40:05.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900a9430 con 0x7fe690071390 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6901f2110 con 0x7fe6900c1880 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46290/0 (socket says 172.21.15.97:46290) 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 -- 172.21.15.97:0/1808910701 learned_addr learned my addr 172.21.15.97:0/1808910701 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6950c6640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe690071390 0x7fe6900c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6958c7640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6900c1880 0x7fe6900c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 -- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6900c1880 msgr2=0x7fe6900c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6900c1880 0x7fe6900c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 -- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe690071390 msgr2=0x7fe6900c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe690071390 0x7fe6900c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 -- 172.21.15.97:0/1808910701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0094d0 con 0x7fe690071e10 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe6948c5640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe6800011f0 tx=0x7fe68000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800074e0 con 0x7fe690071e10 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe680007640 con 0x7fe690071e10 2023-12-04T05:40:05.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900c5af0 con 0x7fe690071e10 2023-12-04T05:40:05.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680004a10 con 0x7fe690071e10 2023-12-04T05:40:05.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6901f2320 con 0x7fe690071e10 2023-12-04T05:40:05.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6900c3c10 con 0x7fe690071e10 2023-12-04T05:40:05.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.964+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe680004b70 con 0x7fe690071e10 2023-12-04T05:40:05.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.968+0000 7fe685ffb640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 0x7fe674068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:05.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.968+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe680083d00 con 0x7fe690071e10 2023-12-04T05:40:05.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.968+0000 7fe6950c6640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 0x7fe674068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:05.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.968+0000 7fe6950c6640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 0x7fe674068d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0ad000 tx=0x7fe68c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:05.972 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:05.972+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6900c3c10 con 0x7fe690071e10 2023-12-04T05:40:06.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.152+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6900c3c10 con 0x7fe690071e10 2023-12-04T05:40:06.155 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.152+0000 7fe685ffb640 1 -- 172.21.15.97:0/1808910701 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6137 (secure 0 0 0) 0x7fe6900c3c10 con 0x7fe690071e10 2023-12-04T05:40:06.155 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:06.156 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:06.156 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 53 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 msgr2=0x7fe674068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 0x7fe674068d90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0ad000 tx=0x7fe68c0a6000 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 msgr2=0x7fe690157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe6800011f0 tx=0x7fe68000c9b0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 shutdown_connections 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fe6740668d0 0x7fe674068d90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6900c1880 0x7fe6900c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe690071e10 0x7fe690157b10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 --2- 172.21.15.97:0/1808910701 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe690071390 0x7fe6900c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.158 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 >> 172.21.15.97:0/1808910701 conn(0x7fe6900c2970 msgr2=0x7fe69014e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 shutdown_connections 2023-12-04T05:40:06.159 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.156+0000 7fe69732a640 1 -- 172.21.15.97:0/1808910701 wait complete. 2023-12-04T05:40:06.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:06.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.312+0000 7f25bb180640 1 Processor -- start 2023-12-04T05:40:06.315 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.312+0000 7f25bb180640 1 -- start start 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25b406be00 0x7f25b406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f25b4071a10 0x7f25b40c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b4152300 con 0x7f25b406be00 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b4071580 con 0x7f25b4071a10 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25bb180640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b414ed50 con 0x7f25b414e970 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25b406be00 0x7f25b406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f25b406be00 0x7f25b406ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46292/0 (socket says 172.21.15.97:46292) 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 -- 172.21.15.97:0/4225242048 learned_addr learned my addr 172.21.15.97:0/4225242048 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25b971d640 1 --2- 172.21.15.97:0/4225242048 >> v2:172.21.15.143:3300/0 conn(0x7f25b4071a10 0x7f25b40c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.318 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25b8f1c640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 -- 172.21.15.97:0/4225242048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 msgr2=0x7f25b406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 -- 172.21.15.97:0/4225242048 >> v2:172.21.15.143:3300/0 conn(0x7f25b4071a10 msgr2=0x7f25b40c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 --2- 172.21.15.97:0/4225242048 >> v2:172.21.15.143:3300/0 conn(0x7f25b4071a10 0x7f25b40c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.316+0000 7f25abfff640 1 -- 172.21.15.97:0/4225242048 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4151d60 con 0x7f25b406be00 2023-12-04T05:40:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25abfff640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b406ca50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f25b4155970 tx=0x7f25a401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad7a98abe1a975f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25ab7fe640 1 -- 172.21.15.97:0/4225242048 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40a7b10 con 0x7f25b406be00 2023-12-04T05:40:06.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25ab7fe640 1 -- 172.21.15.97:0/4225242048 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40a7c70 con 0x7f25b406be00 2023-12-04T05:40:06.321 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25ab7fe640 1 -- 172.21.15.97:0/4225242048 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40af440 con 0x7f25b406be00 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- 172.21.15.97:0/4225242048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 msgr2=0x7f25b406ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b406ca50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f25b4155970 tx=0x7f25a401ea80 comp rx=0 tx=0).stop 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- 172.21.15.97:0/4225242048 shutdown_connections 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 --2- 172.21.15.97:0/4225242048 >> v2:172.21.15.143:3300/0 conn(0x7f25b4071a10 0x7f25b40c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b406ca50 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 --2- 172.21.15.97:0/4225242048 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.322 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- 172.21.15.97:0/4225242048 >> 172.21.15.97:0/4225242048 conn(0x7f25b40c2970 msgr2=0x7f25b40c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:06.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- 172.21.15.97:0/4225242048 shutdown_connections 2023-12-04T05:40:06.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- 172.21.15.97:0/4225242048 wait complete. 2023-12-04T05:40:06.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 Processor -- start 2023-12-04T05:40:06.323 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.320+0000 7f25bb180640 1 -- start start 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b4071a10 0x7f25b41efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b41f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b414bf00 con 0x7f25b406be00 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41433d0 con 0x7f25b4071a10 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b414bc20 con 0x7f25b414e970 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46298/0 (socket says 172.21.15.97:46298) 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 -- 172.21.15.97:0/18512942 learned_addr learned my addr 172.21.15.97:0/18512942 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25abfff640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b4071a10 0x7f25b41efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b971d640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b41f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 -- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 msgr2=0x7f25b41f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b41f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 -- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b4071a10 msgr2=0x7f25b41efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b4071a10 0x7f25b41efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 -- 172.21.15.97:0/18512942 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a400b770 con 0x7f25b406be00 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25b8f1c640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f25b000d5f0 tx=0x7f25b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00125f0 con 0x7f25b406be00 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0012750 con 0x7f25b406be00 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0012ae0 con 0x7f25b406be00 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b41f09f0 con 0x7f25b406be00 2023-12-04T05:40:06.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b41f0cd0 con 0x7f25b406be00 2023-12-04T05:40:06.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4068440 con 0x7f25b406be00 2023-12-04T05:40:06.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.324+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25b0012c40 con 0x7f25b406be00 2023-12-04T05:40:06.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.328+0000 7f25a97fa640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.328+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f25b0084b30 con 0x7f25b406be00 2023-12-04T05:40:06.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.328+0000 7f25abfff640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.328+0000 7f25abfff640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 0x7f25a0068d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b1000 tx=0x7f25a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.332+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25b0051ab0 con 0x7f25b406be00 2023-12-04T05:40:06.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.512+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25b40bfaa0 con 0x7f25b406be00 2023-12-04T05:40:06.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.512+0000 7f25a97fa640 1 -- 172.21.15.97:0/18512942 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f25b00550d0 con 0x7f25b406be00 2023-12-04T05:40:06.515 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:06.515 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:26.441151+0000","modified":"2023-12-04T05:39:29.459213+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.97:6837/2403583657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":2403583657},{"type":"v1","addr":"172.21.15.97:6837","nonce":2403583657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:06.515 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 53 2023-12-04T05:40:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 msgr2=0x7f25a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 0x7f25a0068d90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b1000 tx=0x7f25a4008040 comp rx=0 tx=0).stop 2023-12-04T05:40:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 msgr2=0x7f25b40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f25b000d5f0 tx=0x7f25b000dab0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 shutdown_connections 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f25a00668d0 0x7f25a0068d90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25b414e970 0x7f25b41f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25b4071a10 0x7f25b41efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 --2- 172.21.15.97:0/18512942 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f25b406be00 0x7f25b40c3bd0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 >> 172.21.15.97:0/18512942 conn(0x7f25b40c2970 msgr2=0x7f25b40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 shutdown_connections 2023-12-04T05:40:06.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.516+0000 7f25bb180640 1 -- 172.21.15.97:0/18512942 wait complete. 2023-12-04T05:40:06.535 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:06.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 Processor -- start 2023-12-04T05:40:06.673 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 -- start start 2023-12-04T05:40:06.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8414e970 0x7efd8406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.674 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8406ca50 0x7efd840c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd84152300 con 0x7efd8406be00 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd84071580 con 0x7efd8406ca50 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd8b157640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8414ed50 con 0x7efd8414e970 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8406ca50 0x7efd840c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd8406ca50 0x7efd840c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46304/0 (socket says 172.21.15.97:46304) 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 -- 172.21.15.97:0/393217527 learned_addr learned my addr 172.21.15.97:0/393217527 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd88ef3640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8414e970 0x7efd8406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.675 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 -- 172.21.15.97:0/393217527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8414e970 msgr2=0x7efd8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:06.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8414e970 0x7efd8406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 -- 172.21.15.97:0/393217527 >> v1:172.21.15.143:6789/0 conn(0x7efd8406be00 legacy=0x7efd84071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.676 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.672+0000 7efd896f4640 1 -- 172.21.15.97:0/393217527 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8406cea0 con 0x7efd8406ca50 2023-12-04T05:40:06.677 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd896f4640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd840c1880 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009870 tx=0x7efd7c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ad38f136367de4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd7b7fe640 1 -- 172.21.15.97:0/393217527 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0ab620 con 0x7efd8406ca50 2023-12-04T05:40:06.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd7b7fe640 1 -- 172.21.15.97:0/393217527 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c0ab780 con 0x7efd8406ca50 2023-12-04T05:40:06.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd7b7fe640 1 -- 172.21.15.97:0/393217527 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0abb10 con 0x7efd8406ca50 2023-12-04T05:40:06.678 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 -- 172.21.15.97:0/393217527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 msgr2=0x7efd840c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd840c1880 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009870 tx=0x7efd7c01c420 comp rx=0 tx=0).stop 2023-12-04T05:40:06.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 -- 172.21.15.97:0/393217527 shutdown_connections 2023-12-04T05:40:06.679 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd840c1880 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 --2- 172.21.15.97:0/393217527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8414e970 0x7efd8406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 -- 172.21.15.97:0/393217527 >> 172.21.15.97:0/393217527 conn(0x7efd840c2970 msgr2=0x7efd840c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 -- 172.21.15.97:0/393217527 shutdown_connections 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.676+0000 7efd8b157640 1 -- 172.21.15.97:0/393217527 wait complete. 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 Processor -- start 2023-12-04T05:40:06.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- start start 2023-12-04T05:40:06.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8406be00 0x7efd8414bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.684 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 0x7efd841f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841ee0a0 con 0x7efd8406ca50 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8414f290 con 0x7efd8414e970 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd841ed2e0 con 0x7efd8406be00 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46312/0 (socket says 172.21.15.97:46312) 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 -- 172.21.15.97:0/2917786009 learned_addr learned my addr 172.21.15.97:0/2917786009 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:06.685 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd88ef3640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8406be00 0x7efd8414bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd896f4640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 0x7efd841f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 -- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8406be00 msgr2=0x7efd8414bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8406be00 0x7efd8414bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 -- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 msgr2=0x7efd841f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 0x7efd841f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 -- 172.21.15.97:0/2917786009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0094d0 con 0x7efd8406ca50 2023-12-04T05:40:06.686 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd896f4640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 0x7efd841f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd7bfff640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7efd7400c3c0 tx=0x7efd7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740052d0 con 0x7efd8406ca50 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74005430 con 0x7efd8406ca50 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd841ed5c0 con 0x7efd8406ca50 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74003840 con 0x7efd8406ca50 2023-12-04T05:40:06.687 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.680+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd841edb80 con 0x7efd8406ca50 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840a85d0 con 0x7efd8406ca50 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd740039a0 con 0x7efd8406ca50 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd797fa640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd74083a20 con 0x7efd8406ca50 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd88ef3640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:06.688 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.684+0000 7efd88ef3640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efd80011340 tx=0x7efd8000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:06.689 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.688+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd840a85d0 con 0x7efd8406ca50 2023-12-04T05:40:06.840 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.836+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd84152300 con 0x7efd8406ca50 2023-12-04T05:40:06.841 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd797fa640 1 -- 172.21.15.97:0/2917786009 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20202 (secure 0 0 0) 0x7efd84152300 con 0x7efd8406ca50 2023-12-04T05:40:06.841 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:06.841 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":72,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:39:41.004825+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-04T05:39:24.181958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-04T05:39:25.434038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:06.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 msgr2=0x7efd70068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efd80011340 tx=0x7efd8000b040 comp rx=0 tx=0).stop 2023-12-04T05:40:06.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 msgr2=0x7efd84145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:06.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7efd7400c3c0 tx=0x7efd7400c880 comp rx=0 tx=0).stop 2023-12-04T05:40:06.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 shutdown_connections 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd700668d0 0x7efd70068d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd8414e970 0x7efd841f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd8406ca50 0x7efd84145a90 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 --2- 172.21.15.97:0/2917786009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd8406be00 0x7efd8414bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 >> 172.21.15.97:0/2917786009 conn(0x7efd840c2970 msgr2=0x7efd84148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 shutdown_connections 2023-12-04T05:40:06.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:06.840+0000 7efd8b157640 1 -- 172.21.15.97:0/2917786009 wait complete. 2023-12-04T05:40:06.863 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-04T05:40:07.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 Processor -- start 2023-12-04T05:40:07.002 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 -- start start 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad9414eb30 0x7fad9414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad94154fe0 0x7fad9415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad94154640 con 0x7fad9414f790 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940c0bd0 con 0x7fad9414eb30 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad9ae54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9414ef10 con 0x7fad94154fe0 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad9414eb30 0x7fad9414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fad9414eb30 0x7fad9414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46318/0 (socket says 172.21.15.97:46318) 2023-12-04T05:40:07.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 -- 172.21.15.97:0/1020341846 learned_addr learned my addr 172.21.15.97:0/1020341846 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:07.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad993f1640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad94154fe0 0x7fad9415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 -- 172.21.15.97:0/1020341846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad94154fe0 msgr2=0x7fad9415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:07.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad94154fe0 0x7fad9415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 -- 172.21.15.97:0/1020341846 >> v1:172.21.15.143:6789/0 conn(0x7fad9414f790 legacy=0x7fad941548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.000+0000 7fad98bf0640 1 -- 172.21.15.97:0/1020341846 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad941535a0 con 0x7fad9414eb30 2023-12-04T05:40:07.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad98bf0640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9414f250 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fad90009870 tx=0x7fad9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e690daf745ef6f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.006 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad8b7fe640 1 -- 172.21.15.97:0/1020341846 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900aa670 con 0x7fad9414eb30 2023-12-04T05:40:07.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad8b7fe640 1 -- 172.21.15.97:0/1020341846 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad900aa7d0 con 0x7fad9414eb30 2023-12-04T05:40:07.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad8b7fe640 1 -- 172.21.15.97:0/1020341846 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900aab60 con 0x7fad9414eb30 2023-12-04T05:40:07.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 -- 172.21.15.97:0/1020341846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 msgr2=0x7fad9414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9414f250 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fad90009870 tx=0x7fad9001c510 comp rx=0 tx=0).stop 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 -- 172.21.15.97:0/1020341846 shutdown_connections 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad94154fe0 0x7fad9415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1020341846 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9414f250 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 -- 172.21.15.97:0/1020341846 >> 172.21.15.97:0/1020341846 conn(0x7fad940c5e70 msgr2=0x7fad940c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 -- 172.21.15.97:0/1020341846 shutdown_connections 2023-12-04T05:40:07.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.004+0000 7fad9ae54640 1 -- 172.21.15.97:0/1020341846 wait complete. 2023-12-04T05:40:07.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 Processor -- start 2023-12-04T05:40:07.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 -- start start 2023-12-04T05:40:07.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad9414f790 0x7fad9406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 0x7fad940c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9406e160 con 0x7fad9414eb30 2023-12-04T05:40:07.013 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941f11e0 con 0x7fad94154fe0 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9414ada0 con 0x7fad9414f790 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46334/0 (socket says 172.21.15.97:46334) 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 -- 172.21.15.97:0/1588819550 learned_addr learned my addr 172.21.15.97:0/1588819550 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad8bfff640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad9414f790 0x7fad9406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad993f1640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 0x7fad940c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 -- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad9414f790 msgr2=0x7fad9406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.014 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad9414f790 0x7fad9406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 -- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 msgr2=0x7fad940c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 0x7fad940c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 -- 172.21.15.97:0/1588819550 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900094d0 con 0x7fad9414eb30 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad993f1640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 0x7fad940c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad98bf0640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fad9001abc0 tx=0x7fad9001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900b3800 con 0x7fad9414eb30 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad900b3980 con 0x7fad9414eb30 2023-12-04T05:40:07.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900b3d30 con 0x7fad9414eb30 2023-12-04T05:40:07.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.008+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9414fd20 con 0x7fad9414eb30 2023-12-04T05:40:07.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9414a7e0 con 0x7fad9414eb30 2023-12-04T05:40:07.016 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9406c490 con 0x7fad9414eb30 2023-12-04T05:40:07.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad900b2380 con 0x7fad9414eb30 2023-12-04T05:40:07.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad897fa640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 0x7fad80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.017 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fad9011ed20 con 0x7fad9414eb30 2023-12-04T05:40:07.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad8bfff640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 0x7fad80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.012+0000 7fad8bfff640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 0x7fad80068d90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad9414dae0 tx=0x7fad84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.016+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad9406c490 con 0x7fad9414eb30 2023-12-04T05:40:07.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.204+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad9406c490 con 0x7fad9414eb30 2023-12-04T05:40:07.206 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:40:07.204+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:40:07.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.208+0000 7fad897fa640 1 -- 172.21.15.97:0/1588819550 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad9406c490 con 0x7fad9414eb30 2023-12-04T05:40:07.209 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:40:07.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 msgr2=0x7fad80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 0x7fad80068d90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fad9414dae0 tx=0x7fad84009040 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 msgr2=0x7fad9406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fad9001abc0 tx=0x7fad9001ad50 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 shutdown_connections 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fad800668d0 0x7fad80068d90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad94154fe0 0x7fad940c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad9414f790 0x7fad9406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 --2- 172.21.15.97:0/1588819550 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fad9414eb30 0x7fad9406bf50 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 >> 172.21.15.97:0/1588819550 conn(0x7fad940c5e70 msgr2=0x7fad94144910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 shutdown_connections 2023-12-04T05:40:07.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.212+0000 7fad9ae54640 1 -- 172.21.15.97:0/1588819550 wait complete. 2023-12-04T05:40:07.221 INFO:tasks.ceph.mds.c.smithi097.stderr: -4996> 2023-12-04T05:39:33.041+0000 7fc583772640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:40:07.234 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-04T05:40:07.275 INFO:tasks.ceph.mds.c.smithi097.stdout:starting mds.c at 2023-12-04T05:40:07.382 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.380+0000 7f142112a640 1 Processor -- start 2023-12-04T05:40:07.383 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.380+0000 7f142112a640 1 -- start start 2023-12-04T05:40:07.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f142112a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f141c06c000 0x7f141c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f142112a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c150bc0 con 0x7f141c0c1360 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f142112a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c154fd0 con 0x7f141c154af0 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f142112a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c151a70 con 0x7f141c06c000 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f141ad9d640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f141c0c1360 0x7f141c151360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53606/0 (socket says 172.21.15.97:53606) 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f141ad9d640 1 -- 172.21.15.97:0/1046376162 learned_addr learned my addr 172.21.15.97:0/1046376162 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f1413fff640 1 --2- 172.21.15.97:0/1046376162 >> v2:172.21.15.97:3300/0 conn(0x7f141c06c000 0x7f141c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f1413fff640 1 -- 172.21.15.97:0/1046376162 >> v1:172.21.15.143:6789/0 conn(0x7f141c154af0 legacy=0x7f141c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f1413fff640 1 -- 172.21.15.97:0/1046376162 >> v1:172.21.15.97:6789/0 conn(0x7f141c0c1360 legacy=0x7f141c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f1413fff640 1 -- 172.21.15.97:0/1046376162 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c072160 con 0x7f141c06c000 2023-12-04T05:40:07.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f1413fff640 1 --2- 172.21.15.97:0/1046376162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c06c000 0x7f141c0700b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f14040097c0 tx=0x7f140401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2effa1d265e7bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.384+0000 7f141a59c640 1 -- 172.21.15.97:0/1046376162 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040ab600 con 0x7f141c06c000 2023-12-04T05:40:07.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f141a59c640 1 -- 172.21.15.97:0/1046376162 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040a7050 con 0x7f141c06c000 2023-12-04T05:40:07.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f141a59c640 1 -- 172.21.15.97:0/1046376162 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040ab980 con 0x7f141c06c000 2023-12-04T05:40:07.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- 172.21.15.97:0/1046376162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c06c000 msgr2=0x7f141c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 --2- 172.21.15.97:0/1046376162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c06c000 0x7f141c0700b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f14040097c0 tx=0x7f140401c3f0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- 172.21.15.97:0/1046376162 shutdown_connections 2023-12-04T05:40:07.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 --2- 172.21.15.97:0/1046376162 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c06c000 0x7f141c0700b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- 172.21.15.97:0/1046376162 >> 172.21.15.97:0/1046376162 conn(0x7f141c0c5e70 msgr2=0x7f141c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:07.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- 172.21.15.97:0/1046376162 shutdown_connections 2023-12-04T05:40:07.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- 172.21.15.97:0/1046376162 wait complete. 2023-12-04T05:40:07.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 Processor -- start 2023-12-04T05:40:07.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- start start 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 0x7f141c15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141c154af0 0x7f141c1eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0bb890 con 0x7f141c0c1360 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0bae90 con 0x7f141c06c000 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f142112a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c1ef430 con 0x7f141c154af0 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f1413fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f141ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 0x7f141c15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f1413fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46366/0 (socket says 172.21.15.97:46366) 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f1413fff640 1 -- 172.21.15.97:0/2710658736 learned_addr learned my addr 172.21.15.97:0/2710658736 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f141ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 0x7f141c15e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.97:58940/0 (socket says 172.21.15.97:58940) 2023-12-04T05:40:07.392 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.388+0000 7f141b59e640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141c154af0 0x7f141c1eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 -- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141c154af0 msgr2=0x7f141c1eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141c154af0 0x7f141c1eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 -- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 msgr2=0x7f141c15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:07.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 0x7f141c15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:07.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 -- 172.21.15.97:0/2710658736 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009420 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f1413fff640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1404019000 tx=0x7f1404019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040b4410 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14040b4590 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040b4940 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0bb130 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c0c0200 con 0x7f141c0c1360 2023-12-04T05:40:07.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c068440 con 0x7f141c0c1360 2023-12-04T05:40:07.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f14040b2040 con 0x7f141c0c1360 2023-12-04T05:40:07.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 0x7f13fc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:07.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f140411e870 con 0x7f141c0c1360 2023-12-04T05:40:07.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.392+0000 7f141ad9d640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 0x7f13fc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:07.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.396+0000 7f141ad9d640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 0x7f13fc068dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f140c005890 tx=0x7f140c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:07.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.396+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14040eb7a0 con 0x7f141c0c1360 2023-12-04T05:40:07.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:07.580+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f141c0c2430 con 0x7f141c0c1360 2023-12-04T05:40:08.274 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.272+0000 7f14137fe640 1 -- 172.21.15.97:0/2710658736 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f14040eedc0 con 0x7f141c0c1360 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 msgr2=0x7f13fc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 0x7f13fc068dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f140c005890 tx=0x7f140c009040 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 msgr2=0x7f141c1ee9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1404019000 tx=0x7f1404019190 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 shutdown_connections 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f13fc066900 0x7f13fc068dc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f141c154af0 0x7f141c1eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f141c0c1360 0x7f141c1ee9b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 --2- 172.21.15.97:0/2710658736 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f141c06c000 0x7f141c15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 >> 172.21.15.97:0/2710658736 conn(0x7f141c0c5e70 msgr2=0x7f141c15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:08.277 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 shutdown_connections 2023-12-04T05:40:08.278 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.276+0000 7f142112a640 1 -- 172.21.15.97:0/2710658736 wait complete. 2023-12-04T05:40:08.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-04T05:40:08.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 Processor -- start 2023-12-04T05:40:08.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 -- start start 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7a40155190 0x7f7a40071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 0x7f7a40071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a40158c00 con 0x7f7a4013db70 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a40155700 con 0x7f7a40155190 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a481aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40157c50 con 0x7f7a400c3570 2023-12-04T05:40:08.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a46747640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 0x7f7a40071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a45f46640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7a4013db70 0x7f7a400c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52316/0 (socket says 172.21.15.97:52316) 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a45f46640 1 -- 172.21.15.97:0/3407596687 learned_addr learned my addr 172.21.15.97:0/3407596687 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a45745640 1 --2- 172.21.15.97:0/3407596687 >> v2:172.21.15.143:3300/0 conn(0x7f7a40155190 0x7f7a40071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a44f44640 1 -- 172.21.15.97:0/3407596687 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142856661 0 0) 0x7f7a40158c00 con 0x7f7a4013db70 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a44f44640 1 -- 172.21.15.97:0/3407596687 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c003530 con 0x7f7a4013db70 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a46747640 1 -- 172.21.15.97:0/3407596687 >> v2:172.21.15.143:3300/0 conn(0x7f7a40155190 msgr2=0x7f7a40071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:08.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a46747640 1 --2- 172.21.15.97:0/3407596687 >> v2:172.21.15.143:3300/0 conn(0x7f7a40155190 0x7f7a40071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a46747640 1 -- 172.21.15.97:0/3407596687 >> v1:172.21.15.143:6789/0 conn(0x7f7a4013db70 legacy=0x7f7a400c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.488 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.484+0000 7f7a46747640 1 -- 172.21.15.97:0/3407596687 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4013df50 con 0x7f7a400c3570 2023-12-04T05:40:08.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a46747640 1 --2- 172.21.15.97:0/3407596687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 0x7f7a40071a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009d90 tx=0x7f7a3801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb27716128805ae server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a44f44640 1 -- 172.21.15.97:0/3407596687 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a380a5870 con 0x7f7a400c3570 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a44f44640 1 -- 172.21.15.97:0/3407596687 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a380a59d0 con 0x7f7a400c3570 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a44f44640 1 -- 172.21.15.97:0/3407596687 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a380a5d40 con 0x7f7a400c3570 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 -- 172.21.15.97:0/3407596687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 msgr2=0x7f7a40071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 --2- 172.21.15.97:0/3407596687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 0x7f7a40071a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009d90 tx=0x7f7a3801c8c0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 -- 172.21.15.97:0/3407596687 shutdown_connections 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 --2- 172.21.15.97:0/3407596687 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a400c3570 0x7f7a40071a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 --2- 172.21.15.97:0/3407596687 >> v2:172.21.15.143:3300/0 conn(0x7f7a40155190 0x7f7a40071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 -- 172.21.15.97:0/3407596687 >> 172.21.15.97:0/3407596687 conn(0x7f7a400c2a50 msgr2=0x7f7a400c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:08.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 -- 172.21.15.97:0/3407596687 shutdown_connections 2023-12-04T05:40:08.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.488+0000 7f7a481aa640 1 -- 172.21.15.97:0/3407596687 wait complete. 2023-12-04T05:40:08.492 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 Processor -- start 2023-12-04T05:40:08.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- start start 2023-12-04T05:40:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4013db70 0x7f7a401ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a40155190 0x7f7a401ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c5850 con 0x7f7a400c3570 2023-12-04T05:40:08.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40131a70 con 0x7f7a4013db70 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a401f0930 con 0x7f7a40155190 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46370/0 (socket says 172.21.15.97:46370) 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 -- 172.21.15.97:0/552510950 learned_addr learned my addr 172.21.15.97:0/552510950 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45745640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4013db70 0x7f7a401ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a46747640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a40155190 0x7f7a401ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 -- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a40155190 msgr2=0x7f7a401ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a40155190 0x7f7a401ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 -- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4013db70 msgr2=0x7f7a401ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4013db70 0x7f7a401ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:08.495 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 -- 172.21.15.97:0/552510950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a38009a70 con 0x7f7a400c3570 2023-12-04T05:40:08.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a45f46640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c450 tx=0x7f7a3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:08.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c005cf0 con 0x7f7a400c3570 2023-12-04T05:40:08.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c005e50 con 0x7f7a400c3570 2023-12-04T05:40:08.496 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a401f0e60 con 0x7f7a400c3570 2023-12-04T05:40:08.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0072f0 con 0x7f7a400c3570 2023-12-04T05:40:08.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.492+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a401f0b80 con 0x7f7a400c3570 2023-12-04T05:40:08.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40068440 con 0x7f7a400c3570 2023-12-04T05:40:08.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7a3c007450 con 0x7f7a400c3570 2023-12-04T05:40:08.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a367fc640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 0x7f7a24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:08.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f7a3c083e30 con 0x7f7a400c3570 2023-12-04T05:40:08.498 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a45745640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 0x7f7a24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:08.499 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.496+0000 7f7a45745640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 0x7f7a24068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c5520 tx=0x7f7a30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:08.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.500+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a3c050cb0 con 0x7f7a400c3570 2023-12-04T05:40:08.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:08.648+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a4013b780 con 0x7f7a400c3570 2023-12-04T05:40:09.285 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.284+0000 7f7a367fc640 1 -- 172.21.15.97:0/552510950 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7a3c017020 con 0x7f7a400c3570 2023-12-04T05:40:09.285 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_metadata' removed 2023-12-04T05:40:09.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.284+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 msgr2=0x7f7a24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.284+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 0x7f7a24068d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7a400c5520 tx=0x7f7a30008040 comp rx=0 tx=0).stop 2023-12-04T05:40:09.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.284+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 msgr2=0x7f7a40139250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.284+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c450 tx=0x7f7a3c00c910 comp rx=0 tx=0).stop 2023-12-04T05:40:09.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 shutdown_connections 2023-12-04T05:40:09.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7a240668d0 0x7f7a24068d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a40155190 0x7f7a401ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4013db70 0x7f7a401ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 --2- 172.21.15.97:0/552510950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a400c3570 0x7f7a40139250 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 >> 172.21.15.97:0/552510950 conn(0x7f7a400c2a50 msgr2=0x7f7a400c2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:09.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 shutdown_connections 2023-12-04T05:40:09.290 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.288+0000 7f7a481aa640 1 -- 172.21.15.97:0/552510950 wait complete. 2023-12-04T05:40:09.314 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-04T05:40:09.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.456+0000 7f2d3f355640 1 Processor -- start 2023-12-04T05:40:09.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.456+0000 7f2d3f355640 1 -- start start 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.456+0000 7f2d3f355640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d3814fad0 0x7f2d380a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.456+0000 7f2d3f355640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d38152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3f355640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3814feb0 con 0x7f2d380c3570 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3f355640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3806d560 con 0x7f2d3814fad0 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3f355640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3806d840 con 0x7f2d381527a0 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d3814fad0 0x7f2d380a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2d3814fad0 0x7f2d380a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46378/0 (socket says 172.21.15.97:46378) 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3c8f0640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2d380c3570 0x7f2d380c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53616/0 (socket says 172.21.15.97:53616) 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 -- 172.21.15.97:0/4165893741 learned_addr learned my addr 172.21.15.97:0/4165893741 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d8f2640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d38152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 -- 172.21.15.97:0/4165893741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 msgr2=0x7f2d38152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d38152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 -- 172.21.15.97:0/4165893741 >> v1:172.21.15.97:6789/0 conn(0x7f2d380c3570 legacy=0x7f2d380c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 -- 172.21.15.97:0/4165893741 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3806db20 con 0x7f2d3814fad0 2023-12-04T05:40:09.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d3d0f1640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d380a8e70 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009870 tx=0x7f2d3401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f07ba75ccd3bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d2ffff640 1 -- 172.21.15.97:0/4165893741 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340ab600 con 0x7f2d3814fad0 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d2ffff640 1 -- 172.21.15.97:0/4165893741 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d340a7050 con 0x7f2d3814fad0 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.460+0000 7f2d2ffff640 1 -- 172.21.15.97:0/4165893741 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340ab980 con 0x7f2d3814fad0 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- 172.21.15.97:0/4165893741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 msgr2=0x7f2d380a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d380a8e70 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009870 tx=0x7f2d3401c540 comp rx=0 tx=0).stop 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- 172.21.15.97:0/4165893741 shutdown_connections 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d38152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- 172.21.15.97:0/4165893741 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d380a8e70 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- 172.21.15.97:0/4165893741 >> 172.21.15.97:0/4165893741 conn(0x7f2d380c2a50 msgr2=0x7f2d380c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:09.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- 172.21.15.97:0/4165893741 shutdown_connections 2023-12-04T05:40:09.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- 172.21.15.97:0/4165893741 wait complete. 2023-12-04T05:40:09.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 Processor -- start 2023-12-04T05:40:09.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- start start 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380c3570 0x7f2d3813d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d3813b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38143200 con 0x7f2d3814fad0 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3813c180 con 0x7f2d380c3570 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3f355640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38146360 con 0x7f2d381527a0 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46384/0 (socket says 172.21.15.97:46384) 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 -- 172.21.15.97:0/2810824485 learned_addr learned my addr 172.21.15.97:0/2810824485 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:09.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3d8f2640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d3813b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3d0f1640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380c3570 0x7f2d3813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 -- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 msgr2=0x7f2d3813b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d3813b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 -- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380c3570 msgr2=0x7f2d3813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380c3570 0x7f2d3813d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3c8f0640 1 -- 172.21.15.97:0/2810824485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340094d0 con 0x7f2d3814fad0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.464+0000 7f2d3d8f2640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d3813b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d3c8f0640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c460 tx=0x7f2d2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28007480 con 0x7f2d3814fad0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28007620 con 0x7f2d3814fad0 2023-12-04T05:40:09.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3813d2a0 con 0x7f2d3814fad0 2023-12-04T05:40:09.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004a30 con 0x7f2d3814fad0 2023-12-04T05:40:09.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d38143450 con 0x7f2d3814fad0 2023-12-04T05:40:09.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d38068440 con 0x7f2d3814fad0 2023-12-04T05:40:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2d28004b90 con 0x7f2d3814fad0 2023-12-04T05:40:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 0x7f2d1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f2d28083a30 con 0x7f2d3814fad0 2023-12-04T05:40:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.468+0000 7f2d3d0f1640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 0x7f2d1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:09.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.472+0000 7f2d3d0f1640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 0x7f2d1c068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2d380a9c30 tx=0x7f2d340a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:09.474 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.472+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d28050bb0 con 0x7f2d3814fad0 2023-12-04T05:40:09.624 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:09.620+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d380ac350 con 0x7f2d3814fad0 2023-12-04T05:40:10.289 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d2dffb640 1 -- 172.21.15.97:0/2810824485 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d280180d0 con 0x7f2d3814fad0 2023-12-04T05:40:10.289 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs_data' removed 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 msgr2=0x7f2d1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 0x7f2d1c068d90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2d380a9c30 tx=0x7f2d340a6000 comp rx=0 tx=0).stop 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 msgr2=0x7f2d38144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800c460 tx=0x7f2d2800c920 comp rx=0 tx=0).stop 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 shutdown_connections 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2d1c0668d0 0x7f2d1c068d90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d381527a0 0x7f2d3813b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d3814fad0 0x7f2d38144d30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.291 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 --2- 172.21.15.97:0/2810824485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380c3570 0x7f2d3813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 >> 172.21.15.97:0/2810824485 conn(0x7f2d380c2a50 msgr2=0x7f2d380aa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:10.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 shutdown_connections 2023-12-04T05:40:10.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.288+0000 7f2d3f355640 1 -- 172.21.15.97:0/2810824485 wait complete. 2023-12-04T05:40:10.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:10.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 Processor -- start 2023-12-04T05:40:10.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 -- start start 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa274154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2741547d0 con 0x7fa274151bf0 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa274158b80 con 0x7fa274158630 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27bb72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740c4aa0 con 0x7fa2740c7ef0 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27990e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fa274151bf0 0x7fa2740abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53628/0 (socket says 172.21.15.97:53628) 2023-12-04T05:40:10.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27990e640 1 -- 172.21.15.97:0/3409831418 learned_addr learned my addr 172.21.15.97:0/3409831418 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27910d640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa274154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094597005 0 0) 0x7fa2741547d0 con 0x7fa274151bf0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa260003530 con 0x7fa274151bf0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071161654 0 0) 0x7fa274158b80 con 0x7fa274158630 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2741547d0 con 0x7fa274158630 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1392280912 0 0) 0x7fa260003530 con 0x7fa274151bf0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 msgr2=0x7fa274154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa274154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 >> v1:172.21.15.143:6789/0 conn(0x7fa274158630 legacy=0x7fa27415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740c4d40 con 0x7fa274151bf0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7fa270001680 con 0x7fa274151bf0 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27910d640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa274154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 >> v1:172.21.15.97:6789/0 conn(0x7fa274151bf0 legacy=0x7fa2740abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260003b40 0x7fa260003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa2600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa260004d10 0x7fa260005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740c4aa0 con 0x7fa260004d10 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26000bb20 con 0x7fa260003b40 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26000bce0 con 0x7fa2740c7ef0 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.456+0000 7fa27a10f640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa260004d10 0x7fa260005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27910d640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa2600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27990e640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260003b40 0x7fa260003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 -- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 msgr2=0x7fa2600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2740c7ef0 0x7fa2600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 -- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260003b40 msgr2=0x7fa260003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260003b40 0x7fa260003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 -- 172.21.15.97:0/3409831418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009420 con 0x7fa260004d10 2023-12-04T05:40:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27a10f640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa260004d10 0x7fa260005190 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001fd0 tx=0x7fa26c01c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3802b19791a8990b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0a4c20 con 0x7fa260004d10 2023-12-04T05:40:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c0a4da0 con 0x7fa260004d10 2023-12-04T05:40:10.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.460+0000 7fa27890c640 1 -- 172.21.15.97:0/3409831418 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c003bc0 con 0x7fa260004d10 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- 172.21.15.97:0/3409831418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa260004d10 msgr2=0x7fa260005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 --2- 172.21.15.97:0/3409831418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa260004d10 0x7fa260005190 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001fd0 tx=0x7fa26c01c5c0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 -- 172.21.15.97:0/3409831418 reap_dead start 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- 172.21.15.97:0/3409831418 shutdown_connections 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- 172.21.15.97:0/3409831418 >> 172.21.15.97:0/3409831418 conn(0x7fa274073550 msgr2=0x7fa274073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- 172.21.15.97:0/3409831418 shutdown_connections 2023-12-04T05:40:10.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- 172.21.15.97:0/3409831418 wait complete. 2023-12-04T05:40:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 Processor -- start 2023-12-04T05:40:10.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- start start 2023-12-04T05:40:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa260004d10 0x7fa2740a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27414dcc0 0x7fa2740ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27414ee90 con 0x7fa2740c3090 2023-12-04T05:40:10.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740ab8c0 con 0x7fa27414dcc0 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27bb72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740c3b50 con 0x7fa260004d10 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46398/0 (socket says 172.21.15.97:46398) 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 -- 172.21.15.97:0/1828306643 learned_addr learned my addr 172.21.15.97:0/1828306643 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27990e640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa260004d10 0x7fa2740a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27910d640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27414dcc0 0x7fa2740ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 -- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa260004d10 msgr2=0x7fa2740a9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa260004d10 0x7fa2740a9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 -- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27414dcc0 msgr2=0x7fa2740ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27414dcc0 0x7fa2740ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 -- 172.21.15.97:0/1828306643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740add90 con 0x7fa2740c3090 2023-12-04T05:40:10.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.464+0000 7fa27a10f640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001fd0 tx=0x7fa260005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c003e80 con 0x7fa2740c3090 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c0a4a20 con 0x7fa2740c3090 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2740c3da0 con 0x7fa2740c3090 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0050d0 con 0x7fa2740c3090 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2740c2b40 con 0x7fa2740c3090 2023-12-04T05:40:10.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2740c2b40 con 0x7fa2740c3090 2023-12-04T05:40:10.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa26c005230 con 0x7fa2740c3090 2023-12-04T05:40:10.470 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 0x7fa258068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa26c11d8d0 con 0x7fa2740c3090 2023-12-04T05:40:10.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa27990e640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 0x7fa258068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.471 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.468+0000 7fa27990e640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 0x7fa258068d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c10 tx=0x7fa270001e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.475 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.472+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa26c0eab50 con 0x7fa2740c3090 2023-12-04T05:40:10.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.624+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2740c2b40 con 0x7fa2740c3090 2023-12-04T05:40:10.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.624+0000 7fa26a7fc640 1 -- 172.21.15.97:0/1828306643 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fa26c0011d0 con 0x7fa2740c3090 2023-12-04T05:40:10.627 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:10.627 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":75,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:40:10.285926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/2403583657":"2023-12-05T05:40:07.207202+0000","172.21.15.97:6836/2403583657":"2023-12-05T05:40:07.207202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 msgr2=0x7fa258068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 0x7fa258068d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa270000c10 tx=0x7fa270001e10 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 msgr2=0x7fa2740c1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001fd0 tx=0x7fa260005800 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 shutdown_connections 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fa2580668d0 0x7fa258068d90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa2740c3090 0x7fa2740c1360 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa27414dcc0 0x7fa2740ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 --2- 172.21.15.97:0/1828306643 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa260004d10 0x7fa2740a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 >> 172.21.15.97:0/1828306643 conn(0x7fa274073550 msgr2=0x7fa27414fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 shutdown_connections 2023-12-04T05:40:10.629 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.628+0000 7fa27bb72640 1 -- 172.21.15.97:0/1828306643 wait complete. 2023-12-04T05:40:10.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T05:36:28.253428+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-04T05:39:37.391574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-04T05:39:38.528584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T05:40:10.648 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T05:40:10.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.784+0000 7f6af2c79640 1 Processor -- start 2023-12-04T05:40:10.788 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af2c79640 1 -- start start 2023-12-04T05:40:10.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af2c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 0x7f6aec15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af2c79640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec154640 con 0x7f6aec14f960 2023-12-04T05:40:10.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af2c79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec14ef10 con 0x7f6aec14eb30 2023-12-04T05:40:10.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af2c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0c0bd0 con 0x7f6aec154fe0 2023-12-04T05:40:10.789 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aebfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6aec14f960 0x7f6aec1548d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53636/0 (socket says 172.21.15.97:53636) 2023-12-04T05:40:10.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aebfff640 1 -- 172.21.15.97:0/873820375 learned_addr learned my addr 172.21.15.97:0/873820375 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:10.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af1216640 1 --2- 172.21.15.97:0/873820375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 0x7f6aec15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309921544 0 0) 0x7f6aec154640 con 0x7f6aec14f960 2023-12-04T05:40:10.790 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003530 con 0x7f6aec14f960 2023-12-04T05:40:10.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422586070 0 0) 0x7f6aec14ef10 con 0x7f6aec14eb30 2023-12-04T05:40:10.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aec154640 con 0x7f6aec14eb30 2023-12-04T05:40:10.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af1216640 1 -- 172.21.15.97:0/873820375 >> v1:172.21.15.143:6789/0 conn(0x7f6aec14eb30 legacy=0x7f6aec14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af1216640 1 -- 172.21.15.97:0/873820375 >> v1:172.21.15.97:6789/0 conn(0x7f6aec14f960 legacy=0x7f6aec1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.791 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.788+0000 7f6af1216640 1 -- 172.21.15.97:0/873820375 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec1535a0 con 0x7f6aec154fe0 2023-12-04T05:40:10.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af1216640 1 --2- 172.21.15.97:0/873820375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 0x7f6aec15cc70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009dc0 tx=0x7f6ae401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc71709c856d2fa server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40a5810 con 0x7f6aec154fe0 2023-12-04T05:40:10.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40a5970 con 0x7f6aec154fe0 2023-12-04T05:40:10.793 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6aeb7fe640 1 -- 172.21.15.97:0/873820375 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40a5ce0 con 0x7f6aec154fe0 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 -- 172.21.15.97:0/873820375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 msgr2=0x7f6aec15cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 --2- 172.21.15.97:0/873820375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 0x7f6aec15cc70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009dc0 tx=0x7f6ae401c940 comp rx=0 tx=0).stop 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 -- 172.21.15.97:0/873820375 shutdown_connections 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 --2- 172.21.15.97:0/873820375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec154fe0 0x7f6aec15cc70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 -- 172.21.15.97:0/873820375 >> 172.21.15.97:0/873820375 conn(0x7f6aec0c5e70 msgr2=0x7f6aec0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:10.794 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 -- 172.21.15.97:0/873820375 shutdown_connections 2023-12-04T05:40:10.795 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 -- 172.21.15.97:0/873820375 wait complete. 2023-12-04T05:40:10.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.792+0000 7f6af2c79640 1 Processor -- start 2023-12-04T05:40:10.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- start start 2023-12-04T05:40:10.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6aec14eb30 0x7f6aec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec14f960 0x7f6aec147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec146080 con 0x7f6aec154fe0 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec06d900 con 0x7f6aec14eb30 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec147140 con 0x7f6aec14f960 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46414/0 (socket says 172.21.15.97:46414) 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 -- 172.21.15.97:0/3180958256 learned_addr learned my addr 172.21.15.97:0/3180958256 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6aebfff640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec14f960 0x7f6aec147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af0a15640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6aec14eb30 0x7f6aec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 -- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec14f960 msgr2=0x7f6aec147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec14f960 0x7f6aec147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 -- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6aec14eb30 msgr2=0x7f6aec06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6aec14eb30 0x7f6aec06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 -- 172.21.15.97:0/3180958256 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009a70 con 0x7f6aec154fe0 2023-12-04T05:40:10.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af1216640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6ae401a570 tx=0x7f6ae40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40bd070 con 0x7f6aec154fe0 2023-12-04T05:40:10.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40ad440 con 0x7f6aec154fe0 2023-12-04T05:40:10.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec1479e0 con 0x7f6aec154fe0 2023-12-04T05:40:10.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40ad7f0 con 0x7f6aec154fe0 2023-12-04T05:40:10.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec06db30 con 0x7f6aec154fe0 2023-12-04T05:40:10.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.796+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec147b70 con 0x7f6aec154fe0 2023-12-04T05:40:10.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.800+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6ae40b4070 con 0x7f6aec154fe0 2023-12-04T05:40:10.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.800+0000 7f6ae97fa640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 0x7f6ad0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:10.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.800+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6ae411e580 con 0x7f6aec154fe0 2023-12-04T05:40:10.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.800+0000 7f6af0a15640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 0x7f6ad0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:10.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.800+0000 7f6af0a15640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 0x7f6ad0068dc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00011f0 tx=0x7f6ae0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:10.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.804+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ae40eb770 con 0x7f6aec154fe0 2023-12-04T05:40:10.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.964+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6aec068440 con 0x7f6aec154fe0 2023-12-04T05:40:10.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.964+0000 7f6ae97fa640 1 -- 172.21.15.97:0/3180958256 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ae40eed90 con 0x7f6aec154fe0 2023-12-04T05:40:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 1 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 msgr2=0x7f6ad0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 0x7f6ad0068dc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00011f0 tx=0x7f6ae0009040 comp rx=0 tx=0).stop 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 msgr2=0x7f6aec14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6ae401a570 tx=0x7f6ae40196e0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 shutdown_connections 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6ad0066900 0x7f6ad0068dc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6aec154fe0 0x7f6aec14feb0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6aec14f960 0x7f6aec147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 --2- 172.21.15.97:0/3180958256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6aec14eb30 0x7f6aec06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:10.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 >> 172.21.15.97:0/3180958256 conn(0x7f6aec0c5e70 msgr2=0x7f6aec149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:10.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 shutdown_connections 2023-12-04T05:40:10.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:10.968+0000 7f6af2c79640 1 -- 172.21.15.97:0/3180958256 wait complete. 2023-12-04T05:40:10.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-04T05:40:11.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 Processor -- start 2023-12-04T05:40:11.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 -- start start 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 0x7f56dc06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0aa240 con 0x7f56dc0c1e70 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0aa500 con 0x7f56dc06c440 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56e206b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc152910 con 0x7f56dc1524e0 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56db7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f56dc0c1e70 0x7f56dc0a8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53646/0 (socket says 172.21.15.97:53646) 2023-12-04T05:40:11.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56db7fe640 1 -- 172.21.15.97:0/3371394063 learned_addr learned my addr 172.21.15.97:0/3371394063 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56dbfff640 1 --2- 172.21.15.97:0/3371394063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 0x7f56dc06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218720558 0 0) 0x7f56dc0aa240 con 0x7f56dc0c1e70 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.136+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c4003530 con 0x7f56dc0c1e70 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803573380 0 0) 0x7f56dc0aa500 con 0x7f56dc06c440 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56dc0aa240 con 0x7f56dc06c440 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1781626666 0 0) 0x7f56c4003530 con 0x7f56dc0c1e70 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56dbfff640 1 -- 172.21.15.97:0/3371394063 >> v1:172.21.15.143:6789/0 conn(0x7f56dc06c440 legacy=0x7f56dc06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56dbfff640 1 -- 172.21.15.97:0/3371394063 >> v1:172.21.15.97:6789/0 conn(0x7f56dc0c1e70 legacy=0x7f56dc0a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56dbfff640 1 -- 172.21.15.97:0/3371394063 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0aa7e0 con 0x7f56dc1524e0 2023-12-04T05:40:11.142 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56dbfff640 1 --2- 172.21.15.97:0/3371394063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 0x7f56dc06d920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009dc0 tx=0x7f56d401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9579bc6480c1420 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc001600 con 0x7f56dc1524e0 2023-12-04T05:40:11.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40a55c0 con 0x7f56dc1524e0 2023-12-04T05:40:11.143 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56da7fc640 1 -- 172.21.15.97:0/3371394063 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40a5950 con 0x7f56dc1524e0 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56e206b640 1 -- 172.21.15.97:0/3371394063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 msgr2=0x7f56dc06d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56e206b640 1 --2- 172.21.15.97:0/3371394063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 0x7f56dc06d920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009dc0 tx=0x7f56d401c890 comp rx=0 tx=0).stop 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56e206b640 1 -- 172.21.15.97:0/3371394063 shutdown_connections 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56e206b640 1 --2- 172.21.15.97:0/3371394063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc1524e0 0x7f56dc06d920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.140+0000 7f56e206b640 1 -- 172.21.15.97:0/3371394063 >> 172.21.15.97:0/3371394063 conn(0x7f56dc0c5e70 msgr2=0x7f56dc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- 172.21.15.97:0/3371394063 shutdown_connections 2023-12-04T05:40:11.144 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- 172.21.15.97:0/3371394063 wait complete. 2023-12-04T05:40:11.145 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 Processor -- start 2023-12-04T05:40:11.146 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- start start 2023-12-04T05:40:11.147 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 0x7f56dc1eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 0x7f56dc14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1ef460 con 0x7f56dc0c1e70 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc148ed0 con 0x7f56dc1524e0 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56e206b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1385d0 con 0x7f56dc06c440 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46424/0 (socket says 172.21.15.97:46424) 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 -- 172.21.15.97:0/3668603239 learned_addr learned my addr 172.21.15.97:0/3668603239 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56dbfff640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 0x7f56dc14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56db7fe640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 0x7f56dc1eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 -- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 msgr2=0x7f56dc1eef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 0x7f56dc1eef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 -- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 msgr2=0x7f56dc14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.148 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 0x7f56dc14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 -- 172.21.15.97:0/3668603239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009a70 con 0x7f56dc0c1e70 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56dbfff640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 0x7f56dc14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56db7fe640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 0x7f56dc1eef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56daffd640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c500 tx=0x7f56d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.144+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0001200 con 0x7f56dc0c1e70 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d00052f0 con 0x7f56dc0c1e70 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0003840 con 0x7f56dc0c1e70 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc1388b0 con 0x7f56dc0c1e70 2023-12-04T05:40:11.149 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc142930 con 0x7f56dc0c1e70 2023-12-04T05:40:11.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc149040 con 0x7f56dc0c1e70 2023-12-04T05:40:11.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f56d00039a0 con 0x7f56dc0c1e70 2023-12-04T05:40:11.151 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56c3fff640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 0x7f56c8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f56d0083c10 con 0x7f56dc0c1e70 2023-12-04T05:40:11.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56db7fe640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 0x7f56c8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.152 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.148+0000 7f56db7fe640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 0x7f56c8068dc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f56cc001730 tx=0x7f56cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.152+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56d00547f0 con 0x7f56dc0c1e70 2023-12-04T05:40:11.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56dc068440 con 0x7f56dc0c1e70 2023-12-04T05:40:11.317 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56c3fff640 1 -- 172.21.15.97:0/3668603239 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f56d00054c0 con 0x7f56dc0c1e70 2023-12-04T05:40:11.317 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 32 2023-12-04T05:40:11.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 msgr2=0x7f56c8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 0x7f56c8068dc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f56cc001730 tx=0x7f56cc009040 comp rx=0 tx=0).stop 2023-12-04T05:40:11.319 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 msgr2=0x7f56dc1423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c500 tx=0x7f56d000c9c0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 shutdown_connections 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56c8066900 0x7f56c8068dc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56dc1524e0 0x7f56dc14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f56dc0c1e70 0x7f56dc1423f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 --2- 172.21.15.97:0/3668603239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56dc06c440 0x7f56dc1eef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 >> 172.21.15.97:0/3668603239 conn(0x7f56dc0c5e70 msgr2=0x7f56dc0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 shutdown_connections 2023-12-04T05:40:11.320 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.316+0000 7f56e206b640 1 -- 172.21.15.97:0/3668603239 wait complete. 2023-12-04T05:40:11.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-04T05:40:11.478 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.476+0000 7f7ca65f8640 1 Processor -- start 2023-12-04T05:40:11.479 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.476+0000 7f7ca65f8640 1 -- start start 2023-12-04T05:40:11.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca65f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7ca00c1e70 0x7f7ca01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca65f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca65f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00aa240 con 0x7f7ca00a89a0 2023-12-04T05:40:11.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca65f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca006c0c0 con 0x7f7ca00c1e70 2023-12-04T05:40:11.480 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca65f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00aa500 con 0x7f7ca006c440 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7ca00c1e70 0x7f7ca01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca4b95640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7ca00a89a0 0x7f7ca006d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:52352/0 (socket says 172.21.15.97:52352) 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7ca4b95640 1 -- 172.21.15.97:0/288270907 learned_addr learned my addr 172.21.15.97:0/288270907 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:35070/0 (socket says 172.21.15.97:35070) 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9effd640 1 -- 172.21.15.97:0/288270907 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527278194 0 0) 0x7f7ca00aa240 con 0x7f7ca00a89a0 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9effd640 1 -- 172.21.15.97:0/288270907 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c88003530 con 0x7f7ca00a89a0 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9ffff640 1 -- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 msgr2=0x7f7ca00a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9ffff640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.481 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9ffff640 1 -- 172.21.15.97:0/288270907 >> v1:172.21.15.143:6789/0 conn(0x7f7ca00a89a0 legacy=0x7f7ca006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9ffff640 1 -- 172.21.15.97:0/288270907 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00aa7e0 con 0x7f7ca00c1e70 2023-12-04T05:40:11.482 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.480+0000 7f7c9f7fe640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:11.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7c9ffff640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca00c1e70 0x7f7ca01524e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c9001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86afea5873c75cc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7c9effd640 1 -- 172.21.15.97:0/288270907 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900ab670 con 0x7f7ca00c1e70 2023-12-04T05:40:11.484 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7c9effd640 1 -- 172.21.15.97:0/288270907 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900ab7d0 con 0x7f7ca00c1e70 2023-12-04T05:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7c9effd640 1 -- 172.21.15.97:0/288270907 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900abb60 con 0x7f7ca00c1e70 2023-12-04T05:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca00c1e70 msgr2=0x7f7ca01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca00c1e70 0x7f7ca01524e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7c900097c0 tx=0x7f7c9001c450 comp rx=0 tx=0).stop 2023-12-04T05:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- 172.21.15.97:0/288270907 shutdown_connections 2023-12-04T05:40:11.485 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca006c440 0x7f7ca00a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/288270907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca00c1e70 0x7f7ca01524e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- 172.21.15.97:0/288270907 >> 172.21.15.97:0/288270907 conn(0x7f7ca00c5e70 msgr2=0x7f7ca00c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:11.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- 172.21.15.97:0/288270907 shutdown_connections 2023-12-04T05:40:11.486 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- 172.21.15.97:0/288270907 wait complete. 2023-12-04T05:40:11.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 Processor -- start 2023-12-04T05:40:11.487 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.484+0000 7f7ca65f8640 1 -- start start 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca006c440 0x7f7ca01498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca00c1e70 0x7f7ca014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014f630 con 0x7f7ca00a89a0 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014f8f0 con 0x7f7ca006c440 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014bf20 con 0x7f7ca00c1e70 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46438/0 (socket says 172.21.15.97:46438) 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 -- 172.21.15.97:0/3268922394 learned_addr learned my addr 172.21.15.97:0/3268922394 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9ffff640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca006c440 0x7f7ca01498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca4b95640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca00c1e70 0x7f7ca014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 -- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca00c1e70 msgr2=0x7f7ca014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca00c1e70 0x7f7ca014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 -- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca006c440 msgr2=0x7f7ca01498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca006c440 0x7f7ca01498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 -- 172.21.15.97:0/3268922394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94009420 con 0x7f7ca00a89a0 2023-12-04T05:40:11.490 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9f7fe640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400e980 tx=0x7f7c9400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400ca00 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400cb60 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90009420 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94013470 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00c23d0 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0068440 con 0x7f7ca00a89a0 2023-12-04T05:40:11.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.488+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c940135d0 con 0x7f7ca00a89a0 2023-12-04T05:40:11.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.492+0000 7f7c9cff9640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 0x7f7c8c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.492+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7c94084610 con 0x7f7ca00a89a0 2023-12-04T05:40:11.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.492+0000 7f7c9ffff640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 0x7f7c8c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.492+0000 7f7c9ffff640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 0x7f7c8c068dc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7c900af000 tx=0x7f7c900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.497 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.496+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c940518a0 con 0x7f7ca00a89a0 2023-12-04T05:40:11.645 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7ca006c220 con 0x7f7ca00a89a0 2023-12-04T05:40:11.646 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7c9cff9640 1 -- 172.21.15.97:0/3268922394 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7c94054ec0 con 0x7f7ca00a89a0 2023-12-04T05:40:11.646 INFO:teuthology.orchestra.run.smithi097.stdout:pg_num: 64 2023-12-04T05:40:11.647 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 msgr2=0x7f7c8c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 0x7f7c8c068dc0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7c900af000 tx=0x7f7c900a7000 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 msgr2=0x7f7ca014b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400e980 tx=0x7f7c9400ee40 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 shutdown_connections 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7c8c066900 0x7f7c8c068dc0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ca00c1e70 0x7f7ca014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7ca00a89a0 0x7f7ca014b4a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 --2- 172.21.15.97:0/3268922394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ca006c440 0x7f7ca01498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 >> 172.21.15.97:0/3268922394 conn(0x7f7ca00c5e70 msgr2=0x7f7ca00c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.644+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 shutdown_connections 2023-12-04T05:40:11.648 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.648+0000 7f7ca65f8640 1 -- 172.21.15.97:0/3268922394 wait complete. 2023-12-04T05:40:11.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:11.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 Processor -- start 2023-12-04T05:40:11.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 -- start start 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 0x7fab640a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fab640c2010 0x7fab640c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640a9d30 con 0x7fab64072970 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640aa6d0 con 0x7fab640c2010 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6892a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640aa010 con 0x7fab6406de80 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab5bfff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fab64072970 0x7fab640c4c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53658/0 (socket says 172.21.15.97:53658) 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab5bfff640 1 -- 172.21.15.97:0/1274699523 learned_addr learned my addr 172.21.15.97:0/1274699523 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab62d9d640 1 --2- 172.21.15.97:0/1274699523 >> v2:172.21.15.97:3300/0 conn(0x7fab640c2010 0x7fab640c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6259c640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 0x7fab640a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab61d9b640 1 -- 172.21.15.97:0/1274699523 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330755028 0 0) 0x7fab640a9d30 con 0x7fab64072970 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab61d9b640 1 -- 172.21.15.97:0/1274699523 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab50003530 con 0x7fab64072970 2023-12-04T05:40:11.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab62d9d640 1 -- 172.21.15.97:0/1274699523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 msgr2=0x7fab640a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab62d9d640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 0x7fab640a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab62d9d640 1 -- 172.21.15.97:0/1274699523 >> v1:172.21.15.97:6789/0 conn(0x7fab64072970 legacy=0x7fab640c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab62d9d640 1 -- 172.21.15.97:0/1274699523 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640aa2f0 con 0x7fab640c2010 2023-12-04T05:40:11.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.804+0000 7fab6259c640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 0x7fab640a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:11.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab62d9d640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab640c2460 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009d90 tx=0x7fab5c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6fb1c236436bb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab61d9b640 1 -- 172.21.15.97:0/1274699523 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0a5810 con 0x7fab640c2010 2023-12-04T05:40:11.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab61d9b640 1 -- 172.21.15.97:0/1274699523 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c0a5970 con 0x7fab640c2010 2023-12-04T05:40:11.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab61d9b640 1 -- 172.21.15.97:0/1274699523 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0a5d00 con 0x7fab640c2010 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 -- 172.21.15.97:0/1274699523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 msgr2=0x7fab640c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab640c2460 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009d90 tx=0x7fab5c01c950 comp rx=0 tx=0).stop 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 -- 172.21.15.97:0/1274699523 shutdown_connections 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab640c2460 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 --2- 172.21.15.97:0/1274699523 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab6406de80 0x7fab640a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 -- 172.21.15.97:0/1274699523 >> 172.21.15.97:0/1274699523 conn(0x7fab640c5bf0 msgr2=0x7fab640c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 -- 172.21.15.97:0/1274699523 shutdown_connections 2023-12-04T05:40:11.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.808+0000 7fab6892a640 1 -- 172.21.15.97:0/1274699523 wait complete. 2023-12-04T05:40:11.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 Processor -- start 2023-12-04T05:40:11.812 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- start start 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab6406de80 0x7fab64152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab64072970 0x7fab64150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab64158920 con 0x7fab640c2010 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641596e0 con 0x7fab6406de80 2023-12-04T05:40:11.814 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab641f1470 con 0x7fab64072970 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46464/0 (socket says 172.21.15.97:46464) 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 -- 172.21.15.97:0/435330240 learned_addr learned my addr 172.21.15.97:0/435330240 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab5bfff640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab64072970 0x7fab64150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6259c640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab6406de80 0x7fab64152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 -- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab64072970 msgr2=0x7fab64150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab64072970 0x7fab64150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 -- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab6406de80 msgr2=0x7fab64152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab6406de80 0x7fab64152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 -- 172.21.15.97:0/435330240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c009a70 con 0x7fab640c2010 2023-12-04T05:40:11.815 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab62d9d640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b0040 tx=0x7fab5c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0b9650 con 0x7fab640c2010 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c0b97b0 con 0x7fab640c2010 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0b9b60 con 0x7fab640c2010 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab641f0610 con 0x7fab640c2010 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.812+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641f0b40 con 0x7fab640c2010 2023-12-04T05:40:11.816 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64068440 con 0x7fab640c2010 2023-12-04T05:40:11.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fab5c0b9cc0 con 0x7fab640c2010 2023-12-04T05:40:11.817 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab5affd640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:11.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fab5c11f730 con 0x7fab640c2010 2023-12-04T05:40:11.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab6259c640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:11.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.816+0000 7fab6259c640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 0x7fab44068d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c900 tx=0x7fab54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:11.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:11.820+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab5c0ec910 con 0x7fab640c2010 2023-12-04T05:40:12.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab6415bbc0 con 0x7fab640c2010 2023-12-04T05:40:12.009 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab5affd640 1 -- 172.21.15.97:0/435330240 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fab5c0eff30 con 0x7fab640c2010 2023-12-04T05:40:12.009 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:12.009 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3483003537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3483003537},{"type":"v1","addr":"172.21.15.97:6837","nonce":3483003537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:12.009 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 55 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 msgr2=0x7fab44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 0x7fab44068d90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c900 tx=0x7fab54008040 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 msgr2=0x7fab641505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b0040 tx=0x7fab5c0196f0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 shutdown_connections 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fab440668d0 0x7fab44068d90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab640c2010 0x7fab641505b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab64072970 0x7fab64150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 --2- 172.21.15.97:0/435330240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab6406de80 0x7fab64152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.011 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 >> 172.21.15.97:0/435330240 conn(0x7fab640c5bf0 msgr2=0x7fab640720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 shutdown_connections 2023-12-04T05:40:12.012 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.008+0000 7fab6892a640 1 -- 172.21.15.97:0/435330240 wait complete. 2023-12-04T05:40:12.033 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:12.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 Processor -- start 2023-12-04T05:40:12.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 -- start start 2023-12-04T05:40:12.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0d2c06ca50 0x7f0d2c0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c152300 con 0x7f0d2c06be00 2023-12-04T05:40:12.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c071580 con 0x7f0d2c06ca50 2023-12-04T05:40:12.172 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.168+0000 7f0d32780640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c14ed50 con 0x7f0d2c14e970 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f0d2c06ca50 0x7f0d2c0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2b7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f0d2c06be00 0x7f0d2c071a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53666/0 (socket says 172.21.15.97:53666) 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2b7fe640 1 -- 172.21.15.97:0/550388198 learned_addr learned my addr 172.21.15.97:0/550388198 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2bfff640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 -- 172.21.15.97:0/550388198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 msgr2=0x7f0d2c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 -- 172.21.15.97:0/550388198 >> v1:172.21.15.97:6789/0 conn(0x7f0d2c06be00 legacy=0x7f0d2c071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2affd640 1 -- 172.21.15.97:0/550388198 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510439829 0 0) 0x7f0d20001120 con 0x7f0d2c06be00 2023-12-04T05:40:12.173 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 -- 172.21.15.97:0/550388198 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c06cea0 con 0x7f0d2c06ca50 2023-12-04T05:40:12.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d30d1d640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c0c1880 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65644f38a38a8014 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2affd640 1 -- 172.21.15.97:0/550388198 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a58f0 con 0x7f0d2c06ca50 2023-12-04T05:40:12.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2affd640 1 -- 172.21.15.97:0/550388198 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d240a5a50 con 0x7f0d2c06ca50 2023-12-04T05:40:12.175 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.172+0000 7f0d2affd640 1 -- 172.21.15.97:0/550388198 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240a5de0 con 0x7f0d2c06ca50 2023-12-04T05:40:12.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- 172.21.15.97:0/550388198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06ca50 msgr2=0x7f0d2c0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c0c1880 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009d90 tx=0x7f0d2401c830 comp rx=0 tx=0).stop 2023-12-04T05:40:12.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- 172.21.15.97:0/550388198 shutdown_connections 2023-12-04T05:40:12.176 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c0c1880 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- 172.21.15.97:0/550388198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- 172.21.15.97:0/550388198 >> 172.21.15.97:0/550388198 conn(0x7f0d2c0c2970 msgr2=0x7f0d2c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- 172.21.15.97:0/550388198 shutdown_connections 2023-12-04T05:40:12.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- 172.21.15.97:0/550388198 wait complete. 2023-12-04T05:40:12.177 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 Processor -- start 2023-12-04T05:40:12.178 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- start start 2023-12-04T05:40:12.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.179 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c1eec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c151190 con 0x7f0d2c06be00 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c147960 con 0x7f0d2c06ca50 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d32780640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c147c40 con 0x7f0d2c14e970 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46484/0 (socket says 172.21.15.97:46484) 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 -- 172.21.15.97:0/3992740241 learned_addr learned my addr 172.21.15.97:0/3992740241 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d30d1d640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c1eec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2b7fe640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 -- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 msgr2=0x7f0d2c1eec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c1eec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 -- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d2c06ca50 msgr2=0x7f0d2c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.180 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.176+0000 7f0d2bfff640 1 -- 172.21.15.97:0/3992740241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009a70 con 0x7f0d2c06be00 2023-12-04T05:40:12.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d2bfff640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00d800 tx=0x7f0d1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.181 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00b6c0 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00b820 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c152e40 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00bb90 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c155c30 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c153490 con 0x7f0d2c06be00 2023-12-04T05:40:12.182 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0d1c00bcf0 con 0x7f0d2c06be00 2023-12-04T05:40:12.183 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.180+0000 7f0d28ff9640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 0x7f0d18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.184+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0d1c084b10 con 0x7f0d2c06be00 2023-12-04T05:40:12.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.184+0000 7f0d2b7fe640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 0x7f0d18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.184 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.184+0000 7f0d2b7fe640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 0x7f0d18068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c1559d0 tx=0x7f0d20007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.187 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.184+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0d1c051c50 con 0x7f0d2c06be00 2023-12-04T05:40:12.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.340+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d2c147e50 con 0x7f0d2c06be00 2023-12-04T05:40:12.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.340+0000 7f0d28ff9640 1 -- 172.21.15.97:0/3992740241 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0d1c055270 con 0x7f0d2c06be00 2023-12-04T05:40:12.343 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:12.343 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":75,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:40:10.285926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/2403583657":"2023-12-05T05:40:07.207202+0000","172.21.15.97:6836/2403583657":"2023-12-05T05:40:07.207202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 msgr2=0x7f0d18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 0x7f0d18068d90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c1559d0 tx=0x7f0d20007c10 comp rx=0 tx=0).stop 2023-12-04T05:40:12.345 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 msgr2=0x7f0d2c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00d800 tx=0x7f0d1c00dcc0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 shutdown_connections 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0d180668d0 0x7f0d18068d90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d2c14e970 0x7f0d2c1eec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d2c06ca50 0x7f0d2c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 --2- 172.21.15.97:0/3992740241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d2c06be00 0x7f0d2c146b70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 >> 172.21.15.97:0/3992740241 conn(0x7f0d2c0c2970 msgr2=0x7f0d2c148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 shutdown_connections 2023-12-04T05:40:12.346 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.344+0000 7f0d32780640 1 -- 172.21.15.97:0/3992740241 wait complete. 2023-12-04T05:40:12.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-04T05:40:12.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:12.501 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 Processor -- start 2023-12-04T05:40:12.502 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 -- start start 2023-12-04T05:40:12.503 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c151bf0 0x7fbf4c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c1547d0 con 0x7fbf4c158630 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c158b80 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf5252a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c4aa0 con 0x7fbf4c151bf0 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46494/0 (socket says 172.21.15.97:46494) 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 -- 172.21.15.97:0/2755536803 learned_addr learned my addr 172.21.15.97:0/2755536803 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4bfff640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c151bf0 0x7fbf4c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 -- 172.21.15.97:0/2755536803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c151bf0 msgr2=0x7fbf4c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:12.504 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c151bf0 0x7fbf4c0abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 -- 172.21.15.97:0/2755536803 >> v1:172.21.15.97:6789/0 conn(0x7fbf4c158630 legacy=0x7fbf4c0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4affd640 1 -- 172.21.15.97:0/2755536803 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823293688 0 0) 0x7fbf4c1547d0 con 0x7fbf4c158630 2023-12-04T05:40:12.505 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.500+0000 7fbf4b7fe640 1 -- 172.21.15.97:0/2755536803 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0c4d40 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf4b7fe640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009870 tx=0x7fbf4001c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145bcda85cc702be server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf4affd640 1 -- 172.21.15.97:0/2755536803 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400a4720 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf4affd640 1 -- 172.21.15.97:0/2755536803 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400a4880 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.506 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf4affd640 1 -- 172.21.15.97:0/2755536803 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400a4c10 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 -- 172.21.15.97:0/2755536803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 msgr2=0x7fbf4c154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009870 tx=0x7fbf4001c100 comp rx=0 tx=0).stop 2023-12-04T05:40:12.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 -- 172.21.15.97:0/2755536803 shutdown_connections 2023-12-04T05:40:12.507 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c154c60 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 --2- 172.21.15.97:0/2755536803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c151bf0 0x7fbf4c0abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 -- 172.21.15.97:0/2755536803 >> 172.21.15.97:0/2755536803 conn(0x7fbf4c073550 msgr2=0x7fbf4c073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 -- 172.21.15.97:0/2755536803 shutdown_connections 2023-12-04T05:40:12.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.504+0000 7fbf5252a640 1 -- 172.21.15.97:0/2755536803 wait complete. 2023-12-04T05:40:12.508 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 Processor -- start 2023-12-04T05:40:12.509 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- start start 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf4c151bf0 0x7fbf4c142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c158630 0x7fbf4c142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c1a60 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c9d90 con 0x7fbf4c151bf0 2023-12-04T05:40:12.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c155ac0 con 0x7fbf4c158630 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46508/0 (socket says 172.21.15.97:46508) 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 -- 172.21.15.97:0/585430446 learned_addr learned my addr 172.21.15.97:0/585430446 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf50ac7640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c158630 0x7fbf4c142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4b7fe640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf4c151bf0 0x7fbf4c142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 -- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c158630 msgr2=0x7fbf4c142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c158630 0x7fbf4c142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 -- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf4c151bf0 msgr2=0x7fbf4c142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf4c151bf0 0x7fbf4c142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 -- 172.21.15.97:0/585430446 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094d0 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf4bfff640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d800 tx=0x7fbf3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00b6c0 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c00b820 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c155da0 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c00bb90 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.508+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c156360 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c068440 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf3c00bcf0 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf48ff9640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 0x7fbf38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fbf3c084ad0 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf4b7fe640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 0x7fbf38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.512+0000 7fbf4b7fe640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 0x7fbf38068d90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ae000 tx=0x7fbf40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.516+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf3c051c10 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf4c06c970 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.697 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf48ff9640 1 -- 172.21.15.97:0/585430446 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fbf3c011340 con 0x7fbf4c0c7ef0 2023-12-04T05:40:12.698 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:12.698 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3483003537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3483003537},{"type":"v1","addr":"172.21.15.97:6837","nonce":3483003537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:12.698 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 55 2023-12-04T05:40:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 msgr2=0x7fbf38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 0x7fbf38068d90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ae000 tx=0x7fbf40008040 comp rx=0 tx=0).stop 2023-12-04T05:40:12.699 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 msgr2=0x7fbf4c153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00d800 tx=0x7fbf3c00dcc0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 shutdown_connections 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbf380668d0 0x7fbf38068d90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf4c158630 0x7fbf4c142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf4c151bf0 0x7fbf4c142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 --2- 172.21.15.97:0/585430446 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbf4c0c7ef0 0x7fbf4c153840 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 >> 172.21.15.97:0/585430446 conn(0x7fbf4c073550 msgr2=0x7fbf4c0aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 shutdown_connections 2023-12-04T05:40:12.700 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.696+0000 7fbf5252a640 1 -- 172.21.15.97:0/585430446 wait complete. 2023-12-04T05:40:12.719 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:12.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 Processor -- start 2023-12-04T05:40:12.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 -- start start 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f8ae00c7ef0 0x7f8ae0154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae01547d0 con 0x7f8ae0151bf0 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae0158b80 con 0x7f8ae0158630 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae7209640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae00c4aa0 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae4fa5640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8ae0151bf0 0x7f8ae00abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53676/0 (socket says 172.21.15.97:53676) 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ae4fa5640 1 -- 172.21.15.97:0/570264015 learned_addr learned my addr 172.21.15.97:0/570264015 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:12.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad7fff640 1 --2- 172.21.15.97:0/570264015 >> v2:172.21.15.97:3300/0 conn(0x7f8ae00c7ef0 0x7f8ae0154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad77fe640 1 -- 172.21.15.97:0/570264015 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893054860 0 0) 0x7f8ae01547d0 con 0x7f8ae0151bf0 2023-12-04T05:40:12.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad77fe640 1 -- 172.21.15.97:0/570264015 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac8003530 con 0x7f8ae0151bf0 2023-12-04T05:40:12.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad7fff640 1 -- 172.21.15.97:0/570264015 >> v1:172.21.15.143:6789/0 conn(0x7f8ae0158630 legacy=0x7f8ae015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:12.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad7fff640 1 -- 172.21.15.97:0/570264015 >> v1:172.21.15.97:6789/0 conn(0x7f8ae0151bf0 legacy=0x7f8ae00abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.856+0000 7f8ad7fff640 1 -- 172.21.15.97:0/570264015 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00c4d40 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.861 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ad7fff640 1 --2- 172.21.15.97:0/570264015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae0154c60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ac604dcf1c27d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ad77fe640 1 -- 172.21.15.97:0/570264015 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00a4730 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ad77fe640 1 -- 172.21.15.97:0/570264015 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00a4890 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ad77fe640 1 -- 172.21.15.97:0/570264015 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00a4c20 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 -- 172.21.15.97:0/570264015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 msgr2=0x7f8ae0154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 --2- 172.21.15.97:0/570264015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae0154c60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c000 comp rx=0 tx=0).stop 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 -- 172.21.15.97:0/570264015 shutdown_connections 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 --2- 172.21.15.97:0/570264015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae0154c60 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 -- 172.21.15.97:0/570264015 >> 172.21.15.97:0/570264015 conn(0x7f8ae0073550 msgr2=0x7f8ae0073960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 -- 172.21.15.97:0/570264015 shutdown_connections 2023-12-04T05:40:12.863 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.860+0000 7f8ae7209640 1 -- 172.21.15.97:0/570264015 wait complete. 2023-12-04T05:40:12.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 Processor -- start 2023-12-04T05:40:12.864 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- start start 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae0151bf0 0x7f8ae0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae0158630 0x7f8ae0156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0151070 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae01497f0 con 0x7f8ae0151bf0 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0144d60 con 0x7f8ae0158630 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46534/0 (socket says 172.21.15.97:46534) 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 -- 172.21.15.97:0/454909517 learned_addr learned my addr 172.21.15.97:0/454909517 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae57a6640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae0158630 0x7f8ae0156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.867 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ad7fff640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae0151bf0 0x7f8ae0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 -- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae0158630 msgr2=0x7f8ae0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae0158630 0x7f8ae0156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 -- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae0151bf0 msgr2=0x7f8ae0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae0151bf0 0x7f8ae0156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 -- 172.21.15.97:0/454909517 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009420 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae4fa5640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c500 tx=0x7f8adc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc005cf0 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc005e50 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae01ee440 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0072f0 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.868 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.864+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae01ee6c0 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0148aa0 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8adc007450 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ad57fa640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 0x7f8acc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:12.869 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f8adc083a30 con 0x7f8ae00c7ef0 2023-12-04T05:40:12.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ad7fff640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 0x7f8acc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:12.870 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.868+0000 7f8ad7fff640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 0x7f8acc068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00ae000 tx=0x7f8ad0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:12.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:12.872+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8adc050cb0 con 0x7f8ae00c7ef0 2023-12-04T05:40:13.053 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.052+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae01ee8b0 con 0x7f8ae00c7ef0 2023-12-04T05:40:13.054 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.052+0000 7f8ad57fa640 1 -- 172.21.15.97:0/454909517 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f8adc017020 con 0x7f8ae00c7ef0 2023-12-04T05:40:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:13.055 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3483003537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3483003537},{"type":"v1","addr":"172.21.15.97:6837","nonce":3483003537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T05:39:39.546769+0000","modified":"2023-12-04T05:39:42.531619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6489":{"gid":6489,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6835/758746591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":758746591},{"type":"v1","addr":"172.21.15.97:6835","nonce":758746591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-04T05:40:13.055 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 55 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 msgr2=0x7f8acc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 0x7f8acc068d90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00ae000 tx=0x7f8ad0008040 comp rx=0 tx=0).stop 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 msgr2=0x7f8ae00ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00c500 tx=0x7f8adc00c9c0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 shutdown_connections 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8acc0668d0 0x7f8acc068d90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ae0158630 0x7f8ae0156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.056 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ae0151bf0 0x7f8ae0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 --2- 172.21.15.97:0/454909517 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8ae00c7ef0 0x7f8ae00ca4d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 >> 172.21.15.97:0/454909517 conn(0x7f8ae0073550 msgr2=0x7f8ae00c5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 shutdown_connections 2023-12-04T05:40:13.057 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.056+0000 7f8ae7209640 1 -- 172.21.15.97:0/454909517 wait complete. 2023-12-04T05:40:13.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:13.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 Processor -- start 2023-12-04T05:40:13.213 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 -- start start 2023-12-04T05:40:13.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04600ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.214 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04600c9960 con 0x7f04600c48b0 2023-12-04T05:40:13.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046013d920 con 0x7f04600c8540 2023-12-04T05:40:13.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0466a9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0460155120 con 0x7f046013d1f0 2023-12-04T05:40:13.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0457fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f04600c48b0 0x7f04600c7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53686/0 (socket says 172.21.15.97:53686) 2023-12-04T05:40:13.215 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0457fff640 1 -- 172.21.15.97:0/2206728945 learned_addr learned my addr 172.21.15.97:0/2206728945 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f0464836640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04600ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409581022 0 0) 0x7f04600c9960 con 0x7f04600c48b0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0448003530 con 0x7f04600c48b0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227369197 0 0) 0x7f0448003530 con 0x7f04600c48b0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 msgr2=0x7f04600ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04600ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 >> v1:172.21.15.143:6789/0 conn(0x7f04600c8540 legacy=0x7f046015efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460154a60 con 0x7f04600c48b0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f0450001680 con 0x7f04600c48b0 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.212+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 >> v1:172.21.15.97:6789/0 conn(0x7f04600c48b0 legacy=0x7f04600c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04480039b0 0x7f0448003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.217 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04480047d0 0x7f0448004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460155120 con 0x7f04480039b0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044800bac0 con 0x7f04480047d0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044800bc80 con 0x7f046013d1f0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04480039b0 0x7f0448003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0457fff640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04480047d0 0x7f0448004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0465037640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 -- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 msgr2=0x7f04480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f046013d1f0 0x7f04480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 -- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04480047d0 msgr2=0x7f0448004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04480047d0 0x7f0448004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 -- 172.21.15.97:0/2206728945 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448003530 con 0x7f04480039b0 2023-12-04T05:40:13.218 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0457fff640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04480047d0 0x7f0448004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:13.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f0464836640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04480039b0 0x7f0448003d90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f045c009ae0 tx=0x7f045c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a213ce52ffcdbd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.216+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c0a5610 con 0x7f04480039b0 2023-12-04T05:40:13.219 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c0a5770 con 0x7f04480039b0 2023-12-04T05:40:13.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f04577fe640 1 -- 172.21.15.97:0/2206728945 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c0a5b20 con 0x7f04480039b0 2023-12-04T05:40:13.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- 172.21.15.97:0/2206728945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04480039b0 msgr2=0x7f0448003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.220 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2206728945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04480039b0 0x7f0448003d90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f045c009ae0 tx=0x7f045c01ca20 comp rx=0 tx=0).stop 2023-12-04T05:40:13.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0465037640 1 -- 172.21.15.97:0/2206728945 reap_dead start 2023-12-04T05:40:13.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- 172.21.15.97:0/2206728945 shutdown_connections 2023-12-04T05:40:13.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- 172.21.15.97:0/2206728945 >> 172.21.15.97:0/2206728945 conn(0x7f04600ac160 msgr2=0x7f04600c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- 172.21.15.97:0/2206728945 shutdown_connections 2023-12-04T05:40:13.221 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- 172.21.15.97:0/2206728945 wait complete. 2023-12-04T05:40:13.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 Processor -- start 2023-12-04T05:40:13.222 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- start start 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04480039b0 0x7f04601368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0460136e20 0x7f04601576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601581d0 con 0x7f04601394f0 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460155b60 con 0x7f0460136e20 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0466a9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04601edd60 con 0x7f04480039b0 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0457fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0457fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46546/0 (socket says 172.21.15.97:46546) 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0457fff640 1 -- 172.21.15.97:0/2613519364 learned_addr learned my addr 172.21.15.97:0/2613519364 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0465037640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0460136e20 0x7f04601576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.224 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.220+0000 7f0464836640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04480039b0 0x7f04601368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 -- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04480039b0 msgr2=0x7f04601368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04480039b0 0x7f04601368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 -- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0460136e20 msgr2=0x7f04601576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0460136e20 0x7f04601576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 -- 172.21.15.97:0/2613519364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04601ed1e0 con 0x7f04601394f0 2023-12-04T05:40:13.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0457fff640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f045000e760 tx=0x7f045000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000ee70 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000c8d0 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04601ed4c0 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000cc40 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04601eda80 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0460137510 con 0x7f04601394f0 2023-12-04T05:40:13.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0450013420 con 0x7f04601394f0 2023-12-04T05:40:13.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 0x7f044c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0450083ee0 con 0x7f04601394f0 2023-12-04T05:40:13.227 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.224+0000 7f0464836640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 0x7f044c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.228+0000 7f0464836640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 0x7f044c068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f045c0af000 tx=0x7f045c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.231 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.228+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0460137510 con 0x7f04601394f0 2023-12-04T05:40:13.384 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0460137510 con 0x7f04601394f0 2023-12-04T05:40:13.385 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f04557fa640 1 -- 172.21.15.97:0/2613519364 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0460137510 con 0x7f04601394f0 2023-12-04T05:40:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:13.386 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":75,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:40:10.285926+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-04T05:39:37.391574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-04T05:39:38.528584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6837/2403583657":"2023-12-05T05:40:07.207202+0000","172.21.15.97:6836/2403583657":"2023-12-05T05:40:07.207202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:13.387 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 msgr2=0x7f044c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 0x7f044c068dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f045c0af000 tx=0x7f045c0046d0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 msgr2=0x7f04601571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f045000e760 tx=0x7f045000ec20 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 shutdown_connections 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f044c066900 0x7f044c068dc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0460136e20 0x7f04601576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f04601394f0 0x7f04601571a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 --2- 172.21.15.97:0/2613519364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04480039b0 0x7f04601368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 >> 172.21.15.97:0/2613519364 conn(0x7f04600ac160 msgr2=0x7f046013b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 shutdown_connections 2023-12-04T05:40:13.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.384+0000 7f0466a9a640 1 -- 172.21.15.97:0/2613519364 wait complete. 2023-12-04T05:40:13.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-04T05:40:13.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 Processor -- start 2023-12-04T05:40:13.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 -- start start 2023-12-04T05:40:13.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7fb406d230 0x7f7fb40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40c56e0 con 0x7f7fb40af430 2023-12-04T05:40:13.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb4155400 con 0x7f7fb40bd540 2023-12-04T05:40:13.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fbb396640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40c7d70 con 0x7f7fb406d230 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7fb406d230 0x7f7fb40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7fb406d230 0x7f7fb40c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46550/0 (socket says 172.21.15.97:46550) 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2968705142 learned_addr learned my addr 172.21.15.97:0/2968705142 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fba394640 1 --1- 172.21.15.97:0/2968705142 >> v1:172.21.15.97:6789/0 conn(0x7f7fb40af430 0x7f7fb406bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:53690/0 (socket says 172.21.15.97:53690) 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2968705142 >> v1:172.21.15.143:6789/0 conn(0x7f7fb40bd540 legacy=0x7f7fb40c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2968705142 >> v1:172.21.15.97:6789/0 conn(0x7f7fb40af430 legacy=0x7f7fb406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.544+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2968705142 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40c8050 con 0x7f7fb406d230 2023-12-04T05:40:13.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fb9b93640 1 --2- 172.21.15.97:0/2968705142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb406d230 0x7f7fb40c8330 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009870 tx=0x7f7fa401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0ae8c28e45800d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fb9392640 1 -- 172.21.15.97:0/2968705142 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a6040 con 0x7f7fb406d230 2023-12-04T05:40:13.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fb9392640 1 -- 172.21.15.97:0/2968705142 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40aa400 con 0x7f7fb406d230 2023-12-04T05:40:13.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fb9392640 1 -- 172.21.15.97:0/2968705142 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40aa790 con 0x7f7fb406d230 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 -- 172.21.15.97:0/2968705142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb406d230 msgr2=0x7f7fb40c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2968705142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb406d230 0x7f7fb40c8330 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009870 tx=0x7f7fa401cee0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 -- 172.21.15.97:0/2968705142 shutdown_connections 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2968705142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb406d230 0x7f7fb40c8330 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 -- 172.21.15.97:0/2968705142 >> 172.21.15.97:0/2968705142 conn(0x7f7fb4073dd0 msgr2=0x7f7fb40aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 -- 172.21.15.97:0/2968705142 shutdown_connections 2023-12-04T05:40:13.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.548+0000 7f7fbb396640 1 -- 172.21.15.97:0/2968705142 wait complete. 2023-12-04T05:40:13.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 Processor -- start 2023-12-04T05:40:13.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- start start 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb406d230 0x7f7fb414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb40bd540 0x7f7fb414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb414d100 con 0x7f7fb40af430 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c2450 con 0x7f7fb40bd540 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41574a0 con 0x7f7fb406d230 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46554/0 (socket says 172.21.15.97:46554) 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2123608007 learned_addr learned my addr 172.21.15.97:0/2123608007 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fba394640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb406d230 0x7f7fb414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbab95640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb40bd540 0x7f7fb414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb406d230 msgr2=0x7f7fb414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb406d230 0x7f7fb414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb40bd540 msgr2=0x7f7fb414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb40bd540 0x7f7fb414c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 -- 172.21.15.97:0/2123608007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40094d0 con 0x7f7fb40af430 2023-12-04T05:40:13.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fb9b93640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7fa401a0b0 tx=0x7f7fa401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b3800 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40b3960 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40b3cf0 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb414ce20 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb40c20e0 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.552+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40c1c60 con 0x7f7fb40af430 2023-12-04T05:40:13.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.556+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7fa40c6430 con 0x7f7fb40af430 2023-12-04T05:40:13.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.556+0000 7f7faaffd640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 0x7f7f98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.556+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7fa411f150 con 0x7f7fb40af430 2023-12-04T05:40:13.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.556+0000 7f7fba394640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 0x7f7f98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.556+0000 7f7fba394640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 0x7f7f98068d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000f70 tx=0x7f7fb0007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.561 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.560+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fb40c1c60 con 0x7f7fb40af430 2023-12-04T05:40:13.742 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.740+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f7fb40c1c60 con 0x7f7fb40af430 2023-12-04T05:40:13.742 INFO:tasks.ceph.mon.a.smithi097.stderr:2023-12-04T05:40:13.740+0000 7f35a1b16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T05:40:13.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7faaffd640 1 -- 172.21.15.97:0/2123608007 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7fb40c1c60 con 0x7f7fb40af430 2023-12-04T05:40:13.745 INFO:teuthology.orchestra.run.smithi097.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T05:40:13.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 msgr2=0x7f7f98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 0x7f7f98068d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000f70 tx=0x7f7fb0007cb0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 msgr2=0x7f7fb40c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7fa401a0b0 tx=0x7f7fa401acc0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 shutdown_connections 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7f980668d0 0x7f7f98068d90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb40bd540 0x7f7fb414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fb40af430 0x7f7fb40c28e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 --2- 172.21.15.97:0/2123608007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb406d230 0x7f7fb414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 >> 172.21.15.97:0/2123608007 conn(0x7f7fb4073dd0 msgr2=0x7f7fb41544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 shutdown_connections 2023-12-04T05:40:13.748 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.744+0000 7f7fbb396640 1 -- 172.21.15.97:0/2123608007 wait complete. 2023-12-04T05:40:13.757 INFO:tasks.ceph.mds.a.smithi097.stderr: -4524> 2023-12-04T05:39:42.040+0000 7f454a5e7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T05:40:13.769 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-04T05:40:13.806 INFO:tasks.ceph.mds.a.smithi097.stdout:starting mds.a at 2023-12-04T05:40:13.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.908+0000 7f45661f5640 1 Processor -- start 2023-12-04T05:40:13.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.908+0000 7f45661f5640 1 -- start start 2023-12-04T05:40:13.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f45600c1e70 0x7f45601524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f456006c440 0x7f45600a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600a89a0 0x7f456006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456006c0c0 con 0x7f456006c440 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600aa240 con 0x7f45600c1e70 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f45661f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45600aa500 con 0x7f45600a89a0 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f456006c440 0x7f45600a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f456006c440 0x7f45600a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46596/0 (socket says 172.21.15.97:46596) 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 -- 172.21.15.97:0/4215246327 learned_addr learned my addr 172.21.15.97:0/4215246327 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f455f7fe640 1 --2- 172.21.15.97:0/4215246327 >> v2:172.21.15.143:3300/0 conn(0x7f45600c1e70 0x7f45601524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f455ffff640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600a89a0 0x7f456006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 -- 172.21.15.97:0/4215246327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600a89a0 msgr2=0x7f456006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:13.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600a89a0 0x7f456006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 -- 172.21.15.97:0/4215246327 >> v2:172.21.15.143:3300/0 conn(0x7f45600c1e70 msgr2=0x7f45601524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:13.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 --2- 172.21.15.97:0/4215246327 >> v2:172.21.15.143:3300/0 conn(0x7f45600c1e70 0x7f45601524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.912+0000 7f4557fff640 1 -- 172.21.15.97:0/4215246327 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600aa7e0 con 0x7f456006c440 2023-12-04T05:40:13.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f4557fff640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f45600a8460 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4560072510 tx=0x7f454801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941fd0b3990091de server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f455effd640 1 -- 172.21.15.97:0/4215246327 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456006df60 con 0x7f456006c440 2023-12-04T05:40:13.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f455effd640 1 -- 172.21.15.97:0/4215246327 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45480aa5f0 con 0x7f456006c440 2023-12-04T05:40:13.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f455effd640 1 -- 172.21.15.97:0/4215246327 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480aa980 con 0x7f456006c440 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- 172.21.15.97:0/4215246327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 msgr2=0x7f45600a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f45600a8460 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4560072510 tx=0x7f454801c4d0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- 172.21.15.97:0/4215246327 shutdown_connections 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600a89a0 0x7f456006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- 172.21.15.97:0/4215246327 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f45600a8460 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- 172.21.15.97:0/4215246327 >> v2:172.21.15.143:3300/0 conn(0x7f45600c1e70 0x7f45601524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- 172.21.15.97:0/4215246327 >> 172.21.15.97:0/4215246327 conn(0x7f45600c5e70 msgr2=0x7f45600c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:13.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- 172.21.15.97:0/4215246327 shutdown_connections 2023-12-04T05:40:13.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- 172.21.15.97:0/4215246327 wait complete. 2023-12-04T05:40:13.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 Processor -- start 2023-12-04T05:40:13.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- start start 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45600a89a0 0x7f4560071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600c1e70 0x7f45601f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600700b0 con 0x7f456006c440 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560070f10 con 0x7f45600a89a0 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.916+0000 7f45661f5640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4560070300 con 0x7f45600c1e70 2023-12-04T05:40:13.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46602/0 (socket says 172.21.15.97:46602) 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 -- 172.21.15.97:0/2098094798 learned_addr learned my addr 172.21.15.97:0/2098094798 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455ffff640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600c1e70 0x7f45601f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f4557fff640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45600a89a0 0x7f4560071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 -- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600c1e70 msgr2=0x7f45601f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600c1e70 0x7f45601f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 -- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45600a89a0 msgr2=0x7f4560071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45600a89a0 0x7f4560071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 -- 172.21.15.97:0/2098094798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480094d0 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455f7fe640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f455000e930 tx=0x7f455000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550009690 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455000ca00 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000cd70 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45600c23d0 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45600708c0 con 0x7f456006c440 2023-12-04T05:40:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4560068440 con 0x7f456006c440 2023-12-04T05:40:13.923 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4550013470 con 0x7f456006c440 2023-12-04T05:40:13.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.920+0000 7f455cff9640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 0x7f4540068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:13.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.924+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f4550084b20 con 0x7f456006c440 2023-12-04T05:40:13.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.924+0000 7f4557fff640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 0x7f4540068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:13.924 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.924+0000 7f4557fff640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 0x7f4540068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45480ae000 tx=0x7f45480b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:13.927 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:13.928+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4550051d80 con 0x7f456006c440 2023-12-04T05:40:14.114 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.112+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45600c6ae0 con 0x7f456006c440 2023-12-04T05:40:14.752 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.748+0000 7f455cff9640 1 -- 172.21.15.97:0/2098094798 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7f45500170b0 con 0x7f456006c440 2023-12-04T05:40:14.754 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 msgr2=0x7f4540068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 0x7f4540068d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45480ae000 tx=0x7f45480b5040 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 msgr2=0x7f4560142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f455000e930 tx=0x7f455000edf0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 shutdown_connections 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f45400668d0 0x7f4540068d90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f45600c1e70 0x7f45601f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f45600a89a0 0x7f4560071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 --2- 172.21.15.97:0/2098094798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f456006c440 0x7f4560142b00 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 >> 172.21.15.97:0/2098094798 conn(0x7f45600c5e70 msgr2=0x7f45601545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 shutdown_connections 2023-12-04T05:40:14.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.752+0000 7f45661f5640 1 -- 172.21.15.97:0/2098094798 wait complete. 2023-12-04T05:40:14.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-04T05:40:14.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.960+0000 7f7d044c9640 1 Processor -- start 2023-12-04T05:40:14.963 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.960+0000 7f7d044c9640 1 -- start start 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d044c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cfc14ea50 0x7f7cfc152810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d044c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7cfc152d50 0x7f7cfc0c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d044c9640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc0c05f0 con 0x7f7cfc0c3570 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d044c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc14ee30 con 0x7f7cfc14ea50 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d044c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc152360 con 0x7f7cfc152d50 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cfc14ea50 0x7f7cfc152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7cfc14ea50 0x7f7cfc152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35800/0 (socket says 172.21.15.97:35800) 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 -- 172.21.15.97:0/791431977 learned_addr learned my addr 172.21.15.97:0/791431977 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02a66640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7cfc0c3570 0x7f7cfc06d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48532/0 (socket says 172.21.15.97:48532) 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d01a64640 1 --2- 172.21.15.97:0/791431977 >> v2:172.21.15.143:3300/0 conn(0x7f7cfc152d50 0x7f7cfc0c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 -- 172.21.15.97:0/791431977 >> v2:172.21.15.143:3300/0 conn(0x7f7cfc152d50 msgr2=0x7f7cfc0c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:14.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 --2- 172.21.15.97:0/791431977 >> v2:172.21.15.143:3300/0 conn(0x7f7cfc152d50 0x7f7cfc0c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 -- 172.21.15.97:0/791431977 >> v1:172.21.15.97:6789/0 conn(0x7f7cfc0c3570 legacy=0x7f7cfc06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.964+0000 7f7d02265640 1 -- 172.21.15.97:0/791431977 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc151da0 con 0x7f7cfc14ea50 2023-12-04T05:40:14.967 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d02265640 1 --2- 172.21.15.97:0/791431977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc152810 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc074520 tx=0x7f7cf801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb587bac717428 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:14.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d01263640 1 -- 172.21.15.97:0/791431977 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80ab640 con 0x7f7cfc14ea50 2023-12-04T05:40:14.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d01263640 1 -- 172.21.15.97:0/791431977 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf80a7070 con 0x7f7cfc14ea50 2023-12-04T05:40:14.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d01263640 1 -- 172.21.15.97:0/791431977 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80ab9c0 con 0x7f7cfc14ea50 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- 172.21.15.97:0/791431977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc14ea50 msgr2=0x7f7cfc152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- 172.21.15.97:0/791431977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc152810 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc074520 tx=0x7f7cf801c440 comp rx=0 tx=0).stop 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- 172.21.15.97:0/791431977 shutdown_connections 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- 172.21.15.97:0/791431977 >> v2:172.21.15.143:3300/0 conn(0x7f7cfc152d50 0x7f7cfc0c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- 172.21.15.97:0/791431977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc152810 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- 172.21.15.97:0/791431977 >> 172.21.15.97:0/791431977 conn(0x7f7cfc0c2a50 msgr2=0x7f7cfc0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- 172.21.15.97:0/791431977 shutdown_connections 2023-12-04T05:40:14.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- 172.21.15.97:0/791431977 wait complete. 2023-12-04T05:40:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 Processor -- start 2023-12-04T05:40:14.970 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- start start 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7cfc0c3570 0x7f7cfc13f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.968+0000 7f7d044c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc070a00 con 0x7f7cfc152d50 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d044c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc072540 con 0x7f7cfc14ea50 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d044c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc13cf30 con 0x7f7cfc0c3570 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35810/0 (socket says 172.21.15.97:35810) 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 -- 172.21.15.97:0/854832972 learned_addr learned my addr 172.21.15.97:0/854832972 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d01a64640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.973 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02265640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7cfc0c3570 0x7f7cfc13f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 -- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7cfc0c3570 msgr2=0x7f7cfc13f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7cfc0c3570 0x7f7cfc13f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 -- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cfc14ea50 msgr2=0x7f7cfc13c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc13c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 -- 172.21.15.97:0/854832972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80094d0 con 0x7f7cfc152d50 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d02a66640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c700 tx=0x7f7cf400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400ce10 con 0x7f7cfc152d50 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400a640 con 0x7f7cfc152d50 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400a9b0 con 0x7f7cfc152d50 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc13ffc0 con 0x7f7cfc152d50 2023-12-04T05:40:14.974 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc071c10 con 0x7f7cfc152d50 2023-12-04T05:40:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc068440 con 0x7f7cfc152d50 2023-12-04T05:40:14.975 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.972+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7cf400ab10 con 0x7f7cfc152d50 2023-12-04T05:40:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.976+0000 7f7cf2ffd640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.976+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f7cf4083ad0 con 0x7f7cfc152d50 2023-12-04T05:40:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.976+0000 7f7d02265640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:14.976 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.976+0000 7f7d02265640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 0x7f7ce0068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80af000 tx=0x7f7cf80b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:14.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:14.980+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cf4050da0 con 0x7f7cfc152d50 2023-12-04T05:40:15.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:15.132+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7cfc06ce60 con 0x7f7cfc152d50 2023-12-04T05:40:16.015 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.012+0000 7f7cf2ffd640 1 -- 172.21.15.97:0/854832972 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v77) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7cf4017020 con 0x7f7cfc152d50 2023-12-04T05:40:16.015 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_metadata' removed 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 msgr2=0x7f7ce0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 0x7f7ce0068d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80af000 tx=0x7f7cf80b6040 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 msgr2=0x7f7cfc13c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c700 tx=0x7f7cf400cbc0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 shutdown_connections 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7cfc152d50 0x7f7cfc13c9f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7cfc14ea50 0x7f7cfc13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 --2- 172.21.15.97:0/854832972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7cfc0c3570 0x7f7cfc13f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.018 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 >> 172.21.15.97:0/854832972 conn(0x7f7cfc0c2a50 msgr2=0x7f7cfc14b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:16.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 shutdown_connections 2023-12-04T05:40:16.019 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.016+0000 7f7d044c9640 1 -- 172.21.15.97:0/854832972 wait complete. 2023-12-04T05:40:16.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-04T05:40:16.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 Processor -- start 2023-12-04T05:40:16.190 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 -- start start 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7480155590 0x7f748015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74800c05f0 con 0x7f74800c3570 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7480151da0 con 0x7f748014ea50 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.188+0000 7f7484abb640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748014ee30 con 0x7f7480155590 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747ed9d640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f7480155590 0x7f748015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f7477fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f74800c3570 0x7f74800c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48540/0 (socket says 172.21.15.97:48540) 2023-12-04T05:40:16.192 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f7477fff640 1 -- 172.21.15.97:0/372791385 learned_addr learned my addr 172.21.15.97:0/372791385 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:16.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747ed9d640 1 -- 172.21.15.97:0/372791385 >> v1:172.21.15.143:6789/0 conn(0x7f748014ea50 legacy=0x7f7480152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747ed9d640 1 -- 172.21.15.97:0/372791385 >> v1:172.21.15.97:6789/0 conn(0x7f74800c3570 legacy=0x7f74800c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.193 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747ed9d640 1 -- 172.21.15.97:0/372791385 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480152080 con 0x7f7480155590 2023-12-04T05:40:16.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747ed9d640 1 --2- 172.21.15.97:0/372791385 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7480155590 0x7f748015ccb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7478009d90 tx=0x7f747801ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f24c92233b9ae5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:16.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747dd9b640 1 -- 172.21.15.97:0/372791385 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a7990 con 0x7f7480155590 2023-12-04T05:40:16.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747dd9b640 1 -- 172.21.15.97:0/372791385 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780a7af0 con 0x7f7480155590 2023-12-04T05:40:16.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.192+0000 7f747dd9b640 1 -- 172.21.15.97:0/372791385 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a7e80 con 0x7f7480155590 2023-12-04T05:40:16.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- 172.21.15.97:0/372791385 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7480155590 msgr2=0x7f748015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 --2- 172.21.15.97:0/372791385 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7480155590 0x7f748015ccb0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7478009d90 tx=0x7f747801ead0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- 172.21.15.97:0/372791385 shutdown_connections 2023-12-04T05:40:16.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 --2- 172.21.15.97:0/372791385 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7480155590 0x7f748015ccb0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- 172.21.15.97:0/372791385 >> 172.21.15.97:0/372791385 conn(0x7f74800c2a50 msgr2=0x7f74800c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:16.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- 172.21.15.97:0/372791385 shutdown_connections 2023-12-04T05:40:16.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- 172.21.15.97:0/372791385 wait complete. 2023-12-04T05:40:16.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 Processor -- start 2023-12-04T05:40:16.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- start start 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 0x7f74801ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7480155590 0x7f7480071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748014a110 con 0x7f74800c3570 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7480149080 con 0x7f748014ea50 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7484abb640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7480144de0 con 0x7f7480155590 2023-12-04T05:40:16.200 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35838/0 (socket says 172.21.15.97:35838) 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 -- 172.21.15.97:0/39523279 learned_addr learned my addr 172.21.15.97:0/39523279 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 -- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7480155590 msgr2=0x7f7480071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7480155590 0x7f7480071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 -- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 msgr2=0x7f74801ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f7477fff640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 0x7f74801ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 0x7f74801ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.196+0000 7f747e59c640 1 -- 172.21.15.97:0/39523279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7478009a70 con 0x7f74800c3570 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7477fff640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 0x7f74801ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f747e59c640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f747000c500 tx=0x7f747000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470005220 con 0x7f74800c3570 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7470005380 con 0x7f74800c3570 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7480148da0 con 0x7f74800c3570 2023-12-04T05:40:16.201 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470007270 con 0x7f74800c3570 2023-12-04T05:40:16.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74801ec800 con 0x7f74800c3570 2023-12-04T05:40:16.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7480068440 con 0x7f74800c3570 2023-12-04T05:40:16.202 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f74700073d0 con 0x7f74800c3570 2023-12-04T05:40:16.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 0x7f7460068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:16.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f7470083720 con 0x7f74800c3570 2023-12-04T05:40:16.203 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.200+0000 7f7477fff640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 0x7f7460068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:16.204 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.204+0000 7f7477fff640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 0x7f7460068d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f748014bf00 tx=0x7f7468009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:16.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.204+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7470050a50 con 0x7f74800c3570 2023-12-04T05:40:16.359 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:16.356+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74800c1c70 con 0x7f74800c3570 2023-12-04T05:40:17.022 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.020+0000 7f7476ffd640 1 -- 172.21.15.97:0/39523279 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v78) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7470054070 con 0x7f74800c3570 2023-12-04T05:40:17.023 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'cephfs2_data' removed 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 msgr2=0x7f7460068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 0x7f7460068d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f748014bf00 tx=0x7f7468009040 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 msgr2=0x7f7480149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f747000c500 tx=0x7f747000c9c0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 shutdown_connections 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f74600668d0 0x7f7460068d90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7480155590 0x7f7480071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f748014ea50 0x7f74801ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 --2- 172.21.15.97:0/39523279 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74800c3570 0x7f7480149bd0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 >> 172.21.15.97:0/39523279 conn(0x7f74800c2a50 msgr2=0x7f74801539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 shutdown_connections 2023-12-04T05:40:17.025 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.024+0000 7f7484abb640 1 -- 172.21.15.97:0/39523279 wait complete. 2023-12-04T05:40:17.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-04T05:40:17.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.192+0000 7f6b7df72640 1 Processor -- start 2023-12-04T05:40:17.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.192+0000 7f6b7df72640 1 -- start start 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b7df72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 0x7f6b7814f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b7df72640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b78154640 con 0x7f6b78154fe0 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b7df72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7814ef10 con 0x7f6b7814f790 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b7df72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c0bd0 con 0x7f6b7814eb30 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b77fff640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6b78154fe0 0x7f6b7815bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48556/0 (socket says 172.21.15.97:48556) 2023-12-04T05:40:17.196 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b77fff640 1 -- 172.21.15.97:0/2047817725 learned_addr learned my addr 172.21.15.97:0/2047817725 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b777fe640 1 --2- 172.21.15.97:0/2047817725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 0x7f6b7814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761105506 0 0) 0x7f6b78154640 con 0x7f6b78154fe0 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60005740 con 0x7f6b78154fe0 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035389618 0 0) 0x7f6b7814ef10 con 0x7f6b7814f790 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b78154640 con 0x7f6b7814f790 2023-12-04T05:40:17.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b777fe640 1 -- 172.21.15.97:0/2047817725 >> v1:172.21.15.143:6789/0 conn(0x7f6b7814f790 legacy=0x7f6b781548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b777fe640 1 -- 172.21.15.97:0/2047817725 >> v1:172.21.15.97:6789/0 conn(0x7f6b78154fe0 legacy=0x7f6b7815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.196+0000 7f6b777fe640 1 -- 172.21.15.97:0/2047817725 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b781535a0 con 0x7f6b7814eb30 2023-12-04T05:40:17.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b777fe640 1 --2- 172.21.15.97:0/2047817725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 0x7f6b7814f250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b680097f0 tx=0x7f6b6801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e754dc6dcb577f93 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.205 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a8050 con 0x7f6b7814eb30 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680ac5f0 con 0x7f6b7814eb30 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b767fc640 1 -- 172.21.15.97:0/2047817725 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680ac960 con 0x7f6b7814eb30 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- 172.21.15.97:0/2047817725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 msgr2=0x7f6b7814f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 --2- 172.21.15.97:0/2047817725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 0x7f6b7814f250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b680097f0 tx=0x7f6b6801c490 comp rx=0 tx=0).stop 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- 172.21.15.97:0/2047817725 shutdown_connections 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 --2- 172.21.15.97:0/2047817725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814eb30 0x7f6b7814f250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- 172.21.15.97:0/2047817725 >> 172.21.15.97:0/2047817725 conn(0x7f6b780c5e70 msgr2=0x7f6b780c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- 172.21.15.97:0/2047817725 shutdown_connections 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- 172.21.15.97:0/2047817725 wait complete. 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 Processor -- start 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.200+0000 7f6b7df72640 1 -- start start 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.206 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814f790 0x7f6b78140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78154fe0 0x7f6b78140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7813ffc0 con 0x7f6b7814eb30 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780bf440 con 0x7f6b78154fe0 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780bf720 con 0x7f6b7814f790 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35848/0 (socket says 172.21.15.97:35848) 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 -- 172.21.15.97:0/1253414076 learned_addr learned my addr 172.21.15.97:0/1253414076 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b77fff640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78154fe0 0x7f6b78140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814f790 0x7f6b78140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 -- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814f790 msgr2=0x7f6b78140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814f790 0x7f6b78140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 -- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78154fe0 msgr2=0x7f6b78140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78154fe0 0x7f6b78140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.207 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 -- 172.21.15.97:0/1253414076 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009420 con 0x7f6b7814eb30 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b777fe640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b68000c10 tx=0x7f6b68019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680a8050 con 0x7f6b7814eb30 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680acb70 con 0x7f6b7814eb30 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003620 con 0x7f6b7814eb30 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780bfa00 con 0x7f6b7814eb30 2023-12-04T05:40:17.208 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7813f830 con 0x7f6b7814eb30 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78068440 con 0x7f6b7814eb30 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.204+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6b680b3040 con 0x7f6b7814eb30 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.208+0000 7f6b5ffff640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.208+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6b6811df50 con 0x7f6b7814eb30 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.208+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.209 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.208+0000 7f6b76ffd640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 0x7f6b64068dc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0011f0 tx=0x7f6b6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.212 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.212+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b680eb420 con 0x7f6b7814eb30 2023-12-04T05:40:17.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.360+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6b780a8ac0 con 0x7f6b7814eb30 2023-12-04T05:40:17.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.364+0000 7f6b5ffff640 1 -- 172.21.15.97:0/1253414076 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b680eea40 con 0x7f6b7814eb30 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 msgr2=0x7f6b64068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 0x7f6b64068dc0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0011f0 tx=0x7f6b6c009040 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 msgr2=0x7f6b7813f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b68000c10 tx=0x7f6b68019230 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 shutdown_connections 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6b78154fe0 0x7f6b78140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6b7814f790 0x7f6b78140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 --2- 172.21.15.97:0/1253414076 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b7814eb30 0x7f6b7813f2f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.369 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 >> 172.21.15.97:0/1253414076 conn(0x7f6b780c5e70 msgr2=0x7f6b780663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:17.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 shutdown_connections 2023-12-04T05:40:17.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.368+0000 7f6b7df72640 1 -- 172.21.15.97:0/1253414076 wait complete. 2023-12-04T05:40:17.388 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-04T05:40:17.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 Processor -- start 2023-12-04T05:40:17.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 -- start start 2023-12-04T05:40:17.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c6414fbb0 0x7f4c640a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4c640a88e0 0x7f4c64152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c641530e0 con 0x7f4c640a8460 2023-12-04T05:40:17.527 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6414ff90 con 0x7f4c6414fbb0 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c6ba9a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c640a8cf0 con 0x7f4c640a88e0 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c69836640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f4c6414fbb0 0x7f4c640a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c69035640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f4c640a8460 0x7f4c64152490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48560/0 (socket says 172.21.15.97:48560) 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.524+0000 7f4c69035640 1 -- 172.21.15.97:0/635011114 learned_addr learned my addr 172.21.15.97:0/635011114 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6a037640 1 --2- 172.21.15.97:0/635011114 >> v2:172.21.15.143:3300/0 conn(0x7f4c640a88e0 0x7f4c64152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.528 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c69836640 1 -- 172.21.15.97:0/635011114 >> v2:172.21.15.143:3300/0 conn(0x7f4c640a88e0 msgr2=0x7f4c64152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:17.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c69836640 1 --2- 172.21.15.97:0/635011114 >> v2:172.21.15.143:3300/0 conn(0x7f4c640a88e0 0x7f4c64152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c69836640 1 -- 172.21.15.97:0/635011114 >> v1:172.21.15.97:6789/0 conn(0x7f4c640a8460 legacy=0x7f4c64152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c69836640 1 -- 172.21.15.97:0/635011114 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640a9770 con 0x7f4c6414fbb0 2023-12-04T05:40:17.530 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c69836640 1 --2- 172.21.15.97:0/635011114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c6414fbb0 0x7f4c640a8f20 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4c640c0070 tx=0x7f4c6001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f365afa1645400d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c68834640 1 -- 172.21.15.97:0/635011114 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600ab600 con 0x7f4c6414fbb0 2023-12-04T05:40:17.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c68834640 1 -- 172.21.15.97:0/635011114 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600a7050 con 0x7f4c6414fbb0 2023-12-04T05:40:17.531 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c68834640 1 -- 172.21.15.97:0/635011114 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600ab980 con 0x7f4c6414fbb0 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/635011114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c6414fbb0 msgr2=0x7f4c640a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/635011114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c6414fbb0 0x7f4c640a8f20 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4c640c0070 tx=0x7f4c6001c2f0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/635011114 shutdown_connections 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/635011114 >> v2:172.21.15.143:3300/0 conn(0x7f4c640a88e0 0x7f4c64152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/635011114 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c6414fbb0 0x7f4c640a8f20 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.528+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/635011114 >> 172.21.15.97:0/635011114 conn(0x7f4c640c2970 msgr2=0x7f4c640c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/635011114 shutdown_connections 2023-12-04T05:40:17.532 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/635011114 wait complete. 2023-12-04T05:40:17.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 Processor -- start 2023-12-04T05:40:17.533 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- start start 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 0x7f4c6414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c6414fbb0 0x7f4c64156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c641f01f0 con 0x7f4c640a8460 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64155e30 con 0x7f4c6414fbb0 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6ba9a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c641521c0 con 0x7f4c640a88e0 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.536 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35876/0 (socket says 172.21.15.97:35876) 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 -- 172.21.15.97:0/3512835832 learned_addr learned my addr 172.21.15.97:0/3512835832 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c6a037640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c6414fbb0 0x7f4c64156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69035640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 0x7f4c6414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 -- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 msgr2=0x7f4c6414e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 0x7f4c6414e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 -- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c6414fbb0 msgr2=0x7f4c64156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c6414fbb0 0x7f4c64156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 -- 172.21.15.97:0/3512835832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60009420 con 0x7f4c640a8460 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69035640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 0x7f4c6414e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.532+0000 7f4c69836640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009740 tx=0x7f4c60019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600b4840 con 0x7f4c640a8460 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600b49c0 con 0x7f4c640a8460 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600b4d70 con 0x7f4c640a8460 2023-12-04T05:40:17.537 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c641524a0 con 0x7f4c640a8460 2023-12-04T05:40:17.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c641f0720 con 0x7f4c640a8460 2023-12-04T05:40:17.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c64068440 con 0x7f4c640a8460 2023-12-04T05:40:17.538 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c600b2040 con 0x7f4c640a8460 2023-12-04T05:40:17.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 0x7f4c48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:17.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4c6011e390 con 0x7f4c640a8460 2023-12-04T05:40:17.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c69035640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 0x7f4c48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:17.539 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.536+0000 7f4c69035640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 0x7f4c48068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4c64149d20 tx=0x7f4c54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:17.542 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.540+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c600eb900 con 0x7f4c640a8460 2023-12-04T05:40:17.755 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:17.752+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f4c640bf920 con 0x7f4c640a8460 2023-12-04T05:40:18.024 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c5a7fc640 1 -- 172.21.15.97:0/3512835832 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v234) v1 ==== 159+0+0 (secure 0 0 0) 0x7f4c600eef20 con 0x7f4c640a8460 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 msgr2=0x7f4c48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 0x7f4c48068d90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4c64149d20 tx=0x7f4c54009040 comp rx=0 tx=0).stop 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 msgr2=0x7f4c641f0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009740 tx=0x7f4c60019090 comp rx=0 tx=0).stop 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 shutdown_connections 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f4c480668d0 0x7f4c48068d90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c6414fbb0 0x7f4c64156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:18.027 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640a88e0 0x7f4c6414e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:18.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 --2- 172.21.15.97:0/3512835832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c640a8460 0x7f4c641f0c20 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:18.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 >> 172.21.15.97:0/3512835832 conn(0x7f4c640c2970 msgr2=0x7f4c6406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:18.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 shutdown_connections 2023-12-04T05:40:18.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.024+0000 7f4c6ba9a640 1 -- 172.21.15.97:0/3512835832 wait complete. 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner: 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-04T05:40:18.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi097 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-04T05:40:18.049 INFO:tasks.cephfs_test_runner: 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:Ran 3 tests in 193.807s 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-04T05:40:18.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi097 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-04T05:40:18.051 INFO:tasks.cephfs_test_runner: 2023-12-04T05:40:18.052 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-04T05:40:18.163 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=42a498393eed4a7d9034549be9d1a99e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-04T05:40:18.166 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-04T05:40:18.175 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-04T05:40:18.184 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-04T05:40:18.184 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2023-12-04T05:40:18.184 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:18.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354668k,nr_inodes=4088667,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5425 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-04T05:40:18.198 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2023-12-04T05:40:18.198 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T05:40:18.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2455 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-04T05:40:18.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.209 DEBUG:teuthology.orchestra.run.smithi097:> ip netns list 2023-12-04T05:40:18.254 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T05:40:18.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.255 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T05:40:18.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.321 DEBUG:teuthology.orchestra.run.smithi097:> sudo ip link delete ceph-brx 2023-12-04T05:40:18.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.546 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2023-12-04T05:40:18.556 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T05:40:18.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.558 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T05:40:18.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T05:40:18.623 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2023-12-04T05:40:18.842 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-04T05:40:18.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-04T05:40:18.853 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:40:18.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 Processor -- start 2023-12-04T05:40:18.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 -- start start 2023-12-04T05:40:18.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3860151e10 0x7f38600c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:18.994 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:18.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3860157dc0 con 0x7f38600c5d40 2023-12-04T05:40:18.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600c3cd0 con 0x7f3860151e10 2023-12-04T05:40:18.995 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3866c9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38601521f0 con 0x7f38600a7290 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.97:38232/0 (socket says 172.21.15.97:38232) 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 -- 172.21.15.97:0/599275676 learned_addr learned my addr 172.21.15.97:0/599275676 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f385ffff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f38600c5d40 0x7f3860158550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:51208/0 (socket says 172.21.15.97:51208) 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3864a38640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3860151e10 0x7f38600c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 -- 172.21.15.97:0/599275676 >> v2:172.21.15.143:3300/0 conn(0x7f3860151e10 msgr2=0x7f38600c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 --2- 172.21.15.97:0/599275676 >> v2:172.21.15.143:3300/0 conn(0x7f3860151e10 0x7f38600c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:18.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 -- 172.21.15.97:0/599275676 >> v1:172.21.15.143:6789/0 conn(0x7f38600c5d40 legacy=0x7f3860158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:18.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f3865239640 1 -- 172.21.15.97:0/599275676 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860158c60 con 0x7f38600a7290 2023-12-04T05:40:18.997 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.992+0000 7f385f7fe640 1 -- 172.21.15.97:0/599275676 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635871154 0 0) 0x7f3860157dc0 con 0x7f38600c5d40 2023-12-04T05:40:18.998 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f3865239640 1 --2- 172.21.15.97:0/599275676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e50 tx=0x7f385801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6184742df7be89ec server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:18.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f385f7fe640 1 -- 172.21.15.97:0/599275676 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a5720 con 0x7f38600a7290 2023-12-04T05:40:18.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f385f7fe640 1 -- 172.21.15.97:0/599275676 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38580a5880 con 0x7f38600a7290 2023-12-04T05:40:18.999 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f385f7fe640 1 -- 172.21.15.97:0/599275676 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a5c10 con 0x7f38600a7290 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f3866c9c640 1 -- 172.21.15.97:0/599275676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 msgr2=0x7f38600c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f3866c9c640 1 --2- 172.21.15.97:0/599275676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e50 tx=0x7f385801c950 comp rx=0 tx=0).stop 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f3866c9c640 1 -- 172.21.15.97:0/599275676 shutdown_connections 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:18.996+0000 7f3866c9c640 1 --2- 172.21.15.97:0/599275676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600a7290 0x7f38600c4800 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 --2- 172.21.15.97:0/599275676 >> v2:172.21.15.143:3300/0 conn(0x7f3860151e10 0x7f38600c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- 172.21.15.97:0/599275676 >> 172.21.15.97:0/599275676 conn(0x7f38600c7e40 msgr2=0x7f38600c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- 172.21.15.97:0/599275676 shutdown_connections 2023-12-04T05:40:19.000 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- 172.21.15.97:0/599275676 wait complete. 2023-12-04T05:40:19.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 Processor -- start 2023-12-04T05:40:19.001 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- start start 2023-12-04T05:40:19.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38600a7290 0x7f38601ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.003 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 0x7f386014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f07a0 con 0x7f3860151e10 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f0a80 con 0x7f38600a7290 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3866c9c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f0d60 con 0x7f38600c5d40 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35884/0 (socket says 172.21.15.97:35884) 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 -- 172.21.15.97:0/2106274246 learned_addr learned my addr 172.21.15.97:0/2106274246 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.004 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3864a38640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38600a7290 0x7f38601ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f385ffff640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 0x7f386014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 -- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 msgr2=0x7f386014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 0x7f386014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 -- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38600a7290 msgr2=0x7f38601ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38600a7290 0x7f38601ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 -- 172.21.15.97:0/2106274246 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009b30 con 0x7f3860151e10 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f385ffff640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 0x7f386014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:19.005 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.000+0000 7f3865239640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f385801a580 tx=0x7f38580196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580b8670 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38580b87f0 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580b8ba0 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38601f1040 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386014ff00 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386006bc70 con 0x7f3860151e10 2023-12-04T05:40:19.007 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f38580b8d00 con 0x7f3860151e10 2023-12-04T05:40:19.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 0x7f3844068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f385811f700 con 0x7f3860151e10 2023-12-04T05:40:19.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f3864a38640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 0x7f3844068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.008 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.004+0000 7f3864a38640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 0x7f3844068d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3854009a50 tx=0x7f3854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.010 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.008+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f386006bc70 con 0x7f3860151e10 2023-12-04T05:40:19.161 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.160+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38601f0bf0 con 0x7f38440668d0 2023-12-04T05:40:19.163 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.160+0000 7f385d7fa640 1 -- 172.21.15.97:0/2106274246 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50766 (secure 0 0 0) 0x7f38601f0bf0 con 0x7f38440668d0 2023-12-04T05:40:19.164 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:19.166 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:40:19.166 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 msgr2=0x7f3844068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 0x7f3844068d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3854009a50 tx=0x7f3854008040 comp rx=0 tx=0).stop 2023-12-04T05:40:19.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 msgr2=0x7f3860148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f385801a580 tx=0x7f38580196f0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.167 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 shutdown_connections 2023-12-04T05:40:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f38440668d0 0x7f3844068d90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3860151e10 0x7f3860148f00 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f38600c5d40 0x7f386014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 --2- 172.21.15.97:0/2106274246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f38600a7290 0x7f38601ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.168 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 >> 172.21.15.97:0/2106274246 conn(0x7f38600c7e40 msgr2=0x7f38600663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 shutdown_connections 2023-12-04T05:40:19.170 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.164+0000 7f3866c9c640 1 -- 172.21.15.97:0/2106274246 wait complete. 2023-12-04T05:40:19.186 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-04T05:40:18.238031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":275,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257968,"kb_used_data":8512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716752,"statfs":{"total":773094113280,"available":772829954048,"internally_reserved":0,"allocated":8716288,"data_stored":4511542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001207"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-12-04T05:40:09.290893+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:40:09.290893+0000","last_peered":"2023-12-04T05:40:09.290893+0000","last_clean":"2023-12-04T05:40:09.290893+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:40:09.290893+0000","last_undegraded":"2023-12-04T05:40:09.290893+0000","last_fullsized":"2023-12-04T05:40:09.290893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":1003811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.754},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.81000000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85099999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.55900000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.749},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":1.3169999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":2.0830000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":2.125},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.724}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":2.476},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":2.0419999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":2.524},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":1.369}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.9470000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":1.534}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.9990000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.978}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":424496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.62},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.318},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.371},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.504}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.77200000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.753},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:40:19.187 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:40:19.325 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 Processor -- start 2023-12-04T05:40:19.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 -- start start 2023-12-04T05:40:19.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f82cc14e970 0x7f82cc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.327 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc06ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82cc071a10 0x7f82cc0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc152300 con 0x7f82cc071a10 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc071580 con 0x7f82cc14e970 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d2dd8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc14ed50 con 0x7f82cc06be00 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82cc071a10 0x7f82cc0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82cc071a10 0x7f82cc0c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35894/0 (socket says 172.21.15.97:35894) 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 -- 172.21.15.97:0/2439163537 learned_addr learned my addr 172.21.15.97:0/2439163537 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d0b74640 1 --2- 172.21.15.97:0/2439163537 >> v2:172.21.15.143:3300/0 conn(0x7f82cc14e970 0x7f82cc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82c3fff640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc06ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 -- 172.21.15.97:0/2439163537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 msgr2=0x7f82cc06ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:19.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc06ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 -- 172.21.15.97:0/2439163537 >> v2:172.21.15.143:3300/0 conn(0x7f82cc14e970 msgr2=0x7f82cc06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:19.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 --2- 172.21.15.97:0/2439163537 >> v2:172.21.15.143:3300/0 conn(0x7f82cc14e970 0x7f82cc06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.324+0000 7f82d1375640 1 -- 172.21.15.97:0/2439163537 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc151d60 con 0x7f82cc071a10 2023-12-04T05:40:19.330 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d1375640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc071a10 0x7f82cc0c1880 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f82cc072510 tx=0x7f82c401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d946ad7ffa954f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82c37fe640 1 -- 172.21.15.97:0/2439163537 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40a5700 con 0x7f82cc071a10 2023-12-04T05:40:19.331 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82c37fe640 1 -- 172.21.15.97:0/2439163537 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40a5860 con 0x7f82cc071a10 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82c37fe640 1 -- 172.21.15.97:0/2439163537 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40a5bf0 con 0x7f82cc071a10 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 -- 172.21.15.97:0/2439163537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc071a10 msgr2=0x7f82cc0c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc071a10 0x7f82cc0c1880 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f82cc072510 tx=0x7f82c401c880 comp rx=0 tx=0).stop 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 -- 172.21.15.97:0/2439163537 shutdown_connections 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc06ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/2439163537 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc071a10 0x7f82cc0c1880 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/2439163537 >> v2:172.21.15.143:3300/0 conn(0x7f82cc14e970 0x7f82cc06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 -- 172.21.15.97:0/2439163537 >> 172.21.15.97:0/2439163537 conn(0x7f82cc0c2970 msgr2=0x7f82cc0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.332 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 -- 172.21.15.97:0/2439163537 shutdown_connections 2023-12-04T05:40:19.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.328+0000 7f82d2dd8640 1 -- 172.21.15.97:0/2439163537 wait complete. 2023-12-04T05:40:19.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 Processor -- start 2023-12-04T05:40:19.333 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 -- start start 2023-12-04T05:40:19.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc0ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82cc071a10 0x7f82cc153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc154290 con 0x7f82cc14e970 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc14bf20 con 0x7f82cc071a10 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c40c0 con 0x7f82cc06be00 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35896/0 (socket says 172.21.15.97:35896) 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 -- 172.21.15.97:0/1562573359 learned_addr learned my addr 172.21.15.97:0/1562573359 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82c3fff640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82cc071a10 0x7f82cc153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d0b74640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc0ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 -- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 msgr2=0x7f82cc0ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc0ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 -- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82cc071a10 msgr2=0x7f82cc153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82cc071a10 0x7f82cc153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 -- 172.21.15.97:0/1562573359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009b30 con 0x7f82cc14e970 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d1375640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f82c40af040 tx=0x7f82c4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40b8670 con 0x7f82cc14e970 2023-12-04T05:40:19.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c40b87d0 con 0x7f82cc14e970 2023-12-04T05:40:19.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40b8b80 con 0x7f82cc14e970 2023-12-04T05:40:19.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.332+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc14c4a0 con 0x7f82cc14e970 2023-12-04T05:40:19.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0c3b00 con 0x7f82cc14e970 2023-12-04T05:40:19.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc068440 con 0x7f82cc14e970 2023-12-04T05:40:19.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f82c40b8ce0 con 0x7f82cc14e970 2023-12-04T05:40:19.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82c17fa640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 0x7f82b8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f82c411f670 con 0x7f82cc14e970 2023-12-04T05:40:19.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82d0b74640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 0x7f82b8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.336+0000 7f82d0b74640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 0x7f82b8068d90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009a50 tx=0x7f82c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.340+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82c40eccc0 con 0x7f82cc14e970 2023-12-04T05:40:19.489 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.488+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82cc072310 con 0x7f82b80668d0 2023-12-04T05:40:19.491 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.488+0000 7f82c17fa640 1 -- 172.21.15.97:0/1562573359 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50766 (secure 0 0 0) 0x7f82cc072310 con 0x7f82b80668d0 2023-12-04T05:40:19.491 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:19.492 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:40:19.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 msgr2=0x7f82b8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 0x7f82b8068d90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009a50 tx=0x7f82c8008040 comp rx=0 tx=0).stop 2023-12-04T05:40:19.493 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 msgr2=0x7f82cc0c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f82c40af040 tx=0x7f82c4019620 comp rx=0 tx=0).stop 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 shutdown_connections 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f82b80668d0 0x7f82b8068d90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82cc14e970 0x7f82cc0c5630 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82cc071a10 0x7f82cc153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 --2- 172.21.15.97:0/1562573359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82cc06be00 0x7f82cc0ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 >> 172.21.15.97:0/1562573359 conn(0x7f82cc0c2970 msgr2=0x7f82cc1478b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 shutdown_connections 2023-12-04T05:40:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.492+0000 7f82d2dd8640 1 -- 172.21.15.97:0/1562573359 wait complete. 2023-12-04T05:40:19.512 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-04T05:40:18.238031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":275,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257968,"kb_used_data":8512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716752,"statfs":{"total":773094113280,"available":772829954048,"internally_reserved":0,"allocated":8716288,"data_stored":4511542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001207"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-12-04T05:40:09.290893+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:40:09.290893+0000","last_peered":"2023-12-04T05:40:09.290893+0000","last_clean":"2023-12-04T05:40:09.290893+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:40:09.290893+0000","last_undegraded":"2023-12-04T05:40:09.290893+0000","last_fullsized":"2023-12-04T05:40:09.290893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":1003811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.754},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.81000000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85099999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.55900000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.749},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":1.3169999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":2.0830000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":2.125},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.724}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":2.476},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":2.0419999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":2.524},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":1.369}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.9470000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":1.534}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.9990000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.978}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":424496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.62},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.318},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.371},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.504}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.77200000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.753},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:40:19.514 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-04T05:40:19.514 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:40:19.651 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.648+0000 7fed43079640 1 Processor -- start 2023-12-04T05:40:19.652 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.648+0000 7fed43079640 1 -- start start 2023-12-04T05:40:19.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 0x7fed3c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 0x7fed3c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fed3c06bee0 0x7fed3c06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c0a8670 con 0x7fed3c06bee0 2023-12-04T05:40:19.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c06c550 con 0x7fed3c154260 2023-12-04T05:40:19.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed43079640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c06c760 con 0x7fed3c0a9470 2023-12-04T05:40:19.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fed3c06bee0 0x7fed3c06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fed3c06bee0 0x7fed3c06d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35900/0 (socket says 172.21.15.97:35900) 2023-12-04T05:40:19.654 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 -- 172.21.15.97:0/919599388 learned_addr learned my addr 172.21.15.97:0/919599388 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed33fff640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 0x7fed3c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed40e15640 1 --2- 172.21.15.97:0/919599388 >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 0x7fed3c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 -- 172.21.15.97:0/919599388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 msgr2=0x7fed3c154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 0x7fed3c154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 -- 172.21.15.97:0/919599388 >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 msgr2=0x7fed3c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 --2- 172.21.15.97:0/919599388 >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 0x7fed3c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed41616640 1 -- 172.21.15.97:0/919599388 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c06ca40 con 0x7fed3c06bee0 2023-12-04T05:40:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed40e15640 1 --2- 172.21.15.97:0/919599388 >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 0x7fed3c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:19.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.652+0000 7fed33fff640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 0x7fed3c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:19.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed41616640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c06bee0 0x7fed3c06d800 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0c6f10 tx=0x7fed3401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5769f4f87d27265 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed337fe640 1 -- 172.21.15.97:0/919599388 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340a5620 con 0x7fed3c06bee0 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed337fe640 1 -- 172.21.15.97:0/919599388 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340a5780 con 0x7fed3c06bee0 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed337fe640 1 -- 172.21.15.97:0/919599388 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340a5b10 con 0x7fed3c06bee0 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- 172.21.15.97:0/919599388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c06bee0 msgr2=0x7fed3c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c06bee0 0x7fed3c06d800 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0c6f10 tx=0x7fed3401c910 comp rx=0 tx=0).stop 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- 172.21.15.97:0/919599388 shutdown_connections 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c0a9470 0x7fed3c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.658 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 --2- 172.21.15.97:0/919599388 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c06bee0 0x7fed3c06d800 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 --2- 172.21.15.97:0/919599388 >> v2:172.21.15.143:3300/0 conn(0x7fed3c154260 0x7fed3c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- 172.21.15.97:0/919599388 >> 172.21.15.97:0/919599388 conn(0x7fed3c0c2970 msgr2=0x7fed3c0c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- 172.21.15.97:0/919599388 shutdown_connections 2023-12-04T05:40:19.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- 172.21.15.97:0/919599388 wait complete. 2023-12-04T05:40:19.659 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 Processor -- start 2023-12-04T05:40:19.660 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.656+0000 7fed43079640 1 -- start start 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c06bee0 0x7fed3c0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 0x7fed3c0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0c3b10 con 0x7fed3c154260 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0c5b30 con 0x7fed3c0a9470 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0707c0 con 0x7fed3c06bee0 2023-12-04T05:40:19.661 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35910/0 (socket says 172.21.15.97:35910) 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 -- 172.21.15.97:0/176241336 learned_addr learned my addr 172.21.15.97:0/176241336 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed40e15640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c06bee0 0x7fed3c0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed33fff640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 0x7fed3c0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 -- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c06bee0 msgr2=0x7fed3c0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c06bee0 0x7fed3c0c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 -- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 msgr2=0x7fed3c0c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.662 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 0x7fed3c0c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 -- 172.21.15.97:0/176241336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34009b30 con 0x7fed3c154260 2023-12-04T05:40:19.663 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed33fff640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 0x7fed3c0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed41616640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fed340af040 tx=0x7fed340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340b8670 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340b87d0 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340b8b80 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c070aa0 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c0c4040 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c070c90 con 0x7fed3c154260 2023-12-04T05:40:19.664 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.660+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed340b8ce0 con 0x7fed3c154260 2023-12-04T05:40:19.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.664+0000 7fed317fa640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 0x7fed28068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.664+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fed3411f5d0 con 0x7fed3c154260 2023-12-04T05:40:19.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.664+0000 7fed40e15640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 0x7fed28068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.665 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.664+0000 7fed40e15640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 0x7fed28068dc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed38006fd0 tx=0x7fed38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.668 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.668+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed340ecd20 con 0x7fed3c154260 2023-12-04T05:40:19.818 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.816+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed3c068440 con 0x7fed28066900 2023-12-04T05:40:19.819 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.816+0000 7fed317fa640 1 -- 172.21.15.97:0/176241336 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50766 (secure 0 0 0) 0x7fed3c068440 con 0x7fed28066900 2023-12-04T05:40:19.819 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:19.820 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:40:19.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 msgr2=0x7fed28068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 0x7fed28068dc0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fed38006fd0 tx=0x7fed38008040 comp rx=0 tx=0).stop 2023-12-04T05:40:19.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 msgr2=0x7fed3c145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fed340af040 tx=0x7fed340196b0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.821 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 shutdown_connections 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fed28066900 0x7fed28068dc0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fed3c154260 0x7fed3c145400 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fed3c0a9470 0x7fed3c0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 --2- 172.21.15.97:0/176241336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fed3c06bee0 0x7fed3c0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 >> 172.21.15.97:0/176241336 conn(0x7fed3c0c2970 msgr2=0x7fed3c14c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 shutdown_connections 2023-12-04T05:40:19.822 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.820+0000 7fed43079640 1 -- 172.21.15.97:0/176241336 wait complete. 2023-12-04T05:40:19.840 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-04T05:40:18.238031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":275,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257968,"kb_used_data":8512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716752,"statfs":{"total":773094113280,"available":772829954048,"internally_reserved":0,"allocated":8716288,"data_stored":4511542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-60,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001207"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-12-04T05:40:09.290893+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:40:09.290893+0000","last_peered":"2023-12-04T05:40:09.290893+0000","last_clean":"2023-12-04T05:40:09.290893+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:40:09.290893+0000","last_undegraded":"2023-12-04T05:40:09.290893+0000","last_fullsized":"2023-12-04T05:40:09.290893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":1003811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.754},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.81000000000000005}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.85099999999999998}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":413983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.55900000000000005}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.749},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.83299999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.90800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68999999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67300000000000004}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":1.3169999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":2.0830000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":2.125},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.724}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":2.476},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":2.0419999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":2.524},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":1.369}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.9470000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":1.534}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":1.4099999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.9990000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.978}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":424496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52400000000000002}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.61299999999999999}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.76600000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":937984,"data_stored":413503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.378},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.35699999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.40999999999999998}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.62},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":933888,"data_stored":413469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.435},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.68100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":1004281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.318},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.371},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.504}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.77200000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.753},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:40:19.842 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T05:40:19.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.976+0000 7fcb1e92a640 1 Processor -- start 2023-12-04T05:40:19.979 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.976+0000 7fcb1e92a640 1 -- start start 2023-12-04T05:40:19.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1e92a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 0x7fcb18154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1e92a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb1806df10 0x7fcb18154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.980 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1e92a640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1806c760 con 0x7fcb180a9470 2023-12-04T05:40:19.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1e92a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180a8670 con 0x7fcb1806df10 2023-12-04T05:40:19.981 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1e92a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1806c550 con 0x7fcb18154260 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb177fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fcb180a9470 0x7fcb1806d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48576/0 (socket says 172.21.15.97:48576) 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb177fe640 1 -- 172.21.15.97:0/1218970303 learned_addr learned my addr 172.21.15.97:0/1218970303 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb17fff640 1 --2- 172.21.15.97:0/1218970303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 0x7fcb18154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb1cec7640 1 --2- 172.21.15.97:0/1218970303 >> v2:172.21.15.143:3300/0 conn(0x7fcb1806df10 0x7fcb18154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365105250 0 0) 0x7fcb1806c760 con 0x7fcb180a9470 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb00003530 con 0x7fcb180a9470 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb17fff640 1 -- 172.21.15.97:0/1218970303 >> v2:172.21.15.143:3300/0 conn(0x7fcb1806df10 msgr2=0x7fcb18154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:19.982 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb17fff640 1 --2- 172.21.15.97:0/1218970303 >> v2:172.21.15.143:3300/0 conn(0x7fcb1806df10 0x7fcb18154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb17fff640 1 -- 172.21.15.97:0/1218970303 >> v1:172.21.15.97:6789/0 conn(0x7fcb180a9470 legacy=0x7fcb1806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725603418 0 0) 0x7fcb00003530 con 0x7fcb180a9470 2023-12-04T05:40:19.983 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.980+0000 7fcb17fff640 1 -- 172.21.15.97:0/1218970303 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1806ca40 con 0x7fcb18154260 2023-12-04T05:40:19.984 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb17fff640 1 --2- 172.21.15.97:0/1218970303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 0x7fcb18154640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb0801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee02ee80cce8ba91 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c001680 con 0x7fcb18154260 2023-12-04T05:40:19.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080a7050 con 0x7fcb18154260 2023-12-04T05:40:19.985 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb16ffd640 1 -- 172.21.15.97:0/1218970303 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080ab620 con 0x7fcb18154260 2023-12-04T05:40:19.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 -- 172.21.15.97:0/1218970303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 msgr2=0x7fcb18154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/1218970303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 0x7fcb18154640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb0801c370 comp rx=0 tx=0).stop 2023-12-04T05:40:19.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 -- 172.21.15.97:0/1218970303 shutdown_connections 2023-12-04T05:40:19.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/1218970303 >> v2:172.21.15.143:3300/0 conn(0x7fcb1806df10 0x7fcb18154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.986 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/1218970303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb18154260 0x7fcb18154640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 -- 172.21.15.97:0/1218970303 >> 172.21.15.97:0/1218970303 conn(0x7fcb180c2970 msgr2=0x7fcb180c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:19.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 -- 172.21.15.97:0/1218970303 shutdown_connections 2023-12-04T05:40:19.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 -- 172.21.15.97:0/1218970303 wait complete. 2023-12-04T05:40:19.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.984+0000 7fcb1e92a640 1 Processor -- start 2023-12-04T05:40:19.987 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- start start 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806df10 0x7fcb181eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb18154260 0x7fcb18148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18149010 con 0x7fcb180a9470 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181ecfc0 con 0x7fcb18154260 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18149e20 con 0x7fcb1806df10 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.990 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35924/0 (socket says 172.21.15.97:35924) 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 -- 172.21.15.97:0/71471766 learned_addr learned my addr 172.21.15.97:0/71471766 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 -- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806df10 msgr2=0x7fcb181eca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806df10 0x7fcb181eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 -- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb18154260 msgr2=0x7fcb18148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb18154260 0x7fcb18148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 -- 172.21.15.97:0/71471766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08009420 con 0x7fcb180a9470 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb177fe640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c750 tx=0x7fcb0c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c005af0 con 0x7fcb180a9470 2023-12-04T05:40:19.991 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c005c50 con 0x7fcb180a9470 2023-12-04T05:40:19.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c007070 con 0x7fcb180a9470 2023-12-04T05:40:19.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18147ad0 con 0x7fcb180a9470 2023-12-04T05:40:19.992 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18147d40 con 0x7fcb180a9470 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.988+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb18147f60 con 0x7fcb180a9470 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.992+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb0c0071d0 con 0x7fcb180a9470 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.992+0000 7fcb14ff9640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 0x7fcb04068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.992+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcb0c083d30 con 0x7fcb180a9470 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.992+0000 7fcb17fff640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 0x7fcb04068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:19.993 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.992+0000 7fcb17fff640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 0x7fcb04068de0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ad000 tx=0x7fcb08004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:19.996 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:19.996+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb0c054e10 con 0x7fcb180a9470 2023-12-04T05:40:20.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.148+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb18068440 con 0x7fcb180a9470 2023-12-04T05:40:20.150 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.148+0000 7fcb14ff9640 1 -- 172.21.15.97:0/71471766 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13103 (secure 0 0 0) 0x7fcb0c001370 con 0x7fcb180a9470 2023-12-04T05:40:20.151 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:20.151 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":78,"fsid":"76f28696-8109-44bf-b432-6ecc5796b8c9","created":"2023-12-04T05:36:15.181194+0000","modified":"2023-12-04T05:40:17.016152+0000","last_up_change":"2023-12-04T05:36:27.611423+0000","last_in_change":"2023-12-04T05:36:17.778139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T05:36:28.253428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a25fb4dd-28ea-44ea-b824-6949ae00164b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6801","nonce":420219681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6803","nonce":420219681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6807","nonce":420219681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":420219681},{"type":"v1","addr":"172.21.15.97:6805","nonce":420219681}]},"public_addr":"172.21.15.97:6801/420219681","cluster_addr":"172.21.15.97:6803/420219681","heartbeat_back_addr":"172.21.15.97:6807/420219681","heartbeat_front_addr":"172.21.15.97:6805/420219681","state":["exists","up"]},{"osd":1,"uuid":"198553e2-3fed-46d8-9784-3d16a4bf0715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6810","nonce":344946236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6814","nonce":344946236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6822","nonce":344946236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":344946236},{"type":"v1","addr":"172.21.15.97:6818","nonce":344946236}]},"public_addr":"172.21.15.97:6810/344946236","cluster_addr":"172.21.15.97:6814/344946236","heartbeat_back_addr":"172.21.15.97:6822/344946236","heartbeat_front_addr":"172.21.15.97:6818/344946236","state":["exists","up"]},{"osd":2,"uuid":"f47993fe-6e63-4ff1-b886-d53358bbb0b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6825","nonce":2063616268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6827","nonce":2063616268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6831","nonce":2063616268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2063616268},{"type":"v1","addr":"172.21.15.97:6829","nonce":2063616268}]},"public_addr":"172.21.15.97:6825/2063616268","cluster_addr":"172.21.15.97:6827/2063616268","heartbeat_back_addr":"172.21.15.97:6831/2063616268","heartbeat_front_addr":"172.21.15.97:6829/2063616268","state":["exists","up"]},{"osd":3,"uuid":"6c598c28-9951-4ae0-8ab4-dafca272838f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6809","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6811","nonce":2471126729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6815","nonce":2471126729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6821","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6823","nonce":2471126729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6817","nonce":2471126729},{"type":"v1","addr":"172.21.15.97:6819","nonce":2471126729}]},"public_addr":"172.21.15.97:6811/2471126729","cluster_addr":"172.21.15.97:6815/2471126729","heartbeat_back_addr":"172.21.15.97:6823/2471126729","heartbeat_front_addr":"172.21.15.97:6819/2471126729","state":["exists","up"]},{"osd":4,"uuid":"dff3a4e2-bc3e-462d-8351-ec30355b14c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6817","nonce":3115878334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6819","nonce":3115878334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6823","nonce":3115878334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3115878334},{"type":"v1","addr":"172.21.15.143:6821","nonce":3115878334}]},"public_addr":"172.21.15.143:6817/3115878334","cluster_addr":"172.21.15.143:6819/3115878334","heartbeat_back_addr":"172.21.15.143:6823/3115878334","heartbeat_front_addr":"172.21.15.143:6821/3115878334","state":["exists","up"]},{"osd":5,"uuid":"8eb9702b-1026-4b07-acd4-bb9e365f2b4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6801","nonce":4041478737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6803","nonce":4041478737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6807","nonce":4041478737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":4041478737},{"type":"v1","addr":"172.21.15.143:6805","nonce":4041478737}]},"public_addr":"172.21.15.143:6801/4041478737","cluster_addr":"172.21.15.143:6803/4041478737","heartbeat_back_addr":"172.21.15.143:6807/4041478737","heartbeat_front_addr":"172.21.15.143:6805/4041478737","state":["exists","up"]},{"osd":6,"uuid":"be0dafe0-752d-4cfd-99cf-67de99dd1c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6809","nonce":1463072026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6811","nonce":1463072026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6815","nonce":1463072026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":1463072026},{"type":"v1","addr":"172.21.15.143:6813","nonce":1463072026}]},"public_addr":"172.21.15.143:6809/1463072026","cluster_addr":"172.21.15.143:6811/1463072026","heartbeat_back_addr":"172.21.15.143:6815/1463072026","heartbeat_front_addr":"172.21.15.143:6813/1463072026","state":["exists","up"]},{"osd":7,"uuid":"ca28238f-e4d6-4e33-9e3b-f838e0ede706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6825","nonce":2750869558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6827","nonce":2750869558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6831","nonce":2750869558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":2750869558},{"type":"v1","addr":"172.21.15.143:6829","nonce":2750869558}]},"public_addr":"172.21.15.143:6825/2750869558","cluster_addr":"172.21.15.143:6827/2750869558","heartbeat_back_addr":"172.21.15.143:6831/2750869558","heartbeat_front_addr":"172.21.15.143:6829/2750869558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.485825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.372774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.700597+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.715427+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.578041+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.483367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.582561+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T05:36:23.423114+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.97:6835/758746591":"2023-12-05T05:40:13.743427+0000","172.21.15.97:6834/758746591":"2023-12-05T05:40:13.743427+0000","172.21.15.97:6837/2403583657":"2023-12-05T05:40:07.207202+0000","172.21.15.97:6836/2403583657":"2023-12-05T05:40:07.207202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 msgr2=0x7fcb04068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 0x7fcb04068de0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcb080ad000 tx=0x7fcb08004740 comp rx=0 tx=0).stop 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 msgr2=0x7fcb18070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c750 tx=0x7fcb0c00cc10 comp rx=0 tx=0).stop 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 shutdown_connections 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fcb04066920 0x7fcb04068de0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:20.153 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb18154260 0x7fcb18148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:20.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcb180a9470 0x7fcb18070790 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:20.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 --2- 172.21.15.97:0/71471766 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb1806df10 0x7fcb181eca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:20.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 >> 172.21.15.97:0/71471766 conn(0x7fcb180c2970 msgr2=0x7fcb1814cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:20.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 shutdown_connections 2023-12-04T05:40:20.154 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:20.152+0000 7fcb1e92a640 1 -- 172.21.15.97:0/71471766 wait complete. 2023-12-04T05:40:21.174 INFO:tasks.ceph:Scrubbing osd.0 2023-12-04T05:40:21.174 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:21.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 Processor -- start 2023-12-04T05:40:21.326 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 -- start start 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82380c2120 0x7f8238154250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f82380c39f0 0x7f823815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82380c10f0 con 0x7f8238153e70 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82380c16b0 con 0x7f82380c2120 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.324+0000 7f823759e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8238154920 con 0x7f82380c39f0 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82380c2120 0x7f8238154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f82380c2120 0x7f8238154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35932/0 (socket says 172.21.15.97:35932) 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 -- 172.21.15.97:0/46217886 learned_addr learned my addr 172.21.15.97:0/46217886 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:21.328 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f8236d9d640 1 --2- 172.21.15.97:0/46217886 >> v2:172.21.15.143:3300/0 conn(0x7f82380c39f0 0x7f823815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 -- 172.21.15.97:0/46217886 >> v2:172.21.15.143:3300/0 conn(0x7f82380c39f0 msgr2=0x7f823815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:21.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 --2- 172.21.15.97:0/46217886 >> v2:172.21.15.143:3300/0 conn(0x7f82380c39f0 0x7f823815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 -- 172.21.15.97:0/46217886 >> v1:172.21.15.143:6789/0 conn(0x7f8238153e70 legacy=0x7f82380a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.329 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 -- 172.21.15.97:0/46217886 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82380a9ec0 con 0x7f82380c2120 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f822dd9b640 1 --2- 172.21.15.97:0/46217886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f8238154250 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f82380a4d60 tx=0x7f822001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acaa020568302464 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f8235d9b640 1 -- 172.21.15.97:0/46217886 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200a5740 con 0x7f82380c2120 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f8235d9b640 1 -- 172.21.15.97:0/46217886 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82200a58a0 con 0x7f82380c2120 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.328+0000 7f8235d9b640 1 -- 172.21.15.97:0/46217886 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200a5c30 con 0x7f82380c2120 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- 172.21.15.97:0/46217886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 msgr2=0x7f8238154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- 172.21.15.97:0/46217886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f8238154250 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f82380a4d60 tx=0x7f822001c880 comp rx=0 tx=0).stop 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- 172.21.15.97:0/46217886 shutdown_connections 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- 172.21.15.97:0/46217886 >> v2:172.21.15.143:3300/0 conn(0x7f82380c39f0 0x7f823815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.335 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- 172.21.15.97:0/46217886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f8238154250 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- 172.21.15.97:0/46217886 >> 172.21.15.97:0/46217886 conn(0x7f823806a5f0 msgr2=0x7f823806aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- 172.21.15.97:0/46217886 shutdown_connections 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- 172.21.15.97:0/46217886 wait complete. 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 Processor -- start 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- start start 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f82380703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82380c39f0 0x7f82381530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8238153e70 0x7f823806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.336 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8238153bd0 con 0x7f82380c2120 2023-12-04T05:40:21.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8238070bc0 con 0x7f8238153e70 2023-12-04T05:40:21.337 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823759e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8238070900 con 0x7f82380c39f0 2023-12-04T05:40:21.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f82380703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.338 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f82380703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35948/0 (socket says 172.21.15.97:35948) 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f823659c640 1 -- 172.21.15.97:0/4003288991 learned_addr learned my addr 172.21.15.97:0/4003288991 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f8236d9d640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8238153e70 0x7f823806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.332+0000 7f822dd9b640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82380c39f0 0x7f82381530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 -- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82380c39f0 msgr2=0x7f82381530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82380c39f0 0x7f82381530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 -- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8238153e70 msgr2=0x7f823806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8238153e70 0x7f823806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220009b30 con 0x7f82380c2120 2023-12-04T05:40:21.339 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823659c640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f82380703c0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f822800c3c0 tx=0x7f822800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82280052d0 con 0x7f82380c2120 2023-12-04T05:40:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228005430 con 0x7f82380c2120 2023-12-04T05:40:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82381538f0 con 0x7f82380c2120 2023-12-04T05:40:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228003840 con 0x7f82380c2120 2023-12-04T05:40:21.340 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8238151cd0 con 0x7f82380c2120 2023-12-04T05:40:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f823815b700 con 0x7f82380c2120 2023-12-04T05:40:21.341 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f82280039a0 con 0x7f82380c2120 2023-12-04T05:40:21.342 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8218066900 0x7f8218068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8228083a00 con 0x7f82380c2120 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822dd9b640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8218066900 0x7f8218068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f821806c800 0x7f821806ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f821806f2d0 con 0x7f821806c800 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.336+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8228083db0 con 0x7f82380c2120 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.340+0000 7f8236d9d640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f821806c800 0x7f821806ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.343 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.340+0000 7f822dd9b640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8218066900 0x7f8218068dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82200ae000 tx=0x7f82200a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.340+0000 7f8236d9d640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f821806c800 0x7f821806ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.344 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.340+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== osd.0 v2:172.21.15.97:6800/420219681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f821806f2d0 con 0x7f821806c800 2023-12-04T05:40:21.353 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 --> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8238151850 con 0x7f821806c800 2023-12-04T05:40:21.354 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f822f7fe640 1 -- 172.21.15.97:0/4003288991 <== osd.0 v2:172.21.15.97:6800/420219681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8238151850 con 0x7f821806c800 2023-12-04T05:40:21.354 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:21.355 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f821806c800 msgr2=0x7f821806ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6800/420219681,v1:172.21.15.97:6801/420219681] conn(0x7f821806c800 0x7f821806ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8218066900 msgr2=0x7f8218068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8218066900 0x7f8218068dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f82200ae000 tx=0x7f82200a7070 comp rx=0 tx=0).stop 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 msgr2=0x7f82380703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.356 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 --2- 172.21.15.97:0/4003288991 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f82380c2120 0x7f82380703c0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f822800c3c0 tx=0x7f822800c880 comp rx=0 tx=0).stop 2023-12-04T05:40:21.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f8236d9d640 1 -- 172.21.15.97:0/4003288991 reap_dead start 2023-12-04T05:40:21.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 shutdown_connections 2023-12-04T05:40:21.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 >> 172.21.15.97:0/4003288991 conn(0x7f823806a5f0 msgr2=0x7f823806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 shutdown_connections 2023-12-04T05:40:21.357 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.352+0000 7f823759e640 1 -- 172.21.15.97:0/4003288991 wait complete. 2023-12-04T05:40:21.373 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-04T05:40:21.510 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.508+0000 7f8f8f1aa640 1 Processor -- start 2023-12-04T05:40:21.511 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.508+0000 7f8f8f1aa640 1 -- start start 2023-12-04T05:40:21.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8f1aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f8814f960 0x7f8f881548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8f1aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f88154640 con 0x7f8f8814eb30 2023-12-04T05:40:21.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8f1aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8814ef10 con 0x7f8f88154e10 2023-12-04T05:40:21.512 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8f1aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880c0bd0 con 0x7f8f8814f960 2023-12-04T05:40:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8cf46640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f8f8814eb30 0x7f8f8814f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48586/0 (socket says 172.21.15.97:48586) 2023-12-04T05:40:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8cf46640 1 -- 172.21.15.97:0/1798502086 learned_addr learned my addr 172.21.15.97:0/1798502086 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636403510 0 0) 0x7f8f88154640 con 0x7f8f8814eb30 2023-12-04T05:40:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f70003530 con 0x7f8f8814eb30 2023-12-04T05:40:21.513 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/1798502086 >> v2:172.21.15.143:3300/0 conn(0x7f8f8814f960 0x7f8f881548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.514 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2932214038 0 0) 0x7f8f70003530 con 0x7f8f8814eb30 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 >> v2:172.21.15.143:3300/0 conn(0x7f8f8814f960 msgr2=0x7f8f881548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 --2- 172.21.15.97:0/1798502086 >> v2:172.21.15.143:3300/0 conn(0x7f8f8814f960 0x7f8f881548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 >> v1:172.21.15.143:6789/0 conn(0x7f8f88154e10 legacy=0x7f8f8815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f881535a0 con 0x7f8f8814eb30 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f8f84001680 con 0x7f8f8814eb30 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 >> v1:172.21.15.97:6789/0 conn(0x7f8f8814eb30 legacy=0x7f8f8814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f70003980 0x7f8f70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.515 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f70005190 0x7f8f7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880c0bd0 con 0x7f8f70005190 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7000e240 con 0x7f8f70003980 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7000e400 con 0x7f8f700047d0 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f70003980 0x7f8f70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8d747640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f70005190 0x7f8f7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 -- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f70003980 msgr2=0x7f8f70003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f70003980 0x7f8f70003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.516 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 -- 172.21.15.97:0/1798502086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f70005190 msgr2=0x7f8f7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:21.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f70005190 0x7f8f7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f7ffff640 1 -- 172.21.15.97:0/1798502086 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70003530 con 0x7f8f700047d0 2023-12-04T05:40:21.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8d747640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f70005190 0x7f8f7000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:21.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8d747640 1 -- 172.21.15.97:0/1798502086 reap_dead start 2023-12-04T05:40:21.517 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.512+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f70003980 0x7f8f70003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:21.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f70004c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009ae0 tx=0x7f8f7801ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ff1f0ea8a5689e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780a5640 con 0x7f8f700047d0 2023-12-04T05:40:21.518 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f780a57a0 con 0x7f8f700047d0 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f7f7fe640 1 -- 172.21.15.97:0/1798502086 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780a5b90 con 0x7f8f700047d0 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 msgr2=0x7f8f70004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f70004c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009ae0 tx=0x7f8f7801ca50 comp rx=0 tx=0).stop 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/1798502086 shutdown_connections 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/1798502086 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f70004c50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/1798502086 >> 172.21.15.97:0/1798502086 conn(0x7f8f880c5e70 msgr2=0x7f8f880c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/1798502086 shutdown_connections 2023-12-04T05:40:21.519 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/1798502086 wait complete. 2023-12-04T05:40:21.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.516+0000 7f8f8f1aa640 1 Processor -- start 2023-12-04T05:40:21.520 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- start start 2023-12-04T05:40:21.521 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f880c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 0x7f8f880700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880c53d0 con 0x7f8f88144700 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880c4620 con 0x7f8f880aac40 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880c4ff0 con 0x7f8f700047d0 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35966/0 (socket says 172.21.15.97:35966) 2023-12-04T05:40:21.522 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 -- 172.21.15.97:0/3445457418 learned_addr learned my addr 172.21.15.97:0/3445457418 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 -- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 msgr2=0x7f8f880c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f880c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 0x7f8f880700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f880c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 -- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 msgr2=0x7f8f880700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 0x7f8f880700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 -- 172.21.15.97:0/3445457418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f881450c0 con 0x7f8f88144700 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f880c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:21.523 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f7ffff640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 0x7f8f880700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:21.524 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8d747640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000fae0 tx=0x7f8f8000fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80006d70 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80003980 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003d30 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880c3a10 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f880c3fd0 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.520+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88068440 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.524+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8f80005110 con 0x7f8f88144700 2023-12-04T05:40:21.525 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.524+0000 7f8f7d7fa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 0x7f8f74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.524+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8f800837d0 con 0x7f8f88144700 2023-12-04T05:40:21.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.524+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 0x7f8f74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.526 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.524+0000 7f8f8cf46640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 0x7f8f74068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f88067bd0 tx=0x7f8f84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.529 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.528+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f80050ca0 con 0x7f8f88144700 2023-12-04T05:40:21.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.676+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f88153e40 con 0x7f8f740668d0 2023-12-04T05:40:21.680 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f7d7fa640 1 -- 172.21.15.97:0/3445457418 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f84004c80 con 0x7f8f740668d0 2023-12-04T05:40:21.680 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 msgr2=0x7f8f74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 0x7f8f74068d90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f88067bd0 tx=0x7f8f84009040 comp rx=0 tx=0).stop 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 msgr2=0x7f8f88144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000fae0 tx=0x7f8f8000fee0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 shutdown_connections 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f8f740668d0 0x7f8f74068d90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8f88144700 0x7f8f88144b80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.682 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f880aac40 0x7f8f880700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 --2- 172.21.15.97:0/3445457418 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f700047d0 0x7f8f880c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 >> 172.21.15.97:0/3445457418 conn(0x7f8f880c5e70 msgr2=0x7f8f880c0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 shutdown_connections 2023-12-04T05:40:21.683 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.680+0000 7f8f8f1aa640 1 -- 172.21.15.97:0/3445457418 wait complete. 2023-12-04T05:40:21.700 INFO:tasks.ceph:Scrubbing osd.1 2023-12-04T05:40:21.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:21.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 Processor -- start 2023-12-04T05:40:21.842 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 -- start start 2023-12-04T05:40:21.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 0x7f0a6406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.843 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a641551f0 con 0x7f0a6414e470 2023-12-04T05:40:21.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6406d7d0 con 0x7f0a640c83f0 2023-12-04T05:40:21.844 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.840+0000 7f0a69501640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640ca910 con 0x7f0a6414e850 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a62ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0a6414e470 0x7f0a640c69f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:51224/0 (socket says 172.21.15.97:51224) 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a637fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a62ffd640 1 -- 172.21.15.97:0/2731321398 learned_addr learned my addr 172.21.15.97:0/2731321398 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a5a7fc640 1 --2- 172.21.15.97:0/2731321398 >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 0x7f0a6406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a627fc640 1 -- 172.21.15.97:0/2731321398 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346071633 0 0) 0x7f0a641551f0 con 0x7f0a6414e470 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a627fc640 1 -- 172.21.15.97:0/2731321398 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a50003530 con 0x7f0a6414e470 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a637fe640 1 -- 172.21.15.97:0/2731321398 >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 msgr2=0x7f0a6406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a637fe640 1 --2- 172.21.15.97:0/2731321398 >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 0x7f0a6406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.845 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a637fe640 1 -- 172.21.15.97:0/2731321398 >> v1:172.21.15.143:6789/0 conn(0x7f0a6414e470 legacy=0x7f0a640c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a637fe640 1 -- 172.21.15.97:0/2731321398 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a641554d0 con 0x7f0a6414e850 2023-12-04T05:40:21.846 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.844+0000 7f0a5a7fc640 1 --2- 172.21.15.97:0/2731321398 >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 0x7f0a6406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:21.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a637fe640 1 --2- 172.21.15.97:0/2731321398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6406c330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097f0 tx=0x7f0a5c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5673c27db9fe11b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a627fc640 1 -- 172.21.15.97:0/2731321398 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0ab600 con 0x7f0a6414e850 2023-12-04T05:40:21.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a627fc640 1 -- 172.21.15.97:0/2731321398 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0a7050 con 0x7f0a6414e850 2023-12-04T05:40:21.848 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a627fc640 1 -- 172.21.15.97:0/2731321398 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0ab980 con 0x7f0a6414e850 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- 172.21.15.97:0/2731321398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 msgr2=0x7f0a6406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- 172.21.15.97:0/2731321398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6406c330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097f0 tx=0x7f0a5c01c330 comp rx=0 tx=0).stop 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- 172.21.15.97:0/2731321398 shutdown_connections 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- 172.21.15.97:0/2731321398 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6406c330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- 172.21.15.97:0/2731321398 >> v2:172.21.15.143:3300/0 conn(0x7f0a640c83f0 0x7f0a6406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- 172.21.15.97:0/2731321398 >> 172.21.15.97:0/2731321398 conn(0x7f0a64073c00 msgr2=0x7f0a640c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.849 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- 172.21.15.97:0/2731321398 shutdown_connections 2023-12-04T05:40:21.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- 172.21.15.97:0/2731321398 wait complete. 2023-12-04T05:40:21.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 Processor -- start 2023-12-04T05:40:21.850 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- start start 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a640c83f0 0x7f0a640acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 0x7f0a641467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641ecb20 con 0x7f0a6414e470 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64157690 con 0x7f0a640c83f0 2023-12-04T05:40:21.853 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.848+0000 7f0a69501640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641ecd30 con 0x7f0a6414e850 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 0x7f0a641467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a62ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a640c83f0 0x7f0a640acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 0x7f0a641467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:35974/0 (socket says 172.21.15.97:35974) 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 -- 172.21.15.97:0/3098320561 learned_addr learned my addr 172.21.15.97:0/3098320561 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a637fe640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 -- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 msgr2=0x7f0a6414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a6414e850 0x7f0a6414ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.854 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 -- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a640c83f0 msgr2=0x7f0a640acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a640c83f0 0x7f0a640acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c009420 con 0x7f0a6414e470 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a62ffd640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a640c83f0 0x7f0a640acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5a7fc640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 0x7f0a641467f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9b0 tx=0x7f0a4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00c9a0 con 0x7f0a6414e470 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00cb00 con 0x7f0a6414e470 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c009420 con 0x7f0a6414e470 2023-12-04T05:40:21.855 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c013470 con 0x7f0a6414e470 2023-12-04T05:40:21.856 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641570d0 con 0x7f0a6414e470 2023-12-04T05:40:21.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a64154160 con 0x7f0a6414e470 2023-12-04T05:40:21.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.852+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a4c0135d0 con 0x7f0a6414e470 2023-12-04T05:40:21.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a440668d0 0x7f0a44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0a4c084600 con 0x7f0a6414e470 2023-12-04T05:40:21.857 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a62ffd640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a440668d0 0x7f0a44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7f0a4406c7d0 0x7f0a4406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a4406f2a0 con 0x7f0a4406c7d0 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c084a50 con 0x7f0a6414e470 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a637fe640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7f0a4406c7d0 0x7f0a4406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a62ffd640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a440668d0 0x7f0a44068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0a54001570 tx=0x7f0a54001aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.858 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a637fe640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7f0a4406c7d0 0x7f0a4406ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:21.859 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.856+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== osd.1 v2:172.21.15.97:6808/344946236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0a4406f2a0 con 0x7f0a4406c7d0 2023-12-04T05:40:21.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 --> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0a6406c870 con 0x7f0a4406c7d0 2023-12-04T05:40:21.871 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a5bfff640 1 -- 172.21.15.97:0/3098320561 <== osd.1 v2:172.21.15.97:6808/344946236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0a5c0ab5a0 con 0x7f0a4406c7d0 2023-12-04T05:40:21.871 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:21.871 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:21.871 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:21.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7f0a4406c7d0 msgr2=0x7f0a4406ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6808/344946236,v1:172.21.15.97:6810/344946236] conn(0x7f0a4406c7d0 0x7f0a4406ebf0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.872 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a440668d0 msgr2=0x7f0a44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f0a440668d0 0x7f0a44068d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0a54001570 tx=0x7f0a54001aa0 comp rx=0 tx=0).stop 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 msgr2=0x7f0a641467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 --2- 172.21.15.97:0/3098320561 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a6414e470 0x7f0a641467f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00e9b0 tx=0x7f0a4c00ee70 comp rx=0 tx=0).stop 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a637fe640 1 -- 172.21.15.97:0/3098320561 reap_dead start 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 shutdown_connections 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.868+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 >> 172.21.15.97:0/3098320561 conn(0x7f0a64073c00 msgr2=0x7f0a6406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.872+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 shutdown_connections 2023-12-04T05:40:21.873 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:21.872+0000 7f0a69501640 1 -- 172.21.15.97:0/3098320561 wait complete. 2023-12-04T05:40:21.889 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-04T05:40:22.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 Processor -- start 2023-12-04T05:40:22.028 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 -- start start 2023-12-04T05:40:22.029 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f484014f960 0x7f48401548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4840154e10 0x7f484015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4840154640 con 0x7f484014eb30 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400c0bd0 con 0x7f484014f960 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f48482d6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484014ef10 con 0x7f4840154e10 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4846072640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f484014eb30 0x7f484014f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48602/0 (socket says 172.21.15.97:48602) 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4846072640 1 -- 172.21.15.97:0/796767431 learned_addr learned my addr 172.21.15.97:0/796767431 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:22.030 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845871640 1 --2- 172.21.15.97:0/796767431 >> v2:172.21.15.97:3300/0 conn(0x7f484014f960 0x7f48401548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4846873640 1 --2- 172.21.15.97:0/796767431 >> v2:172.21.15.143:3300/0 conn(0x7f4840154e10 0x7f484015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845070640 1 -- 172.21.15.97:0/796767431 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683661082 0 0) 0x7f4840154640 con 0x7f484014eb30 2023-12-04T05:40:22.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845070640 1 -- 172.21.15.97:0/796767431 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003530 con 0x7f484014eb30 2023-12-04T05:40:22.031 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845871640 1 -- 172.21.15.97:0/796767431 >> v2:172.21.15.143:3300/0 conn(0x7f4840154e10 msgr2=0x7f484015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:22.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845871640 1 --2- 172.21.15.97:0/796767431 >> v2:172.21.15.143:3300/0 conn(0x7f4840154e10 0x7f484015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845871640 1 -- 172.21.15.97:0/796767431 >> v1:172.21.15.97:6789/0 conn(0x7f484014eb30 legacy=0x7f484014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.032 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.028+0000 7f4845871640 1 -- 172.21.15.97:0/796767431 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48401535a0 con 0x7f484014f960 2023-12-04T05:40:22.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f4845871640 1 --2- 172.21.15.97:0/796767431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f484014f960 0x7f48401548d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f48400a8950 tx=0x7f483001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0ce6a8d5c3d856 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f4845070640 1 -- 172.21.15.97:0/796767431 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab600 con 0x7f484014f960 2023-12-04T05:40:22.033 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f4845070640 1 -- 172.21.15.97:0/796767431 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300a7050 con 0x7f484014f960 2023-12-04T05:40:22.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f4845070640 1 -- 172.21.15.97:0/796767431 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab960 con 0x7f484014f960 2023-12-04T05:40:22.034 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 -- 172.21.15.97:0/796767431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f484014f960 msgr2=0x7f48401548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 --2- 172.21.15.97:0/796767431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f484014f960 0x7f48401548d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f48400a8950 tx=0x7f483001c430 comp rx=0 tx=0).stop 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 -- 172.21.15.97:0/796767431 shutdown_connections 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 --2- 172.21.15.97:0/796767431 >> v2:172.21.15.143:3300/0 conn(0x7f4840154e10 0x7f484015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 --2- 172.21.15.97:0/796767431 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f484014f960 0x7f48401548d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 -- 172.21.15.97:0/796767431 >> 172.21.15.97:0/796767431 conn(0x7f48400c5e70 msgr2=0x7f48400c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 -- 172.21.15.97:0/796767431 shutdown_connections 2023-12-04T05:40:22.035 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.032+0000 7f48482d6640 1 -- 172.21.15.97:0/796767431 wait complete. 2023-12-04T05:40:22.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 Processor -- start 2023-12-04T05:40:22.039 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- start start 2023-12-04T05:40:22.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f484014eb30 0x7f48400bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f484014f960 0x7f48400c1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.040 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840147390 con 0x7f4840154e10 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400c0020 con 0x7f484014f960 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400c5c80 con 0x7f484014eb30 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36000/0 (socket says 172.21.15.97:36000) 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 -- 172.21.15.97:0/3467790973 learned_addr learned my addr 172.21.15.97:0/3467790973 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4845871640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f484014f960 0x7f48400c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846072640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f484014eb30 0x7f48400bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.041 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 -- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f484014eb30 msgr2=0x7f48400bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f484014eb30 0x7f48400bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 -- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f484014f960 msgr2=0x7f48400c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f484014f960 0x7f48400c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 -- 172.21.15.97:0/3467790973 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009420 con 0x7f4840154e10 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4846873640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4838007e90 tx=0x7f483800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838014420 con 0x7f4840154e10 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838014580 con 0x7f4840154e10 2023-12-04T05:40:22.042 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838014930 con 0x7f4840154e10 2023-12-04T05:40:22.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48400c57f0 con 0x7f4840154e10 2023-12-04T05:40:22.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48400c51a0 con 0x7f4840154e10 2023-12-04T05:40:22.043 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.036+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48400c5980 con 0x7f4840154e10 2023-12-04T05:40:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.040+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4838014a90 con 0x7f4840154e10 2023-12-04T05:40:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.040+0000 7f4836ffd640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 0x7f4824068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.040+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4838084940 con 0x7f4840154e10 2023-12-04T05:40:22.044 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.040+0000 7f4846072640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 0x7f4824068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.040+0000 7f4846072640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 0x7f4824068d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f483c007fd0 tx=0x7f483c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.045 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.044+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4838051ed0 con 0x7f4840154e10 2023-12-04T05:40:22.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.192+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4840154120 con 0x7f48240668d0 2023-12-04T05:40:22.195 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.192+0000 7f4836ffd640 1 -- 172.21.15.97:0/3467790973 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f483c00f820 con 0x7f48240668d0 2023-12-04T05:40:22.195 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2023-12-04T05:40:22.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 msgr2=0x7f4824068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 0x7f4824068d90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f483c007fd0 tx=0x7f483c009040 comp rx=0 tx=0).stop 2023-12-04T05:40:22.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 msgr2=0x7f48401f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f4838007e90 tx=0x7f483800e4b0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.197 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 shutdown_connections 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f48240668d0 0x7f4824068d90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4840154e10 0x7f48401f03b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f484014f960 0x7f48400c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 --2- 172.21.15.97:0/3467790973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f484014eb30 0x7f48400bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 >> 172.21.15.97:0/3467790973 conn(0x7f48400c5e70 msgr2=0x7f484006d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 shutdown_connections 2023-12-04T05:40:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.196+0000 7f48482d6640 1 -- 172.21.15.97:0/3467790973 wait complete. 2023-12-04T05:40:22.216 INFO:tasks.ceph:Scrubbing osd.2 2023-12-04T05:40:22.216 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:22.361 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 Processor -- start 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 -- start start 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbd700ca180 0x7fbd700ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbd7006cad0 0x7fbd700c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd700c6920 con 0x7fbd70154eb0 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd70151e50 con 0x7fbd700ca180 2023-12-04T05:40:22.362 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd77534640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd700c4930 con 0x7fbd7006cad0 2023-12-04T05:40:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbd700ca180 0x7fbd700ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fbd700ca180 0x7fbd700ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36004/0 (socket says 172.21.15.97:36004) 2023-12-04T05:40:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76d33640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7fbd70154eb0 0x7fbd70157a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48618/0 (socket says 172.21.15.97:48618) 2023-12-04T05:40:22.363 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 -- 172.21.15.97:0/321921651 learned_addr learned my addr 172.21.15.97:0/321921651 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd75d31640 1 --2- 172.21.15.97:0/321921651 >> v2:172.21.15.143:3300/0 conn(0x7fbd7006cad0 0x7fbd700c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 -- 172.21.15.97:0/321921651 >> v2:172.21.15.143:3300/0 conn(0x7fbd7006cad0 msgr2=0x7fbd700c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 --2- 172.21.15.97:0/321921651 >> v2:172.21.15.143:3300/0 conn(0x7fbd7006cad0 0x7fbd700c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 -- 172.21.15.97:0/321921651 >> v1:172.21.15.97:6789/0 conn(0x7fbd70154eb0 legacy=0x7fbd70157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.364 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.360+0000 7fbd76532640 1 -- 172.21.15.97:0/321921651 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd701553a0 con 0x7fbd700ca180 2023-12-04T05:40:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd76532640 1 --2- 172.21.15.97:0/321921651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700ca560 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbd70074530 tx=0x7fbd6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4625d1df21551603 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd75530640 1 -- 172.21.15.97:0/321921651 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0ad660 con 0x7fbd700ca180 2023-12-04T05:40:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd75530640 1 -- 172.21.15.97:0/321921651 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c0ad7c0 con 0x7fbd700ca180 2023-12-04T05:40:22.365 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd75530640 1 -- 172.21.15.97:0/321921651 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0adb50 con 0x7fbd700ca180 2023-12-04T05:40:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 -- 172.21.15.97:0/321921651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 msgr2=0x7fbd700ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 --2- 172.21.15.97:0/321921651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700ca560 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fbd70074530 tx=0x7fbd6c01c470 comp rx=0 tx=0).stop 2023-12-04T05:40:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 -- 172.21.15.97:0/321921651 shutdown_connections 2023-12-04T05:40:22.366 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 --2- 172.21.15.97:0/321921651 >> v2:172.21.15.143:3300/0 conn(0x7fbd7006cad0 0x7fbd700c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 --2- 172.21.15.97:0/321921651 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700ca560 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 -- 172.21.15.97:0/321921651 >> 172.21.15.97:0/321921651 conn(0x7fbd70073720 msgr2=0x7fbd70073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 -- 172.21.15.97:0/321921651 shutdown_connections 2023-12-04T05:40:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.364+0000 7fbd77534640 1 -- 172.21.15.97:0/321921651 wait complete. 2023-12-04T05:40:22.367 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 Processor -- start 2023-12-04T05:40:22.368 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- start start 2023-12-04T05:40:22.370 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd7006cad0 0x7fbd700ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd70154eb0 0x7fbd70153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.371 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700c1b70 con 0x7fbd700ca180 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70154050 con 0x7fbd7006cad0 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70154330 con 0x7fbd70154eb0 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36016/0 (socket says 172.21.15.97:36016) 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 -- 172.21.15.97:0/2593501317 learned_addr learned my addr 172.21.15.97:0/2593501317 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd76532640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd7006cad0 0x7fbd700ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd76d33640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd70154eb0 0x7fbd70153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 -- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd70154eb0 msgr2=0x7fbd70153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.372 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd70154eb0 0x7fbd70153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 -- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd7006cad0 msgr2=0x7fbd700ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd7006cad0 0x7fbd700ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0094d0 con 0x7fbd700ca180 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd76d33640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd70154eb0 0x7fbd70153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd75d31640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700c1630 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d5f0 tx=0x7fbd6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd600125f0 con 0x7fbd700ca180 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60012750 con 0x7fbd700ca180 2023-12-04T05:40:22.373 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd700af920 con 0x7fbd700ca180 2023-12-04T05:40:22.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60012ae0 con 0x7fbd700ca180 2023-12-04T05:40:22.374 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700adb60 con 0x7fbd700ca180 2023-12-04T05:40:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.368+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd701573a0 con 0x7fbd700ca180 2023-12-04T05:40:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbd60012c40 con 0x7fbd700ca180 2023-12-04T05:40:22.375 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbd540668d0 0x7fbd54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbd600846b0 con 0x7fbd700ca180 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd76532640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbd540668d0 0x7fbd54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fbd5406c7d0 0x7fbd5406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd5406f2a0 con 0x7fbd5406c7d0 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd60086c90 con 0x7fbd700ca180 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd76d33640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fbd5406c7d0 0x7fbd5406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd76532640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbd540668d0 0x7fbd54068d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0af000 tx=0x7fbd6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd76d33640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fbd5406c7d0 0x7fbd5406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.376 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.372+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== osd.2 v2:172.21.15.97:6824/2063616268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd5406f2a0 con 0x7fbd5406c7d0 2023-12-04T05:40:22.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.384+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 --> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd700af7a0 con 0x7fbd5406c7d0 2023-12-04T05:40:22.388 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.384+0000 7fbd66ffd640 1 -- 172.21.15.97:0/2593501317 <== osd.2 v2:172.21.15.97:6824/2063616268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd68001ec0 con 0x7fbd5406c7d0 2023-12-04T05:40:22.388 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:22.388 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:22.389 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:22.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fbd5406c7d0 msgr2=0x7fbd5406ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6824/2063616268,v1:172.21.15.97:6825/2063616268] conn(0x7fbd5406c7d0 0x7fbd5406ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbd540668d0 msgr2=0x7fbd54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fbd540668d0 0x7fbd54068d90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0af000 tx=0x7fbd6c008040 comp rx=0 tx=0).stop 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 msgr2=0x7fbd700c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 --2- 172.21.15.97:0/2593501317 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbd700ca180 0x7fbd700c1630 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d5f0 tx=0x7fbd6000dab0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd76d33640 1 -- 172.21.15.97:0/2593501317 reap_dead start 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 shutdown_connections 2023-12-04T05:40:22.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 >> 172.21.15.97:0/2593501317 conn(0x7fbd70073720 msgr2=0x7fbd70073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 shutdown_connections 2023-12-04T05:40:22.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.388+0000 7fbd77534640 1 -- 172.21.15.97:0/2593501317 wait complete. 2023-12-04T05:40:22.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-04T05:40:22.544 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.540+0000 7f97c365a640 1 Processor -- start 2023-12-04T05:40:22.545 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 -- start start 2023-12-04T05:40:22.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97bc156070 0x7f97bc0c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc06e410 0x7f97bc071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc071380 con 0x7f97bc0c0db0 2023-12-04T05:40:22.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc06cc20 con 0x7f97bc156070 2023-12-04T05:40:22.546 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c365a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc06cf00 con 0x7f97bc06e410 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97bc156070 0x7f97bc0c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f97bc156070 0x7f97bc0c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36030/0 (socket says 172.21.15.97:36030) 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 -- 172.21.15.97:0/780521885 learned_addr learned my addr 172.21.15.97:0/780521885 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c0bf5640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc06e410 0x7f97bc071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 -- 172.21.15.97:0/780521885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc06e410 msgr2=0x7f97bc071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc06e410 0x7f97bc071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 -- 172.21.15.97:0/780521885 >> v1:172.21.15.143:6789/0 conn(0x7f97bc0c0db0 legacy=0x7f97bc158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:22.547 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.544+0000 7f97c13f6640 1 -- 172.21.15.97:0/780521885 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc15cbb0 con 0x7f97bc156070 2023-12-04T05:40:22.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c13f6640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc156070 0x7f97bc0c0870 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821fb330d5ddee89 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97b3fff640 1 -- 172.21.15.97:0/780521885 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80ab650 con 0x7f97bc156070 2023-12-04T05:40:22.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97b3fff640 1 -- 172.21.15.97:0/780521885 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80ab7b0 con 0x7f97bc156070 2023-12-04T05:40:22.549 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97b3fff640 1 -- 172.21.15.97:0/780521885 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80abb40 con 0x7f97bc156070 2023-12-04T05:40:22.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 -- 172.21.15.97:0/780521885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc156070 msgr2=0x7f97bc0c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc156070 0x7f97bc0c0870 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b801c500 comp rx=0 tx=0).stop 2023-12-04T05:40:22.550 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 -- 172.21.15.97:0/780521885 shutdown_connections 2023-12-04T05:40:22.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc06e410 0x7f97bc071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 --2- 172.21.15.97:0/780521885 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc156070 0x7f97bc0c0870 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 -- 172.21.15.97:0/780521885 >> 172.21.15.97:0/780521885 conn(0x7f97bc0c5e70 msgr2=0x7f97bc0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 -- 172.21.15.97:0/780521885 shutdown_connections 2023-12-04T05:40:22.551 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 -- 172.21.15.97:0/780521885 wait complete. 2023-12-04T05:40:22.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.548+0000 7f97c365a640 1 Processor -- start 2023-12-04T05:40:22.552 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- start start 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97bc0c0db0 0x7f97bc0c1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 0x7f97bc14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0a8c60 con 0x7f97bc06e410 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc151b00 con 0x7f97bc0c0db0 2023-12-04T05:40:22.554 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc158280 con 0x7f97bc156070 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36044/0 (socket says 172.21.15.97:36044) 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 -- 172.21.15.97:0/525198442 learned_addr learned my addr 172.21.15.97:0/525198442 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c0bf5640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97bc0c0db0 0x7f97bc0c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c1bf7640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 0x7f97bc14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 -- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 msgr2=0x7f97bc14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 0x7f97bc14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 -- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97bc0c0db0 msgr2=0x7f97bc0c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.555 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97bc0c0db0 0x7f97bc0c1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 -- 172.21.15.97:0/525198442 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80094d0 con 0x7f97bc06e410 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c1bf7640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 0x7f97bc14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c13f6640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f97b80ad040 tx=0x7f97b80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80b4800 con 0x7f97bc06e410 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80b4980 con 0x7f97bc06e410 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b80b4d30 con 0x7f97bc06e410 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc158560 con 0x7f97bc06e410 2023-12-04T05:40:22.556 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc157830 con 0x7f97bc06e410 2023-12-04T05:40:22.557 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.552+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc158a10 con 0x7f97bc06e410 2023-12-04T05:40:22.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.556+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f97b80b3380 con 0x7f97bc06e410 2023-12-04T05:40:22.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.556+0000 7f97b1ffb640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 0x7f97a0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.556+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f97b811e950 con 0x7f97bc06e410 2023-12-04T05:40:22.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.556+0000 7f97c0bf5640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 0x7f97a0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.558 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.556+0000 7f97c0bf5640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 0x7f97a0068dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97bc1ef290 tx=0x7f97ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.560 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.560+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97b80ebf70 con 0x7f97bc06e410 2023-12-04T05:40:22.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.708+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f97bc0a8da0 con 0x7f97a0066900 2023-12-04T05:40:22.712 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97b1ffb640 1 -- 172.21.15.97:0/525198442 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f97ac010960 con 0x7f97a0066900 2023-12-04T05:40:22.712 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2023-12-04T05:40:22.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 msgr2=0x7f97a0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.714 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 0x7f97a0068dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97bc1ef290 tx=0x7f97ac008040 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 msgr2=0x7f97bc1572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f97b80ad040 tx=0x7f97b80192a0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 shutdown_connections 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f97a0066900 0x7f97a0068dc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f97bc156070 0x7f97bc14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f97bc0c0db0 0x7f97bc0c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 --2- 172.21.15.97:0/525198442 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f97bc06e410 0x7f97bc1572f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.715 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 >> 172.21.15.97:0/525198442 conn(0x7f97bc0c5e70 msgr2=0x7f97bc163bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 shutdown_connections 2023-12-04T05:40:22.716 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.712+0000 7f97c365a640 1 -- 172.21.15.97:0/525198442 wait complete. 2023-12-04T05:40:22.733 INFO:tasks.ceph:Scrubbing osd.3 2023-12-04T05:40:22.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:22.875 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.872+0000 7f9b532fe640 1 Processor -- start 2023-12-04T05:40:22.876 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.872+0000 7f9b532fe640 1 -- start start 2023-12-04T05:40:22.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b532fe640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b532fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c3570 0x7f9b4c0c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.877 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b532fe640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c14feb0 con 0x7f9b4c0c1ea0 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b532fe640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c06d560 con 0x7f9b4c14fad0 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b532fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c06d840 con 0x7f9b4c0c3570 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36050/0 (socket says 172.21.15.97:36050) 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5189b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f9b4c0c1ea0 0x7f9b4c1527a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48634/0 (socket says 172.21.15.97:48634) 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 -- 172.21.15.97:0/4198130391 learned_addr learned my addr 172.21.15.97:0/4198130391 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.878 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b50899640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c3570 0x7f9b4c0c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b43fff640 1 -- 172.21.15.97:0/4198130391 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126209789 0 0) 0x7f9b4c14feb0 con 0x7f9b4c0c1ea0 2023-12-04T05:40:22.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 -- 172.21.15.97:0/4198130391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c3570 msgr2=0x7f9b4c0c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:22.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c3570 0x7f9b4c0c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 -- 172.21.15.97:0/4198130391 >> v1:172.21.15.97:6789/0 conn(0x7f9b4c0c1ea0 legacy=0x7f9b4c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.879 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.876+0000 7f9b5109a640 1 -- 172.21.15.97:0/4198130391 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c06db20 con 0x7f9b4c14fad0 2023-12-04T05:40:22.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b5109a640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c150040 tx=0x7f9b4801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5951eb9dbd4157e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.880 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b43fff640 1 -- 172.21.15.97:0/4198130391 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480a8a10 con 0x7f9b4c14fad0 2023-12-04T05:40:22.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b43fff640 1 -- 172.21.15.97:0/4198130391 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b480a8b70 con 0x7f9b4c14fad0 2023-12-04T05:40:22.881 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b43fff640 1 -- 172.21.15.97:0/4198130391 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480b0440 con 0x7f9b4c14fad0 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- 172.21.15.97:0/4198130391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c14fad0 msgr2=0x7f9b4c0a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c150040 tx=0x7f9b4801ed10 comp rx=0 tx=0).stop 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- 172.21.15.97:0/4198130391 shutdown_connections 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c3570 0x7f9b4c0c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 --2- 172.21.15.97:0/4198130391 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c0a8e70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- 172.21.15.97:0/4198130391 >> 172.21.15.97:0/4198130391 conn(0x7f9b4c0c2a50 msgr2=0x7f9b4c0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.882 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- 172.21.15.97:0/4198130391 shutdown_connections 2023-12-04T05:40:22.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- 172.21.15.97:0/4198130391 wait complete. 2023-12-04T05:40:22.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 Processor -- start 2023-12-04T05:40:22.883 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.880+0000 7f9b532fe640 1 -- start start 2023-12-04T05:40:22.885 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c1ea0 0x7f9b4c1e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 0x7f9b4c141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1428e0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1469b0 con 0x7f9b4c14fad0 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1ee0d0 con 0x7f9b4c0c1ea0 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 0x7f9b4c141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.886 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 0x7f9b4c141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36054/0 (socket says 172.21.15.97:36054) 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 -- 172.21.15.97:0/1328499251 learned_addr learned my addr 172.21.15.97:0/1328499251 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b5189b640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b5109a640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c1ea0 0x7f9b4c1e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 -- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c1ea0 msgr2=0x7f9b4c1e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b4c0c1ea0 0x7f9b4c1e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 -- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b4c14fad0 msgr2=0x7f9b4c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b4c14fad0 0x7f9b4c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480094d0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.887 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b50899640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 0x7f9b4c141e60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00e900 tx=0x7f9b3c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c009690 con 0x7f9b4c0c3570 2023-12-04T05:40:22.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00ca00 con 0x7f9b4c0c3570 2023-12-04T05:40:22.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00cdb0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c1eddf0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.888 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c141940 con 0x7f9b4c0c3570 2023-12-04T05:40:22.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b4c0c23e0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.889 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.884+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9b3c013470 con 0x7f9b4c0c3570 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b300668d0 0x7f9b30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9b3c0844b0 con 0x7f9b4c0c3570 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b5109a640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b300668d0 0x7f9b30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f9b3006c7d0 0x7f9b3006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b3006f2a0 con 0x7f9b3006c7d0 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b3c086a30 con 0x7f9b4c0c3570 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b5189b640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f9b3006c7d0 0x7f9b3006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:22.890 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b5109a640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b300668d0 0x7f9b30068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b2000 tx=0x7f9b48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b5189b640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f9b3006c7d0 0x7f9b3006ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:22.891 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.888+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== osd.3 v2:172.21.15.97:6809/2471126729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9b3006f2a0 con 0x7f9b3006c7d0 2023-12-04T05:40:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.900+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 --> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b4c06e0e0 con 0x7f9b3006c7d0 2023-12-04T05:40:22.903 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.900+0000 7f9b41ffb640 1 -- 172.21.15.97:0/1328499251 <== osd.3 v2:172.21.15.97:6809/2471126729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9b44004b70 con 0x7f9b3006c7d0 2023-12-04T05:40:22.904 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:22.904 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:22.904 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.900+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f9b3006c7d0 msgr2=0x7f9b3006ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.900+0000 7f9b532fe640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6809/2471126729,v1:172.21.15.97:6811/2471126729] conn(0x7f9b3006c7d0 0x7f9b3006ebf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b300668d0 msgr2=0x7f9b30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f9b300668d0 0x7f9b30068d90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b2000 tx=0x7f9b48008040 comp rx=0 tx=0).stop 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 msgr2=0x7f9b4c141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 --2- 172.21.15.97:0/1328499251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9b4c0c3570 0x7f9b4c141e60 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00e900 tx=0x7f9b3c00edc0 comp rx=0 tx=0).stop 2023-12-04T05:40:22.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b5189b640 1 -- 172.21.15.97:0/1328499251 reap_dead start 2023-12-04T05:40:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 shutdown_connections 2023-12-04T05:40:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 >> 172.21.15.97:0/1328499251 conn(0x7f9b4c0c2a50 msgr2=0x7f9b4c144750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 shutdown_connections 2023-12-04T05:40:22.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:22.904+0000 7f9b532fe640 1 -- 172.21.15.97:0/1328499251 wait complete. 2023-12-04T05:40:22.921 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-04T05:40:23.059 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.056+0000 7f7552c17640 1 Processor -- start 2023-12-04T05:40:23.060 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.056+0000 7f7552c17640 1 -- start start 2023-12-04T05:40:23.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7552c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c071920 0x7f754c0bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7552c17640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f754c06dea0 0x7f754c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.061 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7552c17640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c06da10 con 0x7f754c0bf7e0 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7552c17640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c06d120 con 0x7f754c06dea0 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7552c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c06d3c0 con 0x7f754c071920 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f754c06dea0 0x7f754c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f754c06dea0 0x7f754c0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36060/0 (socket says 172.21.15.97:36060) 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 -- 172.21.15.97:0/1127020666 learned_addr learned my addr 172.21.15.97:0/1127020666 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f75509b3640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c071920 0x7f754c0bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 -- 172.21.15.97:0/1127020666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c071920 msgr2=0x7f754c0bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c071920 0x7f754c0bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.062 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 -- 172.21.15.97:0/1127020666 >> v1:172.21.15.143:6789/0 conn(0x7f754c0bf7e0 legacy=0x7f754c13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.063 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.060+0000 7f7543fff640 1 -- 172.21.15.97:0/1127020666 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c06d6a0 con 0x7f754c06dea0 2023-12-04T05:40:23.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7543fff640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c06dea0 0x7f754c0700b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f753c009870 tx=0x7f753c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746543eff70b3303 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.064 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f75437fe640 1 -- 172.21.15.97:0/1127020666 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0aa680 con 0x7f754c06dea0 2023-12-04T05:40:23.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f75437fe640 1 -- 172.21.15.97:0/1127020666 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c0aa7e0 con 0x7f754c06dea0 2023-12-04T05:40:23.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f75437fe640 1 -- 172.21.15.97:0/1127020666 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0aab70 con 0x7f754c06dea0 2023-12-04T05:40:23.065 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- 172.21.15.97:0/1127020666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c06dea0 msgr2=0x7f754c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c06dea0 0x7f754c0700b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f753c009870 tx=0x7f753c01c540 comp rx=0 tx=0).stop 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- 172.21.15.97:0/1127020666 shutdown_connections 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c06dea0 0x7f754c0700b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 --2- 172.21.15.97:0/1127020666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c071920 0x7f754c0bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- 172.21.15.97:0/1127020666 >> 172.21.15.97:0/1127020666 conn(0x7f754c0c5e70 msgr2=0x7f754c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- 172.21.15.97:0/1127020666 shutdown_connections 2023-12-04T05:40:23.066 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- 172.21.15.97:0/1127020666 wait complete. 2023-12-04T05:40:23.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 Processor -- start 2023-12-04T05:40:23.067 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.064+0000 7f7552c17640 1 -- start start 2023-12-04T05:40:23.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c06dea0 0x7f754c13c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.069 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 0x7f754c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15eec0 con 0x7f754c071920 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c155bb0 con 0x7f754c06dea0 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c130380 con 0x7f754c0bf7e0 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36074/0 (socket says 172.21.15.97:36074) 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 -- 172.21.15.97:0/285489405 learned_addr learned my addr 172.21.15.97:0/285489405 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75509b3640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c06dea0 0x7f754c13c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75511b4640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 0x7f754c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.070 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 -- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 msgr2=0x7f754c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 0x7f754c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 -- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c06dea0 msgr2=0x7f754c13c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c06dea0 0x7f754c13c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 -- 172.21.15.97:0/285489405 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0094d0 con 0x7f754c071920 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75511b4640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 0x7f754c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7543fff640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f753c01abf0 tx=0x7f753c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0b3800 con 0x7f754c071920 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c0b3960 con 0x7f754c071920 2023-12-04T05:40:23.071 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c1395b0 con 0x7f754c071920 2023-12-04T05:40:23.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0b3d10 con 0x7f754c071920 2023-12-04T05:40:23.072 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c139b70 con 0x7f754c071920 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c068440 con 0x7f754c071920 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.068+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f753c0c6390 con 0x7f754c071920 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.072+0000 7f75417fa640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 0x7f7538068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.072+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f753c11ee80 con 0x7f754c071920 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.072+0000 7f75509b3640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 0x7f7538068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.073 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.072+0000 7f75509b3640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 0x7f7538068dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7548007a60 tx=0x7f7548008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.076 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.076+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f753c0ec400 con 0x7f754c071920 2023-12-04T05:40:23.225 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f754c070a00 con 0x7f7538066900 2023-12-04T05:40:23.226 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f75417fa640 1 -- 172.21.15.97:0/285489405 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7548010990 con 0x7f7538066900 2023-12-04T05:40:23.226 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 msgr2=0x7f7538068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 0x7f7538068dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7548007a60 tx=0x7f7548008040 comp rx=0 tx=0).stop 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 msgr2=0x7f754c137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f753c01abf0 tx=0x7f753c01ad80 comp rx=0 tx=0).stop 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 shutdown_connections 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f7538066900 0x7f7538068dc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f754c0bf7e0 0x7f754c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.228 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f754c071920 0x7f754c137570 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 --2- 172.21.15.97:0/285489405 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c06dea0 0x7f754c13c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.224+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 >> 172.21.15.97:0/285489405 conn(0x7f754c0c5e70 msgr2=0x7f754c070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.228+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 shutdown_connections 2023-12-04T05:40:23.229 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.228+0000 7f7552c17640 1 -- 172.21.15.97:0/285489405 wait complete. 2023-12-04T05:40:23.247 INFO:tasks.ceph:Scrubbing osd.4 2023-12-04T05:40:23.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:23.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 Processor -- start 2023-12-04T05:40:23.389 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 -- start start 2023-12-04T05:40:23.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f753014b2f0 0x7f75300c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753014b6d0 con 0x7f75300c7f90 2023-12-04T05:40:23.390 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75300c6880 con 0x7f75301552b0 2023-12-04T05:40:23.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f75363aa640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7530155800 con 0x7f753014b2f0 2023-12-04T05:40:23.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752f7fe640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f75300c7f90 0x7f75300c6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48636/0 (socket says 172.21.15.97:48636) 2023-12-04T05:40:23.391 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752f7fe640 1 -- 172.21.15.97:0/1469591295 learned_addr learned my addr 172.21.15.97:0/1469591295 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752ffff640 1 --2- 172.21.15.97:0/1469591295 >> v2:172.21.15.143:3300/0 conn(0x7f753014b2f0 0x7f75300c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109259257 0 0) 0x7f753014b6d0 con 0x7f75300c7f90 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7518003530 con 0x7f75300c7f90 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248100635 0 0) 0x7f7518003530 con 0x7f75300c7f90 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 >> v2:172.21.15.143:3300/0 conn(0x7f753014b2f0 msgr2=0x7f75300c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 --2- 172.21.15.97:0/1469591295 >> v2:172.21.15.143:3300/0 conn(0x7f753014b2f0 0x7f75300c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.393 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 >> v1:172.21.15.143:6789/0 conn(0x7f75301552b0 legacy=0x7f753015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300ca610 con 0x7f75300c7f90 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f7524001680 con 0x7f75300c7f90 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 >> v1:172.21.15.97:6789/0 conn(0x7f75300c7f90 legacy=0x7f75300c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7518003980 0x7f7518003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f7518004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7518005190 0x7f751800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.394 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530155800 con 0x7f75180047d0 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751800c130 con 0x7f7518003980 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.388+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751800c2f0 con 0x7f7518005190 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f7518004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752ffff640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7518003980 0x7f7518003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f7534947640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7518005190 0x7f751800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 -- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7518005190 msgr2=0x7f751800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7518005190 0x7f751800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 -- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7518003980 msgr2=0x7f7518003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7518003980 0x7f7518003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 -- 172.21.15.97:0/1469591295 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518003530 con 0x7f75180047d0 2023-12-04T05:40:23.396 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f7534947640 1 -- 172.21.15.97:0/1469591295 reap_dead start 2023-12-04T05:40:23.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752f7fe640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f7518004c50 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f752400c240 tx=0x7f752401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0212da083f3a776 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.397 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240a58f0 con 0x7f75180047d0 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75240a5a50 con 0x7f75180047d0 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f752effd640 1 -- 172.21.15.97:0/1469591295 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240a5e80 con 0x7f75180047d0 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f75363aa640 1 -- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 msgr2=0x7f7518004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.392+0000 7f75363aa640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f7518004c50 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f752400c240 tx=0x7f752401cc10 comp rx=0 tx=0).stop 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- 172.21.15.97:0/1469591295 shutdown_connections 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 --2- 172.21.15.97:0/1469591295 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f7518004c50 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- 172.21.15.97:0/1469591295 >> 172.21.15.97:0/1469591295 conn(0x7f7530073720 msgr2=0x7f7530073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.398 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- 172.21.15.97:0/1469591295 shutdown_connections 2023-12-04T05:40:23.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- 172.21.15.97:0/1469591295 wait complete. 2023-12-04T05:40:23.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 Processor -- start 2023-12-04T05:40:23.399 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- start start 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f75300acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753013f7a0 0x7f753013e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f753013f250 0x7f753013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530157550 con 0x7f75180047d0 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530156f20 con 0x7f753013f250 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f75363aa640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75301edb60 con 0x7f753013f7a0 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f75300acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.401 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f75300acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36090/0 (socket says 172.21.15.97:36090) 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 -- 172.21.15.97:0/3097273749 learned_addr learned my addr 172.21.15.97:0/3097273749 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752f7fe640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753013f7a0 0x7f753013e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f7534947640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f753013f250 0x7f753013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 -- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753013f7a0 msgr2=0x7f753013e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753013f7a0 0x7f753013e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 -- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f753013f250 msgr2=0x7f753013ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f753013f250 0x7f753013ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300bda30 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.396+0000 7f752ffff640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f75300acf10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7520011aa0 tx=0x7f7520011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000fb80 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000fce0 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520014680 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75301ede40 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75300ad450 con 0x7f75180047d0 2023-12-04T05:40:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7530068440 con 0x7f75180047d0 2023-12-04T05:40:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f75200147e0 con 0x7f75180047d0 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f751c066900 0x7f751c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7520084950 con 0x7f75180047d0 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752f7fe640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f751c066900 0x7f751c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7f751c06c800 0x7f751c06ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f751c06f2d0 con 0x7f751c06c800 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75200892a0 con 0x7f75180047d0 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.400+0000 7f7534947640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7f751c06c800 0x7f751c06ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.404+0000 7f752f7fe640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f751c066900 0x7f751c068dc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f75240ab000 tx=0x7f75240b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.404+0000 7f7534947640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7f751c06c800 0x7f751c06ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.404+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== osd.4 v2:172.21.15.143:6816/3115878334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f751c06f2d0 con 0x7f751c06c800 2023-12-04T05:40:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 --> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7530157690 con 0x7f751c06c800 2023-12-04T05:40:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f752cff9640 1 -- 172.21.15.97:0/3097273749 <== osd.4 v2:172.21.15.143:6816/3115878334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7528001920 con 0x7f751c06c800 2023-12-04T05:40:23.419 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:23.419 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:23.419 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7f751c06c800 msgr2=0x7f751c06ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.143:6816/3115878334,v1:172.21.15.143:6817/3115878334] conn(0x7f751c06c800 0x7f751c06ec20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f751c066900 msgr2=0x7f751c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f751c066900 0x7f751c068dc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f75240ab000 tx=0x7f75240b0040 comp rx=0 tx=0).stop 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 msgr2=0x7f75300acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 --2- 172.21.15.97:0/3097273749 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f75180047d0 0x7f75300acf10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7520011aa0 tx=0x7f7520011f60 comp rx=0 tx=0).stop 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f7534947640 1 -- 172.21.15.97:0/3097273749 reap_dead start 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 shutdown_connections 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.416+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 >> 172.21.15.97:0/3097273749 conn(0x7f7530073720 msgr2=0x7f7530073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.420+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 shutdown_connections 2023-12-04T05:40:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.420+0000 7f75363aa640 1 -- 172.21.15.97:0/3097273749 wait complete. 2023-12-04T05:40:23.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-04T05:40:23.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 Processor -- start 2023-12-04T05:40:23.577 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 -- start start 2023-12-04T05:40:23.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 0x7efd6c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7efd6c1586c0 0x7efd6c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c155640 con 0x7efd6c0c67d0 2023-12-04T05:40:23.578 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c0c5680 con 0x7efd6c1586c0 2023-12-04T05:40:23.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd727f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c4cb0 con 0x7efd6c155200 2023-12-04T05:40:23.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd717f6640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7efd6c0c67d0 0x7efd6c0c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48650/0 (socket says 172.21.15.97:48650) 2023-12-04T05:40:23.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd717f6640 1 -- 172.21.15.97:0/1082105595 learned_addr learned my addr 172.21.15.97:0/1082105595 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:23.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd71ff7640 1 --2- 172.21.15.97:0/1082105595 >> v2:172.21.15.97:3300/0 conn(0x7efd6c1586c0 0x7efd6c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.579 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd70ff5640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 0x7efd6c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd71ff7640 1 -- 172.21.15.97:0/1082105595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 msgr2=0x7efd6c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd71ff7640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 0x7efd6c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd71ff7640 1 -- 172.21.15.97:0/1082105595 >> v1:172.21.15.97:6789/0 conn(0x7efd6c0c67d0 legacy=0x7efd6c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd71ff7640 1 -- 172.21.15.97:0/1082105595 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0c8620 con 0x7efd6c1586c0 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd70ff5640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 0x7efd6c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.576+0000 7efd63fff640 1 -- 172.21.15.97:0/1082105595 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067588854 0 0) 0x7efd6c155640 con 0x7efd6c0c67d0 2023-12-04T05:40:23.581 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd71ff7640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c1586c0 0x7efd6c0c4770 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db417e15e490475 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd63fff640 1 -- 172.21.15.97:0/1082105595 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640af600 con 0x7efd6c1586c0 2023-12-04T05:40:23.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd63fff640 1 -- 172.21.15.97:0/1082105595 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd640ab050 con 0x7efd6c1586c0 2023-12-04T05:40:23.582 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd63fff640 1 -- 172.21.15.97:0/1082105595 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640af980 con 0x7efd6c1586c0 2023-12-04T05:40:23.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 -- 172.21.15.97:0/1082105595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c1586c0 msgr2=0x7efd6c0c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c1586c0 0x7efd6c0c4770 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6401f130 comp rx=0 tx=0).stop 2023-12-04T05:40:23.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 -- 172.21.15.97:0/1082105595 shutdown_connections 2023-12-04T05:40:23.583 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c1586c0 0x7efd6c0c4770 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 --2- 172.21.15.97:0/1082105595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c155200 0x7efd6c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 -- 172.21.15.97:0/1082105595 >> 172.21.15.97:0/1082105595 conn(0x7efd6c0ab980 msgr2=0x7efd6c0abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 -- 172.21.15.97:0/1082105595 shutdown_connections 2023-12-04T05:40:23.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.580+0000 7efd727f8640 1 -- 172.21.15.97:0/1082105595 wait complete. 2023-12-04T05:40:23.584 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 Processor -- start 2023-12-04T05:40:23.585 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- start start 2023-12-04T05:40:23.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 0x7efd6c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.587 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 0x7efd6c0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c157930 con 0x7efd6c0c67d0 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0aac10 con 0x7efd6c155200 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c93e0 con 0x7efd6c1586c0 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36108/0 (socket says 172.21.15.97:36108) 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 -- 172.21.15.97:0/3156341147 learned_addr learned my addr 172.21.15.97:0/3156341147 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 -- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 msgr2=0x7efd6c0ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.588 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd71ff7640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 0x7efd6c0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd70ff5640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 0x7efd6c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 0x7efd6c0ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 -- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 msgr2=0x7efd6c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 0x7efd6c1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 -- 172.21.15.97:0/3156341147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009a70 con 0x7efd6c0c67d0 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd71ff7640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 0x7efd6c0ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:23.589 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd70ff5640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 0x7efd6c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd717f6640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c480 tx=0x7efd6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680074e0 con 0x7efd6c0c67d0 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68007660 con 0x7efd6c0c67d0 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68004a30 con 0x7efd6c0c67d0 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c148a90 con 0x7efd6c0c67d0 2023-12-04T05:40:23.590 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.584+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0c9680 con 0x7efd6c0c67d0 2023-12-04T05:40:23.591 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c04e890 con 0x7efd6c0c67d0 2023-12-04T05:40:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd68004b90 con 0x7efd6c0c67d0 2023-12-04T05:40:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd61ffb640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 0x7efd50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efd680833a0 con 0x7efd6c0c67d0 2023-12-04T05:40:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd70ff5640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 0x7efd50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.592 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.588+0000 7efd70ff5640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 0x7efd50068d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efd6c14c300 tx=0x7efd5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.593 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.592+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd68054300 con 0x7efd6c0c67d0 2023-12-04T05:40:23.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.740+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efd6c06a7e0 con 0x7efd500668d0 2023-12-04T05:40:23.743 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.740+0000 7efd61ffb640 1 -- 172.21.15.97:0/3156341147 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd6c06a7e0 con 0x7efd500668d0 2023-12-04T05:40:23.743 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 4 to deep-scrub 2023-12-04T05:40:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 msgr2=0x7efd50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 0x7efd50068d90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efd6c14c300 tx=0x7efd5c008040 comp rx=0 tx=0).stop 2023-12-04T05:40:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 msgr2=0x7efd6c1ed360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.745 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c480 tx=0x7efd6800c940 comp rx=0 tx=0).stop 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 shutdown_connections 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7efd500668d0 0x7efd50068d90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd6c1586c0 0x7efd6c0ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd6c155200 0x7efd6c1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 --2- 172.21.15.97:0/3156341147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd6c0c67d0 0x7efd6c1ed360 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 >> 172.21.15.97:0/3156341147 conn(0x7efd6c0ab980 msgr2=0x7efd6c0abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.746 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 shutdown_connections 2023-12-04T05:40:23.747 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.744+0000 7efd727f8640 1 -- 172.21.15.97:0/3156341147 wait complete. 2023-12-04T05:40:23.764 INFO:tasks.ceph:Scrubbing osd.5 2023-12-04T05:40:23.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:23.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 Processor -- start 2023-12-04T05:40:23.905 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 -- start start 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22e006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e00700b0 con 0x7f22e01515e0 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e006bff0 con 0x7f22e00aa830 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22e5180640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e006c990 con 0x7f22e00725b0 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22df59e640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f22e01515e0 0x7f22e006d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48654/0 (socket says 172.21.15.97:48654) 2023-12-04T05:40:23.906 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22df59e640 1 -- 172.21.15.97:0/2056907698 learned_addr learned my addr 172.21.15.97:0/2056907698 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:23.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22de59c640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22e006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6533313 0 0) 0x7f22e00700b0 con 0x7f22e01515e0 2023-12-04T05:40:23.908 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c8003450 con 0x7f22e01515e0 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357721405 0 0) 0x7f22e006bff0 con 0x7f22e00aa830 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e00700b0 con 0x7f22e00aa830 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400761644 0 0) 0x7f22c8003450 con 0x7f22e01515e0 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 msgr2=0x7f22e006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22e006cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 >> v1:172.21.15.143:6789/0 conn(0x7f22e00aa830 legacy=0x7f22e00ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e006c2d0 con 0x7f22e01515e0 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f22d8001a00 con 0x7f22e01515e0 2023-12-04T05:40:23.909 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 >> v1:172.21.15.97:6789/0 conn(0x7f22e01515e0 legacy=0x7f22e006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22c8003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c8008860 0x7f22c800ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c800b190 0x7f22c800d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e006c990 con 0x7f22c8008860 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c800dd00 con 0x7f22c800b190 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c800dec0 con 0x7f22e00725b0 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22de59c640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c8008860 0x7f22c800ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22ded9d640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22c8003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.904+0000 7f22df59e640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c800b190 0x7f22c800d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.910 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 -- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 msgr2=0x7f22c8003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22c8003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 -- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c800b190 msgr2=0x7f22c800d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c800b190 0x7f22c800d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 -- 172.21.15.97:0/2056907698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8003450 con 0x7f22c8008860 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22ded9d640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e00725b0 0x7f22c8003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:23.911 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22df59e640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c800b190 0x7f22c800d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:23.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22de59c640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c8008860 0x7f22c800ac50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ae0 tx=0x7f22d401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34d5674c79b4fdf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5590 con 0x7f22c8008860 2023-12-04T05:40:23.912 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a56f0 con 0x7f22c8008860 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22ddd9b640 1 -- 172.21.15.97:0/2056907698 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5aa0 con 0x7f22c8008860 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 -- 172.21.15.97:0/2056907698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c8008860 msgr2=0x7f22c800ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 --2- 172.21.15.97:0/2056907698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22c8008860 0x7f22c800ac50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ae0 tx=0x7f22d401ca20 comp rx=0 tx=0).stop 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22df59e640 1 -- 172.21.15.97:0/2056907698 reap_dead start 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 -- 172.21.15.97:0/2056907698 shutdown_connections 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 -- 172.21.15.97:0/2056907698 >> 172.21.15.97:0/2056907698 conn(0x7f22e00c2a50 msgr2=0x7f22e00c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 -- 172.21.15.97:0/2056907698 shutdown_connections 2023-12-04T05:40:23.913 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.908+0000 7f22e5180640 1 -- 172.21.15.97:0/2056907698 wait complete. 2023-12-04T05:40:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 Processor -- start 2023-12-04T05:40:23.914 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 -- start start 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c8008860 0x7f22e0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 0x7f22e0150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e014faa0 0x7f22e013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0152d60 con 0x7f22e01f0650 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e014e7b0 con 0x7f22c8008860 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22e5180640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e014ea00 con 0x7f22e014faa0 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 0x7f22e0150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 0x7f22e0150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36138/0 (socket says 172.21.15.97:36138) 2023-12-04T05:40:23.916 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 -- 172.21.15.97:0/2875700018 learned_addr learned my addr 172.21.15.97:0/2875700018 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22df59e640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e014faa0 0x7f22e013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22ded9d640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c8008860 0x7f22e0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 -- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e014faa0 msgr2=0x7f22e013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f22e014faa0 0x7f22e013ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 -- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c8008860 msgr2=0x7f22e0152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22c8008860 0x7f22e0152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e014ece0 con 0x7f22e01f0650 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.912+0000 7f22de59c640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 0x7f22e0150800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f22d401c850 tx=0x7f22c8003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40bc070 con 0x7f22e01f0650 2023-12-04T05:40:23.917 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400f000 con 0x7f22e01f0650 2023-12-04T05:40:23.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e014efc0 con 0x7f22e01f0650 2023-12-04T05:40:23.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a5590 con 0x7f22e01f0650 2023-12-04T05:40:23.918 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e014f580 con 0x7f22e01f0650 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22e015c540 con 0x7f22e01f0650 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f22d40b4040 con 0x7f22e01f0650 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f22cc066900 0x7f22cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f22d411e750 con 0x7f22e01f0650 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22ded9d640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f22cc066900 0x7f22cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f22cc06c800 0x7f22cc06ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:23.919 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22cc06f2d0 con 0x7f22cc06c800 2023-12-04T05:40:23.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22d411eb00 con 0x7f22e01f0650 2023-12-04T05:40:23.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22df59e640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f22cc06c800 0x7f22cc06ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:23.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.916+0000 7f22ded9d640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f22cc066900 0x7f22cc068dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007fd0 tx=0x7f22d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.920 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.920+0000 7f22df59e640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f22cc06c800 0x7f22cc06ec20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:23.921 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.920+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== osd.5 v2:172.21.15.143:6800/4041478737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f22cc06f2d0 con 0x7f22cc06c800 2023-12-04T05:40:23.933 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 --> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22e0068440 con 0x7f22cc06c800 2023-12-04T05:40:23.934 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22c77fe640 1 -- 172.21.15.97:0/2875700018 <== osd.5 v2:172.21.15.143:6800/4041478737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f22e0068440 con 0x7f22cc06c800 2023-12-04T05:40:23.935 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:23.935 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:23.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f22cc06c800 msgr2=0x7f22cc06ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.143:6800/4041478737,v1:172.21.15.143:6801/4041478737] conn(0x7f22cc06c800 0x7f22cc06ec20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:23.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f22cc066900 msgr2=0x7f22cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f22cc066900 0x7f22cc068dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007fd0 tx=0x7f22d0009040 comp rx=0 tx=0).stop 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 msgr2=0x7f22e0150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 --2- 172.21.15.97:0/2875700018 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f22e01f0650 0x7f22e0150800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f22d401c850 tx=0x7f22c8003700 comp rx=0 tx=0).stop 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22df59e640 1 -- 172.21.15.97:0/2875700018 reap_dead start 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 shutdown_connections 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 >> 172.21.15.97:0/2875700018 conn(0x7f22e00c2a50 msgr2=0x7f22e015be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 shutdown_connections 2023-12-04T05:40:23.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:23.932+0000 7f22e5180640 1 -- 172.21.15.97:0/2875700018 wait complete. 2023-12-04T05:40:23.954 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-04T05:40:24.091 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.088+0000 7f6e22d65640 1 Processor -- start 2023-12-04T05:40:24.092 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.088+0000 7f6e22d65640 1 -- start start 2023-12-04T05:40:24.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e22d65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 0x7f6e1c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e22d65640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1c14f790 0x7f6e1c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e22d65640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c154640 con 0x7f6e1c154e10 2023-12-04T05:40:24.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e22d65640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c0c0bd0 con 0x7f6e1c14f790 2023-12-04T05:40:24.093 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e22d65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c14ef10 con 0x7f6e1c14eb30 2023-12-04T05:40:24.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1c14f790 0x7f6e1c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f6e1c14f790 0x7f6e1c1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36140/0 (socket says 172.21.15.97:36140) 2023-12-04T05:40:24.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 -- 172.21.15.97:0/1348865292 learned_addr learned my addr 172.21.15.97:0/1348865292 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.094 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e21302640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f6e1c154e10 0x7f6e1c151310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:48660/0 (socket says 172.21.15.97:48660) 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e20b01640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 0x7f6e1c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 -- 172.21.15.97:0/1348865292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 msgr2=0x7f6e1c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 0x7f6e1c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 -- 172.21.15.97:0/1348865292 >> v1:172.21.15.97:6789/0 conn(0x7f6e1c154e10 legacy=0x7f6e1c151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e13fff640 1 -- 172.21.15.97:0/1348865292 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c1535a0 con 0x7f6e1c14f790 2023-12-04T05:40:24.095 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.092+0000 7f6e20b01640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 0x7f6e1c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:24.096 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e13fff640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1548d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009870 tx=0x7f6e0c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f41b51328a7b3da server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e137fe640 1 -- 172.21.15.97:0/1348865292 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0ab620 con 0x7f6e1c14f790 2023-12-04T05:40:24.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e137fe640 1 -- 172.21.15.97:0/1348865292 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0ab780 con 0x7f6e1c14f790 2023-12-04T05:40:24.097 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e137fe640 1 -- 172.21.15.97:0/1348865292 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0abb10 con 0x7f6e1c14f790 2023-12-04T05:40:24.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- 172.21.15.97:0/1348865292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 msgr2=0x7f6e1c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1548d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009870 tx=0x7f6e0c01c510 comp rx=0 tx=0).stop 2023-12-04T05:40:24.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- 172.21.15.97:0/1348865292 shutdown_connections 2023-12-04T05:40:24.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1548d0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.098 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 --2- 172.21.15.97:0/1348865292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c14eb30 0x7f6e1c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- 172.21.15.97:0/1348865292 >> 172.21.15.97:0/1348865292 conn(0x7f6e1c0c5e70 msgr2=0x7f6e1c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- 172.21.15.97:0/1348865292 shutdown_connections 2023-12-04T05:40:24.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- 172.21.15.97:0/1348865292 wait complete. 2023-12-04T05:40:24.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 Processor -- start 2023-12-04T05:40:24.099 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.096+0000 7f6e22d65640 1 -- start start 2023-12-04T05:40:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1c14eb30 0x7f6e1c071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c154e10 0x7f6e1c1ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.101 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c147d30 con 0x7f6e1c14f790 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c14e2a0 con 0x7f6e1c14eb30 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c14c0e0 con 0x7f6e1c154e10 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:36150/0 (socket says 172.21.15.97:36150) 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 -- 172.21.15.97:0/3777229768 learned_addr learned my addr 172.21.15.97:0/3777229768 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e20b01640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1c14eb30 0x7f6e1c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e21302640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c154e10 0x7f6e1c1ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 -- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c154e10 msgr2=0x7f6e1c1ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.102 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c154e10 0x7f6e1c1ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 -- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1c14eb30 msgr2=0x7f6e1c071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1c14eb30 0x7f6e1c071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.103 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 -- 172.21.15.97:0/3777229768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0094d0 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e13fff640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ad040 tx=0x7f6e0c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0be3f0 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0be570 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0be920 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c147a50 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c06e020 con 0x7f6e1c14f790 2023-12-04T05:40:24.105 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.100+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c14dd90 con 0x7f6e1c14f790 2023-12-04T05:40:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.104+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e0c0b43f0 con 0x7f6e1c14f790 2023-12-04T05:40:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.104+0000 7f6e117fa640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 0x7f6e08068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.104+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6e0c11e510 con 0x7f6e1c14f790 2023-12-04T05:40:24.106 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.104+0000 7f6e20b01640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 0x7f6e08068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.107 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.104+0000 7f6e20b01640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 0x7f6e08068dc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.108 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.108+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e1c14dd90 con 0x7f6e1c14f790 2023-12-04T05:40:24.258 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.256+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e1c14fbd0 con 0x7f6e08066900 2023-12-04T05:40:24.259 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.256+0000 7f6e117fa640 1 -- 172.21.15.97:0/3777229768 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6e1800c040 con 0x7f6e08066900 2023-12-04T05:40:24.259 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 5 to deep-scrub 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 msgr2=0x7f6e08068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 0x7f6e08068dc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18008040 comp rx=0 tx=0).stop 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 msgr2=0x7f6e1c1ed490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ad040 tx=0x7f6e0c01ad50 comp rx=0 tx=0).stop 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 shutdown_connections 2023-12-04T05:40:24.261 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f6e08066900 0x7f6e08068dc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e1c154e10 0x7f6e1c1ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6e1c14f790 0x7f6e1c1ed490 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 --2- 172.21.15.97:0/3777229768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e1c14eb30 0x7f6e1c071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 >> 172.21.15.97:0/3777229768 conn(0x7f6e1c0c5e70 msgr2=0x7f6e1c0c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 shutdown_connections 2023-12-04T05:40:24.262 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.260+0000 7f6e22d65640 1 -- 172.21.15.97:0/3777229768 wait complete. 2023-12-04T05:40:24.280 INFO:tasks.ceph:Scrubbing osd.6 2023-12-04T05:40:24.281 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:24.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.420+0000 7f3e3b59e640 1 Processor -- start 2023-12-04T05:40:24.424 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 -- start start 2023-12-04T05:40:24.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f3e3c153e70 0x7f3e3c154250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3e3c0c39f0 0x7f3e3c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0c10f0 con 0x7f3e3c0c2120 2023-12-04T05:40:24.425 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c16b0 con 0x7f3e3c153e70 2023-12-04T05:40:24.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3b59e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c154920 con 0x7f3e3c0c39f0 2023-12-04T05:40:24.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e39d9b640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f3e3c0c2120 0x7f3e3c0a97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56942/0 (socket says 172.21.15.97:56942) 2023-12-04T05:40:24.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e39d9b640 1 -- 172.21.15.97:0/3833212752 learned_addr learned my addr 172.21.15.97:0/3833212752 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:24.426 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/3833212752 >> v2:172.21.15.97:3300/0 conn(0x7f3e3c153e70 0x7f3e3c154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3ad9d640 1 --2- 172.21.15.97:0/3833212752 >> v2:172.21.15.143:3300/0 conn(0x7f3e3c0c39f0 0x7f3e3c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3a59c640 1 -- 172.21.15.97:0/3833212752 >> v2:172.21.15.143:3300/0 conn(0x7f3e3c0c39f0 msgr2=0x7f3e3c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/3833212752 >> v2:172.21.15.143:3300/0 conn(0x7f3e3c0c39f0 0x7f3e3c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3a59c640 1 -- 172.21.15.97:0/3833212752 >> v1:172.21.15.97:6789/0 conn(0x7f3e3c0c2120 legacy=0x7f3e3c0a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3a59c640 1 -- 172.21.15.97:0/3833212752 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0a9ec0 con 0x7f3e3c153e70 2023-12-04T05:40:24.427 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.424+0000 7f3e3959a640 1 -- 172.21.15.97:0/3833212752 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158447454 0 0) 0x7f3e3c0c10f0 con 0x7f3e3c0c2120 2023-12-04T05:40:24.428 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/3833212752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c154250 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0a4d60 tx=0x7f3e2c01e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb82f0ed755bb41 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3959a640 1 -- 172.21.15.97:0/3833212752 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0a7a90 con 0x7f3e3c153e70 2023-12-04T05:40:24.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3959a640 1 -- 172.21.15.97:0/3833212752 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0ab070 con 0x7f3e3c153e70 2023-12-04T05:40:24.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3959a640 1 -- 172.21.15.97:0/3833212752 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0a7e10 con 0x7f3e3c153e70 2023-12-04T05:40:24.429 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 -- 172.21.15.97:0/3833212752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 msgr2=0x7f3e3c154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/3833212752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c154250 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0a4d60 tx=0x7f3e2c01e9c0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 -- 172.21.15.97:0/3833212752 shutdown_connections 2023-12-04T05:40:24.430 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/3833212752 >> v2:172.21.15.143:3300/0 conn(0x7f3e3c0c39f0 0x7f3e3c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/3833212752 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c154250 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 -- 172.21.15.97:0/3833212752 >> 172.21.15.97:0/3833212752 conn(0x7f3e3c06a5f0 msgr2=0x7f3e3c06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 -- 172.21.15.97:0/3833212752 shutdown_connections 2023-12-04T05:40:24.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 -- 172.21.15.97:0/3833212752 wait complete. 2023-12-04T05:40:24.431 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.428+0000 7f3e3b59e640 1 Processor -- start 2023-12-04T05:40:24.432 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- start start 2023-12-04T05:40:24.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e3c0c2120 0x7f3e3c0a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e3c0c39f0 0x7f3e3c0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c1e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.433 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c071c80 con 0x7f3e3c153e70 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c071390 con 0x7f3e3c0c39f0 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1eca50 con 0x7f3e3c0c2120 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c1e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c1e8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38682/0 (socket says 172.21.15.97:38682) 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 -- 172.21.15.97:0/4227248905 learned_addr learned my addr 172.21.15.97:0/4227248905 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e39d9b640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e3c0c39f0 0x7f3e3c0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e3c0c2120 0x7f3e3c0a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 -- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e3c0c2120 msgr2=0x7f3e3c0a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.434 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e3c0c2120 0x7f3e3c0a7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 -- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e3c0c39f0 msgr2=0x7f3e3c0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e3c0c39f0 0x7f3e3c0c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.435 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c00bc80 con 0x7f3e3c153e70 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3ad9d640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c1e8ad0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d800 tx=0x7f3e3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400b6c0 con 0x7f3e3c153e70 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400b820 con 0x7f3e3c153e70 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bbd0 con 0x7f3e3c153e70 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0720a0 con 0x7f3e3c153e70 2023-12-04T05:40:24.436 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0715c0 con 0x7f3e3c153e70 2023-12-04T05:40:24.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.432+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e3c15d710 con 0x7f3e3c153e70 2023-12-04T05:40:24.437 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3e3400bd30 con 0x7f3e3c153e70 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3e1c0668d0 0x7f3e1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3e34084660 con 0x7f3e3c153e70 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3e1c0668d0 0x7f3e1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7f3e1c06c7d0 0x7f3e1c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e1c06f2a0 con 0x7f3e1c06c7d0 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e34086c40 con 0x7f3e3c153e70 2023-12-04T05:40:24.438 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e39d9b640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7f3e1c06c7d0 0x7f3e1c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e3a59c640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3e1c0668d0 0x7f3e1c068d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0b2000 tx=0x7f3e2c0a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e39d9b640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7f3e1c06c7d0 0x7f3e1c06ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.439 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.436+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== osd.6 v2:172.21.15.143:6808/1463072026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e1c06f2a0 con 0x7f3e1c06c7d0 2023-12-04T05:40:24.451 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 --> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e3c071dc0 con 0x7f3e1c06c7d0 2023-12-04T05:40:24.452 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e2affd640 1 -- 172.21.15.97:0/4227248905 <== osd.6 v2:172.21.15.143:6808/1463072026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3e3c071dc0 con 0x7f3e1c06c7d0 2023-12-04T05:40:24.453 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:24.453 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7f3e1c06c7d0 msgr2=0x7f3e1c06ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.143:6808/1463072026,v1:172.21.15.143:6809/1463072026] conn(0x7f3e1c06c7d0 0x7f3e1c06ebf0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3e1c0668d0 msgr2=0x7f3e1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f3e1c0668d0 0x7f3e1c068d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0b2000 tx=0x7f3e2c0a9070 comp rx=0 tx=0).stop 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 msgr2=0x7f3e3c1e8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.454 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 --2- 172.21.15.97:0/4227248905 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e3c153e70 0x7f3e3c1e8ad0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d800 tx=0x7f3e3400dcc0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3ad9d640 1 -- 172.21.15.97:0/4227248905 reap_dead start 2023-12-04T05:40:24.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 shutdown_connections 2023-12-04T05:40:24.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 >> 172.21.15.97:0/4227248905 conn(0x7f3e3c06a5f0 msgr2=0x7f3e3c0a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 shutdown_connections 2023-12-04T05:40:24.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.452+0000 7f3e3b59e640 1 -- 172.21.15.97:0/4227248905 wait complete. 2023-12-04T05:40:24.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-04T05:40:24.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 Processor -- start 2023-12-04T05:40:24.610 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 -- start start 2023-12-04T05:40:24.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f983414eb30 0x7f983414f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f983414f790 0x7f98341548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9834154640 con 0x7f9834154e10 2023-12-04T05:40:24.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98340c0bd0 con 0x7f983414f790 2023-12-04T05:40:24.611 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f983be79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983414ef10 con 0x7f983414eb30 2023-12-04T05:40:24.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f9839414640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f983414f790 0x7f98341548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f9839414640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f983414f790 0x7f98341548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38692/0 (socket says 172.21.15.97:38692) 2023-12-04T05:40:24.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f9839414640 1 -- 172.21.15.97:0/2550531815 learned_addr learned my addr 172.21.15.97:0/2550531815 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.612 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.608+0000 7f9839c15640 1 --2- 172.21.15.97:0/2550531815 >> v2:172.21.15.143:3300/0 conn(0x7f983414eb30 0x7f983414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9839414640 1 -- 172.21.15.97:0/2550531815 >> v2:172.21.15.143:3300/0 conn(0x7f983414eb30 msgr2=0x7f983414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:24.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9839414640 1 --2- 172.21.15.97:0/2550531815 >> v2:172.21.15.143:3300/0 conn(0x7f983414eb30 0x7f983414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9839414640 1 -- 172.21.15.97:0/2550531815 >> v1:172.21.15.143:6789/0 conn(0x7f9834154e10 legacy=0x7f9834151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.613 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9839414640 1 -- 172.21.15.97:0/2550531815 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98341535a0 con 0x7f983414f790 2023-12-04T05:40:24.614 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9839414640 1 --2- 172.21.15.97:0/2550531815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414f790 0x7f98341548d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f98340c0a80 tx=0x7f982401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178d940241e5653 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9838c13640 1 -- 172.21.15.97:0/2550531815 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240ac640 con 0x7f983414f790 2023-12-04T05:40:24.615 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9838c13640 1 -- 172.21.15.97:0/2550531815 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98240ac7a0 con 0x7f983414f790 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f9838c13640 1 -- 172.21.15.97:0/2550531815 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98240acb30 con 0x7f983414f790 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 -- 172.21.15.97:0/2550531815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414f790 msgr2=0x7f98341548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 --2- 172.21.15.97:0/2550531815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414f790 0x7f98341548d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f98340c0a80 tx=0x7f982401c4d0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 -- 172.21.15.97:0/2550531815 shutdown_connections 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 --2- 172.21.15.97:0/2550531815 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414f790 0x7f98341548d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 --2- 172.21.15.97:0/2550531815 >> v2:172.21.15.143:3300/0 conn(0x7f983414eb30 0x7f983414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.612+0000 7f983be79640 1 -- 172.21.15.97:0/2550531815 >> 172.21.15.97:0/2550531815 conn(0x7f98340c5e70 msgr2=0x7f98340c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.616 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- 172.21.15.97:0/2550531815 shutdown_connections 2023-12-04T05:40:24.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- 172.21.15.97:0/2550531815 wait complete. 2023-12-04T05:40:24.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 Processor -- start 2023-12-04T05:40:24.617 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- start start 2023-12-04T05:40:24.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.619 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f983414f790 0x7f983413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9834154e10 0x7f983413f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983414a000 con 0x7f983414eb30 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340aa4a0 con 0x7f983414f790 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340aa780 con 0x7f9834154e10 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38708/0 (socket says 172.21.15.97:38708) 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 -- 172.21.15.97:0/1138379663 learned_addr learned my addr 172.21.15.97:0/1138379663 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839414640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f983414f790 0x7f983413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983a416640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9834154e10 0x7f983413f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 -- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9834154e10 msgr2=0x7f983413f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9834154e10 0x7f983413f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 -- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f983414f790 msgr2=0x7f983413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f983414f790 0x7f983413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 -- 172.21.15.97:0/1138379663 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240094d0 con 0x7f983414eb30 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f9839c15640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f983000e870 tx=0x7f983000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.621 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830009510 con 0x7f983414eb30 2023-12-04T05:40:24.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983000eec0 con 0x7f983414eb30 2023-12-04T05:40:24.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340aaa60 con 0x7f983414eb30 2023-12-04T05:40:24.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983000cb40 con 0x7f983414eb30 2023-12-04T05:40:24.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.616+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9834148de0 con 0x7f983414eb30 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9834068440 con 0x7f983414eb30 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f983000cca0 con 0x7f983414eb30 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f982a7fc640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 0x7f9818068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f98300845d0 con 0x7f983414eb30 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f9839414640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 0x7f9818068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.623 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.620+0000 7f9839414640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 0x7f9818068d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f98240ae000 tx=0x7f9824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.624+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9830051b60 con 0x7f983414eb30 2023-12-04T05:40:24.774 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.772+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f98340a8770 con 0x7f98180668d0 2023-12-04T05:40:24.775 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.772+0000 7f982a7fc640 1 -- 172.21.15.97:0/1138379663 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98340a8770 con 0x7f98180668d0 2023-12-04T05:40:24.775 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 6 to deep-scrub 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 msgr2=0x7f9818068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 0x7f9818068d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f98240ae000 tx=0x7f9824008040 comp rx=0 tx=0).stop 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 msgr2=0x7f983414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f983000e870 tx=0x7f983000ec70 comp rx=0 tx=0).stop 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 shutdown_connections 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f98180668d0 0x7f9818068d90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9834154e10 0x7f983413f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.777 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f983414f790 0x7f983413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 --2- 172.21.15.97:0/1138379663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f983414eb30 0x7f983414a530 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 >> 172.21.15.97:0/1138379663 conn(0x7f98340c5e70 msgr2=0x7f98340c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 shutdown_connections 2023-12-04T05:40:24.778 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.776+0000 7f983be79640 1 -- 172.21.15.97:0/1138379663 wait complete. 2023-12-04T05:40:24.795 INFO:tasks.ceph:Scrubbing osd.7 2023-12-04T05:40:24.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-04T05:40:24.936 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 Processor -- start 2023-12-04T05:40:24.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 -- start start 2023-12-04T05:40:24.937 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd76c155190 0x7fd76c071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 0x7fd76c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c158c00 con 0x7fd76c13db70 2023-12-04T05:40:24.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c155700 con 0x7fd76c155190 2023-12-04T05:40:24.938 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd774432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c157c50 con 0x7fd76c0c3570 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7729cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 0x7fd76c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7719cd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd76c155190 0x7fd76c071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7721ce640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fd76c13db70 0x7fd76c0c1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.97:55762/0 (socket says 172.21.15.97:55762) 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7721ce640 1 -- 172.21.15.97:0/2429577314 learned_addr learned my addr 172.21.15.97:0/2429577314 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7711cc640 1 -- 172.21.15.97:0/2429577314 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334689899 0 0) 0x7fd76c158c00 con 0x7fd76c13db70 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7729cf640 1 -- 172.21.15.97:0/2429577314 >> v2:172.21.15.143:3300/0 conn(0x7fd76c155190 msgr2=0x7fd76c071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7729cf640 1 --2- 172.21.15.97:0/2429577314 >> v2:172.21.15.143:3300/0 conn(0x7fd76c155190 0x7fd76c071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7729cf640 1 -- 172.21.15.97:0/2429577314 >> v1:172.21.15.143:6789/0 conn(0x7fd76c13db70 legacy=0x7fd76c0c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.939 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.936+0000 7fd7729cf640 1 -- 172.21.15.97:0/2429577314 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c13df50 con 0x7fd76c0c3570 2023-12-04T05:40:24.941 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd7729cf640 1 --2- 172.21.15.97:0/2429577314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 0x7fd76c071a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd764009d90 tx=0x7fd76401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156371a991e8ef16 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd7711cc640 1 -- 172.21.15.97:0/2429577314 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640a5870 con 0x7fd76c0c3570 2023-12-04T05:40:24.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd7711cc640 1 -- 172.21.15.97:0/2429577314 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7640a59d0 con 0x7fd76c0c3570 2023-12-04T05:40:24.942 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd7711cc640 1 -- 172.21.15.97:0/2429577314 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640a5d60 con 0x7fd76c0c3570 2023-12-04T05:40:24.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 -- 172.21.15.97:0/2429577314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 msgr2=0x7fd76c071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 --2- 172.21.15.97:0/2429577314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 0x7fd76c071a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd764009d90 tx=0x7fd76401c8c0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.943 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 -- 172.21.15.97:0/2429577314 shutdown_connections 2023-12-04T05:40:24.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 --2- 172.21.15.97:0/2429577314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c0c3570 0x7fd76c071a40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 --2- 172.21.15.97:0/2429577314 >> v2:172.21.15.143:3300/0 conn(0x7fd76c155190 0x7fd76c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 -- 172.21.15.97:0/2429577314 >> 172.21.15.97:0/2429577314 conn(0x7fd76c0c2a50 msgr2=0x7fd76c0c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 -- 172.21.15.97:0/2429577314 shutdown_connections 2023-12-04T05:40:24.944 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.940+0000 7fd774432640 1 -- 172.21.15.97:0/2429577314 wait complete. 2023-12-04T05:40:24.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 Processor -- start 2023-12-04T05:40:24.945 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- start start 2023-12-04T05:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd76c0c3570 0x7fd76c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 0x7fd76c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c155190 0x7fd76c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1501c0 con 0x7fd76c13db70 2023-12-04T05:40:24.947 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0c3c80 con 0x7fd76c0c3570 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0c52b0 con 0x7fd76c155190 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 0x7fd76c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 0x7fd76c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38722/0 (socket says 172.21.15.97:38722) 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 -- 172.21.15.97:0/1984693913 learned_addr learned my addr 172.21.15.97:0/1984693913 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7721ce640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd76c0c3570 0x7fd76c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7729cf640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c155190 0x7fd76c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 -- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c155190 msgr2=0x7fd76c14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.948 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd76c155190 0x7fd76c14fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 -- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd76c0c3570 msgr2=0x7fd76c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd76c0c3570 0x7fd76c151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764009a70 con 0x7fd76c13db70 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7721ce640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd76c0c3570 0x7fd76c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd7719cd640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 0x7fd76c14f740 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00e8a0 tx=0x7fd75c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c009510 con 0x7fd76c13db70 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00c940 con 0x7fd76c13db70 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c1f0210 con 0x7fd76c13db70 2023-12-04T05:40:24.949 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00ccb0 con 0x7fd76c13db70 2023-12-04T05:40:24.950 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.944+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c0c5830 con 0x7fd76c13db70 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd76c1586e0 con 0x7fd76c13db70 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd75c013470 con 0x7fd76c13db70 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7500668d0 0x7fd750068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd75c0841f0 con 0x7fd76c13db70 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd7721ce640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7500668d0 0x7fd750068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fd75006c7d0 0x7fd75006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:24.951 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75006f2a0 con 0x7fd75006c7d0 2023-12-04T05:40:24.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd75c0867d0 con 0x7fd76c13db70 2023-12-04T05:40:24.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd7729cf640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fd75006c7d0 0x7fd75006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:24.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd7721ce640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7500668d0 0x7fd750068d90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd768007fd0 tx=0x7fd768007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.948+0000 7fd7729cf640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fd75006c7d0 0x7fd75006ebf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:24.952 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.952+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== osd.7 v2:172.21.15.143:6824/2750869558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd75006f2a0 con 0x7fd75006c7d0 2023-12-04T05:40:24.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 --> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd76c068440 con 0x7fd75006c7d0 2023-12-04T05:40:24.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd762ffd640 1 -- 172.21.15.97:0/1984693913 <== osd.7 v2:172.21.15.143:6824/2750869558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd76c068440 con 0x7fd75006c7d0 2023-12-04T05:40:24.966 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2023-12-04T05:40:24.967 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-04T05:40:24.967 INFO:teuthology.orchestra.run.smithi097.stdout:} 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fd75006c7d0 msgr2=0x7fd75006ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.143:6824/2750869558,v1:172.21.15.143:6825/2750869558] conn(0x7fd75006c7d0 0x7fd75006ebf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7500668d0 msgr2=0x7fd750068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fd7500668d0 0x7fd750068d90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd768007fd0 tx=0x7fd768007c20 comp rx=0 tx=0).stop 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 msgr2=0x7fd76c14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 --2- 172.21.15.97:0/1984693913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd76c13db70 0x7fd76c14f740 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00e8a0 tx=0x7fd75c00eca0 comp rx=0 tx=0).stop 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd7729cf640 1 -- 172.21.15.97:0/1984693913 reap_dead start 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 shutdown_connections 2023-12-04T05:40:24.968 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 >> 172.21.15.97:0/1984693913 conn(0x7fd76c0c2a50 msgr2=0x7fd76c0ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 shutdown_connections 2023-12-04T05:40:24.969 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:24.964+0000 7fd774432640 1 -- 172.21.15.97:0/1984693913 wait complete. 2023-12-04T05:40:24.984 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-04T05:40:25.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 Processor -- start 2023-12-04T05:40:25.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 -- start start 2023-12-04T05:40:25.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7a00151f10 0x7f7a000c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a000ca780 con 0x7f7a000c7f00 2023-12-04T05:40:25.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a00158720 con 0x7f7a000cac10 2023-12-04T05:40:25.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a087c4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a00158cc0 con 0x7f7a00151f10 2023-12-04T05:40:25.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a05d5f640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f7a000c7f00 0x7f7a00154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56956/0 (socket says 172.21.15.97:56956) 2023-12-04T05:40:25.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a05d5f640 1 -- 172.21.15.97:0/240815826 learned_addr learned my addr 172.21.15.97:0/240815826 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:25.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489344345 0 0) 0x7f7a000ca780 con 0x7f7a000c7f00 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 --2- 172.21.15.97:0/240815826 >> v2:172.21.15.143:3300/0 conn(0x7f7a00151f10 0x7f7a000c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 --> v1:172.21.15.97:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ec003530 con 0x7f7a000c7f00 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v1:172.21.15.97:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730101075 0 0) 0x7f79ec003530 con 0x7f7a000c7f00 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 >> v2:172.21.15.143:3300/0 conn(0x7f7a00151f10 msgr2=0x7f7a000c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 --2- 172.21.15.97:0/240815826 >> v2:172.21.15.143:3300/0 conn(0x7f7a00151f10 0x7f7a000c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 >> v1:172.21.15.143:6789/0 conn(0x7f7a000cac10 legacy=0x7f7a0015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 --> v1:172.21.15.97:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000bd830 con 0x7f7a000c7f00 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v1:172.21.15.97:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1868134181 0 0) 0x7f79f0001680 con 0x7f7a000c7f00 2023-12-04T05:40:25.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 >> v1:172.21.15.97:6789/0 conn(0x7f7a000c7f00 legacy=0x7f7a00154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 0x7f79ec003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0047d0 0x7f79ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79ec0052b0 0x7f79ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00158cc0 con 0x7f79ec0039d0 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00c1b0 con 0x7f79ec0052b0 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00c370 con 0x7f79ec0047d0 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 0x7f79ec003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06d61640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79ec0052b0 0x7f79ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a05d5f640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0047d0 0x7f79ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 -- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0047d0 msgr2=0x7f79ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0047d0 0x7f79ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 -- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79ec0052b0 msgr2=0x7f79ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f79ec0052b0 0x7f79ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06560640 1 -- 172.21.15.97:0/240815826 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec003530 con 0x7f79ec0039d0 2023-12-04T05:40:25.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.124+0000 7f7a06d61640 1 -- 172.21.15.97:0/240815826 reap_dead start 2023-12-04T05:40:25.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a06560640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 0x7f79ec003df0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009ae0 tx=0x7f79fc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66936c659716f74d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0a5530 con 0x7f79ec0039d0 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0a5690 con 0x7f79ec0039d0 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a0555e640 1 -- 172.21.15.97:0/240815826 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0a5840 con 0x7f79ec0039d0 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 -- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 msgr2=0x7f79ec003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 0x7f79ec003df0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009ae0 tx=0x7f79fc01ca50 comp rx=0 tx=0).stop 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 -- 172.21.15.97:0/240815826 shutdown_connections 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 --2- 172.21.15.97:0/240815826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f79ec0039d0 0x7f79ec003df0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 -- 172.21.15.97:0/240815826 >> 172.21.15.97:0/240815826 conn(0x7f7a00073950 msgr2=0x7f7a00073d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:25.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 -- 172.21.15.97:0/240815826 shutdown_connections 2023-12-04T05:40:25.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.128+0000 7f7a087c4640 1 -- 172.21.15.97:0/240815826 wait complete. 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 Processor -- start 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- start start 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0039d0 0x7f7a00150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 0x7f7a000ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001f0560 con 0x7f7a0014f000 2023-12-04T05:40:25.135 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000ae8a0 con 0x7f7a000afa40 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000aeb80 con 0x7f79ec0039d0 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38730/0 (socket says 172.21.15.97:38730) 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 -- 172.21.15.97:0/2611165210 learned_addr learned my addr 172.21.15.97:0/2611165210 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a06560640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0039d0 0x7f7a00150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a06d61640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 0x7f7a000ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 -- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0039d0 msgr2=0x7f7a00150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.136 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0039d0 0x7f7a00150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 -- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 msgr2=0x7f7a000ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 0x7f7a000ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 -- 172.21.15.97:0/2611165210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000aee60 con 0x7f7a0014f000 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a06d61640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 0x7f7a000ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a05d5f640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e5a0 tx=0x7f79f000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0012590 con 0x7f7a0014f000 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f0012710 con 0x7f7a0014f000 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0012ac0 con 0x7f7a0014f000 2023-12-04T05:40:25.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a000af140 con 0x7f7a0014f000 2023-12-04T05:40:25.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.132+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a000c0c40 con 0x7f7a0014f000 2023-12-04T05:40:25.138 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a00068440 con 0x7f7a0014f000 2023-12-04T05:40:25.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f79f0012c20 con 0x7f7a0014f000 2023-12-04T05:40:25.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f79f6ffd640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 0x7f79e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f79f0083fb0 con 0x7f7a0014f000 2023-12-04T05:40:25.139 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f7a06560640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 0x7f79e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.140 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.136+0000 7f7a06560640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 0x7f79e4068d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0af000 tx=0x7f79fc0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.141 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.140+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79f00513f0 con 0x7f7a0014f000 2023-12-04T05:40:25.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.292+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a001585b0 con 0x7f79e40668d0 2023-12-04T05:40:25.295 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.292+0000 7f79f6ffd640 1 -- 172.21.15.97:0/2611165210 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a001585b0 con 0x7f79e40668d0 2023-12-04T05:40:25.295 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 7 to deep-scrub 2023-12-04T05:40:25.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 msgr2=0x7f79e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 0x7f79e4068d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0af000 tx=0x7f79fc0046d0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 msgr2=0x7f7a000acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f79f000e5a0 tx=0x7f79f000ea60 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 shutdown_connections 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f79e40668d0 0x7f79e4068d90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a000afa40 0x7f7a000ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7a0014f000 0x7f7a000acc80 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 --2- 172.21.15.97:0/2611165210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f79ec0039d0 0x7f7a00150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 >> 172.21.15.97:0/2611165210 conn(0x7f7a00073950 msgr2=0x7f7a00073d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:25.298 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 shutdown_connections 2023-12-04T05:40:25.299 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.296+0000 7f7a087c4640 1 -- 172.21.15.97:0/2611165210 wait complete. 2023-12-04T05:40:25.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:40:25.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.452+0000 7f2a2b409640 1 Processor -- start 2023-12-04T05:40:25.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.452+0000 7f2a2b409640 1 -- start start 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2b409640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f2a240c3c10 0x7f2a2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2b409640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2a24153e80 0x7f2a24154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2b409640 1 -- --> v1:172.21.15.97:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240c4810 con 0x7f2a241532f0 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2b409640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a241536d0 con 0x7f2a240c3c10 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2b409640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2406e300 con 0x7f2a24153e80 2023-12-04T05:40:25.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2a407640 1 --1- >> v1:172.21.15.97:6789/0 conn(0x7f2a241532f0 0x7f2a240a4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.97:6789/0 says I am v1:172.21.15.97:56958/0 (socket says 172.21.15.97:56958) 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2a407640 1 -- 172.21.15.97:0/2487568173 learned_addr learned my addr 172.21.15.97:0/2487568173 (peer_addr_for_me v1:172.21.15.97:0/0) 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29c06640 1 --2- 172.21.15.97:0/2487568173 >> v2:172.21.15.97:3300/0 conn(0x7f2a240c3c10 0x7f2a2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a2ac08640 1 --2- 172.21.15.97:0/2487568173 >> v2:172.21.15.143:3300/0 conn(0x7f2a24153e80 0x7f2a24154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29c06640 1 -- 172.21.15.97:0/2487568173 >> v2:172.21.15.143:3300/0 conn(0x7f2a24153e80 msgr2=0x7f2a24154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29c06640 1 --2- 172.21.15.97:0/2487568173 >> v2:172.21.15.143:3300/0 conn(0x7f2a24153e80 0x7f2a24154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29c06640 1 -- 172.21.15.97:0/2487568173 >> v1:172.21.15.97:6789/0 conn(0x7f2a241532f0 legacy=0x7f2a240a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29c06640 1 -- 172.21.15.97:0/2487568173 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240c4a60 con 0x7f2a240c3c10 2023-12-04T05:40:25.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.456+0000 7f2a29405640 1 -- 172.21.15.97:0/2487568173 <== mon.0 v1:172.21.15.97:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789315743 0 0) 0x7f2a240c4810 con 0x7f2a241532f0 2023-12-04T05:40:25.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a29c06640 1 --2- 172.21.15.97:0/2487568173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a240c3c10 0x7f2a2406d190 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2a2406daa0 tx=0x7f2a1401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c567e3fd39b5b91c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a29405640 1 -- 172.21.15.97:0/2487568173 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140ab600 con 0x7f2a240c3c10 2023-12-04T05:40:25.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a29405640 1 -- 172.21.15.97:0/2487568173 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140a7050 con 0x7f2a240c3c10 2023-12-04T05:40:25.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a29405640 1 -- 172.21.15.97:0/2487568173 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140ab980 con 0x7f2a240c3c10 2023-12-04T05:40:25.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- 172.21.15.97:0/2487568173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a240c3c10 msgr2=0x7f2a2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 --2- 172.21.15.97:0/2487568173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a240c3c10 0x7f2a2406d190 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2a2406daa0 tx=0x7f2a1401c3a0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- 172.21.15.97:0/2487568173 shutdown_connections 2023-12-04T05:40:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 --2- 172.21.15.97:0/2487568173 >> v2:172.21.15.143:3300/0 conn(0x7f2a24153e80 0x7f2a24154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 --2- 172.21.15.97:0/2487568173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a240c3c10 0x7f2a2406d190 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- 172.21.15.97:0/2487568173 >> 172.21.15.97:0/2487568173 conn(0x7f2a240c5a50 msgr2=0x7f2a240c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:25.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- 172.21.15.97:0/2487568173 shutdown_connections 2023-12-04T05:40:25.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- 172.21.15.97:0/2487568173 wait complete. 2023-12-04T05:40:25.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 Processor -- start 2023-12-04T05:40:25.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.460+0000 7f2a2b409640 1 -- start start 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a240c3c10 0x7f2a2415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a24153e80 0x7f2a2414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2414d210 con 0x7f2a241532f0 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24071a20 con 0x7f2a24153e80 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240a6330 con 0x7f2a240c3c10 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:38748/0 (socket says 172.21.15.97:38748) 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 -- 172.21.15.97:0/613583179 learned_addr learned my addr 172.21.15.97:0/613583179 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2a407640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a240c3c10 0x7f2a2415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2ac08640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a24153e80 0x7f2a2414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 -- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a240c3c10 msgr2=0x7f2a2415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a240c3c10 0x7f2a2415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 -- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a24153e80 msgr2=0x7f2a2414ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a24153e80 0x7f2a2414ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 -- 172.21.15.97:0/613583179 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a14009420 con 0x7f2a241532f0 2023-12-04T05:40:25.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a29c06640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2a14019fd0 tx=0x7f2a14019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14004230 con 0x7f2a241532f0 2023-12-04T05:40:25.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14004390 con 0x7f2a241532f0 2023-12-04T05:40:25.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14003840 con 0x7f2a241532f0 2023-12-04T05:40:25.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240a6050 con 0x7f2a241532f0 2023-12-04T05:40:25.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240a8860 con 0x7f2a241532f0 2023-12-04T05:40:25.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2404e890 con 0x7f2a241532f0 2023-12-04T05:40:25.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.464+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a140b2040 con 0x7f2a241532f0 2023-12-04T05:40:25.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.468+0000 7f2a1affd640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 0x7f2a08068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:25.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.468+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2a1411df00 con 0x7f2a241532f0 2023-12-04T05:40:25.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.468+0000 7f2a2a407640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 0x7f2a08068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:25.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.468+0000 7f2a2a407640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 0x7f2a08068dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000f70 tx=0x7f2a20007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:25.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.472+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a140eb480 con 0x7f2a241532f0 2023-12-04T05:40:25.620 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.620+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a2415f680 con 0x7f2a08066900 2023-12-04T05:40:25.622 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.620+0000 7f2a1affd640 1 -- 172.21.15.97:0/613583179 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50683 (secure 0 0 0) 0x7f2a200072a0 con 0x7f2a08066900 2023-12-04T05:40:25.624 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:25.625 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:40:25.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 msgr2=0x7f2a08068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 0x7f2a08068dc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000f70 tx=0x7f2a20007df0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.625 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 msgr2=0x7f2a2414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2a14019fd0 tx=0x7f2a14019140 comp rx=0 tx=0).stop 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 shutdown_connections 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f2a08066900 0x7f2a08068dc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a24153e80 0x7f2a2414ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a241532f0 0x7f2a2414c790 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 --2- 172.21.15.97:0/613583179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a240c3c10 0x7f2a2415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:25.626 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 >> 172.21.15.97:0/613583179 conn(0x7f2a240c5a50 msgr2=0x7f2a24152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 shutdown_connections 2023-12-04T05:40:25.627 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:25.624+0000 7f2a2b409640 1 -- 172.21.15.97:0/613583179 wait complete. 2023-12-04T05:40:25.643 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-12-04T05:40:24.239033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258236,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716484,"statfs":{"total":773094113280,"available":772829679616,"internally_reserved":0,"allocated":8986624,"data_stored":4630720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.222516"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":217,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-12-04T05:40:16.991528+0000","last_change":"2023-12-04T05:36:30.428528+0000","last_active":"2023-12-04T05:40:16.991528+0000","last_peered":"2023-12-04T05:40:16.991528+0000","last_clean":"2023-12-04T05:40:16.991528+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:40:16.991528+0000","last_undegraded":"2023-12-04T05:40:16.991528+0000","last_fullsized":"2023-12-04T05:40:16.991528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T05:36:28.614022+0000","last_clean_scrub_stamp":"2023-12-04T05:36:28.614022+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T09:51:25.781569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1568768,"data_stored":1021616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66000000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.86399999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.628,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84199999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77200000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61799999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":1.046,"15min":1.046},"last":0.874}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.752}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":1.006,"15min":1.006},"last":0.85599999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89400000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.89300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.50800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.47099999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68700000000000006,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66500000000000004,"15min":0.64700000000000002},"min":{"1min":0.50900000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.496,"5min":0.44,"15min":0.44},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.52800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.079,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.55700000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.98799999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84899999999999998,"5min":1.196,"15min":1.196},"last":0.624},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.52200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.84099999999999997}]},{"osd":1,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.875},{"interface":"front","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1419999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0880000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.67700000000000005,"15min":0.69499999999999995},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.754},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.67700000000000005,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86699999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.65600000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.58699999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97099999999999997,"5min":1.631,"15min":1.631},"last":0.68899999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:39:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.014,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95799999999999996,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88900000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67000000000000004,"15min":0.67100000000000004},"min":{"1min":0.47599999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93799999999999994,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.65500000000000003,"15min":0.64300000000000002},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91300000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.55700000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.88600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.03,"15min":1.03},"last":0.77400000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.63600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64800000000000002,"15min":0.66000000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94299999999999995,"5min":1.167,"15min":1.167},"last":0.44400000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95599999999999996,"5min":1.196,"15min":1.196},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.62}]},{"osd":7,"last update":"Mon Dec 4 05:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.016,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.495},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.036,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61099999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60199999999999998,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.501},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.70899999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68400000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76400000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71399999999999997,"15min":0.73799999999999999},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.877,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.74199999999999999,"15min":0.77600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93700000000000006,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.751}]},{"osd":5,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95699999999999996,"5min":1.2,"15min":1.2},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.76200000000000001,"15min":0.78900000000000003},"min":{"1min":0.52500000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86299999999999999,"5min":1.498,"15min":1.498},"last":0.83899999999999997}]},{"osd":6,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96999999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.90400000000000003,"5min":1.256,"15min":1.256},"last":0.82399999999999995}]},{"osd":7,"last update":"Mon Dec 4 05:39:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":1.536,"15min":1.536},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88800000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.26400000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55600000000000005,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.29799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.376}]},{"osd":1,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.42399999999999999}]},{"osd":3,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.47299999999999998,"15min":0.48599999999999999},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.60399999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54000000000000004,"15min":0.53500000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.629,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.749,"15min":0.745},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95799999999999996,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94199999999999995,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.65700000000000003}]},{"osd":5,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.90900000000000003,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.88,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95799999999999996,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0700000000000001,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.628},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.052,"5min":3.472,"15min":3.472},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Dec 4 05:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.89600000000000002,"15min":0.91500000000000004},"min":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.024,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.84299999999999997,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.034,"5min":4.218,"15min":4.218},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57999999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.29099999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.373},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.55400000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59399999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.621,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.38900000000000001}]},{"osd":4,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.53700000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94099999999999995,"5min":1.345,"15min":1.345},"last":0.73499999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.54500000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.036,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0720000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1240000000000001,"5min":1.214,"15min":1.214},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78000000000000003,"15min":0.81399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0620000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Dec 4 05:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78100000000000003,"15min":0.80800000000000005},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.0309999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.58799999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94699999999999995,"5min":1.119,"15min":1.119},"last":0.83599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":1021616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.82599999999999996,"15min":1.0149999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.88700000000000001,"15min":1.093},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.51300000000000001,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.36299999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.53700000000000003,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.81899999999999995,"15min":0.97499999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60699999999999998,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.40500000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.77600000000000002,"15min":0.93400000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.46999999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.95599999999999996,"15min":1.163},"min":{"1min":0.40600000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.56200000000000006,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.41999999999999998}]},{"osd":4,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.88500000000000001,"15min":0.97199999999999998},"min":{"1min":0.42799999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.101,"15min":1.2769999999999999},"min":{"1min":0.57099999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95099999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.81100000000000005}]},{"osd":5,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.081,"15min":1.254},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":8.234,"15min":8.234},"last":0.626},{"interface":"front","average":{"1min":0.746,"5min":0.95099999999999996,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.1240000000000001,"15min":1.28},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.747,"5min":1.1419999999999999,"15min":1.321},"min":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98199999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Dec 4 05:39:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.1140000000000001,"15min":1.28},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0680000000000001,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.92800000000000005,"15min":1.024},"min":{"1min":0.504,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84399999999999997,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:40:25.648 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-04T05:36:28.614022+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=4, tm_hour=5, tm_min=36, tm_sec=28, tm_wday=0, tm_yday=338, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=4, tm_hour=5, tm_min=40, tm_sec=20, tm_wday=0, tm_yday=338, tm_isdst=0) 2023-12-04T05:40:25.648 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-04T05:40:33.760 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:40:33.764 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:40:45.649 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T05:40:45.796 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 Processor -- start 2023-12-04T05:40:45.797 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 -- start start 2023-12-04T05:40:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb040c1880 0x7fdb040c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb0415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.798 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0414b440 con 0x7fdb0406be00 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0406caf0 con 0x7fdb040c1880 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb0b4c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04154670 con 0x7fdb04155230 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb040c1880 0x7fdb040c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7fdb040c1880 0x7fdb040c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46890/0 (socket says 172.21.15.97:46890) 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 -- 172.21.15.97:0/1275123297 learned_addr learned my addr 172.21.15.97:0/1275123297 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09a66640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb0415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 -- 172.21.15.97:0/1275123297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 msgr2=0x7fdb0415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:45.799 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb0415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 -- 172.21.15.97:0/1275123297 >> v1:172.21.15.143:6789/0 conn(0x7fdb0406be00 legacy=0x7fdb04154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:45.800 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.796+0000 7fdb09265640 1 -- 172.21.15.97:0/1275123297 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040c02a0 con 0x7fdb040c1880 2023-12-04T05:40:45.801 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb09265640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb040c1c60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009870 tx=0x7fdb0001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abf88323e11a060 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:45.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdafbfff640 1 -- 172.21.15.97:0/1275123297 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000a9400 con 0x7fdb040c1880 2023-12-04T05:40:45.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdafbfff640 1 -- 172.21.15.97:0/1275123297 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb000a9560 con 0x7fdb040c1880 2023-12-04T05:40:45.802 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdafbfff640 1 -- 172.21.15.97:0/1275123297 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000a98f0 con 0x7fdb040c1880 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/1275123297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 msgr2=0x7fdb040c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb040c1c60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009870 tx=0x7fdb0001c540 comp rx=0 tx=0).stop 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/1275123297 shutdown_connections 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb0415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/1275123297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb040c1c60 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/1275123297 >> 172.21.15.97:0/1275123297 conn(0x7fdb040c2970 msgr2=0x7fdb040c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:45.803 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/1275123297 shutdown_connections 2023-12-04T05:40:45.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.800+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/1275123297 wait complete. 2023-12-04T05:40:45.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 Processor -- start 2023-12-04T05:40:45.804 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- start start 2023-12-04T05:40:45.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb0406be00 0x7fdb041491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.805 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb041564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0413d590 con 0x7fdb040c1880 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04155ed0 con 0x7fdb0406be00 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041edc80 con 0x7fdb04155230 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46904/0 (socket says 172.21.15.97:46904) 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 -- 172.21.15.97:0/227597929 learned_addr learned my addr 172.21.15.97:0/227597929 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:45.806 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb09265640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb0406be00 0x7fdb041491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.807 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb09a66640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb041564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 -- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 msgr2=0x7fdb041564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:45.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb041564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.808 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 -- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb0406be00 msgr2=0x7fdb041491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb0406be00 0x7fdb041491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 -- 172.21.15.97:0/227597929 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000094d0 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb08a64640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400c530 tx=0x7fdaf400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4005220 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4005380 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4007270 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb041ee1b0 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.804+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb041edf80 con 0x7fdb040c1880 2023-12-04T05:40:45.809 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb04068440 con 0x7fdb040c1880 2023-12-04T05:40:45.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdaf40073d0 con 0x7fdb040c1880 2023-12-04T05:40:45.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdaf9ffb640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 0x7fdae8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:45.810 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdaf4083960 con 0x7fdb040c1880 2023-12-04T05:40:45.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdb09265640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 0x7fdae8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:45.811 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.808+0000 7fdb09265640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 0x7fdae8068d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ae000 tx=0x7fdb000b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:45.813 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.812+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdaf4050ee0 con 0x7fdb040c1880 2023-12-04T05:40:45.960 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.960+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 --> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb0406e460 con 0x7fdae80668d0 2023-12-04T05:40:45.962 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.960+0000 7fdaf9ffb640 1 -- 172.21.15.97:0/227597929 <== mgr.4104 v2:172.21.15.97:6832/518581836 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50610 (secure 0 0 0) 0x7fdb000a9850 con 0x7fdae80668d0 2023-12-04T05:40:45.963 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:45.964 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 msgr2=0x7fdae8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 0x7fdae8068d90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ae000 tx=0x7fdb000b3040 comp rx=0 tx=0).stop 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 msgr2=0x7fdb04153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400c530 tx=0x7fdaf400c9f0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 shutdown_connections 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7fdae80668d0 0x7fdae8068d90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.965 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb04155230 0x7fdb041564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb040c1880 0x7fdb04153550 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 --2- 172.21.15.97:0/227597929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb0406be00 0x7fdb041491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 >> 172.21.15.97:0/227597929 conn(0x7fdb040c2970 msgr2=0x7fdb040c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 shutdown_connections 2023-12-04T05:40:45.966 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:45.964+0000 7fdb0b4c9640 1 -- 172.21.15.97:0/227597929 wait complete. 2023-12-04T05:40:45.983 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2023-12-04T05:40:44.243812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258224,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716496,"statfs":{"total":773094113280,"available":772829691904,"internally_reserved":0,"allocated":8986624,"data_stored":4630720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002840"},"pg_stats":[{"pgid":"1.0","version":"78'119","reported_seq":229,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-04T05:40:26.054433+0000","last_change":"2023-12-04T05:40:26.054433+0000","last_active":"2023-12-04T05:40:26.054433+0000","last_peered":"2023-12-04T05:40:26.054433+0000","last_clean":"2023-12-04T05:40:26.054433+0000","last_became_active":"2023-12-04T05:36:30.427438+0000","last_became_peered":"2023-12-04T05:36:30.427438+0000","last_unstale":"2023-12-04T05:40:26.054433+0000","last_undegraded":"2023-12-04T05:40:26.054433+0000","last_fullsized":"2023-12-04T05:40:26.054433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"78'119","last_scrub_stamp":"2023-12-04T05:40:26.054307+0000","last_deep_scrub":"78'119","last_deep_scrub_stamp":"2023-12-04T05:40:26.054307+0000","last_clean_scrub_stamp":"2023-12-04T05:40:26.054307+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T06:37:26.088685+0000","scrub_duration":0.0069507140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":1021616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.878,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.878},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.44500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81899999999999995}]},{"osd":1,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65500000000000003,"15min":0.64700000000000002},"min":{"1min":0.48299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.74399999999999999,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.52000000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.85899999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84099999999999997,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81999999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.47399999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.96999999999999997,"5min":1.046,"15min":1.046},"last":0.96999999999999997}]},{"osd":4,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.41799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76400000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.746}]},{"osd":5,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.65300000000000002},"min":{"1min":0.41599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86599999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92300000000000004,"5min":1.006,"15min":1.006},"last":0.68799999999999994}]},{"osd":6,"last update":"Mon Dec 4 05:40:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93899999999999995,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65900000000000003,"15min":0.64700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.98299999999999998,"5min":1.173,"15min":1.173},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63500000000000001,"15min":0.621},"min":{"1min":0.46700000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91100000000000003,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88900000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95799999999999996,"5min":1.216,"15min":1.216},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66400000000000003,"15min":0.65500000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.51900000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.93100000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":1.016},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.443,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86899999999999999,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.625,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84299999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.70299999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.97599999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Dec 4 05:40:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.996,"5min":1.196,"15min":1.196},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.03,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.749}]},{"osd":1,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67300000000000004,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.875,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96999999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63}]},{"osd":2,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71999999999999997,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91000000000000003,"5min":1.028,"15min":1.028},"last":0.68000000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.081,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72099999999999997,"15min":0.73099999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.81499999999999995,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67400000000000004,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86099999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.504,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92100000000000004,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.75900000000000001,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89000000000000001,"5min":1.631,"15min":1.631},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.875,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.76400000000000001,"15min":0.80400000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91000000000000003,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.68899999999999995}]},{"osd":1,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.46300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.125,"5min":2.125,"15min":2.125},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68200000000000005,"15min":0.66900000000000004},"min":{"1min":0.44500000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.65700000000000003}]},{"osd":2,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.68500000000000005,"15min":0.65300000000000002},"min":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72699999999999998,"15min":0.71499999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.51400000000000001}]},{"osd":6,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.79500000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72899999999999998,"15min":0.73599999999999999},"min":{"1min":0.45300000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.623},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.53800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.76400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56899999999999995,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.376},{"interface":"front","average":{"1min":0.441,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.31,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60599999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.70099999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.434}]},{"osd":2,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70699999999999996,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69399999999999995,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.92400000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72299999999999998,"15min":0.77000000000000002},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.50800000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.2,"15min":1.2},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73999999999999999,"15min":0.78200000000000003},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.871,"5min":1.498,"15min":1.498},"last":0.67800000000000005}]},{"osd":6,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73599999999999999,"15min":0.78800000000000003},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.024,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.497,"15min":0.497},"max":{"1min":1.0249999999999999,"5min":1.256,"15min":1.256},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Dec 4 05:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.55800000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.536,"15min":1.536},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.751,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98799999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.30099999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66400000000000003,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.501,"15min":0.51500000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65100000000000002,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.47499999999999998},"min":{"1min":0.32400000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75900000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.56599999999999995,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":0.55500000000000005}]},{"osd":3,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46600000000000003,"15min":0.48399999999999999},"min":{"1min":0.317,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.46100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.99399999999999999,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.749,"15min":0.745},"min":{"1min":0.54400000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.54400000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.92200000000000004,"5min":5.3710000000000004,"15min":5.3710000000000004},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.86099999999999999,"15min":0.93700000000000006},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.94899999999999995,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81299999999999994,"15min":0.88},"min":{"1min":0.497,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97299999999999998,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.85199999999999998}]},{"osd":6,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79300000000000004,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96699999999999997,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.042,"5min":3.472,"15min":3.472},"last":0.83199999999999996}]},{"osd":7,"last update":"Mon Dec 4 05:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.86399999999999999,"15min":0.90400000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.014,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.85599999999999998},"min":{"1min":0.54000000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88800000000000001,"5min":4.218,"15min":4.218},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.40799999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60299999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66800000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.41999999999999998,"15min":0.42399999999999999},"min":{"1min":0.28399999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.495,"15min":0.51300000000000001},"min":{"1min":0.39400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.46000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80100000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.497,"15min":0.51600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54400000000000004}]},{"osd":4,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.081,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73099999999999998,"15min":0.76800000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.345,"15min":1.345},"last":0.70999999999999996}]},{"osd":5,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1200000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.79100000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98999999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.80700000000000005},"min":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.026,"5min":1.214,"15min":1.214},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.753,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89100000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:40:34 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76700000000000002,"15min":0.80300000000000005},"min":{"1min":0.628,"5min":0.5,"15min":0.5},"max":{"1min":1.05,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.57399999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.879,"5min":1.119,"15min":1.119},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1568768,"data_stored":1021616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.68999999999999995,"15min":0.96999999999999997},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68300000000000005,"5min":8.5719999999999992,"15min":8.5719999999999992},"last":0.371},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.74099999999999999,"15min":1.044},"min":{"1min":0.33000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.69899999999999995,"5min":8.4860000000000007,"15min":8.4860000000000007},"last":0.48699999999999999}]},{"osd":2,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.66300000000000003,"15min":0.875},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.69299999999999995,"5min":6.2779999999999996,"15min":6.2779999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.70399999999999996,"15min":0.93700000000000006},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.76700000000000002,"5min":7.8289999999999997,"15min":7.8289999999999997},"last":0.53200000000000003}]},{"osd":3,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.66000000000000003,"15min":0.89600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59599999999999997,"5min":7.0380000000000003,"15min":7.0380000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.80700000000000005,"15min":1.113},"min":{"1min":0.39000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.73499999999999999,"5min":8.4309999999999992,"15min":8.4309999999999992},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.82099999999999995,"15min":0.95099999999999996},"min":{"1min":0.433,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96299999999999997,"5min":5.8150000000000004,"15min":5.8150000000000004},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.97899999999999998,"15min":1.236},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.95699999999999996,"15min":1.2130000000000001},"min":{"1min":0.496,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91700000000000004,"5min":8.234,"15min":8.234},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.88,"15min":1.0209999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94099999999999995,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":1.0049999999999999,"15min":1.24},"min":{"1min":0.57899999999999996,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90000000000000002,"5min":7.1630000000000003,"15min":7.1630000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":1,"15min":1.274},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Dec 4 05:40:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98899999999999999,"15min":1.238},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92300000000000004,"5min":8.1910000000000007,"15min":8.1910000000000007},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.86099999999999999,"15min":1.002},"min":{"1min":0.55500000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98899999999999999,"5min":5.8470000000000004,"15min":5.8470000000000004},"last":0.84599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T05:40:45.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-04T05:40:46.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 Processor -- start 2023-12-04T05:40:46.120 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 -- start start 2023-12-04T05:40:46.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 0x7f569c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f569c154e10 0x7f569c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c154640 con 0x7f569c14eb30 2023-12-04T05:40:46.121 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0c0bd0 con 0x7f569c154e10 2023-12-04T05:40:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f56a1a79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c14ef10 con 0x7f569c14f960 2023-12-04T05:40:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f569c154e10 0x7f569c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f569c154e10 0x7f569c15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46906/0 (socket says 172.21.15.97:46906) 2023-12-04T05:40:46.122 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 -- 172.21.15.97:0/423306822 learned_addr learned my addr 172.21.15.97:0/423306822 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569affd640 1 --2- 172.21.15.97:0/423306822 >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 0x7f569c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 -- 172.21.15.97:0/423306822 >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 msgr2=0x7f569c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 --2- 172.21.15.97:0/423306822 >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 0x7f569c1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 -- 172.21.15.97:0/423306822 >> v1:172.21.15.143:6789/0 conn(0x7f569c14eb30 legacy=0x7f569c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569bfff640 1 -- 172.21.15.97:0/423306822 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c1535a0 con 0x7f569c154e10 2023-12-04T05:40:46.123 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.120+0000 7f569affd640 1 --2- 172.21.15.97:0/423306822 >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 0x7f569c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T05:40:46.124 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f569bfff640 1 --2- 172.21.15.97:0/423306822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c154e10 0x7f569c15bc60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f569c06e7f0 tx=0x7f569401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166f1e9e58ca4dfb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f569a7fc640 1 -- 172.21.15.97:0/423306822 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940a5730 con 0x7f569c154e10 2023-12-04T05:40:46.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f569a7fc640 1 -- 172.21.15.97:0/423306822 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940a5890 con 0x7f569c154e10 2023-12-04T05:40:46.125 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f569a7fc640 1 -- 172.21.15.97:0/423306822 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940a5c20 con 0x7f569c154e10 2023-12-04T05:40:46.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 -- 172.21.15.97:0/423306822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c154e10 msgr2=0x7f569c15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 --2- 172.21.15.97:0/423306822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c154e10 0x7f569c15bc60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f569c06e7f0 tx=0x7f569401c960 comp rx=0 tx=0).stop 2023-12-04T05:40:46.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 -- 172.21.15.97:0/423306822 shutdown_connections 2023-12-04T05:40:46.126 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 --2- 172.21.15.97:0/423306822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c154e10 0x7f569c15bc60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 --2- 172.21.15.97:0/423306822 >> v2:172.21.15.143:3300/0 conn(0x7f569c14f960 0x7f569c1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 -- 172.21.15.97:0/423306822 >> 172.21.15.97:0/423306822 conn(0x7f569c0c5e70 msgr2=0x7f569c0c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:46.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 -- 172.21.15.97:0/423306822 shutdown_connections 2023-12-04T05:40:46.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 -- 172.21.15.97:0/423306822 wait complete. 2023-12-04T05:40:46.127 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.124+0000 7f56a1a79640 1 Processor -- start 2023-12-04T05:40:46.128 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- start start 2023-12-04T05:40:46.129 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f569c14f960 0x7f569c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f569c154e10 0x7f569c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1430d0 con 0x7f569c14eb30 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1ed0e0 con 0x7f569c14f960 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0700b0 con 0x7f569c154e10 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.130 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46910/0 (socket says 172.21.15.97:46910) 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 -- 172.21.15.97:0/4013776350 learned_addr learned my addr 172.21.15.97:0/4013776350 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569affd640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f569c14f960 0x7f569c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569bfff640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f569c154e10 0x7f569c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 -- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f569c154e10 msgr2=0x7f569c06bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f569c154e10 0x7f569c06bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 -- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f569c14f960 msgr2=0x7f569c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f569c14f960 0x7f569c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 -- 172.21.15.97:0/4013776350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009b30 con 0x7f569c14eb30 2023-12-04T05:40:46.131 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f569b7fe640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c450 tx=0x7f568c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c012830 con 0x7f569c14eb30 2023-12-04T05:40:46.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c0129b0 con 0x7f569c14eb30 2023-12-04T05:40:46.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c012d60 con 0x7f569c14eb30 2023-12-04T05:40:46.132 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c070390 con 0x7f569c14eb30 2023-12-04T05:40:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c1ed660 con 0x7f569c14eb30 2023-12-04T05:40:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.128+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c1ecf40 con 0x7f569c14eb30 2023-12-04T05:40:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.132+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f568c01c460 con 0x7f569c14eb30 2023-12-04T05:40:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.132+0000 7f5683fff640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 0x7f5688068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.133 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.132+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f568c083f50 con 0x7f569c14eb30 2023-12-04T05:40:46.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.132+0000 7f569affd640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 0x7f5688068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.134 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.132+0000 7f569affd640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 0x7f5688068d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f569c072130 tx=0x7f5690008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.137 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.136+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f569c1ecf40 con 0x7f569c14eb30 2023-12-04T05:40:46.288 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.288+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f569c148a00 con 0x7f569c14eb30 2023-12-04T05:40:46.292 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.292+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f568c059e60 con 0x7f569c14eb30 2023-12-04T05:40:46.294 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.292+0000 7f5683fff640 1 -- 172.21.15.97:0/4013776350 <== mon.0 v2:172.21.15.97:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f568c0513c0 con 0x7f569c14eb30 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.292+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 msgr2=0x7f5688068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.292+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 0x7f5688068d90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f569c072130 tx=0x7f5690008040 comp rx=0 tx=0).stop 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 msgr2=0x7f569c071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c450 tx=0x7f568c00c910 comp rx=0 tx=0).stop 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 shutdown_connections 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f56880668d0 0x7f5688068d90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.296 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f569c154e10 0x7f569c06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f569c14f960 0x7f569c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 --2- 172.21.15.97:0/4013776350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f569c14eb30 0x7f569c071bf0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 >> 172.21.15.97:0/4013776350 conn(0x7f569c0c5e70 msgr2=0x7f569c0c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 shutdown_connections 2023-12-04T05:40:46.297 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.296+0000 7f56a1a79640 1 -- 172.21.15.97:0/4013776350 wait complete. 2023-12-04T05:40:46.317 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T05:40:46.317 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T05:40:46.455 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.452+0000 7f91beedd640 1 Processor -- start 2023-12-04T05:40:46.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.452+0000 7f91beedd640 1 -- start start 2023-12-04T05:40:46.456 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91beedd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b814fbb0 0x7f91b80a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91beedd640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f91b80a88e0 0x7f91b8152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91beedd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b81530e0 con 0x7f91b80a8460 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91beedd640 1 -- --> v2:172.21.15.97:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b814ff90 con 0x7f91b80a88e0 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91beedd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80a9770 con 0x7f91b814fbb0 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f91b80a88e0 0x7f91b8152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 --2- >> v2:172.21.15.97:3300/0 conn(0x7f91b80a88e0 0x7f91b8152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46924/0 (socket says 172.21.15.97:46924) 2023-12-04T05:40:46.457 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 -- 172.21.15.97:0/2601864421 learned_addr learned my addr 172.21.15.97:0/2601864421 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:46.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bcc79640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b814fbb0 0x7f91b80a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 -- 172.21.15.97:0/2601864421 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b814fbb0 msgr2=0x7f91b80a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:46.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b814fbb0 0x7f91b80a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.458 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 -- 172.21.15.97:0/2601864421 >> v1:172.21.15.143:6789/0 conn(0x7f91b80a8460 legacy=0x7f91b8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T05:40:46.459 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.456+0000 7f91bd47a640 1 -- 172.21.15.97:0/2601864421 --> v2:172.21.15.97:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8071730 con 0x7f91b80a88e0 2023-12-04T05:40:46.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91bd47a640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b80a88e0 0x7f91b8152ba0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009e50 tx=0x7f91b001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8862f4058f7bb188 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.460 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91af7fe640 1 -- 172.21.15.97:0/2601864421 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00a57b0 con 0x7f91b80a88e0 2023-12-04T05:40:46.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91af7fe640 1 -- 172.21.15.97:0/2601864421 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91b00a5910 con 0x7f91b80a88e0 2023-12-04T05:40:46.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91af7fe640 1 -- 172.21.15.97:0/2601864421 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00a5cc0 con 0x7f91b80a88e0 2023-12-04T05:40:46.461 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- 172.21.15.97:0/2601864421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b80a88e0 msgr2=0x7f91b8152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b80a88e0 0x7f91b8152ba0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009e50 tx=0x7f91b001c8f0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- 172.21.15.97:0/2601864421 shutdown_connections 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b80a88e0 0x7f91b8152ba0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 --2- 172.21.15.97:0/2601864421 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b814fbb0 0x7f91b80a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- 172.21.15.97:0/2601864421 >> 172.21.15.97:0/2601864421 conn(0x7f91b80c2970 msgr2=0x7f91b80c2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- 172.21.15.97:0/2601864421 shutdown_connections 2023-12-04T05:40:46.462 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- 172.21.15.97:0/2601864421 wait complete. 2023-12-04T05:40:46.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 Processor -- start 2023-12-04T05:40:46.463 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.460+0000 7f91beedd640 1 -- start start 2023-12-04T05:40:46.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91b80a8460 0x7f91b8150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.464 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b80a88e0 0x7f91b8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8151fb0 con 0x7f91b814fbb0 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b814ae20 con 0x7f91b80a8460 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80c40b0 con 0x7f91b80a88e0 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:46930/0 (socket says 172.21.15.97:46930) 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 -- 172.21.15.97:0/102678551 learned_addr learned my addr 172.21.15.97:0/102678551 (peer_addr_for_me v2:172.21.15.97:0/0) 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bcc79640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91b80a8460 0x7f91b8150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91affff640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b80a88e0 0x7f91b8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 -- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b80a88e0 msgr2=0x7f91b8155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b80a88e0 0x7f91b8155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 -- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91b80a8460 msgr2=0x7f91b8150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91b80a8460 0x7f91b8150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 -- 172.21.15.97:0/102678551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0009b30 con 0x7f91b814fbb0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91bd47a640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f91b001a520 tx=0x7f91b0019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00b8470 con 0x7f91b814fbb0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91b00b8610 con 0x7f91b814fbb0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00b89e0 con 0x7f91b814fbb0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b814b0c0 con 0x7f91b814fbb0 2023-12-04T05:40:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b814b680 con 0x7f91b814fbb0 2023-12-04T05:40:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b80c42d0 con 0x7f91b814fbb0 2023-12-04T05:40:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.464+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f91b00b8b40 con 0x7f91b814fbb0 2023-12-04T05:40:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.468+0000 7f91ad7fa640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 0x7f91a4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T05:40:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.468+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f91b011f0b0 con 0x7f91b814fbb0 2023-12-04T05:40:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.468+0000 7f91bcc79640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 0x7f91a4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T05:40:46.469 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.468+0000 7f91bcc79640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 0x7f91a4068dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007a60 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T05:40:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.472+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91b80c42d0 con 0x7f91b814fbb0 2023-12-04T05:40:46.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91b80c42d0 con 0x7f91b814fbb0 2023-12-04T05:40:46.653 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91ad7fa640 1 -- 172.21.15.97:0/102678551 <== mon.0 v2:172.21.15.97:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f91b00bce90 con 0x7f91b814fbb0 2023-12-04T05:40:46.654 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-12-04T05:40:46.654 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/2504181450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2504181450},{"type":"v1","addr":"172.21.15.143:6834","nonce":2504181450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/2198394782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":2198394782},{"type":"v1","addr":"172.21.15.143:6835","nonce":2198394782}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/3483003537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":3483003537},{"type":"v1","addr":"172.21.15.97:6837","nonce":3483003537}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/2739229274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":2739229274},{"type":"v1","addr":"172.21.15.97:6835","nonce":2739229274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[]} 2023-12-04T05:40:46.654 INFO:teuthology.orchestra.run.smithi097.stderr:dumped fsmap epoch 57 2023-12-04T05:40:46.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 msgr2=0x7f91a4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 0x7f91a4068dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91b4007a60 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2023-12-04T05:40:46.655 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 msgr2=0x7f91b8155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f91b001a520 tx=0x7f91b0019690 comp rx=0 tx=0).stop 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 shutdown_connections 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:6832/518581836,v1:172.21.15.97:6833/518581836] conn(0x7f91a4066900 0x7f91a4068dc0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f91b814fbb0 0x7f91b8155e50 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91b80a88e0 0x7f91b8155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 --2- 172.21.15.97:0/102678551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91b80a8460 0x7f91b8150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 >> 172.21.15.97:0/102678551 conn(0x7f91b80c2970 msgr2=0x7f91b814d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T05:40:46.656 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 shutdown_connections 2023-12-04T05:40:46.657 INFO:teuthology.orchestra.run.smithi097.stderr:2023-12-04T05:40:46.652+0000 7f91beedd640 1 -- 172.21.15.97:0/102678551 wait complete. 2023-12-04T05:40:46.675 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-04T05:40:46.675 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-04T05:40:46.675 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-04T05:40:46.675 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:46.686 INFO:tasks.ceph.mds.a:Stopped 2023-12-04T05:40:46.687 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-04T05:40:46.687 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:46.742 INFO:tasks.ceph.mds.c:Stopped 2023-12-04T05:40:46.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-04T05:40:46.742 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:46.758 INFO:tasks.ceph.mds.b:Stopped 2023-12-04T05:40:46.759 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-04T05:40:46.759 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:46.813 INFO:tasks.ceph.mds.d:Stopped 2023-12-04T05:40:46.813 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-04T05:40:46.814 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-04T05:40:46.814 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:46.891 INFO:tasks.ceph.osd.0:Stopped 2023-12-04T05:40:46.892 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-04T05:40:46.892 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:52.994 INFO:tasks.ceph.osd.1:Stopped 2023-12-04T05:40:52.994 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-04T05:40:52.995 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:53.060 INFO:tasks.ceph.osd.2:Stopped 2023-12-04T05:40:53.060 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-04T05:40:53.060 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:53.141 INFO:tasks.ceph.osd.3:Stopped 2023-12-04T05:40:53.141 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-04T05:40:53.141 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:53.220 INFO:tasks.ceph.osd.4:Stopped 2023-12-04T05:40:53.220 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-04T05:40:53.220 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:53.308 INFO:tasks.ceph.osd.5:Stopped 2023-12-04T05:40:53.308 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-04T05:40:53.308 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:54.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-04T05:40:54.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-04T05:40:54.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-04T05:40:59.410 INFO:tasks.ceph.osd.6:Stopped 2023-12-04T05:40:59.411 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-04T05:40:59.411 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.474 INFO:tasks.ceph.osd.7:Stopped 2023-12-04T05:40:59.475 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-04T05:40:59.475 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-04T05:40:59.475 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.532 INFO:tasks.ceph.mgr.y:Stopped 2023-12-04T05:40:59.533 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-04T05:40:59.533 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-04T05:40:59.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-12-04T05:40:59.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-04T05:40:59.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-04T05:40:59.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-04T05:40:59.587 INFO:tasks.ceph.mgr.x:Stopped 2023-12-04T05:40:59.587 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-04T05:40:59.587 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-04T05:40:59.587 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.607 INFO:tasks.ceph.mon.a:Stopped 2023-12-04T05:40:59.608 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-04T05:40:59.608 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.625 INFO:tasks.ceph.mon.b:Stopped 2023-12-04T05:40:59.625 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-04T05:40:59.625 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T05:40:59.684 INFO:tasks.ceph.mon.c:Stopped 2023-12-04T05:40:59.684 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-04T05:40:59.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-04T05:40:59.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:40:59.716 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-04T05:40:59.961 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:40:59.961 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-04T05:41:00.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:41:00.171 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-04T05:41:00.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:41:00.350 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-04T05:41:00.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:41:00.534 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-04T05:41:00.817 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:41:00.817 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-04T05:41:00.981 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:41:00.982 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-04T05:41:01.139 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:41:01.139 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-04T05:41:01.314 INFO:tasks.ceph:Archiving mon data... 2023-12-04T05:41:01.318 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/data/mon.a.tgz 2023-12-04T05:41:01.318 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2023-12-04T05:41:01.328 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.PmUv5ehL7P 2023-12-04T05:41:01.329 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PmUv5ehL7P 2023-12-04T05:41:01.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.PmUv5ehL7P 2023-12-04T05:41:01.560 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.PmUv5ehL7P is 447KB 2023-12-04T05:41:01.625 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.PmUv5ehL7P 2023-12-04T05:41:01.634 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/data/mon.b.tgz 2023-12-04T05:41:01.634 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-04T05:41:01.643 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.s3jPRuU9er 2023-12-04T05:41:01.644 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.s3jPRuU9er 2023-12-04T05:41:01.825 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.s3jPRuU9er 2023-12-04T05:41:01.903 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.s3jPRuU9er is 579KB 2023-12-04T05:41:01.969 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.s3jPRuU9er 2023-12-04T05:41:01.978 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/data/mon.c.tgz 2023-12-04T05:41:01.978 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2023-12-04T05:41:02.027 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.fnSQb5jV5O 2023-12-04T05:41:02.027 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fnSQb5jV5O 2023-12-04T05:41:02.206 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.fnSQb5jV5O 2023-12-04T05:41:02.283 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.fnSQb5jV5O is 579KB 2023-12-04T05:41:02.349 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.fnSQb5jV5O 2023-12-04T05:41:02.358 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-04T05:41:02.358 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-04T05:41:02.362 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-04T05:41:02.422 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-04T05:41:02.423 DEBUG:teuthology.orchestra.run.smithi097:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-04T05:41:02.430 DEBUG:teuthology.orchestra.run.smithi143:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-04T05:41:02.468 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-04T05:41:02.505 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-04T05:41:02.512 INFO:tasks.ceph:Archiving crash dumps... 2023-12-04T05:41:02.513 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi097/crash 2023-12-04T05:41:02.515 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-04T05:41:02.540 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi143/crash 2023-12-04T05:41:02.541 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-04T05:41:02.578 INFO:tasks.ceph:Shutting down logrotate 2023-12-04T05:41:02.578 DEBUG:teuthology.orchestra.run.smithi097:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:41:02.586 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T05:41:02.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-04T05:41:02.701 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-04T05:41:02.721 INFO:tasks.ceph:Compressing logs... 2023-12-04T05:41:02.721 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-04T05:41:02.746 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-04T05:41:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56924.log 2023-12-04T05:41:02.787 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2023-12-04T05:41:02.788 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55431.log 2023-12-04T05:41:02.788 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56924.log.gz 2023-12-04T05:41:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2023-12-04T05:41:02.789 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz 2023-12-04T05:41:02.790 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44703.log 2023-12-04T05:41:02.790 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56243.log 2023-12-04T05:41:02.790 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55431.log.gz 2023-12-04T05:41:02.792 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44553.log 2023-12-04T05:41:02.792 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44703.log.gz 2023-12-04T05:41:02.792 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44405.log 2023-12-04T05:41:02.792 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47111.log 2023-12-04T05:41:02.792 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2023-12-04T05:41:02.794 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48110.log 2023-12-04T05:41:02.794 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56243.log.gz 2023-12-04T05:41:02.794 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53587.log 2023-12-04T05:41:02.794 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47111.log.gz 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44553.log.gz 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38534.log 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44405.log.gz 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38414.log 2023-12-04T05:41:02.795 INFO:teuthology.orchestra.run.smithi143.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38534.log.gz 2023-12-04T05:41:02.797 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-04T05:41:02.797 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2023-12-04T05:41:02.797 INFO:teuthology.orchestra.run.smithi143.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38414.log.gz 2023-12-04T05:41:02.797 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44273.log 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48110.log.gz 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53587.log.gz 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2023-12-04T05:41:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45884.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2023-12-04T05:41:02.800 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44688.log 2023-12-04T05:41:02.800 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52429.log 2023-12-04T05:41:02.800 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2023-12-04T05:41:02.802 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44688.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44688.log.gz 2023-12-04T05:41:02.802 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2023-12-04T05:41:02.802 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52429.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.52429.log.gz 2023-12-04T05:41:02.802 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52014.log 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44747.log 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44273.log.gz 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44747.log.gz 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-04T05:41:02.804 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2023-12-04T05:41:02.805 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44597.log 2023-12-04T05:41:02.805 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2023-12-04T05:41:02.805 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44597.log.gz 2023-12-04T05:41:02.805 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-04T05:41:02.807 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2023-12-04T05:41:02.807 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-04T05:41:02.807 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49695.log 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52014.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.52014.log.gz 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49695.log.gz 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46290.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2023-12-04T05:41:02.809 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46368.log 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44580.log 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46368.log.gz 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz -- 2023-12-04T05:41:02.810 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-mgr.y.log 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38390.log 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38390.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-04T05:41:02.813 INFO:teuthology.orchestra.run.smithi143.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38390.log.gz 2023-12-04T05:41:02.814 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44580.log.gz 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50620.log 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49825.log 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47547.log 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50620.log.gz 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45164.log 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49825.log.gz 2023-12-04T05:41:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2023-12-04T05:41:02.816 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47547.log.gz 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53197.log 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45164.log.gz 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45171.log: gzip -5 87.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-client.admin.46630.log 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53197.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.53197.log.gz --verbose 2023-12-04T05:41:02.818 INFO:teuthology.orchestra.run.smithi097.stderr: -- /var/log/ceph/ceph-client.admin.45387.log 2023-12-04T05:41:02.819 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-04T05:41:02.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.44804.log 2023-12-04T05:41:02.819 INFO:teuthology.orchestra.run.smithi143.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-04T05:41:02.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.b.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-04T05:41:02.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-04T05:41:02.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.testuser.44804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.44804.log.gz 2023-12-04T05:41:02.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38510.log 2023-12-04T05:41:02.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-04T05:41:02.821 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38510.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38510.log.gz 2023-12-04T05:41:02.822 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56690.log 2023-12-04T05:41:02.822 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45387.log.gz 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56690.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.56690.log.gz -- 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-client.admin.50728.log 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50080.log 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50728.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.50728.log.gz --verbose 2023-12-04T05:41:02.823 INFO:teuthology.orchestra.run.smithi097.stderr: -- /var/log/ceph/ceph-client.admin.56716.log 2023-12-04T05:41:02.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44449.log 2023-12-04T05:41:02.825 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54909.log 2023-12-04T05:41:02.825 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50080.log.gz 2023-12-04T05:41:02.825 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48188.log 2023-12-04T05:41:02.825 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56716.log.gz 2023-12-04T05:41:02.826 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38486.log 2023-12-04T05:41:02.827 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.44449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44449.log.gz 2023-12-04T05:41:02.827 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49799.log 2023-12-04T05:41:02.827 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54909.log.gz 2023-12-04T05:41:02.828 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2023-12-04T05:41:02.828 INFO:teuthology.orchestra.run.smithi097.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48188.log.gz 2023-12-04T05:41:02.828 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49799.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49799.log.gz 2023-12-04T05:41:02.828 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54564.log 2023-12-04T05:41:02.828 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55808.log 2023-12-04T05:41:02.829 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2023-12-04T05:41:02.829 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54564.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54564.log.gz 2023-12-04T05:41:02.830 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2023-12-04T05:41:02.831 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55808.log.gz 2023-12-04T05:41:02.831 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50359.log 2023-12-04T05:41:02.832 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2023-12-04T05:41:02.832 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-04T05:41:02.833 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.38486.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38486.log.gz 2023-12-04T05:41:02.833 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50359.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50359.log.gz 2023-12-04T05:41:02.833 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2023-12-04T05:41:02.834 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48082.log 2023-12-04T05:41:02.835 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49124.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2023-12-04T05:41:02.835 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49721.log 2023-12-04T05:41:02.836 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48082.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48082.log.gz 2023-12-04T05:41:02.836 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49591.log 2023-12-04T05:41:02.838 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49721.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2023-12-04T05:41:02.838 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2023-12-04T05:41:02.839 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49591.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49591.log.gz 2023-12-04T05:41:02.839 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55405.log 2023-12-04T05:41:02.840 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50002.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2023-12-04T05:41:02.840 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47085.log 2023-12-04T05:41:02.841 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55405.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55405.log.gz 2023-12-04T05:41:02.841 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47371.log 2023-12-04T05:41:02.842 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47085.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47085.log.gz 2023-12-04T05:41:02.842 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48860.log 2023-12-04T05:41:02.843 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2023-12-04T05:41:02.844 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47371.log.gz 2023-12-04T05:41:02.845 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48860.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48860.log.gz 2023-12-04T05:41:02.845 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53730.log 2023-12-04T05:41:02.846 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46498.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2023-12-04T05:41:02.846 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2023-12-04T05:41:02.847 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53730.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53730.log.gz 2023-12-04T05:41:02.847 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48284.log 2023-12-04T05:41:02.848 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47785.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2023-12-04T05:41:02.848 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2023-12-04T05:41:02.849 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.48284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48284.log.gz 2023-12-04T05:41:02.849 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2023-12-04T05:41:02.850 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50816.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2023-12-04T05:41:02.851 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2023-12-04T05:41:02.852 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48990.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2023-12-04T05:41:02.852 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2023-12-04T05:41:02.853 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44968.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2023-12-04T05:41:02.853 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49565.log 2023-12-04T05:41:02.854 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2023-12-04T05:41:02.854 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47729.log 2023-12-04T05:41:02.854 INFO:teuthology.orchestra.run.smithi143.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-04T05:41:02.855 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49565.log.gz 2023-12-04T05:41:02.855 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56016.log 2023-12-04T05:41:02.856 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2023-12-04T05:41:02.856 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47729.log.gz 2023-12-04T05:41:02.857 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56016.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56016.log.gz 2023-12-04T05:41:02.857 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2023-12-04T05:41:02.858 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54238.log 2023-12-04T05:41:02.859 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2023-12-04T05:41:02.860 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz /var/log/ceph/ceph-client.admin.48572.log 2023-12-04T05:41:02.860 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:02.861 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2023-12-04T05:41:02.861 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54238.log.gz 2023-12-04T05:41:02.862 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48572.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz 2023-12-04T05:41:02.862 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55071.log 2023-12-04T05:41:02.864 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49617.log 2023-12-04T05:41:02.864 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2023-12-04T05:41:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55071.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55071.log.gz 2023-12-04T05:41:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52639.log 2023-12-04T05:41:02.866 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44922.log 2023-12-04T05:41:02.866 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49617.log.gz 2023-12-04T05:41:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52639.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52639.log.gz 2023-12-04T05:41:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56768.log 2023-12-04T05:41:02.869 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51372.log 2023-12-04T05:41:02.869 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44922.log.gz 2023-12-04T05:41:02.869 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56768.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56768.log.gz 2023-12-04T05:41:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2023-12-04T05:41:02.870 INFO:teuthology.orchestra.run.smithi097.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-04T05:41:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49872.log 2023-12-04T05:41:02.871 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51372.log.gz 2023-12-04T05:41:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47677.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2023-12-04T05:41:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55938.log 2023-12-04T05:41:02.873 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2023-12-04T05:41:02.873 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49872.log.gz 2023-12-04T05:41:02.874 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53275.log 2023-12-04T05:41:02.874 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55938.log.gz 2023-12-04T05:41:02.875 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53223.log 2023-12-04T05:41:02.875 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2023-12-04T05:41:02.876 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53275.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53275.log.gz 2023-12-04T05:41:02.876 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56191.log 2023-12-04T05:41:02.877 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52325.log 2023-12-04T05:41:02.877 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53223.log.gz 2023-12-04T05:41:02.878 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55353.log 2023-12-04T05:41:02.878 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56191.log.gz 2023-12-04T05:41:02.879 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2023-12-04T05:41:02.879 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52325.log.gz 2023-12-04T05:41:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55353.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55353.log.gz 2023-12-04T05:41:02.880 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50894.log 2023-12-04T05:41:02.881 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2023-12-04T05:41:02.881 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2023-12-04T05:41:02.882 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2023-12-04T05:41:02.882 INFO:teuthology.orchestra.run.smithi097.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50894.log.gz 2023-12-04T05:41:02.883 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46186.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33396.log 2023-12-04T05:41:02.883 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2023-12-04T05:41:02.884 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47267.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2023-12-04T05:41:02.884 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2023-12-04T05:41:02.885 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.tmp-client.admin.33396.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33396.log.gz 2023-12-04T05:41:02.885 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2023-12-04T05:41:02.886 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2023-12-04T05:41:02.886 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2023-12-04T05:41:02.887 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2023-12-04T05:41:02.887 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2023-12-04T05:41:02.888 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2023-12-04T05:41:02.888 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2023-12-04T05:41:02.889 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47293.log 89.4% 2023-12-04T05:41:02.889 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz 2023-12-04T05:41:02.890 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2023-12-04T05:41:02.890 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2023-12-04T05:41:02.891 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47293.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.47293.log.gz --verbose 2023-12-04T05:41:02.891 INFO:teuthology.orchestra.run.smithi097.stderr: -- /var/log/ceph/ceph-client.admin.46316.log 2023-12-04T05:41:02.892 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2023-12-04T05:41:02.892 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2023-12-04T05:41:02.893 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49150.log 2023-12-04T05:41:02.893 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46316.log.gz 2023-12-04T05:41:02.894 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2023-12-04T05:41:02.894 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2023-12-04T05:41:02.895 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56976.log 2023-12-04T05:41:02.895 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49150.log.gz 2023-12-04T05:41:02.896 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47319.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-04T05:41:02.896 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2023-12-04T05:41:02.897 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2023-12-04T05:41:02.897 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56976.log.gz 2023-12-04T05:41:02.898 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53613.log 2023-12-04T05:41:02.899 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49331.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2023-12-04T05:41:02.899 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53782.log 2023-12-04T05:41:02.900 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53613.log.gz 2023-12-04T05:41:02.900 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46212.log 2023-12-04T05:41:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53782.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gz 2023-12-04T05:41:02.901 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2023-12-04T05:41:02.902 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46212.log.gz 2023-12-04T05:41:02.903 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53443.log 2023-12-04T05:41:02.903 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44740.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2023-12-04T05:41:02.904 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2023-12-04T05:41:02.905 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53443.log.gz 2023-12-04T05:41:02.905 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57159.log 2023-12-04T05:41:02.906 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51594.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2023-12-04T05:41:02.906 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2023-12-04T05:41:02.907 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57159.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57159.log.gz 2023-12-04T05:41:02.907 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51104.log 2023-12-04T05:41:02.908 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55039.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2023-12-04T05:41:02.908 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2023-12-04T05:41:02.909 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51104.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51104.log.gz 2023-12-04T05:41:02.909 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56165.log 2023-12-04T05:41:02.910 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45390.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2023-12-04T05:41:02.910 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2023-12-04T05:41:02.911 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56165.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56165.log.gz 2023-12-04T05:41:02.911 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48652.log 2023-12-04T05:41:02.912 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50255.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2023-12-04T05:41:02.912 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2023-12-04T05:41:02.913 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48652.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48652.log.gz 2023-12-04T05:41:02.913 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54590.log 2023-12-04T05:41:02.914 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2023-12-04T05:41:02.914 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2023-12-04T05:41:02.915 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54590.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54590.log.gz 2023-12-04T05:41:02.916 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56872.log 2023-12-04T05:41:02.916 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50054.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2023-12-04T05:41:02.917 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-12-04T05:41:02.918 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56872.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56872.log.gz 2023-12-04T05:41:02.918 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55644.log 2023-12-04T05:41:02.919 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47241.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-12-04T05:41:02.919 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44976.log 2023-12-04T05:41:02.920 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53301.log 2023-12-04T05:41:02.920 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55644.log.gz 2023-12-04T05:41:02.921 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44976.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44976.log.gz 2023-12-04T05:41:02.921 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51226.log 2023-12-04T05:41:02.922 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53301.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53301.log.gz 2023-12-04T05:41:02.922 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54853.log 2023-12-04T05:41:02.922 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.51226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51226.log.gz 2023-12-04T05:41:02.923 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2023-12-04T05:41:02.924 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54853.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54853.log.gz 2023-12-04T05:41:02.924 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-04T05:41:02.925 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50672.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2023-12-04T05:41:02.925 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52795.log 2023-12-04T05:41:02.926 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55592.log 2023-12-04T05:41:02.928 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52795.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52795.log.gz 2023-12-04T05:41:02.928 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2023-12-04T05:41:02.929 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55592.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55592.log.gz 2023-12-04T05:41:02.929 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53126.log 2023-12-04T05:41:02.930 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45650.log 2023-12-04T05:41:02.930 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2023-12-04T05:41:02.932 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53126.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53126.log.gz 2023-12-04T05:41:02.932 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53756.log 2023-12-04T05:41:02.933 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45650.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2023-12-04T05:41:02.933 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47573.log 2023-12-04T05:41:02.934 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2023-12-04T05:41:02.934 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53756.log.gz 2023-12-04T05:41:02.936 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46578.log 2023-12-04T05:41:02.936 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47573.log.gz 2023-12-04T05:41:02.937 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46017.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2023-12-04T05:41:02.937 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2023-12-04T05:41:02.938 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54694.log 2023-12-04T05:41:02.939 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46578.log.gz 2023-12-04T05:41:02.940 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49513.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2023-12-04T05:41:02.940 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47059.log 2023-12-04T05:41:02.941 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54694.log.gz 2023-12-04T05:41:02.941 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2023-12-04T05:41:02.942 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2023-12-04T05:41:02.943 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47059.log.gz 2023-12-04T05:41:02.943 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45180.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2023-12-04T05:41:02.944 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49176.log 2023-12-04T05:41:02.945 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56820.log 2023-12-04T05:41:02.945 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2023-12-04T05:41:02.946 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49176.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49176.log.gz 2023-12-04T05:41:02.946 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56217.log 2023-12-04T05:41:02.948 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56820.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56820.log.gz 2023-12-04T05:41:02.948 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2023-12-04T05:41:02.949 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56217.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56217.log.gz 2023-12-04T05:41:02.949 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2023-12-04T05:41:02.950 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48456.log 2023-12-04T05:41:02.951 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2023-12-04T05:41:02.952 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44423.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2023-12-04T05:41:02.952 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2023-12-04T05:41:02.953 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48456.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2023-12-04T05:41:02.953 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53074.log 2023-12-04T05:41:02.954 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2023-12-04T05:41:02.955 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2023-12-04T05:41:02.956 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53074.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53074.log.gz 2023-12-04T05:41:02.956 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2023-12-04T05:41:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51802.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2023-12-04T05:41:02.957 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46955.log 2023-12-04T05:41:02.962 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46955.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46955.log.gz 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50920.log 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50920.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50920.log.gz 2023-12-04T05:41:02.963 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2023-12-04T05:41:02.964 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52665.log 2023-12-04T05:41:02.964 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2023-12-04T05:41:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48964.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2023-12-04T05:41:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2023-12-04T05:41:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50700.log 2023-12-04T05:41:02.966 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52665.log.gz 2023-12-04T05:41:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48808.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2023-12-04T05:41:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51620.log 2023-12-04T05:41:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2023-12-04T05:41:02.969 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50700.log.gz 2023-12-04T05:41:02.969 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51620.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51620.log.gz 2023-12-04T05:41:02.970 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2023-12-04T05:41:02.971 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2023-12-04T05:41:02.971 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2023-12-04T05:41:02.972 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51424.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2023-12-04T05:41:02.972 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48056.log 2023-12-04T05:41:02.973 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49487.log 2023-12-04T05:41:02.974 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2023-12-04T05:41:02.974 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48056.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48056.log.gz 2023-12-04T05:41:02.975 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2023-12-04T05:41:02.976 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2023-12-04T05:41:02.976 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49487.log.gz 2023-12-04T05:41:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45728.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2023-12-04T05:41:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56794.log 2023-12-04T05:41:02.978 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55964.log 2023-12-04T05:41:02.979 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2023-12-04T05:41:02.979 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56794.log.gz 2023-12-04T05:41:02.980 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49773.log 2023-12-04T05:41:02.980 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2023-12-04T05:41:02.981 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55964.log.gz 2023-12-04T05:41:02.982 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49773.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49773.log.gz 2023-12-04T05:41:02.982 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2023-12-04T05:41:02.983 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2023-12-04T05:41:02.984 INFO:teuthology.orchestra.run.smithi097.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2023-12-04T05:41:02.985 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50646.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2023-12-04T05:41:02.985 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2023-12-04T05:41:02.986 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2023-12-04T05:41:02.986 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2023-12-04T05:41:02.988 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44714.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2023-12-04T05:41:02.988 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51958.log 2023-12-04T05:41:02.989 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48624.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2023-12-04T05:41:02.989 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2023-12-04T05:41:02.990 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51958.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.51958.log.gz -5 2023-12-04T05:41:02.991 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51180.log 2023-12-04T05:41:02.992 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44636.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2023-12-04T05:41:02.992 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56586.log 2023-12-04T05:41:02.993 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52273.log 2023-12-04T05:41:02.994 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51180.log.gz 2023-12-04T05:41:02.995 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56586.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56586.log.gz 2023-12-04T05:41:02.995 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2023-12-04T05:41:02.996 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56470.log 2023-12-04T05:41:02.996 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52273.log.gz 2023-12-04T05:41:02.997 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48378.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2023-12-04T05:41:02.998 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2023-12-04T05:41:02.999 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2023-12-04T05:41:02.999 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56470.log.gz 2023-12-04T05:41:03.000 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46604.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2023-12-04T05:41:03.000 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2023-12-04T05:41:03.002 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2023-12-04T05:41:03.002 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48912.log 2023-12-04T05:41:03.003 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2023-12-04T05:41:03.003 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50567.log 2023-12-04T05:41:03.004 INFO:teuthology.orchestra.run.smithi143.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-04T05:41:03.005 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48912.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48912.log.gz 2023-12-04T05:41:03.005 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54432.log 2023-12-04T05:41:03.006 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52202.log 2023-12-04T05:41:03.006 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50567.log.gz 2023-12-04T05:41:03.007 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54432.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54432.log.gz 2023-12-04T05:41:03.007 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2023-12-04T05:41:03.009 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52202.log.gz 2023-12-04T05:41:03.009 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56321.log 2023-12-04T05:41:03.011 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51540.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gzgzip 2023-12-04T05:41:03.011 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45183.log 2023-12-04T05:41:03.012 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56321.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.56321.log.gz 2023-12-04T05:41:03.012 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56139.log 2023-12-04T05:41:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45183.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45183.log.gz 2023-12-04T05:41:03.013 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2023-12-04T05:41:03.015 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2023-12-04T05:41:03.015 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56139.log.gz 2023-12-04T05:41:03.016 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2023-12-04T05:41:03.016 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51346.log 2023-12-04T05:41:03.018 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56295.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2023-12-04T05:41:03.018 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46264.log 2023-12-04T05:41:03.018 INFO:teuthology.orchestra.run.smithi143.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-04T05:41:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51346.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51346.log.gz 2023-12-04T05:41:03.019 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2023-12-04T05:41:03.021 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54346.log 2023-12-04T05:41:03.021 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46264.log.gz 2023-12-04T05:41:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49976.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2023-12-04T05:41:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46820.log 2023-12-04T05:41:03.023 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50974.log 2023-12-04T05:41:03.023 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54346.log.gz 2023-12-04T05:41:03.024 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46820.log.gz 2023-12-04T05:41:03.024 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2023-12-04T05:41:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51566.log 2023-12-04T05:41:03.026 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50974.log.gz 2023-12-04T05:41:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50028.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2023-12-04T05:41:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2023-12-04T05:41:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51566.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51566.log.gz 2023-12-04T05:41:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50385.log 2023-12-04T05:41:03.030 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46656.log 2023-12-04T05:41:03.030 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2023-12-04T05:41:03.031 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50385.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50385.log.gz 2023-12-04T05:41:03.031 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52144.log 2023-12-04T05:41:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46656.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46656.log.gz 2023-12-04T05:41:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-04T05:41:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52144.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52144.log.gz 2023-12-04T05:41:03.034 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54935.log 2023-12-04T05:41:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2023-12-04T05:41:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53942.log 2023-12-04T05:41:03.037 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54935.log.gz 2023-12-04T05:41:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52481.log 2023-12-04T05:41:03.039 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2023-12-04T05:41:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53942.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53942.log.gz 2023-12-04T05:41:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50868.log 2023-12-04T05:41:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47926.log 2023-12-04T05:41:03.042 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52481.log.gz 2023-12-04T05:41:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2023-12-04T05:41:03.043 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50868.log.gz 2023-12-04T05:41:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 87.8% 2023-12-04T05:41:03.045 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47926.log.gz 2023-12-04T05:41:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52613.log 2023-12-04T05:41:03.046 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2023-12-04T05:41:03.047 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51398.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2023-12-04T05:41:03.047 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2023-12-04T05:41:03.049 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2023-12-04T05:41:03.049 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52613.log.gz 2023-12-04T05:41:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51078.log 2023-12-04T05:41:03.050 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2023-12-04T05:41:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2023-12-04T05:41:03.052 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz 2023-12-04T05:41:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51078.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.51078.log.gz --verbose 2023-12-04T05:41:03.053 INFO:teuthology.orchestra.run.smithi097.stderr: -- /var/log/ceph/ceph-client.admin.45858.log 2023-12-04T05:41:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2023-12-04T05:41:03.055 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2023-12-04T05:41:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55670.log 2023-12-04T05:41:03.056 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45858.log.gz 2023-12-04T05:41:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49669.log 2023-12-04T05:41:03.058 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2023-12-04T05:41:03.059 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56068.log 2023-12-04T05:41:03.059 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55670.log.gz 2023-12-04T05:41:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2023-12-04T05:41:03.060 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49669.log.gz 2023-12-04T05:41:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2023-12-04T05:41:03.062 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56068.log.gz 2023-12-04T05:41:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45702.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz -5 2023-12-04T05:41:03.063 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2023-12-04T05:41:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53916.log 2023-12-04T05:41:03.065 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2023-12-04T05:41:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55271.log 2023-12-04T05:41:03.066 INFO:teuthology.orchestra.run.smithi097.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2023-12-04T05:41:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53916.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53916.log.gz 2023-12-04T05:41:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2023-12-04T05:41:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55271.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55271.log.gz 2023-12-04T05:41:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2023-12-04T05:41:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2023-12-04T05:41:03.071 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2023-12-04T05:41:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2023-12-04T05:41:03.073 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2023-12-04T05:41:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56496.log 2023-12-04T05:41:03.074 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz 2023-12-04T05:41:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2023-12-04T05:41:03.075 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2023-12-04T05:41:03.076 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-04T05:41:03.077 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56496.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-04T05:41:03.077 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56496.log.gz 2023-12-04T05:41:03.078 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55193.log 2023-12-04T05:41:03.079 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2023-12-04T05:41:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51242.log 2023-12-04T05:41:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54746.log 2023-12-04T05:41:03.081 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55193.log.gz 2023-12-04T05:41:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54827.log 2023-12-04T05:41:03.083 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51242.log.gz 2023-12-04T05:41:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56522.log 2023-12-04T05:41:03.084 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54746.log.gz 2023-12-04T05:41:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2023-12-04T05:41:03.086 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54827.log.gz 2023-12-04T05:41:03.087 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56522.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56522.log.gz 2023-12-04T05:41:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2023-12-04T05:41:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46238.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gz 2023-12-04T05:41:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2023-12-04T05:41:03.091 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2023-12-04T05:41:03.091 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2023-12-04T05:41:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2023-12-04T05:41:03.094 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56638.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2023-12-04T05:41:03.094 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2023-12-04T05:41:03.095 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54406.log 2023-12-04T05:41:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2023-12-04T05:41:03.097 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2023-12-04T05:41:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54406.log.gz 2023-12-04T05:41:03.099 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2023-12-04T05:41:03.100 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47846.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2023-12-04T05:41:03.100 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52996.log 2023-12-04T05:41:03.102 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2023-12-04T05:41:03.102 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2023-12-04T05:41:03.103 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52996.log.gz 2023-12-04T05:41:03.103 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2023-12-04T05:41:03.104 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2023-12-04T05:41:03.105 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50762.log 2023-12-04T05:41:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2023-12-04T05:41:03.106 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2023-12-04T05:41:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53560.log 2023-12-04T05:41:03.108 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50762.log.gz 2023-12-04T05:41:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49924.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2023-12-04T05:41:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53560.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53560.log.gz 2023-12-04T05:41:03.111 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55834.log 2023-12-04T05:41:03.112 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2023-12-04T05:41:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52535.log 2023-12-04T05:41:03.114 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55834.log.gz 2023-12-04T05:41:03.116 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2023-12-04T05:41:03.116 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz 2023-12-04T05:41:03.117 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53379.log 2023-12-04T05:41:03.117 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52535.log.gz 2023-12-04T05:41:03.118 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52377.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2023-12-04T05:41:03.118 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2023-12-04T05:41:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2023-12-04T05:41:03.120 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2023-12-04T05:41:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48300.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2023-12-04T05:41:03.122 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2023-12-04T05:41:03.123 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45383.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gzgzip 2023-12-04T05:41:03.123 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2023-12-04T05:41:03.124 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51724.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2023-12-04T05:41:03.124 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51984.log 2023-12-04T05:41:03.126 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49643.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2023-12-04T05:41:03.126 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54108.log 2023-12-04T05:41:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53327.log 2023-12-04T05:41:03.128 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51984.log.gz 2023-12-04T05:41:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2023-12-04T05:41:03.129 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54108.log.gz 2023-12-04T05:41:03.130 INFO:teuthology.orchestra.run.smithi143.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-04T05:41:03.130 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53327.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.55728.log -- replaced with /var/log/ceph/ceph-client.admin.53327.log.gz 2023-12-04T05:41:03.131 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.132 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2023-12-04T05:41:03.132 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2023-12-04T05:41:03.133 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55728.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55728.log.gz 2023-12-04T05:41:03.133 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2023-12-04T05:41:03.135 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2023-12-04T05:41:03.135 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2023-12-04T05:41:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47345.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2023-12-04T05:41:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2023-12-04T05:41:03.138 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55990.log 2023-12-04T05:41:03.138 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2023-12-04T05:41:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54961.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2023-12-04T05:41:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57054.log 2023-12-04T05:41:03.141 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57002.log 2023-12-04T05:41:03.141 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55990.log.gz 2023-12-04T05:41:03.142 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57054.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57054.log.gz 2023-12-04T05:41:03.143 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48886.log 2023-12-04T05:41:03.143 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57002.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57002.log.gz 2023-12-04T05:41:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56399.log 2023-12-04T05:41:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48886.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48886.log.gz 2023-12-04T05:41:03.146 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56269.log 2023-12-04T05:41:03.147 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2023-12-04T05:41:03.147 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56399.log.gz 2023-12-04T05:41:03.148 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56269.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56269.log.gz 2023-12-04T05:41:03.149 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54642.log 2023-12-04T05:41:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45676.log 2023-12-04T05:41:03.150 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gz 2023-12-04T05:41:03.152 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54642.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-04T05:41:03.152 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54642.log.gz 2023-12-04T05:41:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45676.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz -5 2023-12-04T05:41:03.154 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53994.log 2023-12-04T05:41:03.155 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2023-12-04T05:41:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53994.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-04T05:41:03.159 INFO:teuthology.orchestra.run.smithi097.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2023-12-04T05:41:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48678.log 2023-12-04T05:41:03.160 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2023-12-04T05:41:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2023-12-04T05:41:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48678.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48678.log.gz 2023-12-04T05:41:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50443.log 2023-12-04T05:41:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2023-12-04T05:41:03.162 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2023-12-04T05:41:03.166 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55457.log 2023-12-04T05:41:03.166 INFO:teuthology.orchestra.run.smithi097.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50443.log.gz 2023-12-04T05:41:03.166 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48326.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2023-12-04T05:41:03.166 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2023-12-04T05:41:03.167 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55457.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.55457.log.gz /var/log/ceph/ceph-client.testuser.49289.log 2023-12-04T05:41:03.167 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.168 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2023-12-04T05:41:03.168 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2023-12-04T05:41:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.testuser.49289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.49289.log.gz 2023-12-04T05:41:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53249.log 2023-12-04T05:41:03.172 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44870.log 2023-12-04T05:41:03.172 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2023-12-04T05:41:03.172 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2023-12-04T05:41:03.172 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53249.log.gz 2023-12-04T05:41:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54318.log 2023-12-04T05:41:03.174 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44870.log.gz 2023-12-04T05:41:03.174 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-04T05:41:03.175 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2023-12-04T05:41:03.175 INFO:teuthology.orchestra.run.smithi097.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2023-12-04T05:41:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54318.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54318.log.gz 2023-12-04T05:41:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44973.log 2023-12-04T05:41:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2023-12-04T05:41:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2023-12-04T05:41:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44973.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44973.log.gz 2023-12-04T05:41:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52866.log 2023-12-04T05:41:03.182 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2023-12-04T05:41:03.182 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2023-12-04T05:41:03.183 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52866.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52866.log.gz -5 2023-12-04T05:41:03.183 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52587.log 2023-12-04T05:41:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56612.log 2023-12-04T05:41:03.185 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2023-12-04T05:41:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52587.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2023-12-04T05:41:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52118.log 2023-12-04T05:41:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53696.log 2023-12-04T05:41:03.188 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56612.log.gz 2023-12-04T05:41:03.189 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52118.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52118.log.gz 2023-12-04T05:41:03.189 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2023-12-04T05:41:03.191 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56373.log 2023-12-04T05:41:03.191 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53696.log.gz 2023-12-04T05:41:03.192 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51026.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2023-12-04T05:41:03.192 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2023-12-04T05:41:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54186.log 2023-12-04T05:41:03.194 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56373.log.gz 2023-12-04T05:41:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55013.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2023-12-04T05:41:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2023-12-04T05:41:03.197 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57028.log 2023-12-04T05:41:03.197 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54186.log.gz 2023-12-04T05:41:03.197 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-04T05:41:03.198 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47900.log 2023-12-04T05:41:03.198 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2023-12-04T05:41:03.199 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57028.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57028.log.gz 2023-12-04T05:41:03.199 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2023-12-04T05:41:03.200 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-04T05:41:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47900.log.gz 2023-12-04T05:41:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54486.log 2023-12-04T05:41:03.203 INFO:teuthology.orchestra.run.smithi143.stderr: 2023-12-04T05:41:03.203 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m0.432s 2023-12-04T05:41:03.203 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m1.674s 2023-12-04T05:41:03.203 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m0.227s 2023-12-04T05:41:03.204 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45806.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2023-12-04T05:41:03.204 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2023-12-04T05:41:03.204 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54486.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.54486.log.gz /var/log/ceph/ceph-client.admin.54616.log 2023-12-04T05:41:03.204 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.206 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47007.log 2023-12-04T05:41:03.206 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2023-12-04T05:41:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54616.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2023-12-04T05:41:03.207 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2023-12-04T05:41:03.208 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47007.log.gz 2023-12-04T05:41:03.209 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49357.log 2023-12-04T05:41:03.209 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51294.log 2023-12-04T05:41:03.210 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2023-12-04T05:41:03.211 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49357.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49357.log.gz 2023-12-04T05:41:03.212 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48030.log 2023-12-04T05:41:03.212 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51294.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51294.log.gz 2023-12-04T05:41:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2023-12-04T05:41:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48030.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48030.log.gz 2023-12-04T05:41:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2023-12-04T05:41:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52299.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2023-12-04T05:41:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52509.log 2023-12-04T05:41:03.218 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44358.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2023-12-04T05:41:03.218 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49539.log 2023-12-04T05:41:03.219 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52509.log.gz 2023-12-04T05:41:03.219 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2023-12-04T05:41:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49539.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49539.log.gz 2023-12-04T05:41:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47952.log 2023-12-04T05:41:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45364.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2023-12-04T05:41:03.223 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48238.log 2023-12-04T05:41:03.223 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-04T05:41:03.224 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47952.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47952.log.gz 2023-12-04T05:41:03.224 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52403.log 2023-12-04T05:41:03.225 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2023-12-04T05:41:03.225 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48238.log.gz 2023-12-04T05:41:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52403.log.gz 2023-12-04T05:41:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52691.log 2023-12-04T05:41:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54460.log 2023-12-04T05:41:03.227 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2023-12-04T05:41:03.228 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52691.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52691.log.gz 2023-12-04T05:41:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2023-12-04T05:41:03.230 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55860.log 2023-12-04T05:41:03.230 INFO:teuthology.orchestra.run.smithi097.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54460.log.gz 2023-12-04T05:41:03.231 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52040.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2023-12-04T05:41:03.231 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2023-12-04T05:41:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48136.log 2023-12-04T05:41:03.233 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55860.log.gz 2023-12-04T05:41:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2023-12-04T05:41:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55323.log 2023-12-04T05:41:03.234 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55780.log 2023-12-04T05:41:03.234 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48136.log.gz 2023-12-04T05:41:03.235 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55323.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55323.log.gz 2023-12-04T05:41:03.235 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2023-12-04T05:41:03.236 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2023-12-04T05:41:03.237 INFO:teuthology.orchestra.run.smithi097.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55780.log.gz 2023-12-04T05:41:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50281.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2023-12-04T05:41:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2023-12-04T05:41:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47137.log 2023-12-04T05:41:03.239 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2023-12-04T05:41:03.240 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48430.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2023-12-04T05:41:03.240 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50158.log 2023-12-04T05:41:03.241 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53100.log 2023-12-04T05:41:03.241 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47137.log.gz 2023-12-04T05:41:03.242 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50158.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50158.log.gz 2023-12-04T05:41:03.242 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-04T05:41:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53667.log 2023-12-04T05:41:03.244 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53100.log.gz 2023-12-04T05:41:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-04T05:41:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53667.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53667.log.gz 2023-12-04T05:41:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56113.log 2023-12-04T05:41:03.246 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-04T05:41:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52892.log 2023-12-04T05:41:03.248 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56113.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56113.log.gz 2023-12-04T05:41:03.248 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2023-12-04T05:41:03.249 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54264.log 2023-12-04T05:41:03.250 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52892.log.gz 2023-12-04T05:41:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54380.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2023-12-04T05:41:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-04T05:41:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50788.log 2023-12-04T05:41:03.253 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54264.log.gz 2023-12-04T05:41:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2023-12-04T05:41:03.255 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56742.log 2023-12-04T05:41:03.255 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50788.log.gz 2023-12-04T05:41:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52717.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2023-12-04T05:41:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56347.log 2023-12-04T05:41:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56742.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56742.log.gz 2023-12-04T05:41:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2023-12-04T05:41:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2023-12-04T05:41:03.260 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56347.log.gz 2023-12-04T05:41:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56548.log 2023-12-04T05:41:03.261 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2023-12-04T05:41:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2023-12-04T05:41:03.263 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2023-12-04T05:41:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2023-12-04T05:41:03.264 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56548.log.gz 2023-12-04T05:41:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45598.log 2023-12-04T05:41:03.266 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2023-12-04T05:41:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2023-12-04T05:41:03.268 INFO:teuthology.orchestra.run.smithi097.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2023-12-04T05:41:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45598.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45598.log.gz 2023-12-04T05:41:03.269 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46524.log 2023-12-04T05:41:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51268.log 2023-12-04T05:41:03.271 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2023-12-04T05:41:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46524.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46524.log.gz 2023-12-04T05:41:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54160.log 2023-12-04T05:41:03.274 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51320.log 2023-12-04T05:41:03.274 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51268.log.gz 2023-12-04T05:41:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51932.log 2023-12-04T05:41:03.276 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54160.log.gz 2023-12-04T05:41:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46903.log 2023-12-04T05:41:03.277 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51320.log.gz 2023-12-04T05:41:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50495.log 2023-12-04T05:41:03.279 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51932.log.gz 2023-12-04T05:41:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46903.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46903.log.gz 2023-12-04T05:41:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2023-12-04T05:41:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50495.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50495.log.gz 2023-12-04T05:41:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54212.log 2023-12-04T05:41:03.283 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47757.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2023-12-04T05:41:03.283 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46420.log 2023-12-04T05:41:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54212.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54212.log.gz 2023-12-04T05:41:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55509.log 2023-12-04T05:41:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2023-12-04T05:41:03.286 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46420.log.gz 2023-12-04T05:41:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54883.log 2023-12-04T05:41:03.288 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55509.log.gz 2023-12-04T05:41:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49409.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2023-12-04T05:41:03.289 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2023-12-04T05:41:03.291 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53508.log 2023-12-04T05:41:03.291 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54883.log.gz 2023-12-04T05:41:03.293 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2023-12-04T05:41:03.293 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2023-12-04T05:41:03.294 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53508.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53508.log.gz -5 2023-12-04T05:41:03.294 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53152.log 2023-12-04T05:41:03.295 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45175.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2023-12-04T05:41:03.295 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48482.log 2023-12-04T05:41:03.296 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53152.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53152.log.gz 2023-12-04T05:41:03.297 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47651.log 2023-12-04T05:41:03.298 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48482.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.48482.log.gz 2023-12-04T05:41:03.298 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44325.log 2023-12-04T05:41:03.300 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47651.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47651.log.gz 2023-12-04T05:41:03.300 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2023-12-04T05:41:03.301 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44476.log 2023-12-04T05:41:03.302 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44325.log.gz 2023-12-04T05:41:03.303 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51052.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2023-12-04T05:41:03.303 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52351.log 2023-12-04T05:41:03.304 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48730.log 2023-12-04T05:41:03.305 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44476.log.gz 2023-12-04T05:41:03.306 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50132.log 2023-12-04T05:41:03.306 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52351.log.gz 2023-12-04T05:41:03.307 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2023-12-04T05:41:03.307 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57080.log 2023-12-04T05:41:03.308 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50132.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50132.log.gz 2023-12-04T05:41:03.309 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2023-12-04T05:41:03.310 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51646.log 2023-12-04T05:41:03.311 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57080.log.gz 2023-12-04T05:41:03.312 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52944.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2023-12-04T05:41:03.312 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2023-12-04T05:41:03.314 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51646.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51646.log.gz 2023-12-04T05:41:03.314 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2023-12-04T05:41:03.315 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44975.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2023-12-04T05:41:03.316 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48704.log 2023-12-04T05:41:03.317 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50333.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2023-12-04T05:41:03.317 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2023-12-04T05:41:03.317 INFO:teuthology.orchestra.run.smithi097.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-04T05:41:03.318 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55886.log 2023-12-04T05:41:03.319 INFO:teuthology.orchestra.run.smithi097.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48704.log.gz 2023-12-04T05:41:03.319 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44502.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2023-12-04T05:41:03.320 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55219.log 2023-12-04T05:41:03.321 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55886.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55886.log.gz 2023-12-04T05:41:03.321 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2023-12-04T05:41:03.323 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55219.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55219.log.gz 2023-12-04T05:41:03.323 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38346.log 2023-12-04T05:41:03.324 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52561.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2023-12-04T05:41:03.324 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54512.log 2023-12-04T05:41:03.326 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38346.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38346.log.gz 2023-12-04T05:41:03.326 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2023-12-04T05:41:03.327 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54512.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54512.log.gz 2023-12-04T05:41:03.328 INFO:teuthology.orchestra.run.smithi097.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-04T05:41:03.328 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2023-12-04T05:41:03.328 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45832.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2023-12-04T05:41:03.329 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55696.log 2023-12-04T05:41:03.330 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56898.log 2023-12-04T05:41:03.330 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2023-12-04T05:41:03.331 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55696.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55696.log.gz 2023-12-04T05:41:03.331 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2023-12-04T05:41:03.332 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56898.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56898.log.gz 2023-12-04T05:41:03.332 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55245.log 2023-12-04T05:41:03.333 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51854.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2023-12-04T05:41:03.333 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57185.log 2023-12-04T05:41:03.334 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55245.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55245.log.gz 2023-12-04T05:41:03.334 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56042.log 2023-12-04T05:41:03.335 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55618.log 2023-12-04T05:41:03.335 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57185.log.gz 2023-12-04T05:41:03.336 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56042.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph-client.admin.56042.log.gz /var/log/ceph/ceph-client.admin.49461.log 2023-12-04T05:41:03.336 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.337 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55618.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55618.log.gz 2023-12-04T05:41:03.337 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46446.log 2023-12-04T05:41:03.338 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49461.log.gz 2023-12-04T05:41:03.339 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57106.log 2023-12-04T05:41:03.339 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46446.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46446.log.gz 2023-12-04T05:41:03.340 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54668.log 2023-12-04T05:41:03.341 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57106.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.57106.log.gz 2023-12-04T05:41:03.341 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49950.log 2023-12-04T05:41:03.342 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54668.log.gz 2023-12-04T05:41:03.342 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51000.log 2023-12-04T05:41:03.343 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49950.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49950.log.gz /var/log/ceph/ceph-client.admin.46981.log 2023-12-04T05:41:03.343 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.344 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51000.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51000.log.gz 2023-12-04T05:41:03.344 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51480.log 2023-12-04T05:41:03.345 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46981.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46981.log.gz 2023-12-04T05:41:03.345 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2023-12-04T05:41:03.346 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51480.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51480.log.gz 2023-12-04T05:41:03.346 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2023-12-04T05:41:03.348 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51698.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2023-12-04T05:41:03.348 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2023-12-04T05:41:03.349 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46160.log 89.1% 2023-12-04T05:41:03.349 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2023-12-04T05:41:03.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44963.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2023-12-04T05:41:03.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47215.log 2023-12-04T05:41:03.351 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46160.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46160.log.gz 2023-12-04T05:41:03.351 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55754.log 2023-12-04T05:41:03.352 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47978.log 2023-12-04T05:41:03.352 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47215.log.gz 2023-12-04T05:41:03.353 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55754.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55754.log.gz 2023-12-04T05:41:03.353 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2023-12-04T05:41:03.354 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2023-12-04T05:41:03.355 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47978.log.gz 2023-12-04T05:41:03.356 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50411.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2023-12-04T05:41:03.356 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48004.log 2023-12-04T05:41:03.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47703.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2023-12-04T05:41:03.357 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2023-12-04T05:41:03.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48004.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48004.log.gz 2023-12-04T05:41:03.358 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55912.log 2023-12-04T05:41:03.359 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2023-12-04T05:41:03.359 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2023-12-04T05:41:03.361 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55912.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55912.log.gz 2023-12-04T05:41:03.361 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2023-12-04T05:41:03.361 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46794.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2023-12-04T05:41:03.362 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56664.log 2023-12-04T05:41:03.363 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2023-12-04T05:41:03.363 INFO:teuthology.orchestra.run.smithi097.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2023-12-04T05:41:03.363 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56664.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56664.log.gz 2023-12-04T05:41:03.364 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2023-12-04T05:41:03.364 INFO:teuthology.orchestra.run.smithi097.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-04T05:41:03.365 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2023-12-04T05:41:03.365 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2023-12-04T05:41:03.366 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50842.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2023-12-04T05:41:03.366 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2023-12-04T05:41:03.367 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56846.log 2023-12-04T05:41:03.367 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2023-12-04T05:41:03.368 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53812.log 2023-12-04T05:41:03.368 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2023-12-04T05:41:03.369 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53534.log 2023-12-04T05:41:03.369 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56846.log.gz 2023-12-04T05:41:03.370 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2023-12-04T05:41:03.370 INFO:teuthology.orchestra.run.smithi097.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53812.log.gz 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53534.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53534.log.gz -- 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-client.admin.45624.log 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51750.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46131.log 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45624.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53639.log 2023-12-04T05:41:03.375 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.46131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46131.log.gz 2023-12-04T05:41:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55167.log 2023-12-04T05:41:03.376 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46872.log 2023-12-04T05:41:03.376 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53639.log.gz 2023-12-04T05:41:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56950.log 2023-12-04T05:41:03.377 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55167.log.gz 2023-12-04T05:41:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46872.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2023-12-04T05:41:03.377 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.52257.log 2023-12-04T05:41:03.378 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49747.log 2023-12-04T05:41:03.379 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56950.log.gz 2023-12-04T05:41:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.testuser.52257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.52257.log.gz 2023-12-04T05:41:03.379 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55379.log 2023-12-04T05:41:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2023-12-04T05:41:03.380 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49747.log.gz 2023-12-04T05:41:03.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2023-12-04T05:41:03.380 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55379.log.gz 2023-12-04T05:41:03.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2023-12-04T05:41:03.381 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2023-12-04T05:41:03.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57135.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.55297.log -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2023-12-04T05:41:03.382 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2023-12-04T05:41:03.385 INFO:teuthology.orchestra.run.smithi097.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2023-12-04T05:41:03.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44256.log 2023-12-04T05:41:03.385 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55297.log.gz 2023-12-04T05:41:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2023-12-04T05:41:03.386 INFO:teuthology.orchestra.run.smithi097.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gz 2023-12-04T05:41:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44256.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44256.log.gz 2023-12-04T05:41:03.386 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2023-12-04T05:41:03.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44766.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2023-12-04T05:41:03.387 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55566.log 2023-12-04T05:41:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46734.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2023-12-04T05:41:03.388 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53411.log 2023-12-04T05:41:03.389 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2023-12-04T05:41:03.389 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55566.log.gz 2023-12-04T05:41:03.390 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2023-12-04T05:41:03.390 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53411.log.gz 2023-12-04T05:41:03.391 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52170.log 2023-12-04T05:41:03.392 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2023-12-04T05:41:03.392 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45376.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2023-12-04T05:41:03.393 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2023-12-04T05:41:03.393 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55141.log 2023-12-04T05:41:03.394 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52170.log.gz 2023-12-04T05:41:03.394 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54772.log 2023-12-04T05:41:03.395 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2023-12-04T05:41:03.395 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2023-12-04T05:41:03.396 INFO:teuthology.orchestra.run.smithi097.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55141.log.gz 2023-12-04T05:41:03.396 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54772.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54772.log.gz 2023-12-04T05:41:03.397 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2023-12-04T05:41:03.398 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52092.log 2023-12-04T05:41:03.398 INFO:teuthology.orchestra.run.smithi097.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2023-12-04T05:41:03.399 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48510.log 2023-12-04T05:41:03.399 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2023-12-04T05:41:03.400 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52092.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52092.log.gz -5 2023-12-04T05:41:03.400 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55540.log 2023-12-04T05:41:03.401 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46472.log 2023-12-04T05:41:03.401 INFO:teuthology.orchestra.run.smithi097.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48510.log.gz 2023-12-04T05:41:03.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55483.log 2023-12-04T05:41:03.402 INFO:teuthology.orchestra.run.smithi097.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55540.log.gz 2023-12-04T05:41:03.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2023-12-04T05:41:03.403 INFO:teuthology.orchestra.run.smithi097.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46472.log.gz 2023-12-04T05:41:03.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55483.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55483.log.gz 2023-12-04T05:41:03.404 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52840.log 2023-12-04T05:41:03.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54092.log 2023-12-04T05:41:03.405 INFO:teuthology.orchestra.run.smithi097.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2023-12-04T05:41:03.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.55126.log 2023-12-04T05:41:03.406 INFO:teuthology.orchestra.run.smithi097.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52840.log.gz 2023-12-04T05:41:03.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.54092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54092.log.gz 2023-12-04T05:41:03.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.testuser.55126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.55126.log.gz 2023-12-04T05:41:03.478 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-04T05:41:03.499 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-04T05:41:03.501 INFO:teuthology.orchestra.run.smithi097.stderr: 2023-12-04T05:41:03.501 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m0.751s 2023-12-04T05:41:03.501 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m2.526s 2023-12-04T05:41:03.501 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m1.059s 2023-12-04T05:41:03.502 INFO:tasks.ceph:Archiving logs... 2023-12-04T05:41:03.502 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi097/log 2023-12-04T05:41:03.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-04T05:41:04.177 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi143/log 2023-12-04T05:41:04.178 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-04T05:41:04.407 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-04T05:41:04.416 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-04T05:41:04.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-04T05:41:04.420 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-04T05:41:04.507 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-04T05:41:04.516 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-04T05:41:04.517 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T05:41:04.520 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 44.4.53.2 2 u 37 64 377 0.075 -1.121 0.692 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 377 0.071 -0.751 0.567 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.080 -0.219 0.568 2023-12-04T05:41:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:41:04.535 INFO:teuthology.orchestra.run.smithi143.stdout: remote refid st t when poll reach delay offset jitter 2023-12-04T05:41:04.536 INFO:teuthology.orchestra.run.smithi143.stdout:============================================================================== 2023-12-04T05:41:04.536 INFO:teuthology.orchestra.run.smithi143.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.106 -2.058 1.471 2023-12-04T05:41:04.536 INFO:teuthology.orchestra.run.smithi143.stdout:+hv02.front.sepi 63.231.80.2 3 u 37 64 377 0.077 -1.214 1.182 2023-12-04T05:41:04.536 INFO:teuthology.orchestra.run.smithi143.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.080 -0.827 1.296 2023-12-04T05:41:04.536 INFO:teuthology.orchestra.run.smithi143.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-04T05:41:04.537 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-04T05:41:04.585 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-04T05:41:04.585 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-04T05:41:04.595 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-04T05:41:04.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-04T05:41:04.616 INFO:teuthology.task.internal:Duration was 1303.781372 seconds 2023-12-04T05:41:04.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-04T05:41:04.627 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-04T05:41:04.627 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-04T05:41:04.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-04T05:41:04.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-12-04T05:41:04.631 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-04T05:41:04.716 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-04T05:41:04.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2023-12-04T05:41:04.717 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-04T05:41:04.739 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2023-12-04T05:41:04.739 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-04T05:41:04.761 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-04T05:41:04.761 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-04T05:41:04.790 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-04T05:41:04.839 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-04T05:41:04.840 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-04T05:41:04.874 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-04T05:41:04.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-04T05:41:04.961 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-04T05:41:04.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-04T05:41:04.982 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-04T05:41:05.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-04T05:41:05.017 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-04T05:41:05.026 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-04T05:41:05.040 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2023-12-04T05:41:05.064 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2023-12-04T05:41:05.082 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-04T05:41:05.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:41:05.110 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-04T05:41:05.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T05:41:05.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-04T05:41:05.145 INFO:teuthology.task.internal:Transferring archived files... 2023-12-04T05:41:05.145 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi097 2023-12-04T05:41:05.146 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-04T05:41:05.175 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632/remote/smithi143 2023-12-04T05:41:05.176 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-04T05:41:05.200 INFO:teuthology.task.internal:Removing archive directory... 2023-12-04T05:41:05.201 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-04T05:41:05.218 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-04T05:41:05.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-04T05:41:05.259 INFO:teuthology.task.internal:Not uploading archives. 2023-12-04T05:41:05.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-04T05:41:05.268 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-04T05:41:05.269 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-04T05:41:05.272 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-04T05:41:05.278 INFO:teuthology.orchestra.run.smithi097.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 4 05:41 /home/ubuntu/cephtest 2023-12-04T05:41:05.299 INFO:teuthology.orchestra.run.smithi143.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 4 05:41 /home/ubuntu/cephtest 2023-12-04T05:41:05.301 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-04T05:41:05.311 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-04T05:41:05.333 INFO:teuthology.nuke:Checking targets against current locks 2023-12-04T05:41:05.359 DEBUG:teuthology.nuke:shortname: smithi097 2023-12-04T05:41:05.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T05:41:05.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:22.243785', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB3bTo/PTgMXf3A1uSBugWKWKj700MOlex9DrpUHxR/0It3S5nisaOnkBFAPZPFGuvUuzYPGEiKV3JsO4vPqI='} 2023-12-04T05:41:05.387 DEBUG:teuthology.nuke:shortname: smithi143 2023-12-04T05:41:05.388 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T05:41:05.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_05:06:51-fs-wip-vshankar-testing-20231127.102654-distro-default-smithi/7476632', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 05:08:22.245360', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPCSXg8+31216oRUvI2Qnin8aZkRTRTomhx2/8zkEKtXVrI+MjRKBIL/irBi/IxOyPzxSuYoVVzzkF/0g128+/8='} 2023-12-04T05:41:05.442 INFO:teuthology.orchestra.console.smithi097:Power off 2023-12-04T05:41:05.442 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:41:05.470 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-12-04T05:41:05.470 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:05.485 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-04T05:41:05.486 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T05:41:05.498 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-04T05:41:05.509 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-04T05:41:05.509 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:05.532 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-04T05:41:09.502 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:09.533 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:09.615 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-12-04T05:41:09.645 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-04T05:41:13.619 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:13.646 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:13.730 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-12-04T05:41:13.756 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-04T05:41:13.831 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-12-04T05:41:17.759 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T05:41:17.868 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-04T05:41:17.969 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-04T05:41:18.074 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1303.7813715934753 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=42a498393eed4a7d9034549be9d1a99e status: fail success: false 2023-12-04T05:41:18.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T05:41:18.155 INFO:teuthology.run:FAIL